mudler/localai

README EXCERPT

Deutsch Español français 日本語 한국어 Português Русский 中文 LocalAI is the open-source AI engine. Run any model - LLMs, vision, voice, image, video - on any hardware. No GPU required. A small core, not a bundle. Each backend wraps a best-in-class engine (llama.cpp, vLLM, whisper.cpp, stable-diffusion, MLX...) in its own image, pulled only when a model needs it. You install nothing you don't use. - Composable by design : backends are separate and pulled on demand, so you install only what your model needs - Open and extensible : load any model, or build your own backend in any language against an open interface - Drop-in API compatibility : OpenAI, Anthropic, and ElevenLabs APIs across every backend - Any model, any modality : LLMs, vision, voice, image, and video behind one API - Any hardware : NVIDIA, AMD, Intel, Apple Silicon, Vulkan, or CPU-only - Multi-user ready : API key auth, user quotas, role-based access - Built-in AI agents : autonomous agents with tool use, RAG, MCP, and skills - Privacy-first : your data never leaves your infrastructure Created by Ettore Di Giacinto and maintained by the LocalAI team. :book: Documentation :speech balloon: Discord 💻 Quickstart 🖼️ Models ❓FAQ G…

The opening of the GitHub README as stored, at most 1,200 characters. Markdown is not rendered.