Alternatives Engine

litellm Alternatives

Compare open-source alternatives to BerriAI/litellm by fit, deployment, maintenance, quality, and agent readiness.

Open JSON Compare JSON Project Graph

Decision Summary

BerriAI/litellm has 12 alternative candidates. Top match is headroomlabs-ai/headroom at 100/100 because Same mcp server intent with mcp, llm_gateway overlap.

CandidatesExplicitCloudflare-readyAvg similarityTop candidate
123199headroomlabs-ai/headroom
Compare shortlistOpen source graphExplain source scoreOpen source projectGet recommendations

Source Project

BerriAI/litellm

The fastest, litest AI Gateway. Rust core with Python SDK. Call 100+ LLM APIs in OpenAI (or native) format with cost tracking, guardrails, load balancing, and logging [Bedrock, Azure, OpenAI, Anthropic, OpenAI, VertexAI, vLLM, Nvidia NIM]

Python NOASSERTION DockerLibrary OnlyLocal

Best For

Where litellm fits

connect agents to tools
expose APIs through MCP
bootstrap MCP integrations

Not Best For

When to compare alternatives

edge-only Cloudflare Workers deployment without adaptation
users expecting a complete hosted product

Comparison Table

headroomlabs-ai/headroom leads this comparison context

headroomlabs-ai/headroom has the strongest combined agent score and maintenance profile in this comparison.

ProjectSimilarityStarsLanguageDeployQualityAgent
BerriAI/litellmSource59,949PythonDocker, Library Only8489
headroomlabs-ai/headroom100/10074,186PythonDocker, Vercel8492
coddy-project/coddy-agent100/100156GoDocker, Local3166
shibing624/agentica100/100352PythonDocker, Library Only3069
stdapi-ai/stdapi.ai100/10025PythonDocker, Local2961
soapbucket/sbproxy100/10053RustDocker, Kubernetes2863

Alternative Match

headroomlabs-ai/headroom

100/100

Same mcp server intent with mcp, llm_gateway overlap.

Fit: Strong replacement candidate with overlapping indexed use cases.

Compress tool outputs, logs, files, and RAG chunks before they reach the LLM. 20% fewer tokens for coding agents, 60-95% fewer tokens for JSON, same answers. Library, proxy, MCP server.

ExplicitMcp ServerDockerLibrary OnlyMcp
Replacement risklow
Adoption noteSame category, so it can be evaluated as a direct functional substitute.
Adoption noteDeployment overlap: docker, library_only, local.
Quality84
Agent92

Alternative Match

coddy-project/coddy-agent

100/100

Same mcp server intent with mcp, llm_gateway overlap.

Fit: Strong replacement candidate with overlapping indexed use cases.

General-purpose agent in one static Go binary: console TUI, ACP server for editors, OpenAI-compatible API with embedded web UI, Telegram gateway, cron scheduler, swarm relay, remote mode. Rules, skills, subagents, hooks, MCP, background tasks, long-term memory, context compaction. Any OpenAI-compatible provider, distroless-ready.

ExplicitMcp ServerDockerLocalMcp
Replacement risklow
Adoption noteSame category, so it can be evaluated as a direct functional substitute.
Adoption noteDeployment overlap: docker, local, cloud.
Quality31
Agent66

Alternative Match

shibing624/agentica

100/100

Same mcp server intent with mcp, llm_gateway overlap.

Fit: Strong replacement candidate with overlapping indexed use cases.

One person, a team of agents. Multi-session CLI that collaborates across terminals; /goal keeps long tasks running; WeChat/WeCom/Feishu gateway lets you call them back when you walk away. Async Python SDK, persistent memory, self-evolving skills.

ExplicitMcp ServerDockerLibrary OnlyMcp
Replacement risklow
Adoption noteSame category, so it can be evaluated as a direct functional substitute.
Adoption noteDeployment overlap: docker, library_only, local.
Quality30
Agent69

Alternative Match

stdapi-ai/stdapi.ai

100/100

Same mcp server intent with mcp, llm_gateway overlap.

Fit: Strong replacement candidate with overlapping indexed use cases.

Self-hosted AI gateway for Amazon Bedrock. OpenAI, Anthropic, Cohere and Ollama compatible APIs, plus Amazon Polly, Transcribe and Comprehend.

Mcp ServerDockerLocalMcpLlm Provider
Replacement risklow
Adoption noteSame category, so it can be evaluated as a direct functional substitute.
Adoption noteDeployment overlap: docker, local, cloud.
Quality29
Agent61

Alternative Match

soapbucket/sbproxy

100/100

Same mcp server intent with mcp, llm_gateway overlap.

Fit: Strong replacement candidate with overlapping indexed use cases.

Open source Enterprise AI Gateway for API, MCP and agent, and AI model traffic. One Apache-2.0 binary: 72 native providers behind an OpenAI-compatible API, or serve vLLM and llama.cpp on your own GPUs. Keys, budgets, guardrails, semantic cache, WAF.

Mcp ServerDockerLocalMcpLlm Provider
Replacement risklow
Adoption noteSame category, so it can be evaluated as a direct functional substitute.
Adoption noteDeployment overlap: docker, local, cloud.
Quality28
Agent63

Alternative Match

Portkey-AI/gateway

100/100

Same mcp server intent with mcp, llm_gateway overlap.

Fit: Strong replacement candidate with overlapping indexed use cases.

A blazing fast AI Gateway with integrated guardrails. Route to 1,600+ LLMs, 50+ AI Guardrails with 1 fast & friendly API.

Mcp ServerDockerLibrary OnlyMcpLlm Provider
Replacement risklow
Adoption noteSame category, so it can be evaluated as a direct functional substitute.
Adoption noteDeployment overlap: docker, library_only, local.
Quality27
Agent77

Alternative Match

ax128/AegisGate

100/100

Same mcp server intent with mcp, llm_gateway overlap.

Fit: Strong replacement candidate with overlapping indexed use cases.

Open-source security gateway for LLM APIs — prompt injection detection, PII redaction, dangerous response sanitization, and audit logging. OpenAI/Claude compatible, MCP & Agent SKILL support. Drop-in proxy for AI coding agents (Cursor, Claude Code, Codex).

Mcp ServerDockerLibrary OnlyMcpLlm Provider
Replacement risklow
Adoption noteSame category, so it can be evaluated as a direct functional substitute.
Adoption noteDeployment overlap: docker, library_only, local.
Quality11
Agent57

Alternative Match

Portkey-AI/hoot

100/100

Same mcp server intent with mcp, llm_gateway overlap.

Fit: Strong replacement candidate with overlapping indexed use cases.

MCP Testing Tool — Like Postman, but for the Model Context Protocol.

Mcp ServerLibrary OnlyLocalMcpLlm Provider
Replacement risklow
Adoption noteSame category, so it can be evaluated as a direct functional substitute.
Adoption noteDeployment overlap: library_only, local.
Quality4
Agent53

Alternative Match

deepset-ai/haystack

99/100

Same mcp server intent with mcp, llm_gateway overlap.

Fit: Strong replacement candidate with overlapping indexed use cases.

Open-source AI orchestration framework for building context-engineered, production-ready LLM applications. Design modular pipelines and agent workflows with explicit control over retrieval, routing, memory, and generation. Built for scalable agents, RAG, multimodal applications, semantic search, and conversational systems.

Mcp ServerDockerLibrary OnlyMcpLlm Provider
Replacement risklow
Adoption noteSame category, so it can be evaluated as a direct functional substitute.
Adoption noteDeployment overlap: docker, library_only, local.
Quality53
Agent88

Alternative Match

KochC/opencode-llm-proxy

99/100

Same mcp server intent with mcp, llm_gateway overlap.

Fit: Strong replacement candidate with overlapping indexed use cases.

Local OpenCode-backed LLM gateway for OpenAI, Anthropic, Gemini, and Responses API-compatible tools, with streaming and tool/function calling.

Mcp ServerDockerLibrary OnlyMcpLlm Provider
Replacement risklow
Adoption noteSame category, so it can be evaluated as a direct functional substitute.
Adoption noteDeployment overlap: docker, library_only, local.
Quality11
Agent59

Alternative Match

agentic-community/mcp-gateway-registry

98/100

Same mcp server intent with mcp, llm_gateway overlap.

Fit: Strong replacement candidate with overlapping indexed use cases.

Enterprise-ready MCP Gateway & Registry that centralizes AI development tools with secure OAuth authentication, dynamic tool discovery, and unified access for both autonomous AI agents and AI coding assistants. Transform scattered MCP server chaos into governed, auditable tool access with Keycloak/Entra integration.

Mcp ServerDockerLocalMcpLlm Provider
Replacement risklow
Adoption noteSame category, so it can be evaluated as a direct functional substitute.
Adoption noteDeployment overlap: docker, local, cloud.
Quality43
Agent83

Alternative Match

AstrBotDevs/AstrBot

97/100

Same mcp server intent with mcp overlap.

Fit: Strong replacement candidate with overlapping indexed use cases.

AI Agent Assistant & development framework that integrates lots of IM platforms, LLMs, plugins and AI feature, and can be your openclaw alternative. ✨

Mcp ServerDockerLibrary OnlyMcpLlm Provider
Replacement risklow
Adoption noteSame category, so it can be evaluated as a direct functional substitute.
Adoption noteDeployment overlap: docker, library_only, local.
Quality84
Agent89

Data Source

d1 / d1_query

1213 loaded projects. Generated at 2026-10-01T06:17:44.709Z.