provider-litellm Alternatives

Same rag framework intent with rag overlap.

Fit: Strong replacement candidate with overlapping indexed use cases.

RAGFlow is an agent-native database: a Retrieval-Augmented Generation (RAG) engine that grew into context infrastructure.

Same rag framework intent with rag, llm_gateway overlap.

Fit: Strong replacement candidate with overlapping indexed use cases.

Open-source AI gateway. Self-hosted LLM gateway with OpenAI-, Claude- and Gemini-compatible APIs, model routing, access control, usage tracking and cost accounting.

Same rag framework intent with rag, llm_gateway overlap.

Fit: Strong replacement candidate with overlapping indexed use cases.

An open-source long-horizon SuperAgent harness that researches, codes, and creates. With the help of sandboxes, memories, tools, skill, subagents and message gateway, it handles different levels of tasks that could take minutes to hours.

Same rag framework intent with rag, llm_gateway overlap.

Fit: Strong replacement candidate with overlapping indexed use cases.

State of the art inference performance with modern accelerators on Kubernetes

Same rag framework intent with rag overlap.

Fit: Strong replacement candidate with overlapping indexed use cases.

Contrib repository for the OpenTelemetry Collector

Same rag framework intent with rag, llm_gateway overlap.

Fit: Strong replacement candidate with overlapping indexed use cases.

Self-hosted AI gateway for private RAG, natural-language data access, and tool-calling agents.

Same rag framework intent with rag, llm_gateway overlap.

Fit: Strong replacement candidate with overlapping indexed use cases.

Self-hosted LLM gateway that routes requests across AI providers (OpenAI, Anthropic, Gemini, Mistral, Ollama) using intelligent multi-policy scoring — including an LLM-native routing policy. Drop-in compatible: just swap the base URL. No database required, built-in cost tracking, budget enforcement and multi-tenant isolation.

Same rag framework intent with rag, llm_gateway overlap.

Fit: Strong replacement candidate with overlapping indexed use cases.

Build reliable, secure, and production-ready AI apps easily.

Same rag framework intent with rag, llm_gateway overlap.

Fit: Strong replacement candidate with overlapping indexed use cases.

OpenAI-compatible HTTP LLM proxy / gateway for multi-provider inference (Google, Anthropic, OpenAI, PyTorch). Lightweight, extensible Python/FastAPI—use as library or standalone service.

Same rag framework intent with rag overlap.

Fit: Strong replacement candidate with overlapping indexed use cases.

♾️ Private Agent Fleet with Spec Coding. Each agent gets their own GPU-accelerated desktop. Run Claude, Codex, Gemini and open models on a full private AI Stack ♾️

Same rag framework intent with rag overlap.

Fit: Strong replacement candidate with overlapping indexed use cases.

OpenFaaS - Serverless Functions Made Simple

Same rag framework intent with rag overlap.

Fit: Strong replacement candidate with overlapping indexed use cases.

Self-hosted, enterprise-ready AI workflow orchestration with event sourcing, CQRS, fault tolerance, and observability. Single-binary control plane, Python + Go SDKs, embedded Postgres + NATS for zero-config dev.