provider-litellm Alternatives

Same rag framework intent with rag overlap.

Fit: Strong replacement candidate with overlapping indexed use cases.

RAGFlow is a leading open-source Retrieval-Augmented Generation (RAG) engine that fuses cutting-edge RAG with Agent capabilities to create a superior context layer for LLMs

Same rag framework intent with rag, llm_gateway overlap.

Fit: Strong replacement candidate with overlapping indexed use cases.

A unified AI model hub for aggregation & distribution. It supports cross-converting various LLMs into OpenAI-compatible, Claude-compatible, or Gemini-compatible formats. A centralized gateway for personal and enterprise model management.

Same rag framework intent with rag, llm_gateway overlap.

Fit: Strong replacement candidate with overlapping indexed use cases.

An open-source long-horizon SuperAgent harness that researches, codes, and creates. With the help of sandboxes, memories, tools, skill, subagents and message gateway, it handles different levels of tasks that could take minutes to hours.

Same rag framework intent with rag, llm_gateway overlap.

Fit: Strong replacement candidate with overlapping indexed use cases.

Achieve state of the art inference performance with modern accelerators on Kubernetes

Same rag framework intent with rag, llm_gateway overlap.

Fit: Strong replacement candidate with overlapping indexed use cases.

Open-source, OpenAI-compatible LLM gateway you run yourself. One endpoint for 40+ providers, with virtual keys, budgets, and usage tracking.

Same rag framework intent with rag overlap.

Fit: Strong replacement candidate with overlapping indexed use cases.

Contrib repository for the OpenTelemetry Collector

Same rag framework intent with rag, llm_gateway overlap.

Fit: Strong replacement candidate with overlapping indexed use cases.

A self-hostable LLM router / gateway: OpenAI- and Anthropic-compatible, explicit-first routing with fallbacks, spend limits, and metadata-only cost tracking. No markup, no third-party proxy — your keys, your box.

Same rag framework intent with rag, llm_gateway overlap.

Fit: Strong replacement candidate with overlapping indexed use cases.

Self-hosted AI gateway for private RAG, natural-language data access, and tool-calling agents.

Same rag framework intent with rag, llm_gateway overlap.

Fit: Strong replacement candidate with overlapping indexed use cases.

OpenAI-compatible HTTP LLM proxy / gateway for multi-provider inference (Google, Anthropic, OpenAI, PyTorch). Lightweight, extensible Python/FastAPI—use as library or standalone service.

Same rag framework intent with rag, llm_gateway overlap.

Fit: Strong replacement candidate with overlapping indexed use cases.

Self-hosted LLM gateway that routes requests across AI providers (OpenAI, Anthropic, Gemini, Mistral, Ollama) using intelligent multi-policy scoring — including an LLM-native routing policy. Drop-in compatible: just swap the base URL. No database required, built-in cost tracking, budget enforcement and multi-tenant isolation.

Same rag framework intent with rag, llm_gateway overlap.

Fit: Strong replacement candidate with overlapping indexed use cases.

Build reliable, secure, and production-ready AI apps easily.

Same rag framework intent with rag overlap.

Fit: Strong replacement candidate with overlapping indexed use cases.

♾️ Private Agent Fleet with Spec Coding. Each agent gets their own GPU-accelerated desktop. Run Claude, Codex, Gemini and open models on a full private AI Stack ♾️