provider-litellm Alternatives

Same rag framework intent with rag overlap.

Fit: Strong replacement candidate with overlapping indexed use cases.

RAGFlow is a leading open-source Retrieval-Augmented Generation (RAG) engine that fuses cutting-edge RAG with Agent capabilities to create a superior context layer for LLMs

Same rag framework intent with rag, llm_gateway overlap.

Fit: Strong replacement candidate with overlapping indexed use cases.

A unified AI model hub for aggregation & distribution. It supports cross-converting various LLMs into OpenAI-compatible, Claude-compatible, or Gemini-compatible formats. A centralized gateway for personal and enterprise model management. 🍥

Same rag framework intent with rag, llm_gateway overlap.

Fit: Strong replacement candidate with overlapping indexed use cases.

An open-source long-horizon SuperAgent harness that researches, codes, and creates. With the help of sandboxes, memories, tools, skill, subagents and message gateway, it handles different levels of tasks that could take minutes to hours.

Same rag framework intent with rag, llm_gateway overlap.

Fit: Strong replacement candidate with overlapping indexed use cases.

Achieve state of the art inference performance with modern accelerators on Kubernetes

Same rag framework intent with rag, llm_gateway overlap.

Fit: Strong replacement candidate with overlapping indexed use cases.

A self-hostable LLM router / gateway: OpenAI- and Anthropic-compatible, explicit-first routing with fallbacks, spend limits, and metadata-only cost tracking. No markup, no third-party proxy — your keys, your box.

Same rag framework intent with rag, llm_gateway overlap.

Fit: Strong replacement candidate with overlapping indexed use cases.

OpenAI & Anthropic Compatible API Gateway for AWS Bedrock and AI Services

Same rag framework intent with rag overlap.

Fit: Strong replacement candidate with overlapping indexed use cases.

Contrib repository for the OpenTelemetry Collector

Same rag framework intent with rag, llm_gateway overlap.

Fit: Strong replacement candidate with overlapping indexed use cases.

Self-hosted, OpenAI-compatible AI gateway for private RAG, natural-language data access, and tool-calling agents.

Same rag framework intent with rag, llm_gateway overlap.

Fit: Strong replacement candidate with overlapping indexed use cases.

OpenAI-compatible HTTP LLM proxy / gateway for multi-provider inference (Google, Anthropic, OpenAI, PyTorch). Lightweight, extensible Python/FastAPI—use as library or standalone service.

Same rag framework intent with rag, llm_gateway overlap.

Fit: Strong replacement candidate with overlapping indexed use cases.

Build reliable, secure, and production-ready AI apps easily.

Same rag framework intent with rag, llm_gateway overlap.

Fit: Strong replacement candidate with overlapping indexed use cases.

Self-hosted LLM gateway that routes requests across AI providers (OpenAI, Anthropic, Gemini, Mistral, Ollama) using intelligent multi-policy scoring — including an LLM-native routing policy. Drop-in compatible: just swap the base URL. No database required, built-in cost tracking, budget enforcement and multi-tenant isolation.

Same rag framework intent with rag, llm_gateway overlap.

Fit: Strong replacement candidate with overlapping indexed use cases.

A self-hosted LLM proxy and failover gateway supporting OpenAI & Gemini compatible endpoints. Routes requests dynamically across 12+ LLM platforms with automatic fallback, key scheduling, rate-limit tracking and encrypted credential storage.