Rag Framework Projects

LLM inference in C/C++

RAGFlow is a leading open-source Retrieval-Augmented Generation (RAG) engine that fuses cutting-edge RAG with Agent capabilities to create a superior context layer for LLMs

A unified AI model hub for aggregation & distribution. It supports cross-converting various LLMs into OpenAI-compatible, Claude-compatible, or Gemini-compatible formats. A centralized gateway for personal and enterprise model management.

🤗 Transformers: the model-definition framework for state-of-the-art machine learning models in text, vision, audio, and multimodal models, for both inference and training.

The Memory Layer for AI Agents - Drop-in memory infrastructure for AI agents and apps. Context that persists. Built for production.

Build resilient agents.

An open-source long-horizon SuperAgent harness that researches, codes, and creates. With the help of sandboxes, memories, tools, skill, subagents and message gateway, it handles different levels of tasks that could take minutes to hours.

18 Lessons to Get Started Building AI Agents

DSPy: The framework for programming—not prompting—language models

100+ AI Agents, Agent Skills and RAG Apps - Free and Open Source.

Port of OpenAI's Whisper model in C/C++

LMCache: Supercharge Your LLM with the Fastest KV Cache Layer