Project Knowledge

vllm-project/aibrix

Use vllm-project/aibrix when the user needs a llm gateway project with kubernetes, local, cloud deployment options.

llm_gateway
TypeProject / implementation
Difficultybeginner
LanguageGo
LicenseApache-2.0

TL;DR

Use vllm-project/aibrix when the user needs a llm gateway project with kubernetes, local, cloud deployment options.

Use vllm-project/aibrix when the user needs a llm gateway project with kubernetes, local, cloud deployment options.

Install

Use the gateway deployment instructions in the repository README.

KubernetesLocalCloud

Good For

route LLM requests
standardize model provider access
add gateway-level controls

Not Good For

edge-only Cloudflare Workers deployment without adaptation
local-only inference
non-LLM services
Git.Top Score85/100
Agent Score78/100
Maintenance59
Stability76
Quality32/100

Best Use

route LLM requests

Primary situation where this project is a good shortlist candidate.

Watch Out

edge-only Cloudflare Workers deployment without adaptation

Main reason to compare alternatives before adopting it.

Deployment Fit

kubernetes, local, cloud

Git.Top did not classify this as Cloudflare-ready. Evidence: Runtime blocker: gpu.

Best Alternative

Hal0ai/hal0: docker, local

Compare this option when the target stack or language preference differs.

Confidence

2/4 classification signals high; 3 quality signals complete or snapshot

Classification evidence and quality signal confidence should be checked before production recommendations.

Freshness

Repo 2026-08-04; metrics 2026-08-04

Repository and metric timestamps for this knowledge record.

Freshness

Repository and metrics timestamps

Repository synced2026-08-04T09:00:27.144Z
Metrics calculated2026-08-04T09:00:27.144Z

Scoring

Quality and agent score are separate

Quality score weights star movement, commits, releases, contributors, and issue response. Agent score weights documentation, maintenance, deployment, popularity, and community.

Confidence

Signal confidence

Stars 30dsnapshot
Commits 30dcomplete
Releases 180dcomplete
Contributors 90dpartial

Badge

Agent Score badge

Embed a lightweight SVG badge for this repository.

Project Type

Project / implementation

This repository is treated as an implementation project. Compare its deployment fit, maintenance, and alternatives before adopting it.

Cloudflare Readiness

No Cloudflare-ready signal

Git.Top did not classify this as Cloudflare-ready. Evidence: Runtime blocker: gpu.

Selection Guidance

Use the evidence before choosing

Treat this page as a shortlist input. Confirm source metadata, classification confidence, deployment evidence, and current repository activity before making a production recommendation.

Alternatives

Comparable projects

JSON
Hal0ai/hal0Use Hal0ai/hal0 when the user needs a llm gateway project with docker, local, cloud deployment options.
off-grid-ai/OGADUse off-grid-ai/OGAD when the user needs a llm gateway project with library-only, local, cloud deployment options.
andreimerfu/pllmUse andreimerfu/pllm when the user needs a llm gateway project with docker, kubernetes, local deployment options.
openziti/llm-gatewayUse openziti/llm-gateway when the user needs a llm gateway project with local, cloud deployment options.
frieser/antigravity-proxyUse frieser/antigravity-proxy when the user needs a llm gateway project with docker, local, cloud deployment options.

Related Projects

Adjacent ecosystem projects

JSON
frieser/antigravity-proxyUse frieser/antigravity-proxy when the user needs a llm gateway project with docker, local, cloud deployment options. Shared llm gateway category and local deployment context.
openai/openai-openapiUse openai/openai-openapi when the user needs a llm gateway project with local, cloud deployment options. Shared llm gateway category and local deployment context.
openziti/llm-gatewayUse openziti/llm-gateway when the user needs a llm gateway project with local, cloud deployment options. Shared llm gateway category and local deployment context.
Nutlope/llamacoderUse Nutlope/llamacoder when the user needs a llm gateway project with library-only, local, cloud deployment options. Shared llm gateway category and local deployment context.
Binomial-Capital-Management/binomialhashUse Binomial-Capital-Management/binomialhash when the user needs a llm gateway project with library-only, local, cloud deployment options. Shared llm gateway category and local deployment context.
BuilderIO/ai-shellUse BuilderIO/ai-shell when the user needs a llm gateway project with library-only, local, cloud deployment options. Shared llm gateway category and local deployment context.

Deploy

Supported deployment paths

kuberneteslocalcloud

Compatible With

Inferred dependencies and protocols

LLM provider

Use Cases

Where agents should consider it

route LLM requestsstandardize model provider accessadd gateway-level controls

Classification Evidence

Why Git.Top categorized this project

Full JSON
Category: mediumMatched "gateway" in repository content.
Deployment: highMatched "kubernetes" in repository content. Local usage is assumed for open source repositories unless contradicted.
Difficulty: mediumRepository has under 10k stars, so complexity is treated conservatively.
Cloudflare Ready: highRuntime blocker: gpu. No Cloudflare deployment signal detected.

Compare

vllm-project/aibrix leads this context

JSON
ProjectStarsAgentLocalCloudflareScore
vllm-project/aibrix4,993NoYesNo78
Hal0ai/hal062NoYesNo63
off-grid-ai/OGAD50NoYesNo64
andreimerfu/pllm24NoYesNo54