Alternatives Engine

model-hotel Alternatives

Compare open-source alternatives to hugalafutro/model-hotel by fit, deployment, maintenance, quality, and agent readiness.

Open JSON Compare JSON Project Graph

Decision Summary

hugalafutro/model-hotel has 12 alternative candidates. Top match is promptfoo/promptfoo at 100/100 because Similar llm eval with docker/local deployment overlap.

CandidatesExplicitCloudflare-readyAvg similarityTop candidate
123085promptfoo/promptfoo
Compare shortlistOpen source graphExplain source scoreOpen source projectGet recommendations

Source Project

hugalafutro/model-hotel

Multi-Provider AI Gateway - No personal logs by design. Model autodiscovery, Failover groups, High availability, Android companion app, and more. "Because we have LiteLLM at home"

Go MIT DockerLocalCloud

Best For

Where model-hotel fits

evaluate LLM outputs
benchmark prompts and agents
track model quality

Not Best For

When to compare alternatives

edge-only Cloudflare Workers deployment without adaptation

Comparison Table

comet-ml/opik leads this comparison context

comet-ml/opik has the strongest combined agent score and maintenance profile in this comparison.

ProjectSimilarityStarsLanguageDeployQualityAgent
hugalafutro/model-hotelSource51GoDocker, Local3063
promptfoo/promptfoo100/10024,251TypeScriptDocker, Library Only6988
comet-ml/opik100/10021,397PythonDocker, Kubernetes6590
Portkey-AI/models100/100125JavaScriptLocal, Cloud1761
Arize-ai/phoenix83/10011,062PythonDocker, Vercel5789
Giskard-AI/giskard-oss83/1005,752PythonLibrary Only, Local4582

Alternative Match

promptfoo/promptfoo

100/100

Similar llm eval with docker/local deployment overlap.

Fit: Strong replacement candidate with overlapping indexed use cases.

Test your prompts, agents, and RAGs. Red teaming/pentesting/vulnerability scanning for AI. Compare performance of GPT, Claude, Gemini, DeepSeek, and more. Simple declarative configs with command line and CI/CD integration. Used by OpenAI and Anthropic.

ExplicitLlm EvalDockerLocalLlm Provider
Replacement risklow
Adoption noteSame category, so it can be evaluated as a direct functional substitute.
Adoption noteDeployment overlap: docker, local, cloud.
Quality69
Agent88

Alternative Match

comet-ml/opik

100/100

Similar llm eval with docker/local deployment overlap.

Fit: Strong replacement candidate with overlapping indexed use cases.

Debug, evaluate, and monitor your LLM applications, RAG systems, and agentic workflows with comprehensive tracing, automated evaluations, and production-ready dashboards.

ExplicitLlm EvalDockerLocalLlm Provider
Replacement risklow
Adoption noteSame category, so it can be evaluated as a direct functional substitute.
Adoption noteDeployment overlap: docker, local, cloud.
Quality65
Agent90

Alternative Match

Portkey-AI/models

100/100

Same llm eval intent with llm_gateway overlap.

Fit: Strong replacement candidate with overlapping indexed use cases.

This repository contains comprehensive pricing and configuration data for LLMs. It powers cost attribution for 200+ enterprises running 400B+ tokens through Portkey AI Gateway every day.

ExplicitLlm EvalLocalCloudLlm Provider
Replacement risklow
Adoption noteSame category, so it can be evaluated as a direct functional substitute.
Adoption noteDeployment overlap: local, cloud.
Quality17
Agent61

Alternative Match

Arize-ai/phoenix

83/100

Similar llm eval with docker/local deployment overlap.

Fit: Strong replacement candidate with overlapping indexed use cases.

AI Observability & Evaluation

Llm EvalDockerLocalLlm Provider
Replacement risklow
Adoption noteSame category, so it can be evaluated as a direct functional substitute.
Adoption noteDeployment overlap: docker, local.
Quality57
Agent89

Alternative Match

Giskard-AI/giskard-oss

83/100

Similar llm eval with local/cloud deployment overlap.

Fit: Strong replacement candidate with overlapping indexed use cases.

🐢 Open-Source Evaluation & Testing library for LLM Agents

Llm EvalLocalCloudLlm Provider
Replacement risklow
Adoption noteSame category, so it can be evaluated as a direct functional substitute.
Adoption noteDeployment overlap: local, cloud.
Quality45
Agent82

Alternative Match

truera/trulens

82/100

Similar llm eval with local/cloud deployment overlap.

Fit: Strong replacement candidate with overlapping indexed use cases.

Evaluation and Tracking for LLM Experiments and AI Agents

Llm EvalLocalCloudLlm Provider
Replacement risklow
Adoption noteSame category, so it can be evaluated as a direct functional substitute.
Adoption noteDeployment overlap: local, cloud.
Quality39
Agent80

Alternative Match

langwatch/langwatch

82/100

Similar llm eval with docker/local deployment overlap.

Fit: Strong replacement candidate with overlapping indexed use cases.

The platform for LLM evaluations and AI agent testing

Llm EvalDockerLocalLlm Provider
Replacement risklow
Adoption noteSame category, so it can be evaluated as a direct functional substitute.
Adoption noteDeployment overlap: docker, local.
Quality39
Agent81

Alternative Match

langfuse/oss-llmops-stack

81/100

Same llm eval intent with llm_gateway overlap.

Fit: Strong replacement candidate with overlapping indexed use cases.

Modular, open source LLMOps stack that separates concerns: LiteLLM unifies LLM APIs, manages routing and cost controls, and ensures high-availability, while Langfuse focuses on detailed observability, prompt versioning, and performance evaluations.

Llm EvalLocalCloudLlm Provider
Replacement risklow
Adoption noteSame category, so it can be evaluated as a direct functional substitute.
Adoption noteDeployment overlap: local, cloud.
Quality5
Agent51

Alternative Match

modelscope/evalscope

79/100

Similar llm eval with docker/local deployment overlap.

Fit: Strong replacement candidate with overlapping indexed use cases.

A streamlined and customizable framework for efficient large model (LLM, VLM, AIGC) evaluation and performance benchmarking.

Llm EvalDockerLocalLlm Provider
Replacement risklow
Adoption noteSame category, so it can be evaluated as a direct functional substitute.
Adoption noteDeployment overlap: docker, local, cloud.
Quality46
Agent83

Alternative Match

Ahoo-Wang/GodeX

78/100

Same llm eval intent with llm_gateway overlap.

Fit: Strong replacement candidate with overlapping indexed use cases.

Make every model a CodeX engine through an OpenAI-compatible Responses API gateway

Llm EvalDockerLocalLlm Provider
Replacement risklow
Adoption noteSame category, so it can be evaluated as a direct functional substitute.
Adoption noteDeployment overlap: docker, local, cloud.
Quality23
Agent62

Alternative Match

RouteWorks/RouterArena

78/100

Same llm eval intent with llm_gateway overlap.

Fit: Strong replacement candidate with overlapping indexed use cases.

RouterArena: An open framework for evaluating LLM routers with standardized datasets, metrics, an automated framework, and a live leaderboard.

Llm EvalLocalCloudLlm Provider
Replacement risklow
Adoption noteSame category, so it can be evaluated as a direct functional substitute.
Adoption noteDeployment overlap: local, cloud.
Quality9
Agent59

Alternative Match

EricLBuehler/mistral.rs

77/100

Similar llm eval with docker/local deployment overlap.

Fit: Strong replacement candidate with overlapping indexed use cases.

Fast, flexible LLM inference

Llm EvalDockerLocalLlm Provider
Replacement risklow
Adoption noteSame category, so it can be evaluated as a direct functional substitute.
Adoption noteDeployment overlap: docker, local, cloud.
Quality38
Agent85

Data Source

d1 / d1_query

1136 loaded projects. Generated at 2026-08-16T15:43:58.120Z.