vllm-project/vllmUse vllm-project/vllm when the user needs a local llm runtime project with docker, library-only, local deployment options. Shared local llm runtime category and docker deployment context.
microsoft/aiciUse microsoft/aici when the user needs a local llm runtime project with library-only, local, cloud deployment options. Shared local llm runtime category and library_only deployment context.
toverainc/willow-inference-serverUse toverainc/willow-inference-server when the user needs a local llm runtime project with docker, library-only, local deployment options. Shared local llm runtime category and docker deployment context.
bentoml/BentoMLUse bentoml/BentoML when the user needs a local llm runtime project with docker, library-only, local deployment options. Shared local llm runtime category and docker deployment context.
huggingface/optimumUse huggingface/optimum when the user needs a local llm runtime project with docker, library-only, local deployment options. Shared local llm runtime category and docker deployment context.
kserve/kserveUse kserve/kserve when the user needs a local llm runtime project with docker, kubernetes, serverless deployment options. Shared local llm runtime category and docker deployment context.