vllm-project/vllm ↔ microsoft/aiciUse microsoft/aici when the user needs a local llm runtime project with library-only, local, cloud deployment options.
vllm-project/vllm ↔ toverainc/willow-inference-serverUse toverainc/willow-inference-server when the user needs a local llm runtime project with docker, library-only, local deployment options.
vllm-project/vllm ↔ huggingface/optimumUse huggingface/optimum when the user needs a local llm runtime project with docker, library-only, local deployment options.
vllm-project/vllm ↔ kserve/kserveUse kserve/kserve when the user needs a local llm runtime project with docker, kubernetes, serverless deployment options.
vllm-project/vllm ↔ bentoml/BentoMLUse bentoml/BentoML when the user needs a local llm runtime project with docker, library-only, local deployment options.
vllm-project/vllm ↔ oobabooga/textgenUse oobabooga/textgen when the user needs a local llm runtime project with docker, library-only, local deployment options.