toverainc/willow-inference-server ↔ vllm-project/vllmUse vllm-project/vllm when the user needs a local llm runtime project with docker, library-only, local deployment options.
toverainc/willow-inference-server ↔ noumena-labs/SippUse noumena-labs/Sipp when the user needs a local llm runtime project with docker, serverless, library-only deployment options.
toverainc/willow-inference-server ↔ microsoft/foundry-localUse microsoft/foundry-local when the user needs a local llm runtime project with library-only, local, cloud deployment options.
toverainc/willow-inference-server ↔ oobabooga/textgenUse oobabooga/textgen when the user needs a local llm runtime project with docker, library-only, local deployment options.
toverainc/willow-inference-server ↔ huggingface/optimumUse huggingface/optimum when the user needs a local llm runtime project with docker, library-only, local deployment options.
toverainc/willow-inference-server ↔ EricLBuehler/candle-vllmUse EricLBuehler/candle-vllm when the user needs a local llm runtime project with docker, library-only, local deployment options.