Project Graph

toverainc/willow-inference-server

A relationship view of alternatives, deployments, compatible protocols, dependencies, use cases, and categories.

Graph Summary

toverainc/willow-inference-server graph connects 3 alternatives, 8 related projects, 1 inferred dependencies, 4 deployment targets, and 3 use cases.

Nodes35
Edges330
Projects23
Dependencies24

Project Context

willow-inference-server

Maintainertoverainc
LicenseApache-2.0
LanguagePython
Recent activityLast push 178 days ago

Deployment Targets

dockerlibrary_onlylocalcloud

Dependencies

LLM provider

Knowledge Graph

35 nodes / 330 edges

toverainc/willow-… focus local llm run… category docker deployment library_only deployment local deployment cloud deployment run local mod… use case serve inferen… use case prototype pri… use case LLM provider dependency vllm project taOS project BentoML project Sipp project foundry-local project

Use Cases

run local modelsserve inference endpointsprototype private LLM deployments

Categories

local llm runtime

Alternatives

vllm-project/vllmjaylfc/taOSbentoml/BentoMLmlc-ai/mlc-llmmicrosoft/foundry-localvllm-project/vllm-omni

Related Projects

vllm-project/vllmnoumena-labs/Sippmicrosoft/foundry-localoobabooga/textgenhuggingface/optimumEricLBuehler/candle-vllm