semantic-router
vllm-project/semantic-router
A programmable Mixture-of-Models router for heterogeneous LLM inference
5,369stars
Forks
846
Open issues
386
Watchers
5,369
Size
276.4 MB
GoApache License 2.0
ai-gatewayguardrailsinferencekubernetesllmllmroutermixture-of-modelspytorchsemantic-routertransformervllm
Created: Aug 26, 2025
Updated: Aug 28, 2026
Last push: Aug 28, 2026