convez.ai
MCP Server
vllm-project

semantic-router

vllm-project/semantic-router

Ver no GitHub
Muito bomPluginScore · de 0 a 100

System Level Intelligent Router for Mixture-of-Models at Cloud, Data Center and Edge

Instalação

$npx convez-ai vllm-project/semantic-router

1 comando no terminal: detecta o formato do repositório (marketplace ou plugin avulso) e instala via Claude Code. Requer Node 18+ e o Claude Code instalado.

Métricas

Estrelas
6,5 mil
Forks
1,1 mil
Acompanhando
62
Saúde
75%
Último commit
há 1 dia
Versão
v0.4.0
Issues abertas
677
Contribuidores
126

README

A tradução para o português deste README ainda está na fila.


About

In the LLM era, the number of models is exploding. Different models vary across capability, scale, cost, and privacy boundaries. Choosing and connecting the right models to build semantic AI infrastructure is a system problem.

vLLM Semantic Router is a signal-driven intelligent router for that problem. It helps teams build model systems that are more efficient, safer, and more adaptive across cloud, data center, and edge environments.

system

It delivers three core values:

  • Token economics: reduce wasted tokens, increase effective output, and maximize the value of every token.
  • LLM safety: detect jailbreaks, sensitive leakage, and hallucinations so agents remain controllable, trustworthy, and auditable.
  • Fullmesh intelligence: build personal AI at the edge and intelligent MaaS in the cloud by coordinating local, private, and frontier models across cost, privacy, and capability boundaries.

Getting Started

Install

curl -fsSL https://vllm-semantic-router.com/install.sh | bash

For platform notes, detailed setup options, and troubleshooting, see the Installation Guide.

[!IMPORTANT] Online playground default credentials:

  • username: love@vllm-sr.ai
  • password: vllm-sr

Latest News

More announcements are available on the Blog and Publications pages.

Community

For questions, feedback, or to contribute, please join the #semantic-router channel in vLLM Slack.

Community Meetings

We host community meetings on the first and third Tuesday of each month to sync with contributors across different time zones:

Contributing

If you want to contribute, start with CONTRIBUTING.md.

For repository-native development workflow and validation commands, use AGENTS.md as the entrypoint and docs/agent/README.md as the canonical index.

Citation

If you find Semantic Router helpful in your research or projects, please consider citing it:

@misc{semanticrouter2025,
  title={vLLM Semantic Router},
  author={vLLM Semantic Router Team},
  year={2025},
  howpublished={\url{https://github.com/vllm-project/semantic-router}},
}

Star History

Star History Chart

Sponsors

We are grateful to our sponsors who support us:


AMD provides us with GPU resources and ROCm™ software for training and researching frontier router models, enhancing E2E testing, and building the online models playground.


Ver o original no GitHub

Bom para

Relacionados