Repository Issues
vllm-project/semantic-router
System Level Intelligent Router for Mixture-of-Models at Cloud, Data Center and Edge
Issues
Open
Modularize native router model bindings and runtime capability contracts
area/coreenhancementhelp wantedpriority/P1roadmap
No assignee yetHas a beginner-friendly labelContributing guide available
1 comment0 reactions0 assignees
Open
perf: define MIGraphX-first ONNX Runtime provider strategy for AMD router signal models
area/bencharea/environmentenhancementenvironment/rocmevaluationhelp wantedoperationspriority/P1roadmap
Why recommendedNo comments yet · Has a beginner-friendly label
No comments yetHas a beginner-friendly labelContributing guide available
0 comments0 reactions1 assignee
Open
research: evaluate base + multi-LoRA serving for router classifier assets
area/bencharea/momarea/researchenhancementenvironment/rocmevaluationhelp wantedpriority/P1roadmapsignal-decision-engine
Why recommendedHas a beginner-friendly label · Contributing guide available
Has a beginner-friendly labelContributing guide available
1 comment0 reactions1 assignee
Open
feat: define preference-driven recipe objective spec for offline tuning
area/agentarea/model-selectionarea/researchenhancementevaluationhelp wantedpriority/P2roadmapsignal-decision-engine
Why recommendedNo assignee yet · No comments yet
No assignee yetNo comments yetHas a beginner-friendly labelContributing guide available
0 comments0 reactions0 assignees
Open
research: define next-generation router base model and model family
area/bencharea/researchenhancementenvironment/rocmevaluationhelp wantedpriority/P1roadmapsignal-decision-engine
Why recommendedNo assignee yet · Has a beginner-friendly label
No assignee yetHas a beginner-friendly labelContributing guide available
1 comment0 reactions0 assignees
Open
test: revisit E2E framework and testcase matrix across Docker and Kubernetes
area/environmentarea/test-and-releasearea/testinge2eenhancementhelp wantedoperationspriority/P1roadmap
Why recommendedNo assignee yet · Has a beginner-friendly label
No assignee yetHas a beginner-friendly labelContributing guide available
2 comments0 reactions0 assignees
Closed
recipes: tune out-of-box presets for balance, cost, accuracy, speed, privacy, and grounding
area/docsarea/model-selectionarea/user-experiencedocumentationenhancementevaluationhelp wantedpriority/P1roadmap
Why recommendedNo assignee yet · Has a beginner-friendly label
No assignee yetHas a beginner-friendly labelContributing guide available
1 comment0 reactions0 assignees
Open
feat: add TensorRT-LLM and Triton TensorRT-LLM inference-aware backend adapter
area/model-selectionarea/observabilityenhancementhelp wantedoperationspriority/P1roadmap
Why recommendedHas a beginner-friendly label · Contributing guide available
Has a beginner-friendly labelContributing guide available
3 comments0 reactions1 assignee
Open
ops: revisit Docker and Kubernetes backend endpoint support completeness
area/dashboardarea/environmentarea/networkingenhancementhelp wantedoperationspriority/P1roadmap
Why recommendedHas a beginner-friendly label · Contributing guide available
Has a beginner-friendly labelContributing guide available
1 comment0 reactions1 assignee
Open
quality: audit and harden router code quality, security, and API boundaries
area/corearea/testingenhancementhelp wantedpriority/P1roadmapsafety
Why recommendedNo comments yet · Has a beginner-friendly label
No comments yetHas a beginner-friendly labelContributing guide available
0 comments0 reactions1 assignee
Open
feat: support NVIDIA DGX Spark edge deployments with local and external model routing
area/environmentarea/model-selectionarea/user-experienceenhancementhelp wantedoperationspriority/P2roadmap
Why recommendedNo comments yet · Has a beginner-friendly label
No comments yetHas a beginner-friendly labelContributing guide available
0 comments0 reactions1 assignee
Open
feat: support AMD AI PC edge deployments with local and external model routing
area/environmentarea/model-selectionarea/user-experienceenhancementenvironment/rocmhelp wantedoperationspriority/P2roadmap
Why recommendedNo comments yet · Has a beginner-friendly label
No comments yetHas a beginner-friendly labelContributing guide available
0 comments0 reactions1 assignee
Open
perf: analyze and optimize ROCm production performance for high concurrency and long context
area/bencharea/environmentenhancementenvironment/rocmevaluationhelp wantedoperationspriority/P1roadmap
Why recommendedNo assignee yet · No comments yet
No assignee yetNo comments yetHas a beginner-friendly labelContributing guide available
0 comments0 reactions0 assignees
Open
feat: add drift and unrouted-query clustering with privacy controls
area/dashboardarea/observabilityenhancementevaluationhelp wantedpriority/P2roadmap
Why recommendedNo assignee yet · No comments yet
No assignee yetNo comments yetHas a beginner-friendly labelContributing guide available
0 comments0 reactions0 assignees
Open
feat: add frontend routing analytics views for dashboard
area/dashboardarea/observabilityarea/user-experienceenhancementhelp wantedpriority/P2roadmap
Why recommendedNo assignee yet · No comments yet
No assignee yetNo comments yetHas a beginner-friendly labelContributing guide available
0 comments0 reactions0 assignees
Open
feat: add backend analytics read model for routing quality dashboards
area/dashboardarea/observabilityenhancementhelp wantedpriority/P2roadmap
Why recommendedHas a beginner-friendly label · Contributing guide available
Has a beginner-friendly labelContributing guide available
1 comment0 reactions1 assignee
Open
feat: add approval, activation, and rollback flow for agentic config tuning
area/agentarea/model-selectionarea/researchenhancementhelp wantedoperationspriority/P2roadmap
Why recommendedNo assignee yet · No comments yet
No assignee yetNo comments yetHas a beginner-friendly labelContributing guide available
0 comments0 reactions0 assignees
Open
feat: define agentic config proposal and patch contract
area/agentarea/model-selectionarea/researchenhancementhelp wantedpriority/P2roadmap
Why recommendedNo assignee yet · No comments yet
No assignee yetNo comments yetHas a beginner-friendly labelContributing guide available
0 comments0 reactions0 assignees
Open
feat: add Router Memory diagnostics and fail-open runtime receipts
area/agentarea/corearea/observabilityenhancementhelp wantedpriority/P1roadmap
Why recommendedNo assignee yet · No comments yet
No assignee yetNo comments yetHas a beginner-friendly labelContributing guide available
0 comments0 reactions0 assignees
Open
feat: define shared-resource isolation and diagnostics for multi-tenancy
area/corearea/observabilityenhancementhelp wantedoperationspriority/P1roadmap
Why recommendedHas a beginner-friendly label · Contributing guide available
Has a beginner-friendly labelContributing guide available
2 comments0 reactions1 assignee