Repository Issues
vllm-project/semantic-router
System Level Intelligent Router for Mixture-of-Models at Cloud, Data Center and Edge
Issues
Open
test: revisit E2E framework and testcase matrix across Docker and Kubernetes
area/environmentarea/test-and-releasearea/testinge2eenhancementhelp wantedoperationspriority/P1roadmap
No assignee yetHas a beginner-friendly labelContributing guide available
2 comments0 reactions0 assignees
Open
feat: add TensorRT-LLM and Triton TensorRT-LLM inference-aware backend adapter
area/model-selectionarea/observabilityenhancementhelp wantedoperationspriority/P1roadmap
Why recommendedHas a beginner-friendly label · Contributing guide available
Has a beginner-friendly labelContributing guide available
3 comments0 reactions1 assignee
Open
ops: revisit Docker and Kubernetes backend endpoint support completeness
area/dashboardarea/environmentarea/networkingenhancementhelp wantedoperationspriority/P1roadmap
Why recommendedHas a beginner-friendly label · Contributing guide available
Has a beginner-friendly labelContributing guide available
1 comment0 reactions1 assignee
Open
quality: audit and harden router code quality, security, and API boundaries
area/corearea/testingenhancementhelp wantedpriority/P1roadmapsafety
Why recommendedNo comments yet · Has a beginner-friendly label
No comments yetHas a beginner-friendly labelContributing guide available
0 comments0 reactions1 assignee
Open
feat: support NVIDIA DGX Spark edge deployments with local and external model routing
area/environmentarea/model-selectionarea/user-experienceenhancementhelp wantedoperationspriority/P2roadmap
Why recommendedNo comments yet · Has a beginner-friendly label
No comments yetHas a beginner-friendly labelContributing guide available
0 comments0 reactions1 assignee
Open
feat: support AMD AI PC edge deployments with local and external model routing
area/environmentarea/model-selectionarea/user-experienceenhancementenvironment/rocmhelp wantedoperationspriority/P2roadmap
Why recommendedNo comments yet · Has a beginner-friendly label
No comments yetHas a beginner-friendly labelContributing guide available
0 comments0 reactions1 assignee
Open
perf: analyze and optimize ROCm production performance for high concurrency and long context
area/bencharea/environmentenhancementenvironment/rocmevaluationhelp wantedoperationspriority/P1roadmap
Why recommendedNo assignee yet · No comments yet
No assignee yetNo comments yetHas a beginner-friendly labelContributing guide available
0 comments0 reactions0 assignees
Open
feat: add drift and unrouted-query clustering with privacy controls
area/dashboardarea/observabilityenhancementevaluationhelp wantedpriority/P2roadmap
Why recommendedNo assignee yet · No comments yet
No assignee yetNo comments yetHas a beginner-friendly labelContributing guide available
0 comments0 reactions0 assignees
Open
feat: add frontend routing analytics views for dashboard
area/dashboardarea/observabilityarea/user-experienceenhancementhelp wantedpriority/P2roadmap
Why recommendedNo assignee yet · No comments yet
No assignee yetNo comments yetHas a beginner-friendly labelContributing guide available
0 comments0 reactions0 assignees
Open
feat: add backend analytics read model for routing quality dashboards
area/dashboardarea/observabilityenhancementhelp wantedpriority/P2roadmap
Why recommendedHas a beginner-friendly label · Contributing guide available
Has a beginner-friendly labelContributing guide available
1 comment0 reactions1 assignee
Open
feat: add approval, activation, and rollback flow for agentic config tuning
area/agentarea/model-selectionarea/researchenhancementhelp wantedoperationspriority/P2roadmap
Why recommendedNo assignee yet · No comments yet
No assignee yetNo comments yetHas a beginner-friendly labelContributing guide available
0 comments0 reactions0 assignees
Open
feat: define agentic config proposal and patch contract
area/agentarea/model-selectionarea/researchenhancementhelp wantedpriority/P2roadmap
Why recommendedNo assignee yet · No comments yet
No assignee yetNo comments yetHas a beginner-friendly labelContributing guide available
0 comments0 reactions0 assignees
Open
feat: add Router Memory diagnostics and fail-open runtime receipts
area/agentarea/corearea/observabilityenhancementhelp wantedpriority/P1roadmap
Why recommendedNo assignee yet · No comments yet
No assignee yetNo comments yetHas a beginner-friendly labelContributing guide available
0 comments0 reactions0 assignees
Open
feat: define shared-resource isolation and diagnostics for multi-tenancy
area/corearea/observabilityenhancementhelp wantedoperationspriority/P1roadmap
Why recommendedHas a beginner-friendly label · Contributing guide available
Has a beginner-friendly labelContributing guide available
2 comments0 reactions1 assignee
Open
feat: add tenant-scoped config snapshots and recipe activation
area/corearea/dashboardenhancementhelp wantedoperationspriority/P1roadmap
Why recommendedNo assignee yet · No comments yet
No assignee yetNo comments yetHas a beginner-friendly labelContributing guide available
0 comments0 reactions0 assignees
Open
feat: add trusted tenant identity resolution for shared-router multi-tenancy
area/corearea/networkingenhancementhelp wantedoperationspriority/P1roadmap
Why recommendedHas a beginner-friendly label · Contributing guide available
Has a beginner-friendly labelContributing guide available
2 comments0 reactions1 assignee
Open
feat: explore tool- and MCP-aware routing contracts
area/agentarea/researcharea/tool-managementenhancementhelp wantedpriority/P2roadmap
Why recommendedNo assignee yet · No comments yet
No assignee yetNo comments yetHas a beginner-friendly labelContributing guide available
0 comments0 reactions0 assignees
Open
feat: define signal model lifecycle, datasets, and release provenance
area/researchenhancementenvironment/rocmevaluationhelp wantedpriority/P1roadmapsignal-decision-engine
Why recommendedNo assignee yet · No comments yet
No assignee yetNo comments yetHas a beginner-friendly labelContributing guide available
0 comments0 reactions0 assignees
Open
bench: connect fleet-sim capacity modeling to routing policy validation
area/bencharea/model-selectionenhancementevaluationhelp wantedoperationspriority/P2roadmap
Why recommendedNo comments yet · Has a beginner-friendly label
No comments yetHas a beginner-friendly labelContributing guide available
0 comments0 reactions1 assignee
Open
feat: define provider capability inventory and protocol conformance contract
area/corearea/networkingenhancementhelp wantedoperationspriority/P1roadmap
Why recommendedNo assignee yet · Has a beginner-friendly label
No assignee yetHas a beginner-friendly labelContributing guide available
2 comments0 reactions0 assignees