Repository Issues
vllm-project/vllm
A high-throughput and memory-efficient inference and serving engine for LLMs
Issues
Open
[Bug]: ModelOpt Llama-4 Checkpoints Take 5+ minutes to load
bugfeature requestgood first issuehelp wanted
No assignee yetHas a beginner-friendly labelContributing guide available
12 comments0 reactions0 assignees
Open
[Feature]: Enable LoRA support for tower and connector in more MM models
feature requesthelp wantedmulti-modality
Why recommendedNo assignee yet · Has a beginner-friendly label
No assignee yetHas a beginner-friendly labelContributing guide available
10 comments2 reactions0 assignees
Open
[Feature][Cleanup]: Unify `vllm.utils.flashinfer` and `vllm.model_executor.layers.quantization.utils.flashinfer_utils`
feature requestgood first issuehelp wanted
Why recommendedNo assignee yet · Has a beginner-friendly label
No assignee yetHas a beginner-friendly labelContributing guide available
7 comments0 reactions0 assignees
Open
[RFC]: Improve environment variable declaration and handling
RFCgood first issuehelp wantedkeep-open
Why recommendedHas a beginner-friendly label · Contributing guide available
Has a beginner-friendly labelContributing guide available
9 comments2 reactions1 assignee
Open
[Feature]: Default eplb num_redundant_experts to the lowest valid value if unspecified
feature requestgood first issuehelp wantedunstale
Why recommendedNo assignee yet · Has a beginner-friendly label
No assignee yetHas a beginner-friendly labelContributing guide available
9 comments0 reactions0 assignees
Open
[Feature]: Add support for fused fp8 output to FlashAttention 3
feature requesthelp wantedkeep-openperformancetorch.compile
Why recommendedHas a beginner-friendly label · Contributing guide available
Has a beginner-friendly labelContributing guide available
15 comments0 reactions1 assignee
Open
[Feature]: Qwen3 Omni Transcriptions
feature requestgood first issue
Why recommendedHas a beginner-friendly label · Contributing guide available
Has a beginner-friendly labelContributing guide available
9 comments0 reactions1 assignee
Open
[Feature]: Optimize collectives in TP MoE case using torch.compile pass
feature requestgood first issuehelp wantedperformancetorch.compile
Why recommendedHas a beginner-friendly label · Contributing guide available
Has a beginner-friendly labelContributing guide available
33 comments0 reactions2 assignees
Open
[Bug][RL]: Port Conflict
buggood first issuehelp wantedstaleunstale
Why recommendedNo assignee yet · Has a beginner-friendly label
No assignee yetHas a beginner-friendly labelContributing guide available
17 comments2 reactions0 assignees
Open
[Feature]: Improve DCP error messages
feature requestgood first issuestale
Why recommendedNo assignee yet · Has a beginner-friendly label
No assignee yetHas a beginner-friendly labelContributing guide available
5 comments2 reactions0 assignees
Open
[Bug]: AsyncTP pass has poor perf on B200
bughelp wantedkeep-opentorch.compile
Why recommendedHas a beginner-friendly label · Contributing guide available
Has a beginner-friendly labelContributing guide available
5 comments2 reactions2 assignees
Open
[Feature]: Batch Invariant Feature and Performance Optimization
feature requestgood first issue
Why recommendedHas a beginner-friendly label · Contributing guide available
Has a beginner-friendly labelContributing guide available
59 comments27 reactions3 assignees
Open
[Feature]: Tracking Whisper feature requests
feature requestgood first issuehelp wantedkeep-openmulti-modality
Why recommendedNo assignee yet · Has a beginner-friendly label
No assignee yetHas a beginner-friendly labelContributing guide available
13 comments17 reactions0 assignees
Open
[RFC]: Limit the use of envvars in vLLM
RFCgood first issue
Why recommendedHas a beginner-friendly label · Contributing guide available
Has a beginner-friendly labelContributing guide available
17 comments5 reactions2 assignees
Open
[Performance]: Compiled `QuantFP8.forward_native` group quantization (1, 128) slower than CUDA on H100/RTX5090
help wantedkeep-openneeds reproductionperformancetorch.compile
Why recommendedHas a beginner-friendly label · Contributing guide available
Has a beginner-friendly labelContributing guide available
18 comments3 reactions2 assignees
Open
[Feature]: Support `Phi4Flash` model in V1
feature requestgood first issuehelp wantedstaleunstale
Why recommendedNo assignee yet · Has a beginner-friendly label
No assignee yetHas a beginner-friendly labelContributing guide available
7 comments0 reactions0 assignees
Open
[Bug]: Add tests for all parallel sampling parameter combinations
buggood first issuekeep-openstale
Why recommendedHas a beginner-friendly label · Contributing guide available
Has a beginner-friendly labelContributing guide available
7 comments0 reactions1 assignee
Open
[Feature]: Add Triton implementation of NVFP4 GEMM
feature requestgood first issueperformanceunstale
Why recommendedNo assignee yet · Has a beginner-friendly label
No assignee yetHas a beginner-friendly labelContributing guide available
10 comments1 reaction0 assignees
Open
[Feature]: `CustomOp` cleanup
feature requestgood first issuehelp wantedkeep-openstartup-ux
Why recommendedHas a beginner-friendly label · Contributing guide available
Has a beginner-friendly labelContributing guide available
7 comments0 reactions1 assignee
Open
[Feature]: Run performance benchmarks for multi-modal models in CI
feature requesthelp wantedkeep-openmulti-modality
Why recommendedNo assignee yet · Has a beginner-friendly label
No assignee yetHas a beginner-friendly labelContributing guide available
15 comments0 reactions0 assignees