Repository Issues
vllm-project/vllm
A high-throughput and memory-efficient inference and serving engine for LLMs
Issues
Closed
[Usage]: How to get query embeddings from ColBERT?
good first issueusage
Has a beginner-friendly labelContributing guide available
9 comments0 reactions1 assignee
Closed
[Transformers v5] Tarsier2ForConditionalGeneration
good first issuehelp wanted
Why recommendedNo assignee yet · Has a beginner-friendly label
No assignee yetHas a beginner-friendly labelContributing guide available
4 comments0 reactions0 assignees
Closed
[Transformers v5] SarvamMLAForCausalLM
good first issuehelp wanted
Why recommendedHas a beginner-friendly label · Contributing guide available
Has a beginner-friendly labelContributing guide available
2 comments0 reactions1 assignee
Closed
[Transformers v5] IsaacForConditionalGeneration
good first issuehelp wanted
Why recommendedNo assignee yet · Has a beginner-friendly label
No assignee yetHas a beginner-friendly labelContributing guide available
5 comments0 reactions0 assignees
Closed
[Transformers v5] Base model and LoRA used in test has incorrect `tokenizer_config.json`
good first issuehelp wanted
Why recommendedHas a beginner-friendly label · Contributing guide available
Has a beginner-friendly labelContributing guide available
9 comments0 reactions1 assignee
Closed
[Transformers v5] MiniCPMV cannot apply processor
good first issuehelp wanted
Why recommendedHas a beginner-friendly label · Contributing guide available
Has a beginner-friendly labelContributing guide available
8 comments0 reactions1 assignee
Closed
[Feature][Help Wanted]: Add tuning script and config files for Mamba selective_state_update kernel
feature requestgood first issuehelp wanted
Why recommendedNo assignee yet · Has a beginner-friendly label
No assignee yetHas a beginner-friendly labelContributing guide available
11 comments0 reactions0 assignees
Closed
[Bug][Help Wanted]: PPLX + vLLM CUTLASS FP8 Gives Incorrect Responses
bughelp wantedstale
Why recommendedNo assignee yet · Has a beginner-friendly label
No assignee yetHas a beginner-friendly labelContributing guide available
6 comments0 reactions0 assignees
Closed
[Feature]: Integrate RMS+fp4 fused kernel from FlashInfer
feature requestgood first issuehelp wantedstaletorch.compile
Why recommendedHas a beginner-friendly label · Contributing guide available
Has a beginner-friendly labelContributing guide available
14 comments0 reactions1 assignee
Closed
[Feature]: Support DCP with FP8 KV Cache
feature requesthelp wanted
Why recommendedNo assignee yet · Has a beginner-friendly label
No assignee yetHas a beginner-friendly labelContributing guide available
4 comments0 reactions0 assignees
Closed
[Bug]: 0% Acceptance rate with FI Cutlass DeepSeekR1 NVFP4 with mtp ep
bughelp wantedstale
Why recommendedNo assignee yet · Has a beginner-friendly label
No assignee yetHas a beginner-friendly labelContributing guide available
4 comments0 reactions0 assignees
Closed
Why recommendedNo assignee yet · Has a beginner-friendly label
No assignee yetHas a beginner-friendly labelContributing guide available
3 comments0 reactions0 assignees
Closed
[Bug]: FlashInfer Incompatible with Sleep Mode
bughelp wantedstale
Why recommendedNo assignee yet · Has a beginner-friendly label
No assignee yetHas a beginner-friendly labelContributing guide available
4 comments2 reactions0 assignees
Closed
[Feature]: Fused Kernel for GPT-OSS Router
feature requestgood first issuehelp wantedstale
Why recommendedNo assignee yet · Has a beginner-friendly label
No assignee yetHas a beginner-friendly labelContributing guide available
10 comments0 reactions0 assignees
Closed
[Bug]: torch.compile padding causes IMA on Hopper + DBO
bughelp wantedstaletorch.compileunstale
Why recommendedHas a beginner-friendly label · Contributing guide available
Has a beginner-friendly labelContributing guide available
41 comments0 reactions1 assignee
Closed
[torch.compile][Performance]: Unwrap custom ops and improve fusion (Inductor and custom)
help wantedperformancetorch.compile
Why recommendedHas a beginner-friendly label · Contributing guide available
Has a beginner-friendly labelContributing guide available
21 comments11 reactions1 assignee
Closed
[Bug]: Hangs on mulit-node setup when len(prompt) > max_model_len
buggood first issuestale
Why recommendedHas a beginner-friendly label · Contributing guide available
Has a beginner-friendly labelContributing guide available
15 comments1 reaction1 assignee