Repository Issues
sgl-project/sglang
SGLang is a high-performance serving framework for large language models and multimodal models.
Issues
Open
Refactor: TRTLLMHAAttnBackend should not inherit from FlashInferAttnBackend when reuse is small
good first issue
No assignee yetHas a beginner-friendly labelContributing guide available
1 comment0 reactions0 assignees
Open
model: support new diffusion models
Multi-modaldiffusiongood first issuehelp wantednew-model
Why recommendedNo assignee yet · Has a beginner-friendly label
No assignee yetHas a beginner-friendly labelContributing guide available
8 comments2 reactions0 assignees
Open
[Bug] flashinfer gdn kernel not working
good first issue
Why recommendedNo assignee yet · Has a beginner-friendly label
No assignee yetHas a beginner-friendly labelContributing guide available
2 comments0 reactions0 assignees
Open
[Feature] Improve Unit Test Coverage
cienhancementgood first issue
Why recommendedHas a beginner-friendly label · Contributing guide available
Has a beginner-friendly labelContributing guide available
83 comments0 reactions3 assignees
Open
[Feature] Unified JIT / Precompilation Cache Directory
good first issue
Why recommendedNo assignee yet · Has a beginner-friendly label
No assignee yetHas a beginner-friendly labelContributing guide available
3 comments2 reactions0 assignees
Open
[Feature] Refactor common test entries of SGLang Diffusion
good first issue
Why recommendedHas a beginner-friendly label · Contributing guide available
Has a beginner-friendly labelContributing guide available
2 comments0 reactions1 assignee
Open
[Feature] Parallelize module loading to speed up server launch and refit for Diffusion models
good first issue
Why recommendedHas a beginner-friendly label · Contributing guide available
Has a beginner-friendly labelContributing guide available
1 comment0 reactions1 assignee
Open
[Feature] Support offload and wake up of SGLang Diffusion
good first issue
Why recommendedNo assignee yet · Has a beginner-friendly label
No assignee yetHas a beginner-friendly labelContributing guide available
5 comments0 reactions0 assignees
Open
Why recommendedHas a beginner-friendly label · Contributing guide available
Has a beginner-friendly labelContributing guide available
10 comments0 reactions1 assignee
Open
Why recommendedNo assignee yet · Has a beginner-friendly label
No assignee yetHas a beginner-friendly labelContributing guide available
3 comments0 reactions0 assignees
Open
[Feature] Compare the server-disk checksum in VAE and text encoder for update weights from disk of Diffusion models
good first issue
Why recommendedHas a beginner-friendly label · Contributing guide available
Has a beginner-friendly labelContributing guide available
3 comments0 reactions1 assignee
Open
[Feature] Carefully remove duplicated cotents in SGLang Docs and SGLang Cooklook
documentationgood first issue
Why recommendedNo assignee yet · Has a beginner-friendly label
No assignee yetHas a beginner-friendly labelContributing guide available
5 comments0 reactions0 assignees
Open
SGLang Cookbook Community Contribution Roadmap
good first issue
Why recommendedHas a beginner-friendly label · Contributing guide available
Has a beginner-friendly labelContributing guide available
5 comments5 reactions2 assignees
Open
[Feature] Reduce constrained-decoding overhead in TP
good first issue
Why recommendedHas a beginner-friendly label · Contributing guide available
Has a beginner-friendly labelContributing guide available
2 comments0 reactions1 assignee
Open
[Roadmap] sglang auto tuner
good first issue
Why recommendedNo assignee yet · Has a beginner-friendly label
No assignee yetHas a beginner-friendly labelContributing guide available
14 comments29 reactions0 assignees
Open
KeyError: 'model.layers.14.mlp.shared_expert.gate_gate_up_proj.weight'
good first issuehelp wanted
Why recommendedHas a beginner-friendly label · Contributing guide available
Has a beginner-friendly labelContributing guide available
12 comments1 reaction1 assignee
Open
[Feature] Simplify `tree_speculative_sampling_target_only`
good first issue
Why recommendedNo assignee yet · Has a beginner-friendly label
No assignee yetHas a beginner-friendly labelContributing guide available
3 comments0 reactions0 assignees
Open
[Feature] Overlap Spec Support
enhancementgood first issuehelp wantedhigh priority
Why recommendedHas a beginner-friendly label · Contributing guide available
Has a beginner-friendly labelContributing guide available
27 comments25 reactions2 assignees
Open
[Feature] Support piggyback server load report.
good first issue
Why recommendedHas a beginner-friendly label · Contributing guide available
Has a beginner-friendly labelContributing guide available
4 comments0 reactions1 assignee
Open
[Feature] Integrate KVPress in order to try more KV cache optimization heuristics easily
good first issue
Why recommendedNo assignee yet · Has a beginner-friendly label
No assignee yetHas a beginner-friendly labelContributing guide available
9 comments2 reactions0 assignees