Skip to content

Pull requests: sgl-project/sglang

New pull request New
144 Open 2,447 Closed
144 Open 2,447 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Reviews
Filter by reviews
No reviews Review required Approved review Changes requested
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Pull requests list

ROCm: update aiter and its usage to fused moe (bloat16, fp8, fp8 block-quant)
#4053 opened Mar 4, 2025 by HaiShaw Loading…
Fix breakage problem when using custom_ar
#4052 opened Mar 4, 2025 by kkHuang-amd Loading…
6 tasks
1
Remove grafana dashboard's datasource uid
#4051 opened Mar 4, 2025 by kebe7jun Loading…
1
1
Fix debug_tensor_dump_output_folder optional key missing
#4046 opened Mar 4, 2025 by Qubitium Loading…
chore: bump v0.4.4 high priority
#4041 opened Mar 3, 2025 by zhyncs • Draft
12 tasks
@zhyncs
Added fix for TP>1 grammar sync for slow networks
#4040 opened Mar 3, 2025 by TimDettmers Loading…
6 tasks
EAGLE docs
#4038 opened Mar 3, 2025 by simveit • Draft
3
[Fix & Style] Refactor the grammar backend to reduce human errors and improve readability
#4030 opened Mar 3, 2025 by DarkSharpness Loading…
2 of 6 tasks
Avoid duplicated request ids in batch APIs
#4026 opened Mar 3, 2025 by tanconghui Loading…
1 of 6 tasks
HotFix for #3988 using blockwise_int8
#4023 opened Mar 3, 2025 by xihuai18 Loading…
1 of 6 tasks
4
[Feature] Add test for speculative_token_map
#4016 opened Mar 3, 2025 by Achazwl Loading…
2 of 6 tasks
ROCM support tree_speculative_sampling_target_only
#4015 opened Mar 3, 2025 by fsx950223 • Draft
6 tasks
1
[Revision] Add fast decode plan for flashinfer mla
#4012 opened Mar 3, 2025 by Fridge003 Loading…
6 tasks
@Ying1123 @merrymercy @zhyncs
Hierarchical Caching supports MLA
#4009 opened Mar 3, 2025 by zeroorhero Loading…
1 of 6 tasks
2
Reasoning parser
#4001 opened Mar 2, 2025 by tot0 • Draft
6 tasks
bench: add dataset param for bench_multiturn
#3990 opened Mar 2, 2025 by zeroorhero Loading…
1 of 6 tasks
3
Refactor eagle speculative decoding high priority
#3986 opened Mar 2, 2025 by Ying1123 Loading…
5
[Bug Fix] Add partial rotary factor support for Phi-4 and upgrade to transformers v4.49.0
#3984 opened Mar 1, 2025 by adarshxs Loading…
1 task done
1
fix: fix wrong param passed to num_verify_tokens
#3981 opened Mar 1, 2025 by mickqian • Draft
6 tasks
2
Move aiohttp into public dependencies
#3980 opened Mar 1, 2025 by stevapple Loading…
1 of 6 tasks
1
FP4 weight loading and inference (2/2)
#3972 opened Feb 28, 2025 by trevor-m Loading…
6 tasks
[CI] Remove unused imports with Ruff to pre-commit config
#3969 opened Feb 28, 2025 by b8zhong Loading…
3 tasks done
1
9
Blackwell fp8 blockscale
#3968 opened Feb 28, 2025 by elfiegg • Draft
6 tasks
feat(remote_model): support variable remote backend for model loader
#3964 opened Feb 28, 2025 by DellCurry Loading…
2 of 9 tasks
Add device detection and count functions to utils.
#3962 opened Feb 28, 2025 by vshekhawat-hlab Loading…
1 of 6 tasks
10
ProTip! Updated in the last three days: updated:>2025-02-28.