Skip to content

Issues: sgl-project/sglang

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

319 Open 998 Closed
319 Open 998 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Issues list

[Feature] Apply structured output sampling after reasoning steps in Reasoning models
#4055 opened Mar 4, 2025 by xihuai18
2 tasks
NVIDIA L40*8 docker NCCL Hanging During Initialization on Single Node with Multiple GPUs
#4054 opened Mar 4, 2025 by guoshiyin-666
5 tasks done
[Bug] Directly importing Grafana JSON does not work
#4050 opened Mar 4, 2025 by kebe7jun
5 tasks done
1
[Error]Input length (160062 tokens) exceeds the maximum allowed length (59862 tokens). deepseek help wanted Extra attention is needed
#4048 opened Mar 4, 2025 by tingjun-cs
@minleminzui
3
[Bug] ImportError: cannot import name 'BaseImageProcessor' from 'transformers'
#4047 opened Mar 4, 2025 by wavelet2008
5 tasks done
@minleminzui
1
Development Roadmap (2025 H1)
#4042 opened Mar 4, 2025 by zhyncs
1 of 55 tasks
@HaiShaw @Ying1123
@merrymercy @ByronHsu @yizhang2077 @ispobock @zhyncs @Fridge003 @zhaochenyang20
2
[Feature] Refactor all parser features
#4036 opened Mar 3, 2025 by shuaills
2 tasks done
@shuaills
4
[Bug] Config file not found when use NVIDIA_H20-3e quant LLM Quantization
#4028 opened Mar 3, 2025 by wangxiaoyang-dev
2 of 5 tasks
@minleminzui
2
[Bug] How to add chat_template on Offline Batch Inference
#4024 opened Mar 3, 2025 by oasis-0927
2 tasks done
@minleminzui
1
[Bug] running requests low deepseek help wanted Extra attention is needed
#4022 opened Mar 3, 2025 by luhairong11
5 tasks done
@minleminzui
[Bug] After using H200*8 to deploy DeepSeekR1, the large stress test model crashes deepseek help wanted Extra attention is needed
#4020 opened Mar 3, 2025 by wangguo1230
5 tasks done
@minleminzui
3
[Bug] KeyError: 'model.layers.0.mlp.down_proj.weight_scale_inv' when run deepseek 671b with 64 RTX 4090 GPU deepseek help wanted Extra attention is needed
#4018 opened Mar 3, 2025 by RockGo
5 tasks done
@minleminzui
[Bug] deepseek-r1 occasionally crash deepseek
#4017 opened Mar 3, 2025 by zhao-lun
5 tasks done
@minleminzui
[Bug] Qwen2.5-32B-Instruct-GPTQ-Int answer end abnormally，Qwen2.5-32B-Instruct answer is ok，use vllm is ok
#4013 opened Mar 3, 2025 by Flynn-Zh
3 of 5 tasks
@minleminzui
5
[Bug] Stuck at CUDA graph capture when serving with two A100*8 nodes deepseek
#4007 opened Mar 3, 2025 by Grey4sh
5 tasks done
@minleminzui
1
[Bug] The ncu command blocks when collecting data.
#4005 opened Mar 3, 2025 by nevgiu
1 of 5 tasks
@minleminzui
2
[Feature] i can not use function call of deepseek-v3、R1 with sglang==0.4.3.post2.
#4004 opened Mar 3, 2025 by hwaking
2 tasks
@minleminzui
2
[Bug] HiCacheController Stuck when testing using multi long text documents
#3998 opened Mar 2, 2025 by rzwei
1 of 5 tasks
@minleminzui
4
Performance issue comparing on MI210x4
#3996 opened Mar 2, 2025 by VincentXWD
@minleminzui
1
[Bug] [DeepSeek-R1/V3] The description of --kv-cache-dtype in the documentation and the code is inconsistent.
#3995 opened Mar 2, 2025 by VegetaPn
5 tasks done
@minleminzui
2
[Bug] Distributed Initialization of SGLang with accelerate launch
#3974 opened Mar 1, 2025 by jhinpan
5 tasks done
@jhinpan
3
[Feature] Support model unsloth/DeepSeek-R1-GGUF deepseek
#3973 opened Mar 1, 2025 by Qiaolin-Yu
2 tasks done
1
[Feature] Prefill assistant response feature good first issue Good for newcomers help wanted Extra attention is needed
#3971 opened Feb 28, 2025 by RealWorga
2 tasks done
@jhinpan
1
[Bug] Sg-kernel and sglang build from source
#3970 opened Feb 28, 2025 by johnnynunez
5 tasks done
@jhinpan
2
Question sgl_kernel on amd paltforms amd
#3965 opened Feb 28, 2025 by etiennemlb
@jhinpan
10
ProTip! Follow long discussions with comments:>50.