Skip to content

Issues: sgl-project/sglang

Development Roadmap (2024 Q3)
#634 opened Jul 17, 2024 by Ying1123
Open 18
[Tracker] OpenRouter LLM rankings tracking
#1152 opened Aug 19, 2024 by zhyncs
Open 2
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

106 Open 418 Closed
106 Open 418 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Issues list

[Bug] Deepseek-V2.5 capture cuda graph failed
#1479 opened Sep 20, 2024 by halexan
5 tasks done
[Bug] The sglang cannot reach the preset concurrency level.
#1477 opened Sep 20, 2024 by rangehow
5 tasks done
[Bug] The engine hangs after requesting health_generate 190 times.
#1473 opened Sep 19, 2024 by unix1986
5 tasks done
1
[Bug] illegal memory access encountered
#1467 opened Sep 19, 2024 by wonderisland
5 tasks done
[Bug] enable-mixed-chunk may cause the regex request get wrong result and output_token_logprobs
#1466 opened Sep 19, 2024 by liuteng
5 tasks done
[Bug] oom,torch.OutOfMemoryError: seems to only use one gpu on A800-80G,available 40g on each card
#1463 opened Sep 19, 2024 by chuangzhidan
4 of 5 tasks
3
[Bug] Performance issue on MoE with torch.compile performance
#1446 opened Sep 17, 2024 by ispobock
5 tasks done
@merrymercy @ispobock
@zhyncs @hnyls2002
[Bug] Llama 405B FP8 causes OOM on 16xA40
#1439 opened Sep 16, 2024 by sumukshashidhar
5 tasks done
[Feature] Expert parallelism support enhancement New feature or request
#1435 opened Sep 16, 2024 by chongli-uw
2 tasks done
[Bug] Nonsense and slow output under high concurrency
#1434 opened Sep 15, 2024 by tongyx361
5 tasks done
1
[Bug] missing max_workers param when initiate ProcessPoolExecutor
#1424 opened Sep 14, 2024 by wellhowtosay
5 tasks done
2
[Bug] AttributeError: 'MiniCPM3ForCausalLM' object has no attribute 'get_module_name'
#1416 opened Sep 13, 2024 by lixiangtiandashen
5 tasks
2
[Bug] Issue with batch API
#1415 opened Sep 13, 2024 by dmakhervaks
5 tasks
3
[Bug] triton attention-backend bug
#1413 opened Sep 13, 2024 by 81549361
5 tasks done
@ispobock @zhyncs
1
[Bug] RuntimeError: Failed to allocate memory for batch_prefill_tmp_v with size 458752000 and alignment 16 in AlignedAllocator
#1405 opened Sep 12, 2024 by josephydu
5 tasks done
@zhyncs
3
[Bug] This modeling file requires the following packages that were not found in your environment: datamodel_code_generator. Run pip install datamodel_code_generator
#1398 opened Sep 12, 2024 by cicicji
5 tasks done
[Feature] support awq of deepseek-v2 or deepseek-v2.5
#1396 opened Sep 12, 2024 by tutu329
2 tasks done
@ispobock @zhyncs
[Feature] Support torch profiler good first issue Good for newcomers
#1388 opened Sep 11, 2024 by danielhua23
2 tasks done
1
[Feature] Support RM API
#1384 opened Sep 11, 2024 by UbeCc
2 tasks done
1
[Bug] too many processes
#1382 opened Sep 11, 2024 by wellhowtosay
5 tasks
[Feature] 4-bit quantized prefix cache
#1374 opened Sep 10, 2024 by josephrocca
2
[Bug] sgLang v0.3 breaks TP8 Llama 3.1 405B FP8 on 8xH100
#1362 opened Sep 9, 2024 by jischein
5 tasks done
@zhyncs
8
[Feature] support LLaVA-NeXT-Video-32B-Qwen
#1356 opened Sep 9, 2024 by HarperGG
2 tasks done
2
[Feature] support qwen2 vl
#1352 opened Sep 8, 2024 by zhyncs
2 tasks done
@ispobock @zhyncs
3
[Feature] KV Cache Quantization
#1351 opened Sep 8, 2024 by vnkc1
2 tasks done
2
ProTip! Updated in the last three days: updated:>2024-09-17.