Skip to content

Teak mem fraction #20

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Merged
merged 2 commits into from
Jan 17, 2024
Merged

Teak mem fraction #20

merged 2 commits into from
Jan 17, 2024

Conversation

merrymercy
Copy link
Contributor

No description provided.

@merrymercy merrymercy merged commit f9d7238 into main Jan 17, 2024
@merrymercy merrymercy deleted the teak-mem branch January 17, 2024 12:43
@CSEEduanyu CSEEduanyu mentioned this pull request Jan 26, 2025
Closed
5 tasks
timethink pushed a commit to timethink/sglang that referenced this pull request Mar 9, 2025
@merrymercy
Teak mem fraction (sgl-project#20)
3e64e9f
chunyuan-w pushed a commit to chunyuan-w/sglang that referenced this pull request Mar 25, 2025
@yanbing-j
Add fused biased_grouped_topk (sgl-project#20)
a6c4b3d 
* Add fused biased_grouped_topk

* add record function
NorthmanPKU pushed a commit to NorthmanPKU/sglang that referenced this pull request May 16, 2025
@jiakunw
Auto pip install (sgl-project#20)
ff7f9d6 
* feat: automated pip install, but manual environmental variable

* fix:small bug

* feat: added requirements.txt, but encountered some other issues

* fix: run_time lib configed correctly, but _cython does not exist

* fix: worked?

* fix: no .vscode

* fix: "re-Deleted .vscode directory"
@yuleiqin yuleiqin mentioned this pull request May 26, 2025
Closed
5 tasks
chunyuan-w pushed a commit to chunyuan-w/sglang that referenced this pull request May 28, 2025
@yanbing-j @jianan-gu
Add fused biased_grouped_topk (sgl-project#20)
d3752b7 
* Add fused biased_grouped_topk

* add record function
yanbing-j added a commit to yanbing-j/sglang that referenced this pull request Jun 3, 2025
@yanbing-j
Add fused biased_grouped_topk (sgl-project#20)
3f94893 
* Add fused biased_grouped_topk

* add record function
yanbing-j added a commit to yanbing-j/sglang that referenced this pull request Jun 4, 2025
@yanbing-j
Add fused biased_grouped_topk (sgl-project#20)
7c4b6f9 
* Add fused biased_grouped_topk

* add record function
yanbing-j added a commit to yanbing-j/sglang that referenced this pull request Jun 10, 2025
@yanbing-j
Add fused biased_grouped_topk (sgl-project#20)
6535049 
* Add fused biased_grouped_topk

* add record function
yanbing-j added a commit to yanbing-j/sglang that referenced this pull request Jun 18, 2025
@yanbing-j
Add fused biased_grouped_topk (sgl-project#20)
2ad810a 
* Add fused biased_grouped_topk

* add record function
@Zhou-sx Zhou-sx mentioned this pull request Jun 19, 2025
Closed
5 tasks
blzheng pushed a commit to blzheng/sglang that referenced this pull request Jun 23, 2025
@chunyuan-w
fix head_dim in qwen2 when num_attention_heads is padded (sgl-project#20
2bf8d2f 
)
yichiche pushed a commit to yichiche/sglang that referenced this pull request Jul 7, 2025
@Hardcode84 @xintin
decode output dtype (sgl-project#20)
88f1c22 
Signed-off-by: Ivan Butygin <ivan.butygin@gmail.com>
yichiche pushed a commit to yichiche/sglang that referenced this pull request Jul 23, 2025
@Hardcode84 @yichiche
decode output dtype (sgl-project#20)
8bb4d39 
Signed-off-by: Ivan Butygin <ivan.butygin@gmail.com>
yichiche pushed a commit to yichiche/sglang that referenced this pull request Jul 25, 2025
@Hardcode84 @yichiche
decode output dtype (sgl-project#20)
698eed1 
Signed-off-by: Ivan Butygin <ivan.butygin@gmail.com>
yichiche pushed a commit to yichiche/sglang that referenced this pull request Jul 30, 2025
@Hardcode84
decode output dtype (sgl-project#20)
46e485a 
Signed-off-by: Ivan Butygin <ivan.butygin@gmail.com>
yichiche pushed a commit to yichiche/sglang that referenced this pull request Aug 1, 2025
@Hardcode84 @yichiche
decode output dtype (sgl-project#20)
cc69616 
Signed-off-by: Ivan Butygin <ivan.butygin@gmail.com>
yichiche pushed a commit to yichiche/sglang that referenced this pull request Aug 6, 2025
@Hardcode84 @yichiche
decode output dtype (sgl-project#20)
c2ff515 
Signed-off-by: Ivan Butygin <ivan.butygin@gmail.com>
yichiche pushed a commit to yichiche/sglang that referenced this pull request Aug 7, 2025
@Hardcode84 @yichiche
decode output dtype (sgl-project#20)
8715af3 
Signed-off-by: Ivan Butygin <ivan.butygin@gmail.com>
yichiche pushed a commit to yichiche/sglang that referenced this pull request Aug 11, 2025
@Hardcode84 @yichiche
decode output dtype (sgl-project#20)
dba4b0c 
Signed-off-by: Ivan Butygin <ivan.butygin@gmail.com>
yichiche pushed a commit to yichiche/sglang that referenced this pull request Aug 11, 2025
@Hardcode84 @yichiche
decode output dtype (sgl-project#20)
406547f 
Signed-off-by: Ivan Butygin <ivan.butygin@gmail.com>
liupeng374 pushed a commit to liupeng374/sglang that referenced this pull request Aug 11, 2025
@pkking
fix: image tag (sgl-project#20)
ebcc593 
Signed-off-by: mywaaagh_admin <pkwarcraft@gmail.com>
@ericschreiber ericschreiber mentioned this pull request Aug 13, 2025
Open
5 tasks
@gaolaobao gaolaobao mentioned this pull request Aug 25, 2025
Open
5 tasks
zhuyijie88 added a commit to zhuyijie88/sglang that referenced this pull request Sep 1, 2025
@zhuyijie88
pd disaggregation support mtp kvcache (sgl-project#20)
ebbcd85
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers
No reviews
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
2 participants
@merrymercy @AnzeXie