Skip to content

support sglang #750

@rangehow

Description

@rangehow

Feature request / 功能建议

sglang is a high-performance inference framework that is very popular in the open-source community. Currently, glm-4-32B is not yet supported by the framework, and we hope the team can consider adding support for it.

sgl-project/sglang#5441

Metadata

Metadata

Labels

No labels
No labels

Type

No type

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions