Skip to content

Conversation

zhyncs
Copy link
Member

@zhyncs zhyncs commented Dec 27, 2024

Motivation

Modifications

Checklist

  • Format your code according to the Contributor Guide.
  • Add unit tests as outlined in the Contributor Guide.
  • Update documentation as needed, including docstrings or example tutorials.

@zhyncs zhyncs requested review from ispobock and HandH1998 December 27, 2024 16:20
@@ -24,7 +24,7 @@ docker run --gpus all --shm-size 32g -p 30000:30000 -v ~/.cache/huggingface:/roo
### Using pip
```bash
# Installation
pip install "sglang[all]" --find-links https://flashinfer.ai/whl/cu124/torch2.4/flashinfer
pip install "sglang[all]==0.4.1.post1" --find-links https://flashinfer.ai/whl/cu124/torch2.4/flashinfer
Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

We should update the version here. Otherwise, if the user has already installed it and uses the original command again, the local SGLang won't be updated. cc @ispobock @HandH1998

@zhyncs zhyncs merged commit d9e6ee3 into main Dec 27, 2024
3 checks passed
@zhyncs zhyncs deleted the zhyncs/doc branch December 27, 2024 16:21
timethink pushed a commit to timethink/sglang that referenced this pull request Mar 9, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant