Skip to content

Conversation

FrankLeeeee
Copy link
Collaborator

Motivation

Some users are not familiar with how caching works for torch.compile as stated in #3614.

Modifications

Add a section in DeepSeek documentation on how to manage the caching for torch.compile.

Checklist

@FrankLeeeee FrankLeeeee force-pushed the doc/compilation-cache branch from 7a65391 to 327c8c6 Compare February 21, 2025 02:32
@FrankLeeeee
Copy link
Collaborator Author

FrankLeeeee commented Feb 21, 2025

cc @zhaochenyang20 @zhyncs @shuaills for #3614

@zhaochenyang20 zhaochenyang20 merged commit c6a4852 into sgl-project:main Feb 21, 2025
12 checks passed
aoshen524 pushed a commit to aoshen524/sglang that referenced this pull request Mar 10, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants