Skip to content

[Feature] support torch compile cache for DeepSeek V3/R1 #3614

@zhyncs

Description

@zhyncs

Checklist

Motivation

as titled

The time taken for each startup is currently too long when torch compile is enabled. It needs optimization.

Related resources

No response

Metadata

Metadata

Assignees

Type

No type

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions