Skip to content

Rewrite mixed chunked prefill #1383

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Closed
wants to merge 4 commits into from
Closed

Rewrite mixed chunked prefill #1383

wants to merge 4 commits into from

Conversation

hnyls2002
Copy link
Collaborator

Motivation

Modifications

Checklist

  • Format your code according to the Contributor Guide.
  • Add unit tests as outlined in the Contributor Guide.
  • Update documentation as needed, including docstrings or example tutorials.

@hnyls2002 hnyls2002 marked this pull request as draft September 14, 2024 04:32
@hnyls2002 hnyls2002 force-pushed the mixed-attention branch 5 times, most recently from 92b91c7 to 9ef6a21 Compare September 14, 2024 09:17
@merrymercy merrymercy closed this Oct 14, 2024
@merrymercy merrymercy deleted the mixed-attention branch October 14, 2024 05:11
@merrymercy merrymercy mentioned this pull request Nov 24, 2024
Closed
37 tasks
@merrymercy merrymercy mentioned this pull request Nov 30, 2024
Closed
@zhaochenyang20 zhaochenyang20 mentioned this pull request Mar 3, 2025
Closed
22 tasks
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@merrymercy merrymercy Awaiting requested review from merrymercy merrymercy will be requested when the pull request is marked ready for review merrymercy is a code owner

@Ying1123 Ying1123 Awaiting requested review from Ying1123 Ying1123 will be requested when the pull request is marked ready for review Ying1123 is a code owner

@zhyncs zhyncs Awaiting requested review from zhyncs zhyncs will be requested when the pull request is marked ready for review zhyncs is a code owner

@ispobock ispobock Awaiting requested review from ispobock ispobock will be requested when the pull request is marked ready for review ispobock is a code owner

@HaiShaw HaiShaw Awaiting requested review from HaiShaw HaiShaw will be requested when the pull request is marked ready for review HaiShaw is a code owner

@ch-wan ch-wan Awaiting requested review from ch-wan ch-wan will be requested when the pull request is marked ready for review ch-wan is a code owner

@BBuf BBuf Awaiting requested review from BBuf BBuf will be requested when the pull request is marked ready for review BBuf is a code owner

@kushanam kushanam Awaiting requested review from kushanam kushanam will be requested when the pull request is marked ready for review kushanam is a code owner

@Edwardf0t1 Edwardf0t1 Awaiting requested review from Edwardf0t1 Edwardf0t1 will be requested when the pull request is marked ready for review Edwardf0t1 is a code owner

Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
2 participants
@hnyls2002 @merrymercy