-
Notifications
You must be signed in to change notification settings - Fork 2.8k
xgrammar 0.1.14 #3593
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
xgrammar 0.1.14 #3593
Conversation
There are some issues with 0.1.13, please wait for @Ubospica to release a new version. |
@zhyncs understood, thanks for the review and info. I presume the issues you reference are build related? Installing from wheel passed our internal smoke tests fwiw. |
@qeternity Yes the CI fails because xgrammar's new version contains a kernel not compatible with CUDA<12.4. It should work properly for CUDA>=12.4. We have fixed this issue (mlc-ai/xgrammar#206) and will release a new version later. |
@Ubospica gotcha. We are running 12.4 so I guess that explains things :) |
Ah Currently SGLang is using CUDA 12.1 for the CIs :) |
xgrammar just releases 0.1.14, which supports lower version of glibc mlc-ai/xgrammar#113 . Is it possible to support latest version xgrammar to ease the installation on older os? |
I have updated this PR to 0.1.14 |
Why did this PR skip the test? @shuaills @zhaochenyang20 Note: |
@zhyncs I think this should be fine |
@zhaochenyang20 I don't think so. When we update |
Sure. We are fixing this today: If failed, we can revert it. |
Motivation
Xgrammar compiler now supports regex compilation directly and the latest contains fixes (e.g. lazy groups) which bring it closer to parity with Outlines.
Modifications
Upgrade deps and migrate to regex compiler.
Checklist