Skip to content

fix: Updated revision for jina-embeddings-v4 #3046

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged

Conversation

jupyterjazz
Copy link
Contributor

We should remove the hardcoded revision from the jina-embeddings-v4 loader, as the specified version is incompatible with the latest Transformers release and causes evaluation to fail

Signed-off-by: admin <bo.wang@jina.ai>
@Samoed
Copy link
Member

Samoed commented Aug 18, 2025

Can you open an issue in transformers to fix this?

@jupyterjazz
Copy link
Contributor Author

The issue was in the v4 model code, which has been fixed, but because the loader specifies an older revision, it still fails with MTEB

@Samoed
Copy link
Member

Samoed commented Aug 18, 2025

But you can bump revision instead of removing it

Signed-off-by: admin <bo.wang@jina.ai>
@jupyterjazz
Copy link
Contributor Author

you can bump revision instead of removing it

Ok

Also do run it on a task to confirm that this solves the problem

Verified

@KennethEnevoldsen KennethEnevoldsen changed the title fix: hardcoded revision in the jina-embeddings-v4 loader fix: Updated revision for jina-embeddings-v4 Aug 18, 2025
@KennethEnevoldsen KennethEnevoldsen enabled auto-merge (squash) August 18, 2025 13:16
@KennethEnevoldsen KennethEnevoldsen merged commit c58b319 into embeddings-benchmark:main Aug 18, 2025
10 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants