Skip to content

Conversation

24September
Copy link
Contributor

@24September 24September commented Apr 21, 2025

Add model for mteb eng v2

Checklist

  • Run tests locally to make sure nothing is broken using make test.
  • Run the results files checker make pre-push.

Adding a model checklist

  • I have added model implementation to mteb/models/ directory. Instruction to add a model can be found here in the following PR ____

Add model for mteb eng v2
@24September
Copy link
Contributor Author

24September commented Apr 21, 2025

We just made PR, and added our model to the mteb (https://github.com/embeddings-benchmark/mteb/blob/main/mteb/models/relle_models.py).
Could you please check this out?

Copy link
Member

@Samoed Samoed left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

You should move your model to folder with your revision. To 093417798a062ed8ddd8424df3be62145d4ace91 instead of 1

@Samoed Samoed changed the title Submit results for MTEB eng V2 Submit results for relle MTEB eng V2 Apr 21, 2025
@24September
Copy link
Contributor Author

we just moved our model with the revision of 093417798a062ed8ddd8424df3be62145d4ace91, so could you check this again please?

@24September
Copy link
Contributor Author

changed the meta_model.json. Could you please check this out?

@Samoed Samoed enabled auto-merge (squash) April 22, 2025 06:53
@Samoed Samoed merged commit 86a3312 into embeddings-benchmark:main Apr 22, 2025
2 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants