Skip to content

Incorrect annotations for Mistral-based embedding models #2155

@x-tabdeveloping

Description

@x-tabdeveloping

Currently e5-R-mistral-7b is annotated as zero-shot on most benchmark, despite the fact that it was finetuned from e5-mistral, which isn't (e.g. on FEVER)

Metadata

Metadata

Labels

bugSomething isn't workinggood first issueGood for newcomers

Type

No type

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions