Skip to content

Error running MLSUMClusteringP2P.v2 #1110

@Samoed

Description

@Samoed

Hi! I runned MLSUMClusteringP2P.v2 and got error TypeError: 'int' object is not iterable. I'm not shure why this happening

Here is the code that produces the error:

import mteb
from mteb.models.sentence_transformers_models import all_MiniLM_L6_v2

model = mteb.get_model(model_name=all_MiniLM_L6_v2.name, revision=all_MiniLM_L6_v2.revision)
tasks = mteb.get_tasks(tasks=["MLSUMClusteringP2P.v2"])
evaluation = mteb.MTEB(tasks)
evaluation.run(model, output_folder="results", verbosity=2, overwrite_results=True)

colab https://colab.research.google.com/drive/1lY4Iv0PeGjIteLwfl3RaMtwUL6Ii8hoE?usp=sharing

Metadata

Metadata

Labels

bugSomething isn't working

Type

No type

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions