There is ambiguity between classes and modules under the evalutors module. Specifically, evaluators objects under mteb/evaluation/evaluators are named the same as the modules which contain them. For example:

mteb.evaluation.evaluators.RerankingEvaluator references the class RerankingEvaluator in mteb/evaluation/evaluators/RerankingEvaluator.py.

This is problematic because it does not allow to reference the mteb/evaluation/evaluators/RerankingEvaluator.py module and therefore referencing any other definition within it.