I have considered if we might want the interface to be:

import mteb

bench = mteb.Benchmark(tasks=[...])
bench.evaluate(model)

bench = mteb.get_benchmark("MTEB(eng)")
bench.evaluate(model)

Since the mteb.MTEB object is kinda of a benchmark object. (not something we should do now)

This would deprecate the mteb.MTEB object.