2025-01-01 04:48:40.712992: E external/local_xla/xla/stream_executor/cuda/cuda_fft.cc:485] Unable to register cuFFT factory: Attempting to register factory for plugin cuFFT when one has already been registered
2025-01-01 04:48:40.726923: E external/local_xla/xla/stream_executor/cuda/cuda_dnn.cc:8454] Unable to register cuDNN factory: Attempting to register factory for plugin cuDNN when one has already been registered
2025-01-01 04:48:40.730838: E external/local_xla/xla/stream_executor/cuda/cuda_blas.cc:1452] Unable to register cuBLAS factory: Attempting to register factory for plugin cuBLAS when one has already been registered
INFO:mteb.cli:Running with parameters: Namespace(model='minishlab/potion-base-2M', task_types=None, categories=None, tasks=['ClimateFEVERHardNegatives'], languages=None, benchmarks=None, device=None, output_folder='/data/niklas/results/results', verbosity=2, co2_tracker=True, eval_splits=None, model_revision=None, batch_size=32, overwrite=False, save_predictions=False, func=<function run at 0x7f24e7edcf70>)
INFO:mteb.evaluation.MTEB:

## Evaluating 1 tasks:
─────────────────────────────── Selected tasks  ────────────────────────────────
Retrieval
    - ClimateFEVERHardNegatives, s2p


INFO:mteb.evaluation.MTEB:

********************** Evaluating ClimateFEVERHardNegatives **********************
INFO:mteb.abstasks.AbsTaskRetrieval:Loading Corpus...
Overwrite dataset info from restored data version if exists.
INFO:datasets.builder:Overwrite dataset info from restored data version if exists.
Loading Dataset info from /data/huggingface/datasets/mteb___climate_fever_test_top_250_only_w_correct-v2/corpus/0.0.0/3a309e201f3c2c4b13bd4a367a8f37eee2ec1d21
INFO:datasets.info:Loading Dataset info from /data/huggingface/datasets/mteb___climate_fever_test_top_250_only_w_correct-v2/corpus/0.0.0/3a309e201f3c2c4b13bd4a367a8f37eee2ec1d21
Found cached dataset climate_fever_test_top_250_only_w_correct-v2 (/data/huggingface/datasets/mteb___climate_fever_test_top_250_only_w_correct-v2/corpus/0.0.0/3a309e201f3c2c4b13bd4a367a8f37eee2ec1d21)
INFO:datasets.builder:Found cached dataset climate_fever_test_top_250_only_w_correct-v2 (/data/huggingface/datasets/mteb___climate_fever_test_top_250_only_w_correct-v2/corpus/0.0.0/3a309e201f3c2c4b13bd4a367a8f37eee2ec1d21)
Loading Dataset info from /data/huggingface/datasets/mteb___climate_fever_test_top_250_only_w_correct-v2/corpus/0.0.0/3a309e201f3c2c4b13bd4a367a8f37eee2ec1d21
INFO:datasets.info:Loading Dataset info from /data/huggingface/datasets/mteb___climate_fever_test_top_250_only_w_correct-v2/corpus/0.0.0/3a309e201f3c2c4b13bd4a367a8f37eee2ec1d21
Loading cached processed dataset at /data/huggingface/datasets/mteb___climate_fever_test_top_250_only_w_correct-v2/corpus/0.0.0/3a309e201f3c2c4b13bd4a367a8f37eee2ec1d21/cache-cddf4627905fef57.arrow
INFO:datasets.arrow_dataset:Loading cached processed dataset at /data/huggingface/datasets/mteb___climate_fever_test_top_250_only_w_correct-v2/corpus/0.0.0/3a309e201f3c2c4b13bd4a367a8f37eee2ec1d21/cache-cddf4627905fef57.arrow
INFO:mteb.abstasks.AbsTaskRetrieval:Loaded 47416 TEST Documents.
INFO:mteb.abstasks.AbsTaskRetrieval:Doc Example: {'id': '1993_Storm_of_the_Century', 'text': "The 1993 Storm of the Century ( also known as the 93 Super Storm or the Great Blizzard of 1993 ) was a large cyclonic storm that formed over the Gulf of Mexico on March 12 , 1993 . The storm eventually dissipated in the North Atlantic Ocean on March 15 , 1993 . It was unique for its intensity , massive size , and wide-reaching effects . At its height , the storm stretched from Canada to the Gulf of Mexico . The cyclone moved through the Gulf of Mexico and then through the eastern United States before moving onto Canada .   Heavy snow was first reported in highland areas as far south as Alabama and northern Georgia , with Union County , Georgia reporting up to 35 inches of snow in the north Georgia mountains . Birmingham , Alabama , reported a rare 13 in of snow .  The Florida Panhandle reported up to 4 in , with hurricane-force wind gusts and record low barometric pressures . Between Louisiana and Cuba , the hurricane-force winds produced high storm surges across Northwestern Florida which , in combination with scattered tornadoes , killed dozens of people .   Record cold temperatures were seen across portions of the south and east of the US in the wake of this storm . In the United States , the storm was responsible for the loss of electric power to more than 10 million households . An estimated 40 percent of the country 's population experienced the effects of the storm with a total of 208 fatalities .", 'title': '1993 Storm of the Century'}
INFO:mteb.abstasks.AbsTaskRetrieval:Loading Queries...
Overwrite dataset info from restored data version if exists.
INFO:datasets.builder:Overwrite dataset info from restored data version if exists.
Loading Dataset info from /data/huggingface/datasets/mteb___climate_fever_test_top_250_only_w_correct-v2/queries/0.0.0/3a309e201f3c2c4b13bd4a367a8f37eee2ec1d21
INFO:datasets.info:Loading Dataset info from /data/huggingface/datasets/mteb___climate_fever_test_top_250_only_w_correct-v2/queries/0.0.0/3a309e201f3c2c4b13bd4a367a8f37eee2ec1d21
Found cached dataset climate_fever_test_top_250_only_w_correct-v2 (/data/huggingface/datasets/mteb___climate_fever_test_top_250_only_w_correct-v2/queries/0.0.0/3a309e201f3c2c4b13bd4a367a8f37eee2ec1d21)
INFO:datasets.builder:Found cached dataset climate_fever_test_top_250_only_w_correct-v2 (/data/huggingface/datasets/mteb___climate_fever_test_top_250_only_w_correct-v2/queries/0.0.0/3a309e201f3c2c4b13bd4a367a8f37eee2ec1d21)
Loading Dataset info from /data/huggingface/datasets/mteb___climate_fever_test_top_250_only_w_correct-v2/queries/0.0.0/3a309e201f3c2c4b13bd4a367a8f37eee2ec1d21
INFO:datasets.info:Loading Dataset info from /data/huggingface/datasets/mteb___climate_fever_test_top_250_only_w_correct-v2/queries/0.0.0/3a309e201f3c2c4b13bd4a367a8f37eee2ec1d21
Loading cached processed dataset at /data/huggingface/datasets/mteb___climate_fever_test_top_250_only_w_correct-v2/queries/0.0.0/3a309e201f3c2c4b13bd4a367a8f37eee2ec1d21/cache-88a1f9e78ab9bf27.arrow
INFO:datasets.arrow_dataset:Loading cached processed dataset at /data/huggingface/datasets/mteb___climate_fever_test_top_250_only_w_correct-v2/queries/0.0.0/3a309e201f3c2c4b13bd4a367a8f37eee2ec1d21/cache-88a1f9e78ab9bf27.arrow
Overwrite dataset info from restored data version if exists.
INFO:datasets.builder:Overwrite dataset info from restored data version if exists.
Loading Dataset info from /data/huggingface/datasets/mteb___climate_fever_test_top_250_only_w_correct-v2/default/0.0.0/3a309e201f3c2c4b13bd4a367a8f37eee2ec1d21
INFO:datasets.info:Loading Dataset info from /data/huggingface/datasets/mteb___climate_fever_test_top_250_only_w_correct-v2/default/0.0.0/3a309e201f3c2c4b13bd4a367a8f37eee2ec1d21
Found cached dataset climate_fever_test_top_250_only_w_correct-v2 (/data/huggingface/datasets/mteb___climate_fever_test_top_250_only_w_correct-v2/default/0.0.0/3a309e201f3c2c4b13bd4a367a8f37eee2ec1d21)
INFO:datasets.builder:Found cached dataset climate_fever_test_top_250_only_w_correct-v2 (/data/huggingface/datasets/mteb___climate_fever_test_top_250_only_w_correct-v2/default/0.0.0/3a309e201f3c2c4b13bd4a367a8f37eee2ec1d21)
Loading Dataset info from /data/huggingface/datasets/mteb___climate_fever_test_top_250_only_w_correct-v2/default/0.0.0/3a309e201f3c2c4b13bd4a367a8f37eee2ec1d21
INFO:datasets.info:Loading Dataset info from /data/huggingface/datasets/mteb___climate_fever_test_top_250_only_w_correct-v2/default/0.0.0/3a309e201f3c2c4b13bd4a367a8f37eee2ec1d21
Loading cached processed dataset at /data/huggingface/datasets/mteb___climate_fever_test_top_250_only_w_correct-v2/default/0.0.0/3a309e201f3c2c4b13bd4a367a8f37eee2ec1d21/cache-0baa34c511cb5816.arrow
INFO:datasets.arrow_dataset:Loading cached processed dataset at /data/huggingface/datasets/mteb___climate_fever_test_top_250_only_w_correct-v2/default/0.0.0/3a309e201f3c2c4b13bd4a367a8f37eee2ec1d21/cache-0baa34c511cb5816.arrow

Map:   0%|          | 0/3048 [00:00<?, ? examples/s]
Map: 100%|██████████| 3048/3048 [00:00<00:00, 47102.01 examples/s]
Loading cached processed dataset at /data/huggingface/datasets/mteb___climate_fever_test_top_250_only_w_correct-v2/queries/0.0.0/3a309e201f3c2c4b13bd4a367a8f37eee2ec1d21/cache-55ea9f50c4af4b82.arrow
INFO:datasets.arrow_dataset:Loading cached processed dataset at /data/huggingface/datasets/mteb___climate_fever_test_top_250_only_w_correct-v2/queries/0.0.0/3a309e201f3c2c4b13bd4a367a8f37eee2ec1d21/cache-55ea9f50c4af4b82.arrow
INFO:mteb.abstasks.AbsTaskRetrieval:Loaded 1000 TEST Queries.
INFO:mteb.abstasks.AbsTaskRetrieval:Query Example: {'id': '6', 'text': 'The polar bear population has been growing.'}
INFO:mteb.abstasks.AbsTaskRetrieval:Subset: default
INFO:mteb.evaluation.evaluators.RetrievalEvaluator:Encoding Queries.
INFO:mteb.evaluation.evaluators.RetrievalEvaluator:Sorting Corpus by document length (Longest first)...
INFO:mteb.evaluation.evaluators.RetrievalEvaluator:Encoding Corpus in batches... Warning: This might take a while!
INFO:mteb.evaluation.evaluators.RetrievalEvaluator:Encoding Batch 1/1...
ERROR:mteb.evaluation.MTEB:Error while evaluating ClimateFEVERHardNegatives: expected m1 and m2 to have the same dtype, but got: float != double
Traceback (most recent call last):
  File "/env/lib/conda/gritkto/bin/mteb", line 8, in <module>
    sys.exit(main())
  File "/data/niklas/mteb/mteb/cli.py", line 387, in main
    args.func(args)
  File "/data/niklas/mteb/mteb/cli.py", line 145, in run
    eval.run(
  File "/data/niklas/mteb/mteb/evaluation/MTEB.py", line 623, in run
    raise e
  File "/data/niklas/mteb/mteb/evaluation/MTEB.py", line 562, in run
    results, tick, tock = self._run_eval(
  File "/data/niklas/mteb/mteb/evaluation/MTEB.py", line 304, in _run_eval
    results = task.evaluate(
  File "/data/niklas/mteb/mteb/abstasks/AbsTaskRetrieval.py", line 339, in evaluate
    scores[hf_subset] = self._evaluate_subset(
  File "/data/niklas/mteb/mteb/abstasks/AbsTaskRetrieval.py", line 348, in _evaluate_subset
    results = retriever(corpus, queries)
  File "/data/niklas/mteb/mteb/evaluation/evaluators/RetrievalEvaluator.py", line 478, in __call__
    return self.retriever.search(
  File "/data/niklas/mteb/mteb/evaluation/evaluators/RetrievalEvaluator.py", line 170, in search
    similarity_scores = cos_sim(query_embeddings, sub_corpus_embeddings)
  File "/data/niklas/mteb/mteb/evaluation/evaluators/utils.py", line 34, in cos_sim
    return torch.mm(a_norm, b_norm.transpose(0, 1))
RuntimeError: expected m1 and m2 to have the same dtype, but got: float != double

2025-01-01 04:47:26.004591: E external/local_xla/xla/stream_executor/cuda/cuda_fft.cc:485] Unable to register cuFFT factory: Attempting to register factory for plugin cuFFT when one has already been registered
2025-01-01 04:47:26.018907: E external/local_xla/xla/stream_executor/cuda/cuda_dnn.cc:8454] Unable to register cuDNN factory: Attempting to register factory for plugin cuDNN when one has already been registered
2025-01-01 04:47:26.023167: E external/local_xla/xla/stream_executor/cuda/cuda_blas.cc:1452] Unable to register cuBLAS factory: Attempting to register factory for plugin cuBLAS when one has already been registered
INFO:mteb.cli:Running with parameters: Namespace(model='minishlab/M2V_base_output', task_types=None, categories=None, tasks=['ClimateFEVERHardNegatives'], languages=None, benchmarks=None, device=None, output_folder='/data/niklas/results/results', verbosity=2, co2_tracker=True, eval_splits=None, model_revision=None, batch_size=32, overwrite=False, save_predictions=False, func=<function run at 0x7fd71b8d4f70>)
INFO:mteb.evaluation.MTEB:

## Evaluating 1 tasks:
─────────────────────────────── Selected tasks  ────────────────────────────────
Retrieval
    - ClimateFEVERHardNegatives, s2p


INFO:mteb.evaluation.MTEB:

********************** Evaluating ClimateFEVERHardNegatives **********************
INFO:mteb.abstasks.AbsTaskRetrieval:Loading Corpus...
Overwrite dataset info from restored data version if exists.
INFO:datasets.builder:Overwrite dataset info from restored data version if exists.
Loading Dataset info from /data/huggingface/datasets/mteb___climate_fever_test_top_250_only_w_correct-v2/corpus/0.0.0/3a309e201f3c2c4b13bd4a367a8f37eee2ec1d21
INFO:datasets.info:Loading Dataset info from /data/huggingface/datasets/mteb___climate_fever_test_top_250_only_w_correct-v2/corpus/0.0.0/3a309e201f3c2c4b13bd4a367a8f37eee2ec1d21
Found cached dataset climate_fever_test_top_250_only_w_correct-v2 (/data/huggingface/datasets/mteb___climate_fever_test_top_250_only_w_correct-v2/corpus/0.0.0/3a309e201f3c2c4b13bd4a367a8f37eee2ec1d21)
INFO:datasets.builder:Found cached dataset climate_fever_test_top_250_only_w_correct-v2 (/data/huggingface/datasets/mteb___climate_fever_test_top_250_only_w_correct-v2/corpus/0.0.0/3a309e201f3c2c4b13bd4a367a8f37eee2ec1d21)
Loading Dataset info from /data/huggingface/datasets/mteb___climate_fever_test_top_250_only_w_correct-v2/corpus/0.0.0/3a309e201f3c2c4b13bd4a367a8f37eee2ec1d21
INFO:datasets.info:Loading Dataset info from /data/huggingface/datasets/mteb___climate_fever_test_top_250_only_w_correct-v2/corpus/0.0.0/3a309e201f3c2c4b13bd4a367a8f37eee2ec1d21
Loading cached processed dataset at /data/huggingface/datasets/mteb___climate_fever_test_top_250_only_w_correct-v2/corpus/0.0.0/3a309e201f3c2c4b13bd4a367a8f37eee2ec1d21/cache-cddf4627905fef57.arrow
INFO:datasets.arrow_dataset:Loading cached processed dataset at /data/huggingface/datasets/mteb___climate_fever_test_top_250_only_w_correct-v2/corpus/0.0.0/3a309e201f3c2c4b13bd4a367a8f37eee2ec1d21/cache-cddf4627905fef57.arrow
INFO:mteb.abstasks.AbsTaskRetrieval:Loaded 47416 TEST Documents.
INFO:mteb.abstasks.AbsTaskRetrieval:Doc Example: {'id': '1993_Storm_of_the_Century', 'text': "The 1993 Storm of the Century ( also known as the 93 Super Storm or the Great Blizzard of 1993 ) was a large cyclonic storm that formed over the Gulf of Mexico on March 12 , 1993 . The storm eventually dissipated in the North Atlantic Ocean on March 15 , 1993 . It was unique for its intensity , massive size , and wide-reaching effects . At its height , the storm stretched from Canada to the Gulf of Mexico . The cyclone moved through the Gulf of Mexico and then through the eastern United States before moving onto Canada .   Heavy snow was first reported in highland areas as far south as Alabama and northern Georgia , with Union County , Georgia reporting up to 35 inches of snow in the north Georgia mountains . Birmingham , Alabama , reported a rare 13 in of snow .  The Florida Panhandle reported up to 4 in , with hurricane-force wind gusts and record low barometric pressures . Between Louisiana and Cuba , the hurricane-force winds produced high storm surges across Northwestern Florida which , in combination with scattered tornadoes , killed dozens of people .   Record cold temperatures were seen across portions of the south and east of the US in the wake of this storm . In the United States , the storm was responsible for the loss of electric power to more than 10 million households . An estimated 40 percent of the country 's population experienced the effects of the storm with a total of 208 fatalities .", 'title': '1993 Storm of the Century'}
INFO:mteb.abstasks.AbsTaskRetrieval:Loading Queries...
Overwrite dataset info from restored data version if exists.
INFO:datasets.builder:Overwrite dataset info from restored data version if exists.
Loading Dataset info from /data/huggingface/datasets/mteb___climate_fever_test_top_250_only_w_correct-v2/queries/0.0.0/3a309e201f3c2c4b13bd4a367a8f37eee2ec1d21
INFO:datasets.info:Loading Dataset info from /data/huggingface/datasets/mteb___climate_fever_test_top_250_only_w_correct-v2/queries/0.0.0/3a309e201f3c2c4b13bd4a367a8f37eee2ec1d21
Found cached dataset climate_fever_test_top_250_only_w_correct-v2 (/data/huggingface/datasets/mteb___climate_fever_test_top_250_only_w_correct-v2/queries/0.0.0/3a309e201f3c2c4b13bd4a367a8f37eee2ec1d21)
INFO:datasets.builder:Found cached dataset climate_fever_test_top_250_only_w_correct-v2 (/data/huggingface/datasets/mteb___climate_fever_test_top_250_only_w_correct-v2/queries/0.0.0/3a309e201f3c2c4b13bd4a367a8f37eee2ec1d21)
Loading Dataset info from /data/huggingface/datasets/mteb___climate_fever_test_top_250_only_w_correct-v2/queries/0.0.0/3a309e201f3c2c4b13bd4a367a8f37eee2ec1d21
INFO:datasets.info:Loading Dataset info from /data/huggingface/datasets/mteb___climate_fever_test_top_250_only_w_correct-v2/queries/0.0.0/3a309e201f3c2c4b13bd4a367a8f37eee2ec1d21
Loading cached processed dataset at /data/huggingface/datasets/mteb___climate_fever_test_top_250_only_w_correct-v2/queries/0.0.0/3a309e201f3c2c4b13bd4a367a8f37eee2ec1d21/cache-88a1f9e78ab9bf27.arrow
INFO:datasets.arrow_dataset:Loading cached processed dataset at /data/huggingface/datasets/mteb___climate_fever_test_top_250_only_w_correct-v2/queries/0.0.0/3a309e201f3c2c4b13bd4a367a8f37eee2ec1d21/cache-88a1f9e78ab9bf27.arrow
Overwrite dataset info from restored data version if exists.
INFO:datasets.builder:Overwrite dataset info from restored data version if exists.
Loading Dataset info from /data/huggingface/datasets/mteb___climate_fever_test_top_250_only_w_correct-v2/default/0.0.0/3a309e201f3c2c4b13bd4a367a8f37eee2ec1d21
INFO:datasets.info:Loading Dataset info from /data/huggingface/datasets/mteb___climate_fever_test_top_250_only_w_correct-v2/default/0.0.0/3a309e201f3c2c4b13bd4a367a8f37eee2ec1d21
Found cached dataset climate_fever_test_top_250_only_w_correct-v2 (/data/huggingface/datasets/mteb___climate_fever_test_top_250_only_w_correct-v2/default/0.0.0/3a309e201f3c2c4b13bd4a367a8f37eee2ec1d21)
INFO:datasets.builder:Found cached dataset climate_fever_test_top_250_only_w_correct-v2 (/data/huggingface/datasets/mteb___climate_fever_test_top_250_only_w_correct-v2/default/0.0.0/3a309e201f3c2c4b13bd4a367a8f37eee2ec1d21)
Loading Dataset info from /data/huggingface/datasets/mteb___climate_fever_test_top_250_only_w_correct-v2/default/0.0.0/3a309e201f3c2c4b13bd4a367a8f37eee2ec1d21
INFO:datasets.info:Loading Dataset info from /data/huggingface/datasets/mteb___climate_fever_test_top_250_only_w_correct-v2/default/0.0.0/3a309e201f3c2c4b13bd4a367a8f37eee2ec1d21
Loading cached processed dataset at /data/huggingface/datasets/mteb___climate_fever_test_top_250_only_w_correct-v2/default/0.0.0/3a309e201f3c2c4b13bd4a367a8f37eee2ec1d21/cache-0baa34c511cb5816.arrow
INFO:datasets.arrow_dataset:Loading cached processed dataset at /data/huggingface/datasets/mteb___climate_fever_test_top_250_only_w_correct-v2/default/0.0.0/3a309e201f3c2c4b13bd4a367a8f37eee2ec1d21/cache-0baa34c511cb5816.arrow

Map:   0%|          | 0/3048 [00:00<?, ? examples/s]
Map: 100%|██████████| 3048/3048 [00:00<00:00, 39166.20 examples/s]
Loading cached processed dataset at /data/huggingface/datasets/mteb___climate_fever_test_top_250_only_w_correct-v2/queries/0.0.0/3a309e201f3c2c4b13bd4a367a8f37eee2ec1d21/cache-55ea9f50c4af4b82.arrow
INFO:datasets.arrow_dataset:Loading cached processed dataset at /data/huggingface/datasets/mteb___climate_fever_test_top_250_only_w_correct-v2/queries/0.0.0/3a309e201f3c2c4b13bd4a367a8f37eee2ec1d21/cache-55ea9f50c4af4b82.arrow
INFO:mteb.abstasks.AbsTaskRetrieval:Loaded 1000 TEST Queries.
INFO:mteb.abstasks.AbsTaskRetrieval:Query Example: {'id': '6', 'text': 'The polar bear population has been growing.'}
INFO:mteb.abstasks.AbsTaskRetrieval:Subset: default
INFO:mteb.evaluation.evaluators.RetrievalEvaluator:Encoding Queries.
INFO:mteb.evaluation.evaluators.RetrievalEvaluator:Sorting Corpus by document length (Longest first)...
INFO:mteb.evaluation.evaluators.RetrievalEvaluator:Encoding Corpus in batches... Warning: This might take a while!
INFO:mteb.evaluation.evaluators.RetrievalEvaluator:Encoding Batch 1/1...
ERROR:mteb.evaluation.MTEB:Error while evaluating ClimateFEVERHardNegatives: expected m1 and m2 to have the same dtype, but got: float != double
Traceback (most recent call last):
  File "/env/lib/conda/gritkto/bin/mteb", line 8, in <module>
    sys.exit(main())
  File "/data/niklas/mteb/mteb/cli.py", line 387, in main
    args.func(args)
  File "/data/niklas/mteb/mteb/cli.py", line 145, in run
    eval.run(
  File "/data/niklas/mteb/mteb/evaluation/MTEB.py", line 623, in run
    raise e
  File "/data/niklas/mteb/mteb/evaluation/MTEB.py", line 562, in run
    results, tick, tock = self._run_eval(
  File "/data/niklas/mteb/mteb/evaluation/MTEB.py", line 304, in _run_eval
    results = task.evaluate(
  File "/data/niklas/mteb/mteb/abstasks/AbsTaskRetrieval.py", line 339, in evaluate
    scores[hf_subset] = self._evaluate_subset(
  File "/data/niklas/mteb/mteb/abstasks/AbsTaskRetrieval.py", line 348, in _evaluate_subset
    results = retriever(corpus, queries)
  File "/data/niklas/mteb/mteb/evaluation/evaluators/RetrievalEvaluator.py", line 478, in __call__
    return self.retriever.search(
  File "/data/niklas/mteb/mteb/evaluation/evaluators/RetrievalEvaluator.py", line 170, in search
    similarity_scores = cos_sim(query_embeddings, sub_corpus_embeddings)
  File "/data/niklas/mteb/mteb/evaluation/evaluators/utils.py", line 34, in cos_sim
    return torch.mm(a_norm, b_norm.transpose(0, 1))
RuntimeError: expected m1 and m2 to have the same dtype, but got: float != double