Skip to content

BRIGHT #2811

@amallia

Description

@amallia

Describe the bug

HTTP Error 429 thrown while requesting HEAD https://huggingface.co/datasets/xlangai/BRIGHT/resolve/a75a0eb/README.md
Retrying in 1s [Retry 1/5].
HTTP Error 429 thrown while requesting HEAD https://huggingface.co/datasets/xlangai/BRIGHT/resolve/a75a0eb/README.md
Retrying in 2s [Retry 2/5].
HTTP Error 429 thrown while requesting HEAD https://huggingface.co/datasets/xlangai/BRIGHT/resolve/a75a0eb/README.md
Retrying in 4s [Retry 3/5].
HTTP Error 429 thrown while requesting HEAD https://huggingface.co/datasets/xlangai/BRIGHT/resolve/a75a0eb/README.md
Retrying in 8s [Retry 4/5].
HTTP Error 429 thrown while requesting HEAD https://huggingface.co/datasets/xlangai/BRIGHT/resolve/a75a0eb/README.md
Retrying in 8s [Retry 5/5].
HTTP Error 429 thrown while requesting HEAD https://huggingface.co/datasets/xlangai/BRIGHT/resolve/a75a0eb/README.md
HTTP Error 429 thrown while requesting HEAD https://huggingface.co/datasets/xlangai/BRIGHT/resolve/a75a0eb483f6a5233a6efc2d63d71540a4443dfb/BRIGHT.py
Retrying in 1s [Retry 1/5].
HTTP Error 429 thrown while requesting HEAD https://huggingface.co/datasets/xlangai/BRIGHT/resolve/a75a0eb483f6a5233a6efc2d63d71540a4443dfb/BRIGHT.py
Retrying in 2s [Retry 2/5].

It seems that BRIGHT has a new revision.

Currently is set to a75a0eb in MTEB, while the upstream one is 3066d29c9651a576c8aba4832d249807b181ecae

To reproduce

tasks = mteb.get_tasks(tasks=["BrightRetrieval"])
tasks[0].load_data()

Additional information

No response

Are you interested to contribute a fix for this bug?

Yes

Metadata

Metadata

Labels

No labels
No labels

Type

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions