Skip to content

Add Visual Document Retrieval tab in leaderboard #2723

@isaac-chung

Description

@isaac-chung

Add Visual Document Retrieval as an additional tab in the leaderboard:

  • Vidore v1 + v2 tasks

================ [Quote] ==============

          @ManuelFay I have considered that we should allow custom tables in the leaderboard.

Essentially, keep "Summary" open for a custom implementation pr. benchmark, but keeping the two others forced:

Screenshot 2025-05-23 at 15 34 20

We could do a similar thing with the plots (where the benchmark is also allowed to produce its own visualisations). This is not currently a feature yet.

For now, it seems like it is a reasonable idea to add it here:

Screenshot 2025-05-23 at 15 37 09

As "Visual Document Retrieval" (@isaac-chung, @gowitheflow-1998)

Originally posted by @KennethEnevoldsen in #2713 (comment)

Metadata

Metadata

Assignees

No one assigned

    Labels

    leaderboardissues related to the leaderboard

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions