Skip to content
Permalink

Comparing changes

Choose two branches to see what’s changed or to start a new pull request. If you need to, you can also or learn more about diff comparisons.

Open a pull request

Create a new pull request by comparing changes across two branches. If you need to, you can also . Learn more about diff comparisons here.
base repository: open-compass/opencompass
Failed to load repositories. Confirm that selected base ref is valid, then try again.
Loading
base: 0.3.4
Choose a base ref
...
head repository: open-compass/opencompass
Failed to load repositories. Confirm that selected head ref is valid, then try again.
Loading
compare: 0.3.5
Choose a head ref
  • 13 commits
  • 80 files changed
  • 7 contributors

Commits on Oct 28, 2024

  1. [Datasets] Add datasets CMO&AIME (#1610) 

    * add datasets cmo&aime

* delete unused modules

* modify prompt

* update __init__

* update data load and add README

* update data load

* update performance

* update md5

* remove indents

* add indent

* fix log for debug mode
    @jnanliu
    jnanliu authored Oct 28, 2024
    Configuration menu
    Copy the full SHA
    645c5f3 View commit details
    Browse the repository at this point in the history

Commits on Oct 29, 2024

  1. [Update] Update wildbench max_seq_len (#1648) 

    * [Update] Wildbench max_seq_len update

* [Update] Wildbench max_seq_len update
    @MaiziXiao
    MaiziXiao authored Oct 29, 2024
    Configuration menu
    Copy the full SHA
    8172af4 View commit details
    Browse the repository at this point in the history

  2. [Fix] Fix ruler_16k_gen (#1643)

    @changlan
    changlan authored Oct 29, 2024
    Configuration menu
    Copy the full SHA
    46affab View commit details
    Browse the repository at this point in the history

  3. [Update] Update Needlebench OSS path (#1651)

    @MaiziXiao
    MaiziXiao authored Oct 29, 2024
    Configuration menu
    Copy the full SHA
    d91d667 View commit details
    Browse the repository at this point in the history

  4. [Feature] Update Models, Summarizers (#1600)

    @MaiziXiao
    MaiziXiao authored Oct 29, 2024
    Configuration menu
    Copy the full SHA
    df57c08 View commit details
    Browse the repository at this point in the history

Commits on Oct 30, 2024

  1. [Update] Add new model configs (#1653)

    @MaiziXiao
    MaiziXiao authored Oct 30, 2024
    Configuration menu
    Copy the full SHA
    5212ffe View commit details
    Browse the repository at this point in the history

Commits on Oct 31, 2024

  1. [Doc] Update Doc (#1655)

    @tonysy
    tonysy authored Oct 31, 2024
    Configuration menu
    Copy the full SHA
    d611907 View commit details
    Browse the repository at this point in the history

Commits on Nov 1, 2024

  1. [Add] Add CompassArenaSubjectiveBench (#1645) 

    * fix pip version

* fix pip version

* add compassarenasubjectivebench

* add compassarenasubjectivebench

* add compassarenabench
    @bittersweet1999
    bittersweet1999 authored Nov 1, 2024
    Configuration menu
    Copy the full SHA
    a0853c9 View commit details
    Browse the repository at this point in the history

  2. [Update] Add lmdeploy DeepSeek configs (#1656) 

    * [Update] Add lmdeploy DeepSeek configs

* update max out length
    @MaiziXiao
    MaiziXiao authored Nov 1, 2024
    Configuration menu
    Copy the full SHA
    695738a View commit details
    Browse the repository at this point in the history

  3. [Fix] the automatically download for several datasets (#1652) 

    * [Fix] the automatically download for several datasets

* Update

* Update

* Update CI
    @tonysy
    tonysy authored Nov 1, 2024
    Configuration menu
    Copy the full SHA
    c789ce5 View commit details
    Browse the repository at this point in the history

  4. [Update] Update mmmlu_lite dataload (#1658) 

    * update mmmlu_lite dataload from oss

* update mmmlu_lite dataload from oss
    @liushz
    liushz authored Nov 1, 2024
    Configuration menu
    Copy the full SHA
    f7d8998 View commit details
    Browse the repository at this point in the history

Commits on Nov 2, 2024

  1. [Fix] Update loglikehood compatibility (#1659)

    @lvhan028
    lvhan028 authored Nov 2, 2024
    Configuration menu
    Copy the full SHA
    888f1f3 View commit details
    Browse the repository at this point in the history

Commits on Nov 3, 2024

  1. [Bump] Bump version to v0.3.5 (#1657)

    @MaiziXiao
    MaiziXiao authored Nov 3, 2024
    Configuration menu
    Copy the full SHA
    db258eb View commit details
    Browse the repository at this point in the history
Loading