Skip to content
Permalink

Comparing changes

Choose two branches to see what’s changed or to start a new pull request. If you need to, you can also or learn more about diff comparisons.

Open a pull request

Create a new pull request by comparing changes across two branches. If you need to, you can also . Learn more about diff comparisons here.
base repository: open-compass/opencompass
Failed to load repositories. Confirm that selected base ref is valid, then try again.
Loading
base: 0.3.5
Choose a base ref
...
head repository: open-compass/opencompass
Failed to load repositories. Confirm that selected head ref is valid, then try again.
Loading
compare: 0.3.6
Choose a head ref
  • 18 commits
  • 65 files changed
  • 9 contributors

Commits on Nov 7, 2024

  1. [Update] Update DLC Runner(#1662) 

    * push interntrain hard code

* push interntrain hard code

* remove redundant post process

---------

Co-authored-by: changcheng <changcheng@pjlab.org.cb>
Co-authored-by: changcheng <changcheng@pjlab.org.cn>
    @MCplayerFromPRC
    3 people authored Nov 7, 2024
    Configuration menu
    Copy the full SHA
    fd7aa83 View commit details
    Browse the repository at this point in the history

Commits on Nov 8, 2024

  1. [Feature] Add long context evaluation for base models (#1666) 

    * [Update] Add base long context evaluation

* update
    @MaiziXiao
    MaiziXiao authored Nov 8, 2024
    Configuration menu
    Copy the full SHA
    835bf75 View commit details
    Browse the repository at this point in the history

  2. [Update] Dingo Dataset update (#1670) 

    * [Update] Dingo Dataset update

* update
    @MaiziXiao
    MaiziXiao authored Nov 8, 2024
    Configuration menu
    Copy the full SHA
    a0ef2fd View commit details
    Browse the repository at this point in the history

Commits on Nov 12, 2024

  1. [Hotfix] lmdeploy temp (#1674) 

    * fix pip version

* fix pip version

* hotfix
    @bittersweet1999
    bittersweet1999 authored Nov 12, 2024
    Configuration menu
    Copy the full SHA
    17b5e52 View commit details
    Browse the repository at this point in the history

  2. add single lora adapter support for vLLM inference. (#1679)

    @yqchen0205
    yqchen0205 authored Nov 12, 2024
    Configuration menu
    Copy the full SHA
    3ec178f View commit details
    Browse the repository at this point in the history

  3. [ci] react daily test (#1668) 

    * updaste

* update

* update

* update

* update

* update

* update

* update

* update

* update

* updaste

* update

* update

* refactor summarize

* update

* update

* update

* update

* update

* updaste

* update

* update

* update

* update

* updaste

* update

* update

* update

* update

* update

* updaste

* updaste

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* Update daily-run-test.yml

* Update daily-run-test.yml

* update

* update

* update

* update

* update

* Update daily-run-test.yml

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* Update daily-run-test.yml

* Update daily-run-test.yml

* update

* update

* Update daily-run-test.yml

* update

* update

* update

---------

Co-authored-by: zhulin1 <zhulin1@pjlab.org.cn>
    @zhulinJulia24
    zhulinJulia24 and zhulin1 authored Nov 12, 2024
    Configuration menu
    Copy the full SHA
    a9d6b64 View commit details
    Browse the repository at this point in the history

Commits on Nov 13, 2024

  1. [Hotfix] Hotfix (#1683) 

    * fix pip version

* fix pip version

* fix lint

* hotfix
    @bittersweet1999
    bittersweet1999 authored Nov 13, 2024
    Configuration menu
    Copy the full SHA
    aca8ec3 View commit details
    Browse the repository at this point in the history

  2. [CI] update (#1682) 

    Co-authored-by: zhulin1 <zhulin1@pjlab.org.cn>
    @zhulinJulia24
    zhulinJulia24 and zhulin1 authored Nov 13, 2024
    Configuration menu
    Copy the full SHA
    f8a1c1f View commit details
    Browse the repository at this point in the history

  3. [Update] Auto-download for followbench (#1685)

    @MaiziXiao
    MaiziXiao authored Nov 13, 2024
    Configuration menu
    Copy the full SHA
    2fee63f View commit details
    Browse the repository at this point in the history

Commits on Nov 14, 2024

  1. [Feature] BABILong Dataset added (#1684) 

    * update

* update

* update

* update
    @MaiziXiao
    MaiziXiao authored Nov 14, 2024
    Configuration menu
    Copy the full SHA
    e92a5d4 View commit details
    Browse the repository at this point in the history

  2. [Fix] Fix bug for first_option_postprocess (#1688)

    @MaiziXiao
    MaiziXiao authored Nov 14, 2024
    Configuration menu
    Copy the full SHA
    d415439 View commit details
    Browse the repository at this point in the history

  3. [Feature] MuSR Datset Evaluation (#1689) 

    * MuSR Datset Evaluation

* MuSR Datset Evaluation

Add an assertion and a Readme.md
    @abrohamLee
    abrohamLee authored Nov 14, 2024
    Configuration menu
    Copy the full SHA
    e9e4b69 View commit details
    Browse the repository at this point in the history

Commits on Nov 15, 2024

  1. [Update] MUSR dataset config prefix update (#1692)

    @MaiziXiao
    MaiziXiao authored Nov 15, 2024
    Configuration menu
    Copy the full SHA
    40a9f0b View commit details
    Browse the repository at this point in the history

  2. [CI] Update baselines (#1693) 

    Co-authored-by: zhulin1 <zhulin1@pjlab.org.cn>
    @zhulinJulia24
    zhulinJulia24 and zhulin1 authored Nov 15, 2024
    Configuration menu
    Copy the full SHA
    4a20e11 View commit details
    Browse the repository at this point in the history

Commits on Nov 18, 2024

  1. [Update] update volc CPU flavor (#1698)

    @MaiziXiao
    MaiziXiao authored Nov 18, 2024
    Configuration menu
    Copy the full SHA
    4653f69 View commit details
    Browse the repository at this point in the history

  2. [Update] first_option_postprocess (#1699) 

    * update first_option_postprocess

* update
    @MaiziXiao
    MaiziXiao authored Nov 18, 2024
    Configuration menu
    Copy the full SHA
    98242ff View commit details
    Browse the repository at this point in the history

  3. [Update] Update Math auto-download data (#1700)

    @MaiziXiao
    MaiziXiao authored Nov 18, 2024
    Configuration menu
    Copy the full SHA
    ab8fdbb View commit details
    Browse the repository at this point in the history

  4. [BUMP] Bump version to 0.3.6 (#1694)

    @MaiziXiao
    MaiziXiao authored Nov 18, 2024
    Configuration menu
    Copy the full SHA
    ff831b1 View commit details
    Browse the repository at this point in the history
Loading