Skip to content
Permalink

Comparing changes

Choose two branches to see what’s changed or to start a new pull request. If you need to, you can also or learn more about diff comparisons.

Open a pull request

Create a new pull request by comparing changes across two branches. If you need to, you can also . Learn more about diff comparisons here.
base repository: OpenBMB/BMTrain
Failed to load repositories. Confirm that selected base ref is valid, then try again.
Loading
base: 0.1.7
Choose a base ref
...
head repository: OpenBMB/BMTrain
Failed to load repositories. Confirm that selected head ref is valid, then try again.
Loading
compare: 0.1.8
Choose a head ref
  • 20 commits
  • 13 files changed
  • 4 contributors

Commits on Jun 14, 2022

  1. update readme

    @a710128
    a710128 committed Jun 14, 2022
    Configuration menu
    Copy the full SHA
    d8a117c View commit details
    Browse the repository at this point in the history

  2. DOCS: update init_distributed

    @a710128
    a710128 committed Jun 14, 2022
    Configuration menu
    Copy the full SHA
    ad38bdb View commit details
    Browse the repository at this point in the history

  3. DOCS: update docs

    @a710128
    a710128 committed Jun 14, 2022
    Configuration menu
    Copy the full SHA
    f2c046d View commit details
    Browse the repository at this point in the history

Commits on Jun 15, 2022

  1. FIX: release the parameter at some special case

    @MayDomine
    MayDomine authored Jun 15, 2022
    Configuration menu
    Copy the full SHA
    632b97a View commit details
    Browse the repository at this point in the history

  2. Merge pull request #32 from MayDomine/zero2_fixed 

    FIX: release the parameter at some special case
    @a710128
    a710128 authored Jun 15, 2022
    Configuration menu
    Copy the full SHA
    5b96863 View commit details
    Browse the repository at this point in the history

  3. patch 0.1.7

    @a710128
    a710128 committed Jun 15, 2022
    Configuration menu
    Copy the full SHA
    b9c66b3 View commit details
    Browse the repository at this point in the history

Commits on Jul 3, 2022

  1. Support the maximize parameter for adam when dtype is torch.half

    @alphaGem
    alphaGem committed Jul 3, 2022
    Configuration menu
    Copy the full SHA
    3847162 View commit details
    Browse the repository at this point in the history

Commits on Jul 4, 2022

  1. fix grad not passed to Adam function

    @alphaGem
    alphaGem committed Jul 4, 2022
    Configuration menu
    Copy the full SHA
    d9c7cf2 View commit details
    Browse the repository at this point in the history

Commits on Jul 5, 2022

  1. Support param maximize for adam float32 and adam_offload; fix grad no… 

    …t passed to Adam
    @alphaGem
    alphaGem committed Jul 5, 2022
    Configuration menu
    Copy the full SHA
    7128324 View commit details
    Browse the repository at this point in the history

  2. fix grad no view(-1) at float16 in adam_offload

    @alphaGem
    alphaGem committed Jul 5, 2022
    Configuration menu
    Copy the full SHA
    2509746 View commit details
    Browse the repository at this point in the history

Commits on Jul 7, 2022

  1. Merge pull request #1 from OpenBMB/main 

    update
    @MayDomine
    MayDomine authored Jul 7, 2022
    Configuration menu
    Copy the full SHA
    e86d6a9 View commit details
    Browse the repository at this point in the history

  2. add __iter__ to make TransformerBlockList Iterable

    @MayDomine
    MayDomine committed Jul 7, 2022
    Configuration menu
    Copy the full SHA
    bbe73a4 View commit details
    Browse the repository at this point in the history

Commits on Jul 8, 2022

  1. Merge pull request #35 from alphaGem/param-maximize-for-adam 

    Support the maximize parameter for adam when dtype is torch.half
    @a710128
    a710128 authored Jul 8, 2022
    Configuration menu
    Copy the full SHA
    e6ba031 View commit details
    Browse the repository at this point in the history

  2. Merge pull request #37 from MayDomine/main 

    add __iter__ to make TransformerBlockList Iterable
    @a710128
    a710128 authored Jul 8, 2022
    Configuration menu
    Copy the full SHA
    3ed3e3c View commit details
    Browse the repository at this point in the history

  3. FX: support pytorch 1.12

    @a710128
    a710128 committed Jul 8, 2022
    Configuration menu
    Copy the full SHA
    b7790dd View commit details
    Browse the repository at this point in the history

  4. UPD: add default rank/world_size if bmtrain is not initialized. Raise… 

    … RuntimeError when calling distributed functions if bmtrain is not initialized.
    @a710128
    a710128 committed Jul 8, 2022
    Configuration menu
    Copy the full SHA
    2954ee7 View commit details
    Browse the repository at this point in the history

  5. FX: all_gather typo

    @a710128
    a710128 committed Jul 8, 2022
    Configuration menu
    Copy the full SHA
    0b9ec59 View commit details
    Browse the repository at this point in the history

  6. FX: state_dict warning after pytorch 1.12

    @a710128
    a710128 committed Jul 8, 2022
    Configuration menu
    Copy the full SHA
    05a4804 View commit details
    Browse the repository at this point in the history

  7. Merge pull request #38 from OpenBMB/UPD_0708 

    Upd 0708
    @a710128
    a710128 authored Jul 8, 2022
    Configuration menu
    Copy the full SHA
    ed5e1b7 View commit details
    Browse the repository at this point in the history

  8. update version

    @a710128
    a710128 committed Jul 8, 2022
    Configuration menu
    Copy the full SHA
    4fa4108 View commit details
    Browse the repository at this point in the history
Loading