Skip to content

Merging the train-olmo-large branch #599

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Merged
merged 53 commits into from
May 30, 2024
Merged

Merging the train-olmo-large branch #599

merged 53 commits into from
May 30, 2024

Conversation

dirkgr
Copy link
Member

@dirkgr dirkgr commented May 29, 2024

No description provided.

dirkgr and others added 30 commits May 6, 2024 15:36
@dirkgr
Llamaish7 config, finally
351f431
@dirkgr
Create way more detailed artifacts
4d3afa6
@epwalsh
Plan C: backtrack, cut LR in half
732b397
@epwalsh
fix branch
59034d6
@AkshitaB
pile llamaish
7015172
@AkshitaB
try on jupiter
26ba864
@dirkgr
Resume the detailed llamaish run
453fed1
@dirkgr
Merge branch 'train-olmo-large' of https://github.com/allenai/LLM int…
612934b 
…o train-olmo-large
@AkshitaB
fix filename
3ce4ec9
@AkshitaB
run on pluto
05b8f39
@epwalsh
whitelist nodes
391a537
@AkshitaB
lumi config
c541af1
@AkshitaB
lumi script
4095258
@AkshitaB
jupiter
92496f4
@AkshitaB
increase sync timeout
c1816db
@AkshitaB
load from path
d37125a
@AkshitaB
fix
45e407b
@epwalsh
update config for restart
420d6dd
@epwalsh
update config
05ad705
@2015aroras @dirkgr
Try stop wandb from flaking at cancel
06fc94f
@dirkgr
Configure mitchish7 to continue (with the datafix)
1e603a8
@dirkgr
I am normal.
52cfe84
@dirkgr
This is supposed to run on Jupiter.
5c8b115
@dirkgr
Config for a restart with constant LR
45acb65
@dirkgr
Fix OLMo-core
b394ac2
@dirkgr
Need to specify nodes
5f14392
@dirkgr
Fix OLMo-core
b8b4368
@dirkgr
New nodes
7a6d39d
@dirkgr
Continue running the 70B on Jupiter
a03bbf2
@dirkgr
Run in the proper workspace
3f5f019
dirkgr and others added 22 commits May 20, 2024 23:16
@dirkgr
Run as me
8fc56c1
@dirkgr
Run preemptible
8d74d6c
@dirkgr
Multiple clusters
6f8a909
@dirkgr
Formatting
96b1bcb
@dirkgr
Improve the script that dry-runs the dataloader
a7e6588
@dirkgr
Off by one
44f3c2d
@dirkgr
Save in torch format
613715c
@dirkgr
Revert "Save in torch format"
1c22396 
This reverts commit 613715c.
@dirkgr
Reapply "Save in torch format"
055eff7 
This reverts commit 1c22396.
@dirkgr
Torch doesn't have an uint16 type.
446e90b
@dirkgr
Merge remote-tracking branch 'origin/main' into train-olmo-large
9c809e6 
# Conflicts:
#	olmo/checkpoint.py
#	olmo/train.py
@dirkgr
Silence warning
99c71f7
@dirkgr
Silence another warning
bed4324
@dirkgr
isort
4beb980
@dirkgr
Run preemptible
60d90f4
@dirkgr
More clusters
d5912f9
@dirkgr
preemptible
16fad9d
@2015aroras
Remove usages of Auto* methods in hf_olmo tests
9383d29
@2015aroras
Make test_config_save save to temp file
86f7f97
@2015aroras
Run ruff
5b98858
@dirkgr
This should respect the default.
f7f0f88
@dirkgr
Merge remote-tracking branch 'origin/shanea/fix-hf-olmo-tests' into t…
20f5213 
…rain-olmo-large
@dirkgr dirkgr merged commit 40210bb into main May 30, 2024
@dirkgr dirkgr deleted the train-olmo-large branch May 30, 2024 18:17
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@2015aroras 2015aroras 2015aroras approved these changes

Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
4 participants
@dirkgr @2015aroras @epwalsh @AkshitaB