Skip to content

How can I finetune Olmo-7B using this repo? #499

@rajasekharmekala

Description

@rajasekharmekala

❓ The question

Hi @epwalsh, @2015aroras

I am trying to setup finetuning for OLMo-7B from huggingface model, but seems like that might not be possible, as the checkpoint requires trainer and optimizer states e.t.c.

Is it possible to use this repo for finetuning from the public checkpoint? or if I can download the checkpoint that is compatible with this repo?

Thanks.

Metadata

Metadata

Assignees

No one assigned

    Labels

    type/questionAn issue that's a question

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions