Skip to content

Completions Only Loss is incompatible with use_liger_kernel set as true #3484

@arashpreetsinghmor

Description

@arashpreetsinghmor

Hi Team, discovered that completions only loss does not work when use_liger_kernel is set as true, since this line drops the completion_mask. Is this an expected behavior?

dataset = dataset.select_columns("input_ids")

Metadata

Metadata

Assignees

No one assigned

    Labels

    🏋 SFTRelated to SFT🐛 bugSomething isn't working

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions