Skip to content

Why does Phi3 always ignore the prompt? #1774

@zjost

Description

@zjost

The __call__ method of the tokenizer invokes: self.tokenize_messages, which has the default arg ignore_system_prompts: bool = True. Is this intended?

To be concrete, I'm trying to instruction fine-tune Phi3 and I have a dataset with input/output columns, but I'd like to prepend a system prompt. I can make my own tokenizer, just want to verify there's not a good reason for this.

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions