Skip to content

Issue with evaluator when the dataset is passed as a string. #226

@lvwerra

Description

@lvwerra

If a dataset is passed as a string the loading of the data will fail since the rest of the pipeline expects a dataset.Dataset and not a dataset.DatasetDict which is returned if no split is provided. I propose we auto-select a split with the following logic: test > validation > train. We can inform the user with a log which split is evaluated.

cc @fxmarty @ola13

Metadata

Metadata

Assignees

Labels

No labels
No labels

Type

No type

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions