Reproduction

When using the CLI I cannot recreate the docs examples. I'm sure if this is caused by the parameters or if the errors are incorrect.

trl sft --config examples/cli_configs/example_config.yaml

outputs:

trl sft: error: the following arguments are required: --dataset_name/--dataset-name

If I pass the the dataset name like this:

trl sft --config examples/cli_configs/example_config.yaml --dataset-name stanfordnlp/imdb

Then I get this error:

RL CLI: error: unrecognized arguments: --config examples/cli_configs/example_config.yaml

System Info

• Platform: Linux-5.15.0-1048-aws-x86_64-with-glibc2.31
• Python version: 3.11.11
• TRL version: 0.16.0.dev0
• PyTorch version: 2.6.0
• CUDA device(s): NVIDIA H100 80GB HBM3, NVIDIA H100 80GB HBM3, NVIDIA H100 80GB HBM3, NVIDIA H100 80GB HBM3, NVIDIA H100 80GB HBM3, NVIDIA H100 80GB HBM3, NVIDIA H100 80GB HBM3, NVIDIA H100 80GB HBM3
• Transformers version: 4.50.0.dev0
• Accelerate version: 1.5.2
• Accelerate config: not found
• Datasets version: 3.4.1
• HF Hub version: 0.29.3
• bitsandbytes version: not installed
• DeepSpeed version: 0.16.4
• Diffusers version: not installed
• Liger-Kernel version: 0.5.5
• LLM-Blender version: not installed
• OpenAI version: not installed
• PEFT version: not installed
• vLLM version: not installed

Checklist

• I have checked that my issue isn't already filed (see open issues)
• I have included my system information
• Any code provided is minimal, complete, and reproducible (more on MREs)
• Any code provided is properly formatted in code blocks, (no screenshot, more on code blocks)
• Any traceback provided is complete