As far as I can see, it only supports FSDP1 for the moment.

It would be great (and clean) to also port FSDP2 support to the simple fsdp_sft_trainer.py in the spirit of:

• [fsdp] feat: support fsdp2 training and inference in fsdp_workers #1026