[SFT VLM] Add support for SmolVLM models #2408
Description
Feature request
In line with #2136, extend the sft_vlm.py script to support the new SmolVLM models.
Motivation
The smol models are designed for efficiency and are suitable for on-device applications. The family of models is described here.
Your contribution
A new training script ready to train SmolVLM using SFT 😄