Add SmolLM2 (WIP)

[ysjprojects]

https://huggingface.co/collections/HuggingFaceTB/smollm2-6723884218bcda64b34d7db9

SOTA small language models (135M, 360M, 1.7B) by Hugging Face.

Great for on-device uses

Adding because of request on mobile-oriented models #1846

[Andrei-Aksionov]

Hello @ysjprojects

Do you think it's ready for a review or still in WIP?

[ysjprojects]

Hello @ysjprojects

Do you think it's ready for a review or still in WIP?

just pushed some final changes, should be ready for review

[Andrei-Aksionov]

Hello @ysjprojects
I cannot download the model.
For some reason, huggingface_hub returns more files than are shown on the model page.
One of the files is training_args.bin, which breaks the download code.
In other words, the code finds .bin files and "thinks" that's this is a model, so doesn't make an attempt to download.safetensors.

(made a small change to download only model weights if there is .bin files.)

[ysjprojects]

Hello @ysjprojects I cannot download the model. For some reason, huggingface_hub returns more files than are shown on the model page. One of the files is training_args.bin, which breaks the download code. In other words, the code finds .bin files and "thinks" that's this is a model, so doesn't make an attempt to download.safetensors.

(made a small change to download only model weights if there is .bin files.)

interesting, does the small change fix the issue or would I need to look into it?