ctranslate2 conversions for faster_whisper

[ooobo]

Congrats on the release!
Not an issue as such (but couldn't make a discussion), but would be great to trial these models in ctranslate2 format using faster-whisper.
I'm particularly interested in running these low-resource models on CPU only, faster-whisper is still quickest for ASR on CPU. Have quite a few use-cases for this and always looking to squeeze a little more transcription quality out of limited resources.
I should have time to take a look at converting next week, but in case anyone's already done the work...

[Tamnac]

I was interested in the same thing. Initial testing throws the error ValueError: No conversion is registered for the model configuration LiteWhisperConfig (supported configurations are: BartConfig, BertConfig, BloomConfig, CodeGenConfig, DistilBertConfig, FalconConfig, GPT2Config, GPTBigCodeConfig, GPTJConfig, GPTNeoXConfig, Gemma2Config, GemmaConfig, LlamaConfig, M2M100Config, MBartConfig, MPTConfig, MT5Config, MarianConfig, MistralConfig, MixFormerSequentialConfig, OPTConfig, PegasusConfig, Phi3Config, PhiConfig, RWConfig, T5Config, Wav2Vec2BertConfig, Wav2Vec2Config, WhisperConfig, XLMRobertaConfig)

I don't know if support needs to be added to ctranslate, or if there's some way to force it to treat it as a regular whisper model WhisperConfig

[Tamnac]

It seems it requires support from the Ctranslate2 side, see OpenNMT/CTranslate2#1869

[Eyoel-gebre]

@ooobo If you haven't started yet, I can gladly begin working on creating the converter. Let me know if you've started though - I can help out if you have.

[ooobo]

Nope, haven't started anything yet sorry! Had a quick look but I think as others have pointed out would need to implement the differences in ctranslate first, not sure how difficult that would be

…

On Thu, 3 Apr 2025 at 17:50, Eyoel Gebre ***@***.***> wrote: @ooobo <https://github.com/ooobo> If you haven't started yet, I can gladly begin working on creating the converter. Let me know if you've started though - I can help. — Reply to this email directly, view it on GitHub <#7 (comment)>, or unsubscribe <https://github.com/notifications/unsubscribe-auth/AANT2MTMDKQSTV2GKCUPDD32XTK4TAVCNFSM6AAAAABZOXTVISVHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMZDONZUGY2TOOBZGI> . You are receiving this because you were mentioned.Message ID: ***@***.***> [image: Eyoel-gebre]*Eyoel-gebre* left a comment (efeslab/LiteASR#7) <#7 (comment)> @ooobo <https://github.com/ooobo> If you haven't started yet, I can gladly begin working on creating the converter. Let me know if you've started though - I can help. — Reply to this email directly, view it on GitHub <#7 (comment)>, or unsubscribe <https://github.com/notifications/unsubscribe-auth/AANT2MTMDKQSTV2GKCUPDD32XTK4TAVCNFSM6AAAAABZOXTVISVHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMZDONZUGY2TOOBZGI> . You are receiving this because you were mentioned.Message ID: ***@***.***>

[bzikst]

btw ct2 support: OpenNMT/CTranslate2#1913