Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[Plan] support more tts models #90

Closed
7 of 8 tasks
Tracked by #91
zhzLuke96 opened this issue Jul 5, 2024 · 3 comments
Closed
7 of 8 tasks
Tracked by #91

[Plan] support more tts models #90

zhzLuke96 opened this issue Jul 5, 2024 · 3 comments
Labels
enhancement New feature or request Story Next iteration summary and TODO list

Comments

@zhzLuke96
Copy link
Member

zhzLuke96 commented Jul 5, 2024 •
edited

PLAN desc

支持更多 tts models

由于目前主要基于 chattts 开发，部分模块对其有依赖，需要逐个解离

  • 需要区分不同模型的能力问题，涉及 Special tokens and refiners
  • 加载多模型可能需要引入自动unload检测
  • tn管道需要支持函数可拔插

TODOs
@zhzLuke96 zhzLuke96 added enhancement New feature or request Story Next iteration summary and TODO list labels Jul 5, 2024
@zhzLuke96
Copy link
Member Author

refs #89

@zhzLuke96 zhzLuke96 mentioned this issue Jul 12, 2024
Closed
9 tasks
zhzLuke96 added a commit that referenced this issue Jul 13, 2024
@zhzLuke96
✨ webui in tts_pipeline
ea39d6b 
- add infer_config.sync_gen 以支持 track_tqdm
- remove 老代码

refs #91 #90
@zhzLuke96 zhzLuke96 mentioned this issue Jul 13, 2024
Merged
zhzLuke96 added a commit that referenced this issue Jul 14, 2024
@zhzLuke96
♻️ refactor TTSSpeaker #90
7d7f465 
- add speaker file serialization
- refactor Speaker => TTSSpeaker
- 简单适配 api 和 webui
@zhzLuke96
Copy link
Member Author

added 1835565 af9efdf c8905df

fish speech 推理部分已接入，但是效果有点感人...😓 暂时不推进了，有兴趣调试的可以在 modules.core.models.tts.FishSpeechModel 模块测试

zhzLuke96 added a commit that referenced this issue Jul 23, 2024
@zhzLuke96
✨ add CosyVoiceModel #90
3adb574 
- impl `CosyVoiceModel` `CosyVoiceFE`
- 增加 DcSpkReference.lang
- remove devices old code
- add setup_repos_paths
zhzLuke96 added a commit that referenced this issue Jul 25, 2024
@zhzLuke96
✨ support more tts models #90
e3d1b14 
- tts/openai api support other models
- fix the problem that encoder thread cannot be recycled
- impl model_zoo
- add `CosyVoiceTN`
- add `FishSpeechTN`
@zhzLuke96
Copy link
Member Author

done

@zhzLuke96 zhzLuke96 mentioned this issue Aug 10, 2024
Closed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
enhancement New feature or request Story Next iteration summary and TODO list
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
1 participant
@zhzLuke96