Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Text feature extraction using SpeechLM #68

Open
wonjune-kang opened this issue Jan 2, 2024 · 0 comments
Open

Text feature extraction using SpeechLM #68

wonjune-kang opened this issue Jan 2, 2024 · 0 comments

Comments

@wonjune-kang
Copy link

Hello, thank you for your great work on this repo!

I'm interested in using SpeechLM to produce text representations in addition to speech representations. Is there a simple way of doing this, similar to the code snippet that you provide here for speech representations? I found the forward_text function which seems like it should be doing this, but I couldn't figure out a way to easily produce src_tokens to feed in there.

Thank you!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant