Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Feature request] Translating system audio #92

Open
2 tasks done
mzltest opened this issue Nov 21, 2024 · 4 comments
Open
2 tasks done

[Feature request] Translating system audio #92

mzltest opened this issue Nov 21, 2024 · 4 comments
Assignees
Labels
enhancement New feature or request

Comments

@mzltest
Copy link

mzltest commented Nov 21, 2024

Thank you for wanting to share an idea! But before starting, ensure to check if this feature request respects the following requirements:

  • It is written in English (I can translate what you say, but issues written in English are easier to read for the other users).
  • There is not already a similar feature request among the open or closed issues.

It would be good if it can be used to translate system audio, similar to Chrome's auto caption when playing videos. This would be useful when consuming media content and I really didn't see any application with this functionality.

I believe starting from Android version 10 casting the screen will also receive system audio stream ( I use https://github.com/rom1v/sndcpy to redirect my device audio to computers ) so technically this might be possible. and floaty window should be available in Android since long time ago.

(Note I don't know android development so I might be wrong)

@mzltest mzltest added the enhancement New feature or request label Nov 21, 2024
@mzltest
Copy link
Author

mzltest commented Nov 21, 2024

here is a photo showcasing my mentioned feature in a desktop environment to make sure you know what i mean

generate-live-captions-for-any-streaming-video-audio-file-using-chromes-desktop-app 1280x600

@niedev
Copy link
Owner

niedev commented Nov 23, 2024

Hi, thank you for your suggestion, unfortunately I don't have much time to work on the app at the moment, so I prefer to prioritize fixing bugs and improving the features it already has instead of adding new ones. But this would be a really useful feature, so I added it to the list of things to do in the future, if it will be possible to implement it, sooner or later it will surely be included in RTranslator.

@voodoozlx
Copy link

I think a lot of people need this feature, but right now there's only one app <讯飞听见> that can do this job, but it's not open source.

@mzltest
Copy link
Author

mzltest commented Dec 10, 2024

This feature is technically possible as I previously stated (sndcpy can get audio stream = any android app can too) , but since I don't know Android development I can't help with code.

Speaking of live captions,I actually built a desktop web alternative before ,using Chrome's screen sharing capability (before I knew chrome included live captions , around March 2024) and streaming audio to 3rd-party recognition apis. It's bad, but better than nothing.

ec9ed560e933cd35a1cb39ec8600ebe3
^ the show is an episode of Wednesday Downtown, episode 24.01.31 . Japanese -> Chinese . No longer works due to deta sunset.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request
Projects
None yet
Development

No branches or pull requests

3 participants