Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Increasing speed #6

Open
PaulMacMADEit opened this issue Sep 4, 2023 · 3 comments
Open

Increasing speed #6

PaulMacMADEit opened this issue Sep 4, 2023 · 3 comments

Comments

@PaulMacMADEit
Copy link

Fantastic work. Was able to get it up and running easily.

I'm hoping to increase the speed of transcription.

The transcription speed once it hits Whisper seems fine, but I think the lag comes in before that. Do you have any recommendations on how I might improve the speed?

@reriiasu
Copy link
Owner

reriiasu commented Sep 4, 2023

hello PaulMacMADEit

Thank you! I'm glad to hear that you were able to get it up and running easily.

Do you mean the time it takes for loading to be released after the "Start Transcription" button is pressed?
The initialization process is taking time, as you indicated.
Unfortunately, this is not a problem that can be addressed through settings.
I apologize for any inconvenience caused.

@PaulMacMADEit
Copy link
Author

I'm trying to get real time transcription using faster whisper (so I'm using the real time option).
Faster Whisper can process the audio very quickly, but I'm trying to understand where the delay is in the system.
Do you have any tips on where it might be coming from and/or how to improve it?

@reriiasu
Copy link
Owner

reriiasu commented Sep 5, 2023

The recommended options for "faster-whisper" are as follows, but please note that they come with a trade-off in accuracy.

  • reduce beam_size
  • reduce best_of
  • set the temperature to 0

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants