Skip to content

Tuning for threads, CPUs and cores #403

Answered by ggerganov
xrd asked this question in Q&A
Discussion options

You must be logged in to vote

The -p argument of main is not related to the CPU processor.
These are "Whisper" processors. It's a strategy that we explored to split the input audio into -p chunks and process the chunks in parallel. Sometimes it can speed-up the process, but the transcription result at the splits will likely be worse due to partial words and losing context.

A rule of thumb is that -p * -t should be less or equal to the number of CPU cores that you have.

Replies: 1 comment

Comment options

You must be logged in to vote
0 replies
Answer selected by xrd
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Category
Q&A
Labels
None yet
2 participants