-
Notifications
You must be signed in to change notification settings - Fork 607
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
ZLUDA with faster-whisper: Could not load library libcudnn_ops_infer.so.8 #215
Comments
Also, I tried faster-whisper together with ZLUDA. It looks that ctranslate2 (library behind faster-whisper) needs something from CUDNN that is not yet implemented. Here are the details:
Following ctranslate2 line causes the error: https://github.com/OpenNMT/CTranslate2/blob/39f48f2e843df52245e6c857326e1115bca12b03/src/ops/conv1d_gpu.cu#L37. |
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
It was very promising that faster-whisper actually started, but when audio is being processed, I get this:
INFO:main:Ready
INFO:faster_whisper:Processing audio with duration 00:01.530
Could not load library libcudnn_ops_infer.so.8. Error: libcudnn_ops_infer.so.8: cannot open shared object file: No such file or directory
Traceback (most recent call last):
File "/home/jarno/wyoming-faster-whisper/script/run", line 15, in
subprocess.check_call([context.env_exe, "-m", "wyoming_faster_whisper"] + sys.argv[1:])
File "/home/jarno/miniforge3/lib/python3.10/subprocess.py", line 369, in check_call
raise CalledProcessError(retcode, cmd)
subprocess.CalledProcessError: Command '['/home/jarno/wyoming-faster-whisper/.venv/bin/python3', '-m', 'wyoming_faster_whisper', '--model', 'whisper-large-finnish-v3', '--device', 'cuda', '--beam-size', '5', '--compute-type', 'int8', '--language', 'fi', '--uri', 'tcp://0.0.0.0:10300', '--data-dir', '/data', '--download-dir', '/data']' died with <Signals.SIGABRT: 6>.
Is there any workaround for this or is the missing library something that could be added to zluda?
The text was updated successfully, but these errors were encountered: