RuntimeError: Library libcublas.so.12 is not found or cannot be loaded

[sunbaichi]

cuda version11.8

File "/App/install/OPS/pyenv/ai-speech/lib/python3.10/site-packages/transformers/pipelines/base.py", line 1112, in forward
model_outputs = self._forward(model_inputs, **forward_params)
File "/App/install/OPS/whisperX-main/whisperx/asr.py", line 152, in _forward
outputs = self.model.generate_segment_batched(model_inputs['inputs'], self.tokenizer, self.options)
File "/App/install/OPS/whisperX-main/whisperx/asr.py", line 47, in generate_segment_batched
encoder_output = self.encode(features)
File "/App/install/OPS/whisperX-main/whisperx/asr.py", line 86, in encode
return self.model.encode(features, to_cpu=to_cpu)
RuntimeError: Library libcublas.so.12 is not found or cannot be loaded

[sunbaichi]

The installed version is cuda11.8
File/usr/local/cuda/lib64/libcublas.so.11 exists
But why would you look for libcublas.so.12?

[Razatator]

I had the same problem. By installing Pytorch version Cuda 12.1 and installing whisperX by Pip, this installed the libcublass and cudnn dependencies automatically.
pip3 install torch torchvision torchaudio
pip install whisperx

[ghostcow]

The issue stems from faster-whisper having not specify a version in requirements.txt:
ctranslate2>=4.0,<5
Leading to the installation of untested versions of CTranslate2:
A few days ago a version 4.2.1 of ctranslate2 came out and installing it creates this problem.

pip installing the package ctranslate2==4.2.0 before installing the whisperx package can solve this problem