DLL load failed for CUDA on Python 3.8 for Windows #2039

cashlo · 2020-03-28T04:32:27Z

Expected Behavior

>>> import dlib
>>> :)

Current Behavior

>>> import dlib
Traceback (most recent call last):
  File "<stdin>", line 1, in <module>
ImportError: DLL load failed while importing dlib: The specified module could not be found.
>>> :(

Steps to Reproduce

Install CUDA
Install cuDNN
git clone https://github.com/davisking/dlib.git
python setup.py install
python -c"import dlib"

Because of A change in Python 3.8 for Windows, Python no longer searches for DLLs in directories listed in the PATH environment variable and fails to find curand64_10.dll, this is fixed after running os.add_dll_directory(os.path.join(os.environ['CUDA_PATH'], 'bin'))

Version: 19.19.99
Where did you get dlib: this github repo
Platform: Python 3.8 64-bit for Windows 10

The text was updated successfully, but these errors were encountered:

davisking · 2020-03-28T11:28:16Z

Urg, windows dynamic loading is such a mess :(

davisking · 2020-03-28T18:58:44Z

I'm marking this help wanted because I'm not feeling super motivated to figure out how to fix this right now. So if someone wants to make this work I would much appreciate it.

It seems like the solution is to make CMake/setup.py generate a init.py that includes the appropriate os.add_dll_directory() call and then imports everything from the compiled dlib library users currently import.

cashlo · 2020-03-28T22:16:22Z

Let me see if I can do that in the next few days, I have everything needed to reproduce it anyway.

Mouradost · 2020-05-13T22:42:20Z

Expected Behavior
>>> import dlib
>>> :)
Current Behavior
>>> import dlib
Traceback (most recent call last):
  File "<stdin>", line 1, in <module>
ImportError: DLL load failed while importing dlib: The specified module could not be found.
>>> :(
Steps to Reproduce

Install CUDA

Install cuDNN

git clone https://github.com/davisking/dlib.git

python setup.py install

python -c"import dlib"

Because of A change in Python 3.8 for Windows, Python no longer searches for DLLs in directories listed in the PATH environment variable and fails to find curand64_10.dll, this is fixed after running os.add_dll_directory(os.path.join(os.environ['CUDA_PATH'], 'bin'))

Version: 19.19.99

Where did you get dlib: this github repo

Platform: Python 3.8 64-bit for Windows 10

I followed the same steps but I'm still getting the error of DLL load failed while importing dlib: The specified module could not be found

cashlo · 2020-05-28T07:31:54Z

Well, clearly I failed to work on this. This seems to be a much bigger change than I expected.
@Mouradost do you have the dlls in your CUDA_PATH?

Mouradost · 2020-05-30T03:43:08Z

@cashlo Yes I do since I'm using Tensorflow with the GPU here is my CUDA_PATHs

issaiass · 2020-06-07T17:29:26Z

For some reason:

Test1:
1 - Open a terminal
2 - Run the python command
3 - Impor dlib

Result: Causes DLL error

Test2:
1 - Open Terminal
2 - Run the python command
3 - import cv2
4 - import dlib

Result: No error, also, i checked the version! 💯

davisking · 2020-06-07T21:01:20Z

I just pushed a change to how dlib is packaged that should fix this. So pull the latest dlib from github and try installing that version.

Mouradost · 2020-06-08T07:44:48Z

For some reason:

Test1:
1 - Open a terminal
2 - Run the python command
3 - Impor dlib

Result: Causes DLL error

Test2:
1 - Open Terminal
2 - Run the python command
3 - import cv2
4 - import dlib

Result: No error, also, i checked the version! 💯

I just pushed a change to how dlib is packaged that should fix this. So pull the latest dlib from github and try installing that version.

still getting DLL errors

davisking · 2020-06-09T11:38:23Z

What's in your CUDA_PATH environment variable?

Mouradost · 2020-06-10T07:42:58Z

What's in your CUDA_PATH environment variable?

davisking · 2020-06-10T11:26:20Z

@Mouradost That doesn't look like the contents of the CUDA_PATH variable, but PATH or something else. I say this because it would be very surprising if all those c:\windows paths were in CUDA_PATH.

Mouradost · 2020-06-10T13:03:50Z

@Mouradost That doesn't look like the contents of the CUDA_PATH variable, but PATH or something else. I say this because it would be very surprising if all those c:\windows paths were in CUDA_PATH.

my bad sorry

davisking · 2020-06-11T11:55:06Z

So whats in C:\Program Files\NVIDIA GPU Computing Toolkit\CUDA\v10.1\bin?

Mouradost · 2020-06-14T08:08:32Z

So whats in C:\Program Files\NVIDIA GPU Computing Toolkit\CUDA\v10.1\bin?

These are the files in C:\Program Files\NVIDIA GPU Computing Toolkit\CUDA\v10.1\bin

davisking · 2020-06-16T18:21:13Z

I don't see cudnn's .dll file in that list. You need to install cudnn. Which is curious, since cmake must have found a copy of cudnn somewhere on your computer based on other things you said.

…

On Sun, Jun 14, 2020 at 4:08 AM mourad lablack ***@***.***> wrote: So whats in C:\Program Files\NVIDIA GPU Computing Toolkit\CUDA\v10.1\bin? These are the files in C:\Program Files\NVIDIA GPU Computing Toolkit\CUDA\v10.1\bin [image: image] <https://user-images.githubusercontent.com/17816194/84588343-2be56e00-ae59-11ea-9146-d744a4594f25.png> — You are receiving this because you commented. Reply to this email directly, view it on GitHub <#2039 (comment)>, or unsubscribe <https://github.com/notifications/unsubscribe-auth/ABPYFRZH72KFTJVMOR5QMLTRWSAQXANCNFSM4LVOATAQ> .

Mouradost · 2020-06-17T07:23:05Z

I don't see cudnn's .dll file in that list. You need to install cudnn. Which is curious, since cmake must have found a copy of cudnn somewhere on your computer based on other things you said.
…
On Sun, Jun 14, 2020 at 4:08 AM mourad lablack @.***> wrote: So whats in C:\Program Files\NVIDIA GPU Computing Toolkit\CUDA\v10.1\bin? These are the files in C:\Program Files\NVIDIA GPU Computing Toolkit\CUDA\v10.1\bin [image: image] https://user-images.githubusercontent.com/17816194/84588343-2be56e00-ae59-11ea-9146-d744a4594f25.png — You are receiving this because you commented. Reply to this email directly, view it on GitHub <#2039 (comment)>, or unsubscribe https://github.com/notifications/unsubscribe-auth/ABPYFRZH72KFTJVMOR5QMLTRWSAQXANCNFSM4LVOATAQ .

I have it under a different folder on c:\tools\cuda\bin should I add a copy to the C:\Program Files\NVIDIA GPU Computing Toolkit\CUDA\v10.1\bin ?

Mouradost · 2020-06-17T07:26:05Z

it's working awesome thank you @davisking
I wonder could you guys give away a possibility to specify the path for cudnn if it's not moved to the cuda main folder? or directly grab it from the windows paths? like tensorflow do

davisking · 2020-06-17T10:01:30Z

Where was it? Oh you noted in your other comment. Really we should make the install process record the location of the copy it found rather than expecting the user to do something special.

davisking · 2020-06-18T01:31:55Z

@Mouradost I just pushed a change to github that should make this work without needing to assume anything about CUDA_PATH. So try the latest dlib on github.

Mouradost · 2020-06-18T08:33:53Z

@Mouradost I just pushed a change to github that should make this work without needing to assume anything about CUDA_PATH. So try the latest dlib on github.

Sure I will give you my feedback thank you for your consideration and your help

Mouradost · 2020-06-18T08:37:32Z

Where was it? Oh you noted in your other comment. Really we should make the install process record the location of the copy it found rather than expecting the user to do something special.

I had the habit to create a separate folder in the C:\ called tools and I put my cudnn files there which make it easy to find and change only the cudnn files if I want to use different version on cudnn without touching cuda that's why I thought it will be better to have your library allowing for additional paths.

ElPrg · 2020-09-21T18:45:43Z

Expected Behavior
>>> import dlib
>>> :)
Current Behavior
>>> import dlib
Traceback (most recent call last):
  File "<stdin>", line 1, in <module>
ImportError: DLL load failed while importing dlib: The specified module could not be found.
>>> :(
Steps to Reproduce
1. Install CUDA

2. Install cuDNN

3. `git clone https://github.com/davisking/dlib.git`

4. `python setup.py install`

5. `python -c"import dlib"`
Because of A change in Python 3.8 for Windows, Python no longer searches for DLLs in directories listed in the PATH environment variable and fails to find curand64_10.dll, this is fixed after running os.add_dll_directory(os.path.join(os.environ['CUDA_PATH'], 'bin'))
* **Version**: 19.19.99

* **Where did you get dlib**: this github repo

* **Platform**: Python 3.8 64-bit for Windows 10

I had a situation that dlib crashed when I did import it, in general I did the following. I changed setup.py and set it to compile Debug, but with Release it didn't work on Win 7 x 4 Py 3.7.

link on setup_for Debug compile
https://drive.google.com/file/d/1Wfy9ou3yYce4wqywY22jPxC9IkN6_Dch

VasilijKolomiets · 2021-04-03T08:40:29Z

I instal version Dlib 19.7.0. on python 3,6.13

pip install https://pypi.python.org/packages/da/06/bd3e241c4eb0a662914b3b4875fc52dd176a9db0d4a2c915ac2ad8800e9e/dlib-19.7.0-cp36-cp36m-win_amd64.whl#md5=b7330a5b2d46420343fbed5df69e6a3f
all works... but may be any advices about new versions?

VasilijKolomiets · 2021-04-03T09:00:18Z

I work in:

Windows10
CUDA10.1
Anaconda
Python 3.8

Steps to reproduce

Install CUDA
Install cuDNN
Install Anaconda
create env
in terminal write conda install dlib -c conda-forge
Environment (conda list):

> (dlib) C:\Users\Vasil>conda list
> # packages in environment at D:\Games\conda\envs\dlib:
> #
> # Name                    Version                   Build  Channel
> ca-certificates           2020.12.5            h5b45459_0    conda-forge
> certifi                   2020.12.5        py38haa244fe_1    conda-forge
> dlib                      19.21.1          py38h082dfc2_0    conda-forge
> intel-openmp              2020.3             h57928b3_311    conda-forge
> jpeg                      9d                   h8ffe710_0    conda-forge
> libblas                   3.9.0                     8_mkl    conda-forge
> libcblas                  3.9.0                     8_mkl    conda-forge
> liblapack                 3.9.0                     8_mkl    conda-forge
> libpng                    1.6.37               h1d00b33_2    conda-forge
> mkl                       2020.4             hb70f87d_311    conda-forge
> numpy                     1.20.1           py38h0cc643e_0    conda-forge
> openssl                   1.1.1k               h8ffe710_0    conda-forge
> pip                       21.0.1             pyhd8ed1ab_0    conda-forge
> python                    3.8.8           h7840368_0_cpython    conda-forge
> python_abi                3.8                      1_cp38    conda-forge
> setuptools                49.6.0           py38haa244fe_3    conda-forge
> sqlite                    3.35.3               h8ffe710_0    conda-forge
> vc                        14.2                 hb210afc_4    conda-forge
> vs2015_runtime            14.28.29325          h5e1d092_4    conda-forge
> wheel                     0.36.2             pyhd3deb0d_0    conda-forge
> wincertstore              0.2             py38haa244fe_1006    conda-forge
> zlib                      1.2.11            h62dcd97_1010    conda-forge
> 
> (dlib) C:\Users\Vasil>

Details about conda and system ( conda info ):

>     active environment : dlib
>     active env location : D:\Games\conda\envs\dlib
>             shell level : 1
>        user config file : C:\Users\Vasil\.condarc
>  populated config files : C:\Users\Vasil\.condarc
>           conda version : 4.9.2
>     conda-build version : 3.20.5
>          python version : 3.8.5.final.0
>        virtual packages : __cuda=11.2=0
>                           __win=0=0
>                           __archspec=1=x86_64
>        base environment : D:\Games\conda  (writable)
>            channel URLs : https://conda.anaconda.org/conda-forge/win-64
>                           https://conda.anaconda.org/conda-forge/noarch
>                           https://repo.anaconda.com/pkgs/main/win-64
>                           https://repo.anaconda.com/pkgs/main/noarch
>                           https://repo.anaconda.com/pkgs/r/win-64
>                           https://repo.anaconda.com/pkgs/r/noarch
>                           https://repo.anaconda.com/pkgs/msys2/win-64
>                           https://repo.anaconda.com/pkgs/msys2/noarch
>           package cache : D:\Games\conda\pkgs
>                           C:\Users\Vasil\.conda\pkgs
>                           C:\Users\Vasil\AppData\Local\conda\conda\pkgs
>        envs directories : D:\Games\conda\envs
>                           C:\Users\Vasil\.conda\envs
>                           C:\Users\Vasil\AppData\Local\conda\conda\envs
>                platform : win-64
>              user-agent : conda/4.9.2 requests/2.24.0 CPython/3.8.5 Windows/10 Windows/10.0.19041
>           administrator : False
>              netrc file : None
>            offline mode : False

What seams strange - that line virtual packages : __cuda=11.2=0 when I have CUDA10.1

All I did - just install dlib in new env and try to do import:

(dlib) C:\Users\Vasil>conda install dlib
Collecting package metadata (current_repodata.json): done
Solving environment: done

## Package Plan ##

  environment location: D:\Games\conda\envs\dlib

  added / updated specs:
    - dlib


The following NEW packages will be INSTALLED:

  dlib               conda-forge/win-64::dlib-19.21.1-py38h082dfc2_0
  intel-openmp       conda-forge/win-64::intel-openmp-2020.3-h57928b3_311
  jpeg               conda-forge/win-64::jpeg-9d-h8ffe710_0
  libblas            conda-forge/win-64::libblas-3.9.0-8_mkl
  libcblas           conda-forge/win-64::libcblas-3.9.0-8_mkl
  liblapack          conda-forge/win-64::liblapack-3.9.0-8_mkl
  libpng             conda-forge/win-64::libpng-1.6.37-h1d00b33_2
  mkl                conda-forge/win-64::mkl-2020.4-hb70f87d_311
  numpy              conda-forge/win-64::numpy-1.20.1-py38h0cc643e_0
  zlib               conda-forge/win-64::zlib-1.2.11-h62dcd97_1010


Proceed ([y]/n)? y

Preparing transaction: done
Verifying transaction: done
Executing transaction: done

(dlib) C:\Users\Vasil>python
Python 3.8.8 | packaged by conda-forge | (default, Feb 20 2021, 15:50:08) [MSC v.1916 64 bit (AMD64)] on win32
Type "help", "copyright", "credits" or "license" for more information.
>>> import dlib
Traceback (most recent call last):
  File "<stdin>", line 1, in <module>
  
  File "D:\Games\conda\envs\dlib\lib\site-packages\dlib\__init__.py", line 19, in <module>
    from _dlib_pybind11 import *
ImportError: DLL load failed while importing _dlib_pybind11: A dynamic link library (DLL) initialization routine failed.

here is my windows PATH

CUDA_PATH=C:\Program Files\NVIDIA GPU Computing Toolkit\CUDA\v10.1 CUDA_PATH_V10_1=C:\Program Files\NVIDIA GPU Computing Toolkit\CUDA\v10.1 ...      
PATH=D:\Games\conda\envs\dlib;D:\Games\conda\envs\dlib\Library\mingw-w64\bin;
D:\Games\conda\envs\dlib\Library\usr\bin;D:\Games\conda\envs\dlib\Library\bin;
D:\Games\conda\envs\dlib\Scripts;
D:\Games\conda\envs\dlib\bin;
D:\Games\conda\condabin;
D:\Games\conda;
D:\Games\conda\Library\mingw-w64\bin;
D:\Games\conda\Library\usr\bin;
D:\Games\conda\Library\bin;
D:\Games\conda\Scripts;
C:\Program Files (x86)\Common Files\Oracle\Java\javapath;
C:\Program Files\NVIDIA GPU Computing Toolkit\CUDA\v10.1\bin;
C:\Program Files\NVIDIA GPU Computing Toolkit\CUDA\v10.1\libnvvp;
C:\Windows\system32;C:\Windows;
C:\Windows\System32\Wbem;
C:\Windows\System32\WindowsPowerShell\v1.0;
C:\Windows\System32\OpenSSH;
C:\Program Files\NVIDIA Corporation\NVIDIA NvDLISR;
C:\Program Files (x86)\NVIDIA Corporation\PhysX\Common;
C:\Program Files\NVIDIA Corporation\Nsight Compute 2019.3.0;
C:\WINDOWS\system32;
C:\WINDOWS;
C:\WINDOWS\System32\Wbem;
C:\WINDOWS\System32\WindowsPowerShell\v1.0;
C:\WINDOWS\System32\OpenSSH;
C:\Program Files\PuTTY;
D:\Program Files\Git\cmd;
C:\Program Files\nodejs;C:\Program Files\dotnet;
C:\Users\Vasil\AppData\Local\Microsoft\WindowsApps;
C:\Users\Vasil\AppData\Local\Programs\Microsoft VS Code\bin;
C:\Users\Vasil\AppData\Local\GitHubDesktop\bin;
C:\Users\Vasil\AppData\Local\Microsoft\WindowsApps;
d:\Program Files\heroku\bin;C:\Users\Vasil\AppData\Roaming\npm;
C:\Program Files\NVIDIA GPU Computing Toolkit\CUDA\v10.1\bin;.

and cudnn64_7.dll is in C:\Program Files\NVIDIA GPU Computing Toolkit\CUDA\v10.1\bin

hrkrx · 2021-04-30T00:18:07Z

I am facing the same error but on Python 3.9, I compiled it and everything seemed okay. But when i import dlib the before mentioned DLL error is displayed.

EDIT: I got Cuda to run in WSL 2, so I'll probably stick with it even if windows gets fixed. I'd suggest dropping windows all together once WSL 2 is outside of the Windows insider program

EDIT: after installing the expirmental CUDA for WSL driver it also worked on windows, but don't ask me why

mtsnrtkhr · 2024-02-05T12:31:52Z

I had same issue when I compile dlib with CUDA enabled.
In my case, the reason is the path of cuDNN.

"C:\Program Files\NVIDIA\CUDNN\v8.9.7.29\lib\cudnn.lib"

"import dlib" failed with that error.

When I move the filed under lib to "x64" as originally from cuDNN,zip

"C:\Program Files\NVIDIA\CUDNN\v8.9.7.29\lib\x64\cudnn.lib"

the problem solved.

This was referenced Mar 28, 2020

ImportError: DLL load failed: The specified module could not be found. #1954

Closed

dlib module not found only in api.py ageitgey/face_recognition#1089

Closed

davisking added bug help wanted labels Mar 28, 2020

VasilijKolomiets mentioned this issue Mar 28, 2021

ImportError: DLL load failed while importing _dlib_pybind11: A dynamic link library (DLL) initialization routine failed. conda-forge/dlib-feedstock#52

Closed

Anonymous-31415926 mentioned this issue Jun 10, 2023

Traceback error williamyang1991/StyleGANEX#10

Closed

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

DLL load failed for CUDA on Python 3.8 for Windows #2039

DLL load failed for CUDA on Python 3.8 for Windows #2039

cashlo commented Mar 28, 2020

davisking commented Mar 28, 2020

davisking commented Mar 28, 2020

cashlo commented Mar 28, 2020

Mouradost commented May 13, 2020

Expected Behavior

Current Behavior

Steps to Reproduce

cashlo commented May 28, 2020

Mouradost commented May 30, 2020

issaiass commented Jun 7, 2020 •

edited

davisking commented Jun 7, 2020

Mouradost commented Jun 8, 2020

davisking commented Jun 9, 2020

Mouradost commented Jun 10, 2020

davisking commented Jun 10, 2020

Mouradost commented Jun 10, 2020

davisking commented Jun 11, 2020

Mouradost commented Jun 14, 2020 •

edited

davisking commented Jun 16, 2020 via email

Mouradost commented Jun 17, 2020

Mouradost commented Jun 17, 2020 •

edited

davisking commented Jun 17, 2020 •

edited

davisking commented Jun 18, 2020 •

edited

Mouradost commented Jun 18, 2020

Mouradost commented Jun 18, 2020 •

edited

ElPrg commented Sep 21, 2020

Expected Behavior

Current Behavior

Steps to Reproduce

VasilijKolomiets commented Apr 3, 2021 •

edited

VasilijKolomiets commented Apr 3, 2021 •

edited

hrkrx commented Apr 30, 2021 •

edited

mtsnrtkhr commented Feb 5, 2024

DLL load failed for CUDA on Python 3.8 for Windows #2039

DLL load failed for CUDA on Python 3.8 for Windows #2039

Comments

cashlo commented Mar 28, 2020

Expected Behavior

Current Behavior

Steps to Reproduce

davisking commented Mar 28, 2020

davisking commented Mar 28, 2020

cashlo commented Mar 28, 2020

Mouradost commented May 13, 2020

Expected Behavior

Current Behavior

Steps to Reproduce

cashlo commented May 28, 2020

Mouradost commented May 30, 2020

issaiass commented Jun 7, 2020 • edited

davisking commented Jun 7, 2020

Mouradost commented Jun 8, 2020

davisking commented Jun 9, 2020

Mouradost commented Jun 10, 2020

davisking commented Jun 10, 2020

Mouradost commented Jun 10, 2020

davisking commented Jun 11, 2020

Mouradost commented Jun 14, 2020 • edited

davisking commented Jun 16, 2020 via email

Mouradost commented Jun 17, 2020

Mouradost commented Jun 17, 2020 • edited

davisking commented Jun 17, 2020 • edited

davisking commented Jun 18, 2020 • edited

Mouradost commented Jun 18, 2020

Mouradost commented Jun 18, 2020 • edited

ElPrg commented Sep 21, 2020

Expected Behavior

Current Behavior

Steps to Reproduce

VasilijKolomiets commented Apr 3, 2021 • edited

VasilijKolomiets commented Apr 3, 2021 • edited

Steps to reproduce

hrkrx commented Apr 30, 2021 • edited

mtsnrtkhr commented Feb 5, 2024

issaiass commented Jun 7, 2020 •

edited

Mouradost commented Jun 14, 2020 •

edited

Mouradost commented Jun 17, 2020 •

edited

davisking commented Jun 17, 2020 •

edited

davisking commented Jun 18, 2020 •

edited

Mouradost commented Jun 18, 2020 •

edited

VasilijKolomiets commented Apr 3, 2021 •

edited

VasilijKolomiets commented Apr 3, 2021 •

edited

hrkrx commented Apr 30, 2021 •

edited