nvidia 4070 support for DLC through WSL #8417
nkomarov1410
started this conversation in
General
Replies: 0 comments
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
-
Hello,
I'm struggling to get the specific parameters right in order to get tensorflow and cudnn to work correctly in wsl.
Is this even possible? Is there something I'm missing?
DLC runs, and everything works, but it doesn't use my GPU. It just runs off CPU.
Here is the full log from starting the example dataset:
Loading DLC 2.3.8...
Starting GUI...
QStandardPaths: wrong permissions on runtime directory /run/user/1000/, 0755 instead of 0700
Config:
{'all_joints': [[0], [1], [2], [3]],
'all_joints_names': ['snout', 'leftear', 'rightear', 'tailbase'],
'alpha_r': 0.02,
'apply_prob': 0.5,
'batch_size': 1,
'contrast': {'clahe': True,
'claheratio': 0.1,
'histeq': True,
'histeqratio': 0.1},
'convolution': {'edge': False,
'emboss': {'alpha': [0.0, 1.0], 'strength': [0.5, 1.5]},
'embossratio': 0.1,
'sharpen': False,
'sharpenratio': 0.3},
'crop_pad': 0,
'cropratio': 0.4,
'dataset': 'training-datasets/iteration-0/UnaugmentedDataSet_openfieldOct30/openfield_Pranav95shuffle1.mat',
'dataset_type': 'imgaug',
'decay_steps': 30000,
'deterministic': False,
'display_iters': 1000,
'fg_fraction': 0.25,
'global_scale': 0.8,
'init_weights': '/home/kit/anaconda3/envs/dlc/lib/python3.10/site-packages/deeplabcut/pose_estimation_tensorflow/models/pretrained/resnet_v1_50.ckpt',
'intermediate_supervision': False,
'intermediate_supervision_layer': 12,
'location_refinement': True,
'locref_huber_loss': True,
'locref_loss_weight': 0.05,
'locref_stdev': 7.2801,
'log_dir': 'log',
'lr_init': 0.0005,
'max_input_size': 1500,
'mean_pixel': [123.68, 116.779, 103.939],
'metadataset': 'training-datasets/iteration-0/UnaugmentedDataSet_openfieldOct30/Documentation_data-openfield_95shuffle1.pickle',
'min_input_size': 64,
'mirror': False,
'multi_stage': False,
'multi_step': [[0.005, 10000],
[0.02, 430000],
[0.002, 730000],
[0.001, 1030000]],
'net_type': 'resnet_50',
'num_joints': 4,
'optimizer': 'sgd',
'pairwise_huber_loss': False,
'pairwise_predict': False,
'partaffinityfield_predict': False,
'pos_dist_thresh': 17,
'project_path': '/mnt/c/Users/nkoma/Downloads/DeepLabCut-main/DeepLabCut-main/examples/openfield-Pranav-2018-10-30',
'regularize': False,
'rotation': 25,
'rotratio': 0.4,
'save_iters': 50000,
'scale_jitter_lo': 0.5,
'scale_jitter_up': 1.25,
'scoremap_dir': 'test',
'shuffle': True,
'snapshot_prefix': '/mnt/c/Users/nkoma/Downloads/DeepLabCut-main/DeepLabCut-main/examples/openfield-Pranav-2018-10-30/dlc-models/iteration-0/openfieldOct30-trainset95shuffle1/train/snapshot',
'stride': 8.0,
'weigh_negatives': False,
'weigh_only_present_joints': False,
'weigh_part_predictions': False,
'weight_decay': 0.0001}
/home/kit/anaconda3/envs/dlc/lib/python3.10/site-packages/tensorflow/python/keras/engine/base_layer_v1.py:1694: UserWarning:
layer.apply
is deprecated and will be removed in a future version. Please uselayer.__call__
method instead.warnings.warn('
layer.apply
is deprecated and '2024-02-03 21:18:58.479338: I tensorflow/stream_executor/cuda/cuda_gpu_executor.cc:966] could not open file to read NUMA node: /sys/bus/pci/devices/0000:01:00.0/numa_node
Your kernel may have been built without NUMA support.
2024-02-03 21:18:58.479968: W tensorflow/stream_executor/platform/default/dso_loader.cc:64] Could not load dynamic library 'libcudart.so.11.0'; dlerror: libcudart.so.11.0: cannot open shared object file: No such file or directory; LD_LIBRARY_PATH: /home/kit/anaconda3/envs/dlc/lib/python3.10/site-packages/cv2/../../lib64:/usr/local/cuda-12.3/lib64::/home/kit/anaconda3/envs/dlc/lib/
2024-02-03 21:18:58.480524: W tensorflow/stream_executor/platform/default/dso_loader.cc:64] Could not load dynamic library 'libcublas.so.11'; dlerror: libcublas.so.11: cannot open shared object file: No such file or directory; LD_LIBRARY_PATH: /home/kit/anaconda3/envs/dlc/lib/python3.10/site-packages/cv2/../../lib64:/usr/local/cuda-12.3/lib64::/home/kit/anaconda3/envs/dlc/lib/
2024-02-03 21:18:58.481145: W tensorflow/stream_executor/platform/default/dso_loader.cc:64] Could not load dynamic library 'libcublasLt.so.11'; dlerror: libcublasLt.so.11: cannot open shared object file: No such file or directory; LD_LIBRARY_PATH: /home/kit/anaconda3/envs/dlc/lib/python3.10/site-packages/cv2/../../lib64:/usr/local/cuda-12.3/lib64::/home/kit/anaconda3/envs/dlc/lib/
2024-02-03 21:18:58.481752: W tensorflow/stream_executor/platform/default/dso_loader.cc:64] Could not load dynamic library 'libcufft.so.10'; dlerror: libcufft.so.10: cannot open shared object file: No such file or directory; LD_LIBRARY_PATH: /home/kit/anaconda3/envs/dlc/lib/python3.10/site-packages/cv2/../../lib64:/usr/local/cuda-12.3/lib64::/home/kit/anaconda3/envs/dlc/lib/
2024-02-03 21:18:58.595634: W tensorflow/stream_executor/platform/default/dso_loader.cc:64] Could not load dynamic library 'libcusparse.so.11'; dlerror: libcusparse.so.11: cannot open shared object file: No such file or directory; LD_LIBRARY_PATH: /home/kit/anaconda3/envs/dlc/lib/python3.10/site-packages/cv2/../../lib64:/usr/local/cuda-12.3/lib64::/home/kit/anaconda3/envs/dlc/lib/
2024-02-03 21:18:58.597035: W tensorflow/core/common_runtime/gpu/gpu_device.cc:1934] Cannot dlopen some GPU libraries. Please make sure the missing libraries mentioned above are installed properly if you would like to use GPU. Follow the guide at https://www.tensorflow.org/install/gpu for how to download and setup the required libraries for your platform.
Skipping registering GPU devices...
2024-02-03 21:18:58.598290: I tensorflow/core/platform/cpu_feature_guard.cc:193] This TensorFlow binary is optimized with oneAPI Deep Neural Network Library (oneDNN) to use the following CPU instructions in performance-critical operations: AVX2 AVX512F AVX512_VNNI AVX512_BF16 FMA
To enable them in other operations, rebuild TensorFlow with the appropriate compiler flags.
2024-02-03 21:18:58.788483: I tensorflow/stream_executor/cuda/cuda_gpu_executor.cc:966] could not open file to read NUMA node: /sys/bus/pci/devices/0000:01:00.0/numa_node
Your kernel may have been built without NUMA support.
2024-02-03 21:18:58.788525: W tensorflow/core/common_runtime/gpu/gpu_device.cc:1934] Cannot dlopen some GPU libraries. Please make sure the missing libraries mentioned above are installed properly if you would like to use GPU. Follow the guide at https://www.tensorflow.org/install/gpu for how to download and setup the required libraries for your platform.
Skipping registering GPU devices...
2024-02-03 21:18:59.437521: I tensorflow/compiler/mlir/mlir_graph_optimization_pass.cc:354] MLIR V1 optimization pass is not enabled
Beta Was this translation helpful? Give feedback.
All reactions