Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Detection box returns nan when running detect.py #411

Open
saturn-drm opened this issue Feb 23, 2024 · 0 comments
Open

Detection box returns nan when running detect.py #411

saturn-drm opened this issue Feb 23, 2024 · 0 comments

Comments

@saturn-drm
Copy link

Environment: Ubuntu 22.02, Python 3.7, tf-gpu==2.1.0

2024-02-23 17:53:11.979467: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10

2024-02-23 17:54:07.115039: W tensorflow/core/common_runtime/bfc_allocator.cc:309] Garbage collection: deallocate free memory regions (i.e., allocations) so that we can re-allocate a larger region to avoid OOM due to memory fragmentation. If you see this message frequently, you are running near the threshold of the available device memory and re-allocation may incur great performance overhead. You may try smaller batch sizes to observe the performance impact. Set TF_ENABLE_GPU_GARBAGE_COLLECTION=false if you'd like to disable this feature.

box = tf.Tensor(

[[[nan nan nan nan]

[nan nan nan nan]

[nan nan nan nan]
...

For full information, please refer to the attachment.

6359E72E-4CAD-4ce3-99EC-07FDFA630C4D.txt

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant