Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

InvalidArgumentError (see above for traceback): Nan in summary histogram for: HistogramSummary_2 [[Node: HistogramSummary_2 = HistogramSummary[T=DT_FLOAT, _device="/job:localhost/replica:0/task:0/cpu:0"](HistogramSummary_2/tag, discriminator_1/Sigmoid)]] #398

Open
zhou20120904 opened this issue Dec 18, 2023 · 1 comment

Comments

@zhou20120904
Copy link

when I trying to train a model,it only run for 940 batchs,and i got an error.
`Traceback (most recent call last):
File "main.py", line 147, in
tf.app.run()
File "/Users/xiaochenyue/opt/anaconda3/envs/py33/lib/python2.7/site-packages/tensorflow/python/platform/app.py", line 43, in run
sys.exit(main(sys.argv[:1] + flags_passthrough))
File "main.py", line 120, in main
dcgan.train(FLAGS)
File "/Users/xiaochenyue/Desktop/zjy/DCGAN-tensorflow/model.py", line 284, in train
feed_dict={ self.z: batch_z })
File "/Users/xiaochenyue/opt/anaconda3/envs/py33/lib/python2.7/site-packages/tensorflow/python/client/session.py", line 766, in run
run_metadata_ptr)
File "/Users/xiaochenyue/opt/anaconda3/envs/py33/lib/python2.7/site-packages/tensorflow/python/client/session.py", line 964, in _run
feed_dict_string, options, run_metadata)
File "/Users/xiaochenyue/opt/anaconda3/envs/py33/lib/python2.7/site-packages/tensorflow/python/client/session.py", line 1014, in _do_run
target_list, options, run_metadata)
File "/Users/xiaochenyue/opt/anaconda3/envs/py33/lib/python2.7/site-packages/tensorflow/python/client/session.py", line 1034, in _do_call
raise type(e)(node_def, op, message)
tensorflow.python.framework.errors_impl.InvalidArgumentError: Nan in summary histogram for: HistogramSummary_2
[[Node: HistogramSummary_2 = HistogramSummary[T=DT_FLOAT, _device="/job:localhost/replica:0/task:0/cpu:0"](HistogramSummary_2/tag, discriminator_1/Sigmoid)]]

Caused by op u'HistogramSummary_2', defined at:
File "main.py", line 147, in
tf.app.run()
File "/Users/xiaochenyue/opt/anaconda3/envs/py33/lib/python2.7/site-packages/tensorflow/python/platform/app.py", line 43, in run
sys.exit(main(sys.argv[:1] + flags_passthrough))
File "main.py", line 115, in main
max_to_keep=FLAGS.max_to_keep)
File "/Users/xiaochenyue/Desktop/zjy/DCGAN-tensorflow/model.py", line 104, in init
self.build_model()
File "/Users/xiaochenyue/Desktop/zjy/DCGAN-tensorflow/model.py", line 132, in build_model
self.d__sum = histogram_summary("d_", self.D_)
File "/Users/xiaochenyue/opt/anaconda3/envs/py33/lib/python2.7/site-packages/tensorflow/python/util/deprecation.py", line 110, in new_func
return func(*args, **kwargs)
File "/Users/xiaochenyue/opt/anaconda3/envs/py33/lib/python2.7/site-packages/tensorflow/python/ops/logging_ops.py", line 101, in histogram_summary
tag=tag, values=values, name=scope)
File "/Users/xiaochenyue/opt/anaconda3/envs/py33/lib/python2.7/site-packages/tensorflow/python/ops/gen_logging_ops.py", line 139, in _histogram_summary
name=name)
File "/Users/xiaochenyue/opt/anaconda3/envs/py33/lib/python2.7/site-packages/tensorflow/python/framework/op_def_library.py", line 759, in apply_op
op_def=op_def)
File "/Users/xiaochenyue/opt/anaconda3/envs/py33/lib/python2.7/site-packages/tensorflow/python/framework/ops.py", line 2240, in create_op
original_op=self._default_original_op, op_def=op_def)
File "/Users/xiaochenyue/opt/anaconda3/envs/py33/lib/python2.7/site-packages/tensorflow/python/framework/ops.py", line 1128, in init
self._traceback = _extract_stack()

InvalidArgumentError (see above for traceback): Nan in summary histogram for: HistogramSummary_2
[[Node: HistogramSummary_2 = HistogramSummary[T=DT_FLOAT, _device="/job:localhost/replica:0/task:0/cpu:0"](HistogramSummary_2/tag, discriminator_1/Sigmoid)]]`
when I rerun it,it will run for a while,and raise same error.

@lihh1023
Copy link

lihh1023 commented Dec 18, 2023 via email

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants