Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Saver / tf.train.latest_checkpoint doesn't work very well with relative paths #571

Closed
ilblackdragon opened this issue Dec 20, 2015 · 3 comments

Comments

@ilblackdragon
Copy link
Contributor

For example, if model is saved into a folder test by doing saver.save(session, '/path/to/test') - will result in the having checkpoints and model-0 files. Where checkpoints file will have something like this:

model_checkpoint_path: "test/model-0"
all_model_checkpoint_paths: "test/model-0"

Which if you call now tf.train.latest_checkpoint('test') from the same directory, will result in the None.

This is due to os.path.join(checkpoint_dir, ckpt.model_checkpoint_path) which for relative path like above will result in the test/test/model-0.

@sherrym
Copy link
Contributor

sherrym commented Dec 23, 2015

Fixed by:
Change-Id: I47d8536b9b2ed3dcc193d6e6b7f4573a4e22c9b3

@sherrym sherrym closed this as completed Dec 23, 2015
@vrv vrv reopened this Dec 23, 2015
@vrv
Copy link

vrv commented Dec 23, 2015

We abandoned the gerrit one -- if #573 looks good, we can merge

@vrv vrv closed this as completed in eef2aaa Jan 8, 2016
polm referenced this issue in hardmaru/sketch-rnn Mar 20, 2016
Relative path handling seems to have changed at some point since this
was released; see issues #571 and 751. -POLM
@vsuarezpaniagua
Copy link

This issue persists when you change the name of the run folder. It seems that the checkpoints/checkpoint file only keep the old path and tf fails when latest_checkpoint is used over this new folder.

darkbuck pushed a commit to darkbuck/tensorflow that referenced this issue Jan 23, 2020
…pstream-zyin-merge-conv-algo-picker

[XLA:GPU] Refactor cudnn & miopen conv algorithm picker for find mode
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

4 participants