Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Kits-19.ipynb #129

Open
sreeharih opened this issue Mar 9, 2022 · 5 comments
Open

Kits-19.ipynb #129

sreeharih opened this issue Mar 9, 2022 · 5 comments
Assignees
Labels
bug Something isn't working

Comments

@sreeharih
Copy link

Hi,
When I am executing the crossvalidation function it is showing the following error.
Temporary files are created in the batches directory.

Error_file.txt

@muellerdo
Copy link
Member

Short summary from e-mail traffic:

  • Working on Google Colab
  • No GPU usage during application -> runs on CPU
  • Seems like that temporary files are successfully created
  • Running for 17 hours without any progress
  • Google Colab switched to Tensorflow 2.8 recently
  • MIScnn standard pypi install has 2.7 TF

I would assume that the installed Tensorflow version isn't compatible to the Google Colab CUDA version?

Last mail:

I have installed miscnn from the dev branch and changed the tensorflow version to 2.7 but now I am getting the following error.

Try not changing the Tensorflow version in the Colab (so it's compatible with CUDA) and install MIScnn via dev branch.

pip install git+https://github.com/frankkramer-lab/MIScnn.git@development

The dev branch is more "dynamic" to differences in module versions.

Cheers,
Dominik

@muellerdo muellerdo self-assigned this Mar 9, 2022
@muellerdo muellerdo added the bug Something isn't working label Mar 9, 2022
@sreeharih
Copy link
Author

Hi,
Thanks for the solution the training had started.
Now a new problem cropped up I had given k_fold=2, epochs=20, iterations=150, it had completed fold_0 but it didn't start the next fold.It's running for around 16 hours.

Output.txt
image

@sreeharih
Copy link
Author

Instead of cross_validation () this time I had used model.train() for 20 epochs it's running for 23 hours without any progress.

@muellerdo
Copy link
Member

Hello @sreeharih,

any updates on this issue?

I was not able to reproduce this bug of the KiTS19 notebook on a google colab with our dev branch.

Please provide more information on this issue.
Is the prepare_subfunction completed and do you have all training samples in your batch directory?
Please send a public google colab link for bug reproducibility.

Are you using a free colab account? The KiTS19 is around 200GB and with prepare_subfunction on true, a full copy of the dataset is created. I don't know if Google Colab provide such large disk space for free.

@sreeharih
Copy link
Author

sreeharih commented Apr 10, 2022 via email

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working
Projects
None yet
Development

No branches or pull requests

2 participants