Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Encountering suboptimal results during the reproduction process, seeking your insights and guidance. #5

Open
EmarkZOU opened this issue Oct 2, 2023 · 1 comment

Comments

@EmarkZOU
Copy link

EmarkZOU commented Oct 2, 2023

Hello, thank you for your contributions in the field of semi-supervised contrastive learning. I have gained a lot from your work!

However, during the reproduction process, I encountered some issues. When I attempted to apply the original model to the polyp dataset (kvasir-seg), I found that the performance was not ideal, with a dice score of only around 23. The log files also indicated that the dataloader filtered out many images with sizes not meeting the default trainsize.

Initially, I suspected the issue might be with the filters in data.py, so I commented out the filtering operations. This improved the training dice value to around 33, but it's clearly not reflective of the true capabilities of the model.

Next, I tried another polyp dataset, colon, and trained the original model. The best dice during training was over 85, which is quite impressive.

I then switched to the kvasir-instrument dataset mentioned in the original paper, using the original model parameters for training. However, the results were not satisfactory, similar to kvasir-seg, with a dice score of only around 20 during training.

What's strange is that the image sizes for all three datasets don't match the trainsize. I'm wondering if it's necessary to modify the default value of trainsize to try and improve experimental results?

This process has left me quite perplexed. I look forward to your response and greatly appreciate your assistance.

@EmarkZOU
Copy link
Author

EmarkZOU commented Oct 3, 2023

I noticed in a closed issue that a similar issue was mentioned. I would like to know if there is a solution available. Thank you!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant