Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Pixelated image reconstruction #29

Open
coolbunnyx opened this issue Jan 8, 2024 · 7 comments
Open

Pixelated image reconstruction #29

coolbunnyx opened this issue Jan 8, 2024 · 7 comments

Comments

@coolbunnyx
Copy link

coolbunnyx commented Jan 8, 2024

Trained the model on a set of 10K images (randomly cropped 128 x 128 patches) for 6K iteration with a batch size of 8. The output looks pixelated. Is this what is expected, or the output should somehow look similar to the input? Any feedbacks are appreciated!

2024-01-07_19-45-46

@coolbunnyx coolbunnyx changed the title Pixelated output Image reconstruction: pixelated output Jan 8, 2024
@coolbunnyx coolbunnyx changed the title Image reconstruction: pixelated output Pixelated image reconstruction Jan 8, 2024
@BenicioEnriquez
Copy link

@coolbunnyx is there any chance you could share the script you used to train this?

@syyxsxx
Copy link

syyxsxx commented Jan 22, 2024

meeting the same problem,Have you solved this problem?
@coolbunnyx

@coolbunnyx
Copy link
Author

meeting the same problem,Have you solved this problem? @coolbunnyx

I've given it up; not sure if the issue is the code or just me lacking the computing resources to make it converge quickly to the right solution. Intuitively, it should converge to something similar to the input image instead of getting pixelated, though I might be wrong.

@Borhanv-nd
Copy link

@lucidrains do you have any comment, I am facing the same issue

@canqin001
Copy link

Trained the model on a set of 10K images (randomly cropped 128 x 128 patches) for 6K iteration with a batch size of 8. The output looks pixelated. Is this what is expected, or the output should somehow look similar to the input? Any feedbacks are appreciated!

2024-01-07_19-45-46

Could you please share your config for training? I just cannot reproduce anything except the black blocks. Many thanks!

@Jason3900
Copy link

Trained the model on a set of 10K images (randomly cropped 128 x 128 patches) for 6K iteration with a batch size of 8. The output looks pixelated. Is this what is expected, or the output should somehow look similar to the input? Any feedbacks are appreciated!
2024-01-07_19-45-46

Could you please share your config for training? I just cannot reproduce anything except the black blocks. Many thanks!

It may work if you turn off the use_gan.

@void-main
Copy link

@lucidrains @Borhanv-nd I'm running into the same situation, do you have any comments on this issue? Do I need to train more steps?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

7 participants