Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Zero-Shot Image Restoration model for final denoising steps in Image Generation task? #49

Open
5thGenDev opened this issue Jul 17, 2023 · 3 comments

Comments

@5thGenDev
Copy link

5thGenDev commented Jul 17, 2023

Let's say an Image Generation model is meant to generate image from random noise in 50 steps:

  1. What if I use Image Generation model for the initial 20 steps to generate a half-way noisy image.
  2. Input that noisy image into a Zero-Shot Image Restoration model to generate a clean image.

Has anyone tried this approach? Does it have any advantage in classical image generation quality, few-shot image generation?

@wyhuai
Copy link
Owner

wyhuai commented Jul 17, 2023

I haven't tried it, but I think this probably won't produce better quality than the default method.

@5thGenDev
Copy link
Author

fair enough, this will be the topic for my thesis then :P

@wyhuai
Copy link
Owner

wyhuai commented Jul 17, 2023

Good luck and hope you can find a way to make it work!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants