Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

How did you weight the KL divergence term and the frequency loss term in the VAE training? #17

Open
wubowen416 opened this issue Feb 21, 2024 · 0 comments

Comments

@wubowen416
Copy link

Hi, thank you for providing the code. It was really helpful.

One thing I am curious about is that when training VAE, unlike VanillaAE, the KL loss weight can affect the recontruction quality.
Adding focal frequency loss without changing the weight for KL loss will casue the recontruction loss to be weighted more, so that it is trivially able to reconstruct more details.

Can you share about how did you weight these terms? I did not find this description in the paper.

Thanks in advance!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant