Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

clip模型得到的图像嵌入维度 #52

Open
lwtgithublwt opened this issue May 6, 2024 · 1 comment
Open

clip模型得到的图像嵌入维度 #52

lwtgithublwt opened this issue May 6, 2024 · 1 comment

Comments

@lwtgithublwt
Copy link

作者您好,据我目前所了解,通过clip编码器得到的维度是[1, 512]的,您是如何把他们变为c , h, w的形状,并融入扩散模型?感谢您的回答。

@Algolzw
Copy link
Owner

Algolzw commented May 7, 2024

你好,这里跟stable diffusion一样是用的cross-attention,图像会被reshap成 (b, h*w, c)这样,具体代码可以看这个attention.py

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants