New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

The parameters of BIKE are smaller than the original CLIP ViT-L/14 is that in the BIKE model. #4

Open

leexinhao opened this issue Jun 29, 2023 · 0 comments

leexinhao commented Jun 29, 2023

          The reason why the parameters of BIKE are smaller than the original CLIP ViT-L/14 is that in the BIKE model, we only utilize the vision encoder from CLIP and do not include the parameters of CLIP's text encoder.

Originally posted by @whwu95 in #3 (comment)

In fact, the parameters of visual encoder is 303M for ViT-L/16, which excludes text encoder.

The text was updated successfully, but these errors were encountered:

leexinhao changed the title The reason why the parameters of BIKE are smaller than the original CLIP ViT-L/14 is that in the BIKE model, we only utilize the vision encoder from CLIP and do not include the parameters of CLIP's text encoder. The parameters of BIKE are smaller than the original CLIP ViT-L/14 is that in the BIKE model.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment