Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Optim-wip: Add the CLIP ResNet 50x4 model #927

Open
wants to merge 4 commits into
base: optim-wip
Choose a base branch
from

Conversation

ProGamerGov
Copy link
Contributor

@ProGamerGov ProGamerGov commented Apr 26, 2022

  • Added the CLIP ResNet 50x4 model used in the 'Multimodal Neurons in Artificial Neural Networks' research paper: https://distill.pub/2021/multimodal-neurons/
  • To make it easier to conduct research, the CLIP ResNet 50x4 model is divided into two parts; the image model and the text model.

I have a couple tutorials ready that use this model. I also have another PR ready that implements the tokenizer for the text model, using torchtext's CLIPTokenizer.

@ProGamerGov
Copy link
Contributor Author

The CLIP PRs are: #927, #943, #945, #961, #965, #966, #968

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

2 participants