Implementing the Vision Transformer paper from scratch for course project.
Forked From https://github.com/junawaneshivani/VisionTransformer
https://docs.google.com/presentation/d/1RsRGqMjHmnO_fLm3aUj6h0z6HxdyEqkTHxQ6k8ijVi8/edit?usp=sharing
- Reference Paper: https://arxiv.org/abs/2010.11929
- Attention Mechanism: https://towardsdatascience.com/all-you-need-to-know-about-attention-and-transformers-in-depth-understanding-part-1-552f0b41d021#8607
- Auxiliary Presentation: https://tugot17.github.io/Vision-Transformer-Presentation/#/1
- Auxiliary Presentation 2: https://theaisummer.com/vision-transformer/
- Auxiliary Presentation 3: https://medium.com/machine-intelligence-and-deep-learning-lab/vit-vision-transformer-cc56c8071a20