Skip to content

PyTorch implementation of 'Swin Transformer' (Liu et al., 2021) from scratch.

Notifications You must be signed in to change notification settings

KimRass/Swin-Transformer

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

6 Commits
 
 
 
 
 
 
 
 

Repository files navigation

Swin Transformer: Hierarchical Vision Transformer using Shifted Windows

To-Dos

  • Patch partition
  • Patch merging
  • Relative position bias
  • Feature map padding
  • Self-attention in non-overlapped windows
  • Shifted Window based Self-Attention

About

PyTorch implementation of 'Swin Transformer' (Liu et al., 2021) from scratch.

Topics

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages