You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
E.g. The shape of key backbone.stages.0.blocks.0.attn.w_msa.relative_position_index is 36x36, not 49x49.
Environment
None.
Other information
No response
The text was updated successfully, but these errors were encountered:
SheffieldCao
changed the title
[Doc] SimMIM pretrained weights DO NOT MATCH the descriptions
[Bug] SimMIM pretrained weights DO NOT MATCH the descriptions
Jan 19, 2024
Branch
main branch (mmpretrain version)
Describe the bug
The pretrained model
swin-base-w7_simmim-100e-pre_8xb256-coslr-100e_in1k
andswin-large-w14_simmim-800e-pre_8xb256-coslr-100e_in1k
are actually withwindow size = 6
andwindow size = 12
respectively. This is misleading.E.g. The shape of key
backbone.stages.0.blocks.0.attn.w_msa.relative_position_index
is36x36
, not49x49
.Environment
None.
Other information
No response
The text was updated successfully, but these errors were encountered: