How to Load a Close-set Fine-tuned Grounding Dino into Grounded SAM

[narchitect]

Hello. Following issue #241, I fine-tuned a grounding Dino via mmdetection for a close-set. However, when I try to load these fine-tuned weights into Grounded SAM, it says the model layers are different, and thus, loading fails. I'm curious if there's a way to successfully load a close-set fine-tuned Grounding Dino model into Grounded SAM. It seems it would be highly effective to be able to load the close-set model for downstream tasks. Thanks in advance for your response.

[rcao-hk]

Same issue, look at the network defination is slightly different.