Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

The ap of lvis measured by the public model is inconsistent with the ap in the paper. #115

Open
yaohusama opened this issue Dec 24, 2023 · 1 comment

Comments

@yaohusama
Copy link

When testing the ap of the lvis data set, whether to combine the output of hqsam and the output mask of sam itself to test the ap. Is sam's prediction used to select the box combined with the prediction score on the box? When using vit-det to get the detection frame, is the detection head mask rcnn or cascade rcnn? I use mask rcnn as the detection head, and the ap of hqsam-l is 45.289. The one in the paper is 43.9. Why is my measurement different from the one in the paper?
Thanks.

@ymq2017
Copy link
Collaborator

ymq2017 commented Dec 26, 2023

Hi, we use cascade rcnn with this config.
And for evaluation, we simply use all pred bbox as prompt without combining score or using output mask as another prompt.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants