Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Different evaluation results #26

Open
yigepingzi opened this issue Mar 24, 2022 · 0 comments
Open

Different evaluation results #26

yigepingzi opened this issue Mar 24, 2022 · 0 comments

Comments

@yigepingzi
Copy link

Thank you for sharing the code and model.

I used the pre-trained model to generate the predicted camera trans_mat.
Then I used the SDF_DISN model to generate objects in the chair category.
I evaluated cd , emd and iou using the given code
I got 'avg_cf:9.560469307306612, avg_emd:2.9551014315527326 iou_avg: 0.5158811568751639'
Which is worse than the value reported in the paper. ''7.71, 2.67,54.3''
After I ran the clean small parts code, I test again
'cat_id:03001627, avg_cf:17.86277202301404, avg_emd:3.270745912187432
cat_id: 03001627, iou_avg: 0.5100998931483642'
However, the result was worse than the previous without clean small parts.

Am I doing anything wrong? How to get the value reported in the paper.
Could anyone help me? Thanks a lot.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant