Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

FileNotFoundError: [Errno 2] No such file or directory: '/home/chen/datasets/HO3D_v2/modelsprocess' #14

Open
MengHao666 opened this issue Oct 7, 2020 · 3 comments

Comments

@MengHao666
Copy link

Hi, thanks for update on ho3d_v2, I have 2 questions here:

  1. When I run python evalho3dv2.py --resume releasemodels/ho3dv2/realonly/checkpoint_200.pth --val_split test --json_folder jsonres/res, I got error below.It seems object models are neeeded.So could u share them?
    Traceback (most recent call last): File "evalho3dv2.py", line 156, in <module> main(args) File "evalho3dv2.py", line 56, in main has_dist2strong=True, File "/home/chen/PycharmProjects/handobjectconsist/meshreg/netscripts/get_dataset.py", line 41, in get_dataset full_sequences=False, File "/home/chen/PycharmProjects/handobjectconsist/meshreg/datasets/ho3dv2.py", line 260, in __init__ self.obj_meshes = ho3dfullutils.load_objects(os.path.join(self.root, "modelsprocess")) File "/home/chen/PycharmProjects/handobjectconsist/meshreg/datasets/ho3dfullutils.py", line 8, in load_objects object_names = [obj_name for obj_name in os.listdir(obj_root) if ".tgz" not in obj_name] FileNotFoundError: [Errno 2] No such file or directory: '/home/chen/datasets/HO3D_v2/modelsprocess'
  2. I got confuesd about that you could generate results to Codalab Competion ,as your method depicted in CVPR2020 paper couldn't handle unseen object in official evaluation set. And I remember u once upload one better result to Codalab Competition using method mentioned in your CVPR2019 paper.Could u spare some time to explain it?

Merci beaucoup!

@hassony2
Copy link
Owner

Dear @MengHao666,

Thank you for your interest in our work :)

  1. for this I used meshlab and the Quadric Edge Collapse Decimation (with texture) filter to downsample the HO3D models to reach ~2000 faces, however, I am not sure about copyright issues regarding making available the downsampled YCB models.
  2. Yes, I understand how you could easily get confused with this !
    You can find some more information about the extension of the CVPR19 work which allowed me to produce results in world coordinates here

Let me know if this helps !

@MengHao666
Copy link
Author

Hi,hassony.
Thanks for reply. I get more confused after reading your reply.These are 3 questions:

  1. As I can see from Codalab Not aligned result, you report the evaluation result on the offical evaluation set of HO3D_v2 in the following chart. So what is the method of this relsut? The method of your CVPR 2020 or CVPR2019 paper?
1 Sguha 122 06/27/20 2.38 (1) 0.580 (3) 2.30 (1) 0.565 (1) 0.268 (2) 0.781 (1) View
2 jameel 25 10/01/20 2.46 (2) 0.631 (1) 2.70 (2) 0.544 (2) 0.284 (1) 0.760 (2) View
3 hpoes 73 10/22/20 3.13 (3) 0.587 (2) 57.12 (10) 0.000 (9) 0.000 (9) 0.000 (9) View
4 zly123 15 10/03/20 3.58 (4) 0.379 (4) 3.59 (3) 0.379 (4) 0.191 (3) 0.643 (3) View
5 haomeng 293 10/02/20 3.63 (5) 0.370 (6) 3.64 (4) 0.370 (5) 0.186 (5) 0.631 (4) View
6 Harken 10 09/06/20 4.49 (6) 0.374 (5) 4.36 (5) 0.381 (3) 0.187 (4) 0.588 (5) View
7 Moyingxu 10 10/04/20 4.88 (7) 0.266 (8) 57.12 (10) 0.000 (9) 0.000 (9) 0.000 (9) View
8 yhasson 18 09/14/20 5.52 (8) 0.202 (9) 5.51 (6) 0.202 (7) 0.106 (7) 0.404 (7) View

2.As I can see from HO3D Challenge Benchmark , u ever submitted a better result ,and sure, the following chart show the aligned result.And the question comes again:What is the method of this relsut? The method of your CVPR 2020 or CVPR2019 paper?

Method Mesh Error (cm) (procrustes alignement) F@5mm F@15mm Joint error (cm)
[1] 1.06 0.51 0.94 3.04
[2] 1.10 0.46 0.93 3.18

[1] Hampali et al. HOnnotate: A method for 3D Annotation of Hand and Object Poses. CVPR'20

[2] Hasson et al. Learning Joint Reconstruction of Hands and Manipulated Objects. CVPR'19

3.Could u share the plot data of Figure 5, just for the fair comparison?

Hope you could be generous to spare time to reply!
Merci beaucoup! Bonne journee!

@fuqichen1998
Copy link

I have the same question. @hassony2 Can you please directly share the ho3d results submitted to the official evaluation? Meanwhile, can you please specify which alignment you used for the metrics reported in your paper (PROCRUSTES ALIGNED or SCALE-TRANSLATION ALIGNED)?

Looking forward to your reply!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

3 participants