Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

How can I prepare folder "human_model_files" #9

Closed
eeyrw opened this issue Apr 9, 2023 · 7 comments
Closed

How can I prepare folder "human_model_files" #9

eeyrw opened this issue Apr 9, 2023 · 7 comments

Comments

@eeyrw
Copy link

eeyrw commented Apr 9, 2023

I am a newbie of pose estimation and want to leverage the OSX to extract 3d mesh body model and try to inference with the code. I have signed up a lot of account of xxx.is.tue.mpg.de and download a lot of models but turn out still not enough to preparing the folder according readme. Here are downloaded files:
image
Current match:
image
Any tips of that?

@linjing7
Copy link
Collaborator

linjing7 commented Apr 9, 2023

@eeyrw Hi, you can download the model files by:

  1. smpl: SMPL_NEUTRAL.pkl, SMPL_MALE.pkl and SMPL_FEMALE.pkl. You need to rename basicModel_f_lbs_10_207_0_v1.0.0.pkl and basicModel_m_lbs_10_207_0_v1.0.0.pkl to SMPL_FEMALE.pkl and SMPL_MALE.pkl.
  2. smplx: MANO_SMPLX_vertex_ids.pkl and SMPL-X__FLAME_vertex_ids.npy, SMPLX_NEUTRAL.pkl, SMPLX_NEUTRAL.npz, SMPLX_MALE.npz, SMPLX_FEMALE.npz, SMPLX_to_J14.pkl.
  3. mano: here
  4. flame: flame_dynamic_embedding.npy and flame_static_embedding.pkl, FLAME_NEUTRAL.pkl. You need to rename generic_model.pkl to FLAME_NEUTRAL.pkl.

@eeyrw
Copy link
Author

eeyrw commented Apr 9, 2023

Thank for your tips and I finally collected complete files.
But the demo.py still need more..?

  File "E:\OSX\main\demo.py", line 37, in <module>
    from OSX import get_model
  File "E:\OSX\main\..\main\OSX.py", line 4, in <module>
    from nets.module import PositionNet, HandRotationNet, FaceRegressor, BoxNet, BoxSizeNet, HandRoI, FaceRoI, BodyRotationNet
  File "E:\OSX\main\..\common\nets\module.py", line 6, in <module>
    from utils.human_models import smpl_x
  File "E:\OSX\main\..\common\utils\human_models.py", line 176, in <module>
    smpl = SMPL()
  File "E:\OSX\main\..\common\utils\human_models.py", line 156, in __init__
    self.layer = {'neutral': smplx.create(cfg.human_model_path, 'smpl', gender='NEUTRAL', **self.layer_arg), 'male': smplx.create(cfg.human_model_path, 'smpl', gender='MALE', **self.layer_arg), 'female': smplx.create(cfg.human_model_path, 'smpl', gender='FEMALE', **self.layer_arg)}
  File "E:\OSX\main\..\common\utils\smplx\smplx\body_models.py", line 2321, in create
    return SMPL(model_path, **kwargs)
  File "E:\OSX\main\..\common\utils\smplx\smplx\body_models.py", line 130, in __init__
    assert osp.exists(smpl_path), 'Path {} does not exist!'.format(
AssertionError: Path E:\OSX\main\..\common\utils\human_model_files\smpl\SMPL_MALE.pkl does not exist!

The code seems a tendency to ensure that all gender models are existing...

@linjing7
Copy link
Collaborator

linjing7 commented Apr 9, 2023

Hi, I'm sorry that I miss SMPL_FEMALE.pkl and SMPL_MALE.pkl. Please download them from here and renamebasicModel_f_lbs_10_207_0_v1.0.0.pkl and basicModel_m_lbs_10_207_0_v1.0.0.pkl to SMPL_FEMALE.pkl and SMPL_MALE.pkl.

@eeyrw
Copy link
Author

eeyrw commented Apr 9, 2023

It works now. SMPL things are really complicated. It seems that the body mesh output is neutral. Can I specific male or female output?

@linjing7 linjing7 closed this as completed Apr 9, 2023
@linjing7 linjing7 reopened this Apr 9, 2023
@linjing7
Copy link
Collaborator

linjing7 commented Apr 9, 2023

Hi, you can modify neutral in this line into male or female.

@eeyrw
Copy link
Author

eeyrw commented Apr 9, 2023

I see. Thank you.

@eeyrw eeyrw closed this as completed Apr 9, 2023
@walterhuang23
Copy link
Contributor

@eeyrw Hi, you can download the model files by:

  1. smpl: SMPL_NEUTRAL.pkl, SMPL_MALE.pkl and SMPL_FEMALE.pkl. You need to rename basicModel_f_lbs_10_207_0_v1.0.0.pkl and basicModel_m_lbs_10_207_0_v1.0.0.pkl to SMPL_FEMALE.pkl and SMPL_MALE.pkl.
  2. smplx: MANO_SMPLX_vertex_ids.pkl and SMPL-X__FLAME_vertex_ids.npy, SMPLX_NEUTRAL.pkl, SMPLX_NEUTRAL.npz, SMPLX_MALE.npz, SMPLX_FEMALE.npz, SMPLX_to_J14.pkl.
  3. mano: here
  4. flame: flame_dynamic_embedding.npy and flame_static_embedding.pkl, FLAME_NEUTRAL.pkl. You need to rename generic_model.pkl to FLAME_NEUTRAL.pkl.

While following the steps to prepare the “human_model_files”, I encountered a similar problem on mano downloading as mentioned in this [issue](hassony2/manopth#5 (comment)).

I attempted to download the file using:

wget --no-check-certificate https://psfiles.is.tuebingen.mpg.de/downloads/mano/mano_v1_2-zip

However, the result was a “Download denied” HTML file, which is the same as when I tried accessing the link through the Chrome browser. It seems to require login credentials.

I tried various URLs, such as https://psfiles.is.tuebingen.mpg.de, https://is.tuebingen.mpg.de, and others, but I was unable to find the correct download link. It appears that *is.tuebingen* is not the right way to locate the file.

After several muddling attempts, I discovered that the correct approach is to log in to the site https://mano.is.tue.mpg.de/download.php and click on Models & Code. This will eventually lead to the target download link: https://psfiles.is.tuebingen.mpg.de/downloads/mano/mano_v1_2-zip.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

3 participants