How to generate visualization mesh real time

[kai-lan]

Is there a way to generate body mesh based on model output at real-time? Isn't the model output compatible with SMPL paramters and we just need a formula like Vertices_new = Vertices_template + shape_param * beta + pose_param * pose because we have the pose? Why do we need python -m visualize.render_mesh, which seems to construct mesh from the output .mp4 video, and would take quite a few minutes?

Maybe somewhere I understood wrong?

[GuyTevet]

The SMPL mesh is currently constructed from the HumanML pose locations according to https://github.com/EricGuo5513/HumanML3D , hence there is a SMPLlify optimization in the loop that is not real-time. It should be possible to extract SMPL from the HumanML rotations (with some tweaks since they don't have the same rest pose), this should make the mesh visualization run in real-time.