Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

The original capture in the wireframe skeleton seems better than the processed for full body #63

Open
PeterJared opened this issue Feb 6, 2024 · 6 comments

Comments

@PeterJared
Copy link

PeterJared commented Feb 6, 2024

The top body captures are systematically good, always.
The full body captures, after trying many settings seems worse than the original wireframe capture, the black window with a wireframed skeleton that appears on the right. The original capture seems to stick very well to the floor when the processed one tilts, it is less steady and the feet keep less his place on the floor.
Please, check the example:
https://drive.google.com/file/d/1182AHu8aSup_Sj4ybFBHSniuXQu6k5mp/view?usp=drive_link

@PeterJared PeterJared changed the title The original capture in the wireframe seems better than the processed for full body The original capture in the wireframe skeleton seems better than the processed for full body Feb 6, 2024
@ButzYung
Copy link
Owner

ButzYung commented Feb 6, 2024

You link doesn't seem to be public.

@PeterJared
Copy link
Author

Sorry, I changed the rights of the link
Let me know if any problem
https://drive.google.com/file/d/1182AHu8aSup_Sj4ybFBHSniuXQu6k5mp/view?usp=sharing

@ButzYung
Copy link
Owner

ButzYung commented Feb 6, 2024

This looks fairly fine to me. The legs may be a bit too close together occasionally, but that's an issue of the default model itself as the resting poses of the legs of the default model are not totally straight and are bending a bit inward. If you use another model with straight legs the problem will be gone. Also it seems your webcam is placed at a relatively high position pointing slightly downward? This may explain the tilt issue, and the nature of the 3D perspective camera may also cause some visual difference from the 2D wireframe display.

@PeterJared
Copy link
Author

PeterJared commented Feb 6, 2024

My point is that the original capture from MediaPipe, which appears in the video, seems better. I guess there is a significant problem with calculating the pelvis position, but the feet do not drift in the original capture displayed by the software. The upper body has very good accuracy. I really like the app and am happy with the performance of the upper body alone, without any extras. I was wondering about the difference in precision, as it results in sliding feet in the animations.

@ButzYung
Copy link
Owner

ButzYung commented Feb 7, 2024

The translation of MediaPipe mocap data to actual joint rotations on avatar model is a complicated process, especially when you have to take various differences between the source and avatar model such as body proportion into account. It's difficult to make them look exactly the same. Besides, the wireframe display is 2D. Even when things look stable in 2D doesn't mean there isn't any fluctuation in the third dimension. That's why the actual 3D view of the data doesn't look as stable as the 2D wireframe.

@PeterJared
Copy link
Author

Thanks a lot to developer of this software, I think in overall is really good.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants