Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Evalation metrics for scalars and shape+scalar #2218

Closed
nawazishkhan1-nk opened this issue Mar 19, 2024 · 2 comments
Closed

Evalation metrics for scalars and shape+scalar #2218

nawazishkhan1-nk opened this issue Mar 19, 2024 · 2 comments

Comments

@nawazishkhan1-nk
Copy link
Contributor

Feature Summary

  • Add a feature to visualize reconstruction errors on the feature scalar value computed between the feature predicted from the shape model and the original feature value. This would allow users to assess the impact of using "features" during optimization and tune the feature weight accordingly.
  • Similarly, add quantitative evaluation metrics (compactness, generalization, specificity) on the feature space and shape + feature space.
@akenmorris
Copy link
Contributor

@jadie1 , Please add python implementation. Thanks!

@jadie1
Copy link
Contributor

jadie1 commented Mar 26, 2024

Here is the equation for chamfer distance between two point clouds S1 and S2:
image
It is the L2 distance between each point and its nearest neighbor in the other point cloud, so the main functionality you need nearest neighbors.
I've been using this PyTorch implementation: https://pytorch3d.readthedocs.io/en/latest/modules/loss.html
There are some other repos that implement the functionality in C++ and adapt it for pytorch, for example: https://github.com/otaheri/chamfer_distance

akenmorris added a commit that referenced this issue Mar 27, 2024
…redicted scalar on all samples as well as the diff to predicted.
akenmorris added a commit that referenced this issue Mar 28, 2024
@akenmorris akenmorris changed the title Evaulation metrics for feature scalar (if used in optimization) Evalation metrics for scalars and shape+scalar May 5, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
ShapeWorks
  
Awaiting triage
Development

No branches or pull requests

3 participants