You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Currently, the generalization is measured using the distance between true and reconstructed unseen particles, and specificity is measured using the distance between sampled particles and closest real particles.
The problem with this is it is dependent on the accuracy of correspondence. When the SSM has miscorrespondences they may be incorrectly captured in PCA as variations that are actually present in the training data. This can lead to a model that, when generating new samples, produces shapes that are closer to these "noisy" versions of the training shapes, yielding good specificity when the sampled shapes do not actually resemble the shape population.
To remedy this, generalization and specificity should not be quantified as distance between particles, but rather as distance between particles and the ground truth shape/surface. Meaning generalization is the distance between reconstructed particles and the true shape surface and specificity is the distance between sampled particles and the surface. This would provide more consistent metrics.
The text was updated successfully, but these errors were encountered:
Currently, the generalization is measured using the distance between true and reconstructed unseen particles, and specificity is measured using the distance between sampled particles and closest real particles.
The problem with this is it is dependent on the accuracy of correspondence. When the SSM has miscorrespondences they may be incorrectly captured in PCA as variations that are actually present in the training data. This can lead to a model that, when generating new samples, produces shapes that are closer to these "noisy" versions of the training shapes, yielding good specificity when the sampled shapes do not actually resemble the shape population.
To remedy this, generalization and specificity should not be quantified as distance between particles, but rather as distance between particles and the ground truth shape/surface. Meaning generalization is the distance between reconstructed particles and the true shape surface and specificity is the distance between sampled particles and the surface. This would provide more consistent metrics.
The text was updated successfully, but these errors were encountered: