New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

heatmap generation #163

Open

thanisornsr opened this issue Mar 18, 2021 · 1 comment

thanisornsr commented Mar 18, 2021

Hi,

I am confusing about heatmap generation.

From COCO dataset, the valid of joint are 0 for not in the image, 1 for in the image but not visible, and 2 for in the image and visible. How do you encode this into heatmap? If valid is 0, it will be zero matrix? if it's 1 or 2, it will be heatmap with 1 peak? Am I right?
The loss function when training, It's MSE between predicted heatmaps and targeted heatmaps according to the paper. Do I have to multiply with valid? or it's not needed?

All the best,
Than

tucachmo2202 commented Jun 9, 2021

From COCO dataset, the valid of joint are 0 for not in the image, 1 for in the image but not visible, and 2 for in the image and visible. How do you encode this into heatmap? If valid is 0, it will be zero matrix? if it's 1 or 2, it will be heatmap with 1 peak? Am I right?

Hi, They use 2D Gaussian centered to generate heatmap.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment