Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

bni.obj reconstruct failed #33

Open
surheaven opened this issue Mar 15, 2023 · 5 comments
Open

bni.obj reconstruct failed #33

surheaven opened this issue Mar 15, 2023 · 5 comments

Comments

@surheaven
Copy link

image

Can you tell me what caused this to happen? thanks

@surheaven
Copy link
Author

When I use the Perspective Camera, it again causes the following problems
image

@xucao-42
Copy link
Collaborator

From the first image, it looks like the mask is not provided correctly. Would you share the input image and the estimated normal maps?
Also, could you provide more details about how you use a perspective camera? ECON should assume an orthographic camera for the input image.

@surheaven
Copy link
Author

image & normal:
000000
normal
and i use perspective camera to get the depth map:
depth
while the depth in orthographic camera:
depth_orth
I modified it here to get the depth chart:
image

@surheaven
Copy link
Author

And i also use the code from bilateral_normal_integration to get z in perspective camera.
image
But when do np.log() it failed because the depth is -25856.
So can you tell me how to modify in perspective camera? And i find the depth is processed as followed, so how can i process depth in perspective camera? Thanks!
image

@xucao-42
Copy link
Collaborator

If you borrow the code from bilateral_normal_integraion, please ensure you have provided the mask, otherwise the entire image will be integrated (in you case the black backgroud). Also, please check this part for handling persepective normal maps is included in your code.
https://github.com/xucao-42/bilateral_normal_integration/blob/fd853ba2cbb59be6a9e09f9418523a85c7ba4cf0/bilateral_normal_integration_cupy.py#L196

You can try perspective camera, but it should only work well for the front view but not for the back view. I am not so sure what's going to happen for the back view (maybe large distortion).

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants