Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

3d mesh reconstruction of a bike is very bad compared to an airplane #97

Open
monacv opened this issue Mar 19, 2021 · 5 comments
Open

Comments

@monacv
Copy link

monacv commented Mar 19, 2021

Thanks a lot for open-sourcing your source code.

When I tried your demo code on an image of a bike, the results were not good at all compared to when tried on image of an airplane.

Do you have any suggestions for improvement?
Screenshot from 2021-03-18 21-01-18

Screenshot from 2021-03-18 21-04-03

However for airplane I have these
Screenshot from 2021-03-18 20-45-50
plane

@MrMois
Copy link

MrMois commented Mar 19, 2021

There are two things you could try:

  1. Train on a dataset specific for bike models. ShapeNet contains significanty more plane models (4045) than bike models (59): https://shapenet.org/taxonomy-viewer
  2. Crop the image, so that just the bike is in focus. Compared to the plane image, there is quite alot of other stuff in the image like people and houses. There might also be a network available for this.

@monacv
Copy link
Author

monacv commented Mar 19, 2021

@MrMois thanks a lot for your feedback.

So I downloaded this bike image which is transparent and only contains one bike and still the image is terribly rendered.

Do you know which dataset would have 3D bikes that would be similar in features to ShapeNet or could you guide me how to create my own such dataset?

Screenshot from 2021-03-19 16-11-43
bike

@Msj5
Copy link

Msj5 commented Mar 25, 2021

Hi, This model just not very rubust to complex images. You can try it with some sample and smooth image like chair .
crop the image and convert it to .png(alpha = 0) @monacv

@topinfrassi01
Copy link

Since the deformation starts from an ellipsoid, it cannot generalize to meshs that aren't from the same genus, meaning that meshs with holes in it like the bike won't be reconstructed properly.

@harisraharjo
Copy link

To be able to train this model with specific dataset, do I need to prepare an image with multiple views or just one view?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

5 participants