Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

What are best practises to use equirectangular image frames from a 360 video as input? #2529

Open
Bardo-Konrad opened this issue Apr 20, 2024 · 5 comments

Comments

@Bardo-Konrad
Copy link

Bardo-Konrad commented Apr 20, 2024

My approach

Use aliceVision_split360Images.exe --splitMode equirectangular --equirectangularNbSplits 8 --equirectangularSplitResolution 768 --fov 90.0

Result is random. Some datasets are found using exhaustive matching, many others are not.

Using it in meshroom works for some reason, but meshroom does not export to colmap for further processing.

What are best practises to use equirectangular image frames from a 360 video as input to get good feature matching?

@lambdald
Copy link

lambdald commented Apr 22, 2024

I have implemented panoramic camera sfm in colmap,https://github.com/lambdald/colmap which may be helpful to you

@json87
Copy link
Contributor

json87 commented Apr 27, 2024

My approach

Use aliceVision_split360Images.exe --splitMode equirectangular --equirectangularNbSplits 8 --equirectangularSplitResolution 768 --fov 90.0

Result is random. Some datasets are found using exhaustive matching, many others are not.

Using it in meshroom works for some reason, but meshroom does not export to colmap for further processing.

What are best practises to use equirectangular image frames from a 360 video as input to get good feature matching?

You can try our repo https://github.com/json87/SphereSfM

@ErfolgreichCharismatisch
Copy link

ErfolgreichCharismatisch commented Apr 27, 2024

@json87 Your repo creates files gaussian splatting cannot handle as it doesn't have the appropriate lens.

@json87
Copy link
Contributor

json87 commented Apr 27, 2024

@json87 Your repo creates files gaussian splatting cannot handle as it doesn't have the appropriate lens.

I think you should modify the code of GS to support spherical images.

@ErfolgreichCharismatisch

@json87 Your repo creates files gaussian splatting cannot handle as it doesn't have the appropriate lens.

I think you should modify the code of GS to support spherical images.

Feel free to fork it.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

4 participants