Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Accelerate AKAZE with WebGPU #14

Open
vadixidav opened this issue Aug 1, 2020 · 2 comments
Open

Accelerate AKAZE with WebGPU #14

vadixidav opened this issue Aug 1, 2020 · 2 comments

Comments

@vadixidav
Copy link
Member

vadixidav commented Aug 1, 2020

AKAZE can be sped up in several places with GPU routines. Support should be added using WebGPU to get the highest level of cross-platform support for compute acceleration. The three parts that are important is the diffusion step, gradient computation, and feature extraction. Currently, the first two of these are done with ndarray, but GPU should be optionally supported. This will be gated behind an optional feature, but it should be capable of falling back to the CPU implementation if GPUs are not available for compute. At this time, it is not necessary to tell AKAZE which GPU device to use to perform the compute.

@AdrianEddy
Copy link

Would it be possible to implement more algorithms in GPU using something like emu or wgpu-rs so it works cross-platform?

@vadixidav
Copy link
Member Author

Would it be possible to implement more algorithms in GPU using something like emu or wgpu-rs so it works cross-platform?

Of course. In case it wasn't clear, WebGPU is wgpu. AKAZE will be the first algorithm converted to GPU because that is required to get >5 FPS visual SLAM. However, I would love it if everything in cv-sfm could eventually be ran on the GPU without any CPU routines bottlenecking the process. Also, image processing routines all running GPU side would be excellent as well. However, it will take some time, and this issue is just to solve a small piece of that GPU optimization.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants