Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Support for unbounded scenes #72

Open
Salarios77 opened this issue Nov 17, 2022 · 1 comment
Open

Support for unbounded scenes #72

Salarios77 opened this issue Nov 17, 2022 · 1 comment
Labels
enhancement New feature or request

Comments

@Salarios77
Copy link

Hi! Is there going to be support for handling unbounded scenes via background models with re-parameterized inputs in the near future? If not, would it be possible for you to provide some tips on how to best implement that?

@orperel
Copy link
Collaborator

orperel commented Dec 4, 2022

Hi @Salarios77 , agreed that would indeed be a useful thing to have.
We should implement that, but until we do, here is a quick workaround for you, which involves extending the current tracer with one that queries some background model:

  1. Add a new forward_bg() function to your neural field (BaseNeuralField subclass). The implementation of this function should accept, i.e., a tensor of rays.

  2. Duplicate PackedRFTracer to create a customized version of your own tracer. You can find it here.

  3. Remove these lines which delete the rays tensor, as you'll need it soon as input.

  4. These lines determine the blending with the background color. Instead of assuming a fixed color (i.e. 1.0 - alpha is assumed to be multiplied with a "white" color here ), query the forward_bg function of your nef instance for a predicted background color.

@orperel orperel added the enhancement New feature or request label Dec 4, 2022
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request
Projects
None yet
Development

No branches or pull requests

2 participants