Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

oom problem during train #191

Open
hanjoonwon opened this issue Mar 18, 2024 · 0 comments
Open

oom problem during train #191

hanjoonwon opened this issue Mar 18, 2024 · 0 comments

Comments

@hanjoonwon
Copy link

hanjoonwon commented Mar 18, 2024

my gpu is gv100 with 12gb vram

and my config is
parent: projects/neuralangelo/configs/base.yaml
data:
readjust:
center:
- 0.0
- 0.0
- 0.0
scale: 1.0
root: /home/xiangyue/joonwon/neuralangelo/data/owl/
train:
image_size:
- 800
- 600
type: projects.neuralangelo.data
val:
image_size:
- 401
- 300
model:
appear_embed:
enabled: false
object:
sdf:
encoding:
dict_size: 19
dim: 4
coarse2fine:
init_active_level: 4
mlp:
inside_out: false

but occur oom problem
how can i solve it??
I tried reducing the train image size and also tried dict-size to 17.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant