How to achieve it under 8G VRAM?

[theoldsong]

I have seen that many people have implemented this program under 8G VRAM, and the speed is still fast. The author does not provide a similar implementation method. How can I do it?

[theoldsong]

I see someone using the CPU uninstallation method to implement, how do you operate, thank you

[yueool]

reference:
https://www.bilibili.com/video/BV1by411h7Vg/?vd_source=a25b27836b1cea089a7471b5f6f899cd at 42s

edit gradio_demo/app.py
add code after line 130 (130 : pipe.unet_encoder.to(device))

pipe.enable_sequential_cpu_offload()

only need 8G

[cardosofelipe]

reference: https://www.bilibili.com/video/BV1by411h7Vg/?vd_source=a25b27836b1cea089a7471b5f6f899cd at 42s

edit gradio_demo/app.py add code after line 130 (130 : pipe.unet_encoder.to(device))

pipe.enable_sequential_cpu_offload()

only need 8G

Can you post the code here? That site only allows high resolution via registration...