VRAM?
#11
by
Loyallyon
- opened
How much VRAM do I need?
How much VRAM do I need?
my 5090 with 32gb is not enough without optimizations. it using 31.5gb vram and around 4-5gb RAM. in this case generation take about 3h lol. but with cpu offloading or fp8/quantization i think 20 gb vram should be enough. maybe even less
I am able to make it run on my 3070 with 8 GB VRAM and 64 GB RAM. A bit slow, but works.