Spaces:
Running
on
Zero
Running
on
Zero
Error when running on A100
#4
by
PulpMud
- opened
I get an out of memory error when running it on an A100. How much VRAM is required to run the space?
This demo is running on the A100, I cannot see the specific model of this A100 here, but it should be the A100-80G. If you are using the A100-80G, you should not encounter memory-related errors. However, if you are using the A100-40G, you might need some optimization strategies, such as offloading. Please refer to this doc for more details.
I was indeed running it on A100-40G.
Thanks for your quick reply and also for your work.