runtime error
Exit code: 1. Reason: The installed version of bitsandbytes was compiled without GPU support. 8-bit optimizers, 8-bit multiplication, and GPU quantization are unavailable. config.json: 0%| | 0.00/510 [00:00<?, ?B/s][A config.json: 100%|██████████| 510/510 [00:00<00:00, 2.91MB/s] Traceback (most recent call last): File "/home/user/app/app.py", line 44, in <module> transformer_8bit = HunyuanVideoTransformer3DModel.from_pretrained( File "/usr/local/lib/python3.10/site-packages/huggingface_hub/utils/_validators.py", line 114, in _inner_fn return fn(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/diffusers/models/modeling_utils.py", line 726, in from_pretrained hf_quantizer.validate_environment(torch_dtype=torch_dtype, from_flax=from_flax, device_map=device_map) File "/usr/local/lib/python3.10/site-packages/diffusers/quantizers/bitsandbytes/bnb_quantizer.py", line 348, in validate_environment raise RuntimeError("No GPU found. A GPU is needed for quantization.") RuntimeError: No GPU found. A GPU is needed for quantization.
Container logs:
Fetching error logs...