runtime error

Exit code: 1. Reason: config.json: 0%| | 0.00/662 [00:00<?, ?B/s] config.json: 100%|██████████| 662/662 [00:00<00:00, 2.87MB/s] model.safetensors: 0%| | 0.00/3.67G [00:00<?, ?B/s] model.safetensors: 1%| | 31.5M/3.67G [00:01<02:38, 23.0MB/s] model.safetensors: 13%|█▎ | 472M/3.67G [00:02<00:13, 231MB/s]  model.safetensors: 27%|██▋ | 1.01G/3.67G [00:03<00:07, 357MB/s] model.safetensors: 39%|███▉ | 1.44G/3.67G [00:04<00:05, 384MB/s] model.safetensors: 53%|█████▎ | 1.94G/3.67G [00:05<00:04, 408MB/s] model.safetensors: 69%|██████▉ | 2.55G/3.67G [00:06<00:02, 468MB/s] model.safetensors: 86%|████████▌ | 3.16G/3.67G [00:07<00:01, 507MB/s] model.safetensors: 100%|█████████▉| 3.67G/3.67G [00:08<00:00, 448MB/s] generation_config.json: 0%| | 0.00/121 [00:00<?, ?B/s] generation_config.json: 100%|██████████| 121/121 [00:00<00:00, 935kB/s] Traceback (most recent call last): File "/home/user/app/app.py", line 18, in <module> model = PeftModel.from_pretrained(model, adapter_path) File "/usr/local/lib/python3.10/site-packages/peft/peft_model.py", line 541, in from_pretrained load_result = model.load_adapter( File "/usr/local/lib/python3.10/site-packages/peft/peft_model.py", line 1330, in load_adapter dispatch_model( File "/usr/local/lib/python3.10/site-packages/accelerate/big_modeling.py", line 383, in dispatch_model raise ValueError( ValueError: We need an `offload_dir` to dispatch this model according to this `device_map`, the following submodules need to be offloaded: base_model.model.model.layers.18, base_model.model.model.layers.19, base_model.model.model.layers.20, base_model.model.model.layers.21, base_model.model.model.layers.22, base_model.model.model.layers.23, base_model.model.model.norm, base_model.model.model.rotary_emb, base_model.model.lm_head.

Container logs:

Fetching error logs...