Unable to load the model

by jk12p - opened 11 days ago

11 days ago

Hey I am unable to load the model I tried using the kaggle t4 X 2 gpu and also kaggle p100 gpu but none of them are working from last one day I am even unable to load the model the config files are not loading but the safetoners are getting downloaded

rom7

8 days ago

@jk12p What is the code that you are using to load the model? Can you please share?
Also, the model would require ~50GB GPU VRAM to load in bf16. t4x2 would not have that much VRAM.

Upload images, audio, and videos by dragging in the text input, pasting, or clicking here.

Tap or paste here to upload images

· Sign up or log in to comment