Spaces:

fffiloni
/

Sa2VA-simple-demo

Running on Zero

fffiloni commited on Jan 10

Commit

893825d

verified ·

1 Parent(s): 86023a7

keep device tight to cuda:0

Files changed (1) hide show

app.py CHANGED Viewed

@@ -19,7 +19,7 @@ model_path = "ByteDance/Sa2VA-4B"
 model = AutoModelForCausalLM.from_pretrained(
     model_path,
     torch_dtype="auto",
-    device_map="auto",
     trust_remote_code=True,
 ).eval().cuda()

 model = AutoModelForCausalLM.from_pretrained(
     model_path,
     torch_dtype="auto",
+    device_map="cuda:0",
     trust_remote_code=True,
 ).eval().cuda()