Spaces:

artemisiaai
/

STC-demo-v2_dev

Runtime error

fCola commited on May 21

Commit

4cc4fb0

verified ·

1 Parent(s): 594ef46

Update app.py

Files changed (1) hide show

app.py CHANGED Viewed

@@ -18,7 +18,7 @@ class HfModelWrapper:
     ):
         self.model = AutoModelForCausalLM.from_pretrained(
-            model_path, device_map="auto", quantization_config=quantization
         )
         self.tokenizer = AutoTokenizer.from_pretrained(model_path)
         self.sys_prompt = sys_prompt

     ):
         self.model = AutoModelForCausalLM.from_pretrained(
+            model_path, device_map="auto"
         )
         self.tokenizer = AutoTokenizer.from_pretrained(model_path)
         self.sys_prompt = sys_prompt