Spaces:

MawaredHR
/

mawared-Cohere

Sleeping

Daemontatox commited on Jan 18

Commit

0ed0b94

verified ·

1 Parent(s): 1a4274f

Update app.py

Files changed (1) hide show

app.py CHANGED Viewed

@@ -233,7 +233,7 @@ def initialize_model():
         torch_dtype=torch.float16,
         device_map="cuda",
         attn_implementation="flash_attention_2",
-        quantization_config=quantization_config
     )

         torch_dtype=torch.float16,
         device_map="cuda",
         attn_implementation="flash_attention_2",
+        #quantization_config=quantization_config
     )