Spaces:

ophycare
/

ophycare-ai

Paused

safihaider commited on Nov 22, 2023

Commit

b50d476

•

1 Parent(s): a82338b

update

Files changed (1) hide show

ChatService.py CHANGED Viewed

@@ -23,7 +23,7 @@ class ChatService:
         pipeline = transformers.pipeline(
             task="text-generation",
             model=model_name,
-            torch_dtype=torch.bfloat16,
             device_map="auto",
         )

         pipeline = transformers.pipeline(
             task="text-generation",
             model=model_name,
+            torch_dtype=torch.float16,
             device_map="auto",
         )