Spaces:

mohamedrasheqA
/

Deepseek-R1-PF

Runtime error

MRasheq commited on Jan 31

Commit

9ca5fa9

1 Parent(s): 07be9b4

Fourth Commit

Files changed (1) hide show

app.py CHANGED Viewed

@@ -30,7 +30,6 @@ class RAGPipeline:
             "deepseek-ai/DeepSeek-R1",
             trust_remote_code=True,
             torch_dtype=torch.float16 if torch.cuda.is_available() else torch.float32,
-            load_in_4bit=True,
             device_map="auto",
             quantization_config={
                 "load_in_4bit": True,

             "deepseek-ai/DeepSeek-R1",
             trust_remote_code=True,
             torch_dtype=torch.float16 if torch.cuda.is_available() else torch.float32,
             device_map="auto",
             quantization_config={
                 "load_in_4bit": True,