Intel
/

DeepSeek-V3.1-int4-AutoRound

Text Generation

4-bit precision

Model card Files Files and versions

n1ck-guo commited on 20 days ago

Commit

51539a5

·

verified ·

1 Parent(s): a6e43b3

Update README.md

Files changed (1) hide show

README.md +1 -1

README.md CHANGED Viewed

@@ -15,7 +15,7 @@ Please follow the license of the original model.
 from transformers import AutoModelForCausalLM, AutoTokenizer
 import transformers
 import torch
-quantized_model_dir = "Intel/DeepSeek-V3.1-int4-mixed-AutoRound"
 model = AutoModelForCausalLM.from_pretrained(
         quantized_model_dir,

 from transformers import AutoModelForCausalLM, AutoTokenizer
 import transformers
 import torch
+quantized_model_dir = "Intel/DeepSeek-V3.1-int4-AutoRound"
 model = AutoModelForCausalLM.from_pretrained(
         quantized_model_dir,