OpenVINO
/

Qwen3-1.7B-int4-ov

Model card Files Files and versions Community

amokrov commited on 5 days ago

Commit

6f32d81

·

verified ·

1 Parent(s): 1230ed9

Update README.md

Files changed (1) hide show

README.md +1 -0

README.md CHANGED Viewed

@@ -84,6 +84,7 @@ import openvino_genai as ov_genai
 device = "CPU"
 pipe = ov_genai.LLMPipeline(model_path, device)
 print(pipe.generate("What is OpenVINO?", max_length=200))
 ```

 device = "CPU"
 pipe = ov_genai.LLMPipeline(model_path, device)
+pipe.get_tokenizer().set_chat_template(pipe.get_tokenizer().chat_template)
 print(pipe.generate("What is OpenVINO?", max_length=200))
 ```