OpenVINO
/

Qwen3-4B-int8-ov

Model card Files Files and versions Community

amokrov commited on 5 days ago

Commit

8f1c06f

·

verified ·

1 Parent(s): 0fe2959

Update README.md

Files changed (1) hide show

README.md +1 -0

README.md CHANGED Viewed

@@ -82,6 +82,7 @@ import openvino_genai as ov_genai
 device = "CPU"
 pipe = ov_genai.LLMPipeline(model_path, device)
 print(pipe.generate("What is OpenVINO?", max_length=200))
 ```

 device = "CPU"
 pipe = ov_genai.LLMPipeline(model_path, device)
+pipe.get_tokenizer().set_chat_template(pipe.get_tokenizer().chat_template)
 print(pipe.generate("What is OpenVINO?", max_length=200))
 ```