OpenVINO
/

Qwen3-4B-fp16-ov

Model card Files Files and versions Community

amokrov commited on 6 days ago

Commit

00298f1

·

verified ·

1 Parent(s): df6ac5e

Update README.md

Files changed (1) hide show

README.md +1 -0

README.md CHANGED Viewed

@@ -73,6 +73,7 @@ import openvino_genai as ov_genai
 device = "CPU"
 pipe = ov_genai.LLMPipeline(model_path, device)
 print(pipe.generate("What is OpenVINO?", max_length=200))
 ```

 device = "CPU"
 pipe = ov_genai.LLMPipeline(model_path, device)
+pipe.get_tokenizer().set_chat_template(pipe.get_tokenizer().chat_template)
 print(pipe.generate("What is OpenVINO?", max_length=200))
 ```