Hugging Face's logo

nsbendre25
/
llama-3-8B-Instruct-ov-fp16-int4-sym

Text Generation
Transformers
OpenVINO
English
llama
OpenVINO
meta
llama-3
optimum-intel
conversational
Model card Files Community
nsbendre25 commited on
Commit
dfd7c8d
·
verified ·
1 Parent(s): 3a1890f

Updated README.md

Browse files
Files changed (1) hide show
  1. README.md +1 -1
README.md CHANGED
@@ -56,5 +56,5 @@ tokenizer = AutoTokenizer.from_pretrained(model_id)
56
  model = OVModelForCausalLM.from_pretrained(model_id)
57
 
58
  pipeline = transformers.pipeline("text-generation", model=model_id, model_kwargs={"torch_dtype": torch.bfloat16}, device_map="auto")
59
- pipeline("Hey how are you doing today?")
60
  ```
 
56
  model = OVModelForCausalLM.from_pretrained(model_id)
57
 
58
  pipeline = transformers.pipeline("text-generation", model=model_id, model_kwargs={"torch_dtype": torch.bfloat16}, device_map="auto")
59
+ pipeline("i am in paris, plan me a 2 week trip")
60
  ```