Template (LM Studio)

<|start_header_id|>system<|end_header_id|>
{System}
<|eot_id|>
<|start_header_id|>B<|end_header_id|>
{User}
<|eot_id|><|start_header_id|>A<|end_header_id|>
{Assistant}

LM Studio Demo

image/png

Ollama Template

TEMPLATE """{{- if .System }}<|start_header_id|>system<|end_header_id|>
{{ .System }}
<|eot_id|>
{{- end }}

<|start_header_id|>B<|end_header_id|>
{{ .Prompt }}
<|eot_id|>
<|start_header_id|>A<|end_header_id|>
"""

Ollama DEMO

image/png

Stop Token

<|eot_id|>
<|start_header_id|>
<|end_header_id|>
<|begin_of_text|> 
<|end_of_text|>
Downloads last month
113
GGUF
Model size
8.03B params
Architecture
llama

4-bit

5-bit

6-bit

8-bit

Inference Providers NEW
This model is not currently available via any of the supported third-party Inference Providers, and the model is not deployed on the HF Inference API.