Hugging Face's logo

teddylee777
/
llama-3-8b-it-ko-chang-gguf

Text Generation
Transformers
GGUF
Korean
llama
conversational
Model card Files Community
1
llama-3-8b-it-ko-chang-gguf
File size: 1,131 Bytes 
5f01157
 
 
 
 
 
 
 
 
 
46026d7
 
 
 
 
 
 
 
 
 
 
 
d55777c
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
46026d7
 
 
 
 
 
 
 
 
 
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
 
---
library_name: transformers
license: apache-2.0
language:
- ko
---

- Original model is [lcw99/llama-3-8b-it-ko-chang](https://huggingface.co/lcw99/llama-3-8b-it-ko-chang)
- Quantized by [teddylee777](https://huggingface.co/teddylee777) by using [llama.cpp](https://github.com/ggerganov/llama.cpp)

## Template (LM Studio)

```
<|start_header_id|>system<|end_header_id|>
{System}
<|eot_id|>
<|start_header_id|>B<|end_header_id|>
{User}
<|eot_id|><|start_header_id|>A<|end_header_id|>
{Assistant}
```

### LM Studio Demo

![image/png](https://cdn-uploads.huggingface.co/production/uploads/649d86964ee9d3611f71f39e/oBr-a6-hf0frsKwtDDafL.png)


## Ollama Template

```
TEMPLATE """{{- if .System }}<|start_header_id|>system<|end_header_id|>
{{ .System }}
<|eot_id|>
{{- end }}

<|start_header_id|>B<|end_header_id|>
{{ .Prompt }}
<|eot_id|>
<|start_header_id|>A<|end_header_id|>
"""
```

### Ollama DEMO

![image/png](https://cdn-uploads.huggingface.co/production/uploads/649d86964ee9d3611f71f39e/fed4vqNcjQPW3WuzPjgKv.png)

## Stop Token

```
<|eot_id|>
<|start_header_id|>
<|end_header_id|>
<|begin_of_text|> 
<|end_of_text|>
```