Update README.md
Browse files
README.md
CHANGED
|
@@ -56,13 +56,13 @@ Resources:
|
|
| 56 |
|
| 57 |
```bash
|
| 58 |
# mmproj
|
| 59 |
-
wget https://huggingface.co/xtuner/llava-phi-3-mini-gguf/resolve/main/mmproj-
|
| 60 |
|
| 61 |
# fp16 llm
|
| 62 |
-
wget https://huggingface.co/xtuner/llava-phi-3-mini-gguf/resolve/main/
|
| 63 |
|
| 64 |
# int4 llm
|
| 65 |
-
wget https://huggingface.co/xtuner/llava-phi-3-mini-gguf/resolve/main/
|
| 66 |
```
|
| 67 |
|
| 68 |
### Build environment
|
|
@@ -72,13 +72,14 @@ wget https://huggingface.co/xtuner/llava-phi-3-mini-gguf/resolve/main/ggml-model
|
|
| 72 |
|
| 73 |
### Chat by `./llava-cli`
|
| 74 |
|
|
|
|
| 75 |
|
| 76 |
```bash
|
| 77 |
# fp16
|
| 78 |
-
./llava-cli -m ./
|
| 79 |
|
| 80 |
# int4
|
| 81 |
-
./llava-cli -m ./
|
| 82 |
```
|
| 83 |
|
| 84 |
### Reproduce
|
|
|
|
| 56 |
|
| 57 |
```bash
|
| 58 |
# mmproj
|
| 59 |
+
wget https://huggingface.co/xtuner/llava-phi-3-mini-gguf/resolve/main/llava-phi-3-mini-mmproj-f16.gguf
|
| 60 |
|
| 61 |
# fp16 llm
|
| 62 |
+
wget https://huggingface.co/xtuner/llava-phi-3-mini-gguf/resolve/main/llava-phi-3-mini-f16.gguf
|
| 63 |
|
| 64 |
# int4 llm
|
| 65 |
+
wget https://huggingface.co/xtuner/llava-phi-3-mini-gguf/resolve/main/llava-phi-3-mini-int4.gguf
|
| 66 |
```
|
| 67 |
|
| 68 |
### Build environment
|
|
|
|
| 72 |
|
| 73 |
### Chat by `./llava-cli`
|
| 74 |
|
| 75 |
+
Note: llava-phi-3-mini uses the `Phi-3-instruct` chat template.
|
| 76 |
|
| 77 |
```bash
|
| 78 |
# fp16
|
| 79 |
+
./llava-cli -m ./llava-phi-3-mini-f16.gguf --mmproj ./llava-phi-3-mini-mmproj-f16.gguf --image YOUR_IMAGE.jpg -c 4096
|
| 80 |
|
| 81 |
# int4
|
| 82 |
+
./llava-cli -m ./llava-phi-3-mini-int4.gguf --mmproj ./llava-phi-3-mini-mmproj-f16.gguf --image YOUR_IMAGE.jpg -c 4096
|
| 83 |
```
|
| 84 |
|
| 85 |
### Reproduce
|