Update README.md
Browse files
README.md
CHANGED
|
@@ -23,6 +23,7 @@ This repo contains GGUF format model files for [SpeakLeash](https://speakleash.o
|
|
| 23 |
|
| 24 |
### Available quantization formats:
|
| 25 |
* **q8_0:** Almost indistinguishable from float16. High resource use and slow. Not recommended for most users.
|
|
|
|
| 26 |
|
| 27 |
### Ollama Modfile
|
| 28 |
The GGUF file can be used with [Ollama](https://ollama.com/). To do this, you need to import the model using the configuration defined in the Modfile. For model eg. Bielik-4.5B-v3.0-Instruct.Q4_K_M.gguf (full path to model location) Modfile looks like:
|
|
|
|
| 23 |
|
| 24 |
### Available quantization formats:
|
| 25 |
* **q8_0:** Almost indistinguishable from float16. High resource use and slow. Not recommended for most users.
|
| 26 |
+
* **fp16:** Converted Bielik-4.5B-v3.0-Instruct to fp16 GGUF
|
| 27 |
|
| 28 |
### Ollama Modfile
|
| 29 |
The GGUF file can be used with [Ollama](https://ollama.com/). To do this, you need to import the model using the configuration defined in the Modfile. For model eg. Bielik-4.5B-v3.0-Instruct.Q4_K_M.gguf (full path to model location) Modfile looks like:
|