|
|
--- |
|
|
tags: |
|
|
- experimental |
|
|
- testing |
|
|
- gguf |
|
|
- roleplay |
|
|
- multimodal |
|
|
- vision |
|
|
- llava |
|
|
--- |
|
|
# #Roleplay #Multimodal #Vision |
|
|
|
|
|
**These are quants for an experimental model.** |
|
|
|
|
|
quantization_options = [ |
|
|
"Q4_K_M", "Q4_K_S", "IQ4_XS", |
|
|
"Q5_K_M", "Q5_K_S", |
|
|
"Q6_K", "Q8_0" |
|
|
] |
|
|
|
|
|
Original model weights and information: <br> https://huggingface.co/Nitral-AI/Eris_PrimeV4.69-Vision-32k-7B |
|
|
|
|
|
MMPROJ: <br> [./mmproj/mmproj-model-f16.gguf](./mmproj/mmproj-model-f16.gguf) |
|
|
|
|
|
 |
|
|
|
|
|
# Vision/multimodal capabilities: |
|
|
|
|
|
If you want to use vision functionality: |
|
|
|
|
|
* You must use the latest version of [KoboldCpp](https://github.com/LostRuins/koboldcpp). |
|
|
|
|
|
To use the multimodal capabilities of this model and use **vision** you need to load the specified **mmproj** file, this can be found inside this model repo. |
|
|
|
|
|
* You can load the **mmproj** by using the corresponding section in the interface: |
|
|
|
|
|
 |
|
|
|
