FLOR-6.3B-xat-Q5_K

FLOR-6.3B-xat-Q5_K és la versió quantitzada del model FLOR-6.3B-xat d'en xaviviro

Prompt Template

FLOR-6.3B-xat-Q5_K usa ChatML com a prompt template:

<|im_start|>user
Qui va ser Isaac Newton?<|im_end|>
<|im_start|>assistant\n

GGUF

Model size

6.45B params

Architecture

bloom

Hardware compatibility

5-bit

Inference Providers NEW

This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Base model

Quantized

(5)

this model