Some of my own quants:

  • ChatAYT-Lora-Assamble-Marcoroni_Q5_K_M.gguf

Source: PulsarAI

Source Model: ChatAYT-Lora-Assamble-Marcoroni

Source models for PulsarAI/ChatAYT-Lora-Assamble-Marcoroni (Merge)

Downloads last month
5
GGUF
Model size
13B params
Architecture
llama
Hardware compatibility
Log In to view the estimation

5-bit

Inference Providers NEW
This model isn't deployed by any Inference Provider. ๐Ÿ™‹ Ask for provider support