unsloth

/

Kimi-Dev-72B-GGUF

like 14

Follow

Unsloth AI 6.47k

These models cannot be so small.

Q4_K_M
2.83 GB

Q4_K_XL
2.94 GB

Q5_K_S
2.96 GB

Q5_K_M
3.11 GB

Thanks there mustve been something wrong with the conversion process

This problem also appears in China's platform modelscope.

We removed them - it seems like Q4_* has NaNs during the conversion process