license: apache-2.0 | |
https://huggingface.co/mistralai/Mistral-Small-24B-Base-2501 | |
Q6_K_XL: Q6_K weights, F16 output, F16 embed | |
Fits 24K CTX on a 24GiB GPU |
license: apache-2.0 | |
https://huggingface.co/mistralai/Mistral-Small-24B-Base-2501 | |
Q6_K_XL: Q6_K weights, F16 output, F16 embed | |
Fits 24K CTX on a 24GiB GPU |