MikeRoz
/

Mistral-Large-Instruct-2407-exl3

Model card Files Files and versions Community

MikeRoz commited on Apr 16

Commit

6c48be5

·

verified ·

1 Parent(s): 54b3789

Update README.md

Files changed (1) hide show

README.md +1 -1

README.md CHANGED Viewed

@@ -13,7 +13,7 @@ tags:
 Will update this space with links to the quant branches as they finish uploading. Expect the same sizes as in [turboderp's exl3 quant of Mistral-Large-Instruct-2411](https://huggingface.co/turboderp/Mistral-Large-Instruct-2411-exl3).
 [1.40 bpw/H4](https://huggingface.co/MikeRoz/Mistral-Large-Instruct-2407-exl3/tree/1.4bpw_H4) 20.820 GiB
-1.60 bpw/H4 23.670 GiB
 [1.80 bpw/H5](https://huggingface.co/MikeRoz/Mistral-Large-Instruct-2407-exl3/tree/1.80bpw_H5) 26.541 GiB
 [2.00 bpw/H5](https://huggingface.co/MikeRoz/Mistral-Large-Instruct-2407-exl3/tree/2.00bpw_H5) 29.389 GiB
 [2.25 bpw/H5](https://huggingface.co/MikeRoz/Mistral-Large-Instruct-2407-exl3/tree/2.25bpw_H5) 32.927 GiB

 Will update this space with links to the quant branches as they finish uploading. Expect the same sizes as in [turboderp's exl3 quant of Mistral-Large-Instruct-2411](https://huggingface.co/turboderp/Mistral-Large-Instruct-2411-exl3).
 [1.40 bpw/H4](https://huggingface.co/MikeRoz/Mistral-Large-Instruct-2407-exl3/tree/1.4bpw_H4) 20.820 GiB
+[1.60 bpw/H4](https://huggingface.co/MikeRoz/Mistral-Large-Instruct-2407-exl3/tree/1.60bpw_H4) 23.670 GiB
 [1.80 bpw/H5](https://huggingface.co/MikeRoz/Mistral-Large-Instruct-2407-exl3/tree/1.80bpw_H5) 26.541 GiB
 [2.00 bpw/H5](https://huggingface.co/MikeRoz/Mistral-Large-Instruct-2407-exl3/tree/2.00bpw_H5) 29.389 GiB
 [2.25 bpw/H5](https://huggingface.co/MikeRoz/Mistral-Large-Instruct-2407-exl3/tree/2.25bpw_H5) 32.927 GiB