Update README.md
Browse files
README.md
CHANGED
@@ -12,10 +12,15 @@ tags:
|
|
12 |
|
13 |
Will update this space with links to the quant branches as they finish uploading. Expect the same sizes as in [turboderp's exl3 quant of Mistral-Large-Instruct-2411](https://huggingface.co/turboderp/Mistral-Large-Instruct-2411-exl3).
|
14 |
|
15 |
-
[1.40 bpw/H4](https://huggingface.co/MikeRoz/Mistral-Large-Instruct-2407-exl3/tree/1.4bpw_H4)
|
16 |
-
|
17 |
-
[
|
18 |
-
[2.
|
19 |
-
[2.
|
20 |
-
[
|
21 |
-
[
|
|
|
|
|
|
|
|
|
|
|
|
12 |
|
13 |
Will update this space with links to the quant branches as they finish uploading. Expect the same sizes as in [turboderp's exl3 quant of Mistral-Large-Instruct-2411](https://huggingface.co/turboderp/Mistral-Large-Instruct-2411-exl3).
|
14 |
|
15 |
+
[1.40 bpw/H4](https://huggingface.co/MikeRoz/Mistral-Large-Instruct-2407-exl3/tree/1.4bpw_H4) 20.820 GiB
|
16 |
+
1.60 bpw/H4 23.670 GiB
|
17 |
+
[1.80 bpw/H5](https://huggingface.co/MikeRoz/Mistral-Large-Instruct-2407-exl3/tree/1.80bpw_H5) 26.541 GiB
|
18 |
+
[2.00 bpw/H5](https://huggingface.co/MikeRoz/Mistral-Large-Instruct-2407-exl3/tree/2.00bpw_H5) 29.389 GiB
|
19 |
+
[2.25 bpw/H5](https://huggingface.co/MikeRoz/Mistral-Large-Instruct-2407-exl3/tree/2.25bpw_H5) 32.927 GiB
|
20 |
+
[2.50 bpw/H5](https://huggingface.co/MikeRoz/Mistral-Large-Instruct-2407-exl3/tree/2.50bpw_H5) 36.470 GiB
|
21 |
+
[3.00 bpw/H6](https://huggingface.co/MikeRoz/Mistral-Large-Instruct-2407-exl3/tree/3.0bpw_H6) 43.616 GiB
|
22 |
+
3.50 bpw/H6 50.697 GiB
|
23 |
+
4.00 bpw/H6 57.795 GiB
|
24 |
+
[5.00 bpw/H6](https://huggingface.co/MikeRoz/Mistral-Large-Instruct-2407-exl3/tree/5.00bpw_H6) 71.975 GiB
|
25 |
+
6.00 bpw/H6 86.155 GiB
|
26 |
+
8.00 bpw/H8 114.609 GiB
|