MikeRoz commited on
Commit
54b3789
·
verified ·
1 Parent(s): 56639d0

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +12 -7
README.md CHANGED
@@ -12,10 +12,15 @@ tags:
12
 
13
  Will update this space with links to the quant branches as they finish uploading. Expect the same sizes as in [turboderp's exl3 quant of Mistral-Large-Instruct-2411](https://huggingface.co/turboderp/Mistral-Large-Instruct-2411-exl3).
14
 
15
- [1.40 bpw/H4](https://huggingface.co/MikeRoz/Mistral-Large-Instruct-2407-exl3/tree/1.4bpw_H4)
16
- [1.80 bpw/H5](https://huggingface.co/MikeRoz/Mistral-Large-Instruct-2407-exl3/tree/1.80bpw_H5)
17
- [2.00 bpw/H5](https://huggingface.co/MikeRoz/Mistral-Large-Instruct-2407-exl3/tree/2.00bpw_H5)
18
- [2.25 bpw/H5](https://huggingface.co/MikeRoz/Mistral-Large-Instruct-2407-exl3/tree/2.25bpw_H5)
19
- [2.50 bpw/H5](https://huggingface.co/MikeRoz/Mistral-Large-Instruct-2407-exl3/tree/2.50bpw_H5)
20
- [3.00 bpw/H6](https://huggingface.co/MikeRoz/Mistral-Large-Instruct-2407-exl3/tree/3.0bpw_H6)
21
- [5.00 bpw/H6](https://huggingface.co/MikeRoz/Mistral-Large-Instruct-2407-exl3/tree/5.00bpw_H6)
 
 
 
 
 
 
12
 
13
  Will update this space with links to the quant branches as they finish uploading. Expect the same sizes as in [turboderp's exl3 quant of Mistral-Large-Instruct-2411](https://huggingface.co/turboderp/Mistral-Large-Instruct-2411-exl3).
14
 
15
+ [1.40 bpw/H4](https://huggingface.co/MikeRoz/Mistral-Large-Instruct-2407-exl3/tree/1.4bpw_H4) 20.820 GiB
16
+ 1.60 bpw/H4 23.670 GiB
17
+ [1.80 bpw/H5](https://huggingface.co/MikeRoz/Mistral-Large-Instruct-2407-exl3/tree/1.80bpw_H5) 26.541 GiB
18
+ [2.00 bpw/H5](https://huggingface.co/MikeRoz/Mistral-Large-Instruct-2407-exl3/tree/2.00bpw_H5) 29.389 GiB
19
+ [2.25 bpw/H5](https://huggingface.co/MikeRoz/Mistral-Large-Instruct-2407-exl3/tree/2.25bpw_H5) 32.927 GiB
20
+ [2.50 bpw/H5](https://huggingface.co/MikeRoz/Mistral-Large-Instruct-2407-exl3/tree/2.50bpw_H5) 36.470 GiB
21
+ [3.00 bpw/H6](https://huggingface.co/MikeRoz/Mistral-Large-Instruct-2407-exl3/tree/3.0bpw_H6) 43.616 GiB
22
+ 3.50 bpw/H6 50.697 GiB
23
+ 4.00 bpw/H6 57.795 GiB
24
+ [5.00 bpw/H6](https://huggingface.co/MikeRoz/Mistral-Large-Instruct-2407-exl3/tree/5.00bpw_H6) 71.975 GiB
25
+ 6.00 bpw/H6 86.155 GiB
26
+ 8.00 bpw/H8 114.609 GiB