Hugging Face's logo

ArtusDev
/
Delta-Vector_Austral-70B-Preview-EXL3

Transformers
English
roleplay
finetune
axolotl
creative-writing
70B
llama
exl3
Model card Files
xet
Community
ArtusDev commited on
Commit
922c765
·
verified ·
1 Parent(s): ee93f7d

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +2 -0
README.md CHANGED
@@ -41,9 +41,11 @@ EXL3 quants of [Delta-Vector/Austral-70B-Preview](https://huggingface.co/Delta-V
41
  ### Quants
42
  | Quant(Revision) | Bits per Weight | Head Bits |
43
  | -------- | ---------- | --------- |
 
44
  | [3.0_H6](https://huggingface.co/ArtusDev/Delta-Vector_Austral-70B-Preview-EXL3/tree/3.0bpw_H6) | 3.0 | 6 |
45
  | [3.25_H6](https://huggingface.co/ArtusDev/Delta-Vector_Austral-70B-Preview-EXL3/tree/3.25bpw_H6) | 3.25 | 6 |
46
  | [4.0_H6](https://huggingface.co/ArtusDev/Delta-Vector_Austral-70B-Preview-EXL3/tree/4.0bpw_H6) | 4.0 | 6 |
 
47
  | [4.5_H6](https://huggingface.co/ArtusDev/Delta-Vector_Austral-70B-Preview-EXL3/tree/4.5bpw_H6) | 4.5 | 6 |
48
  | [5.0_H6](https://huggingface.co/ArtusDev/Delta-Vector_Austral-70B-Preview-EXL3/tree/5.0bpw_H6) | 5.0 | 6 |
49
  | [6.0_H6](https://huggingface.co/ArtusDev/Delta-Vector_Austral-70B-Preview-EXL3/tree/6.0bpw_H6) | 6.0 | 6 |
 
41
  ### Quants
42
  | Quant(Revision) | Bits per Weight | Head Bits |
43
  | -------- | ---------- | --------- |
44
+ | [2.5_H6](https://huggingface.co/ArtusDev/Delta-Vector_Austral-70B-Preview-EXL3/tree/2.5bpw_H6) | 2.5 | 6 |
45
  | [3.0_H6](https://huggingface.co/ArtusDev/Delta-Vector_Austral-70B-Preview-EXL3/tree/3.0bpw_H6) | 3.0 | 6 |
46
  | [3.25_H6](https://huggingface.co/ArtusDev/Delta-Vector_Austral-70B-Preview-EXL3/tree/3.25bpw_H6) | 3.25 | 6 |
47
  | [4.0_H6](https://huggingface.co/ArtusDev/Delta-Vector_Austral-70B-Preview-EXL3/tree/4.0bpw_H6) | 4.0 | 6 |
48
+ | [4.25_H6](https://huggingface.co/ArtusDev/Delta-Vector_Austral-70B-Preview-EXL3/tree/4.25bpw_H6) | 4.25 | 6 |
49
  | [4.5_H6](https://huggingface.co/ArtusDev/Delta-Vector_Austral-70B-Preview-EXL3/tree/4.5bpw_H6) | 4.5 | 6 |
50
  | [5.0_H6](https://huggingface.co/ArtusDev/Delta-Vector_Austral-70B-Preview-EXL3/tree/5.0bpw_H6) | 5.0 | 6 |
51
  | [6.0_H6](https://huggingface.co/ArtusDev/Delta-Vector_Austral-70B-Preview-EXL3/tree/6.0bpw_H6) | 6.0 | 6 |