Hugging Face's logo

unsloth
/
Llama-3.3-70B-Instruct-GGUF

Text Generation
Transformers
GGUF
PyTorch
English
llama
llama-3
meta
facebook
unsloth
imatrix
conversational
Model card Files
xet
Community
5
danielhanchen commited on
Commit
aaa5e8f
·
verified ·
1 Parent(s): 62ffeca

Upload folder using huggingface_hub

Browse files
Files changed (8) hide show
  1. .gitattributes +7 -0
  2. Llama-3.3-70B-Instruct-Q4_K_S.gguf +3 -0
  3. Llama-3.3-70B-Instruct-Q5_K_S.gguf +3 -0
  4. Llama-3.3-70B-Instruct-UD-Q5_K_XL.gguf +3 -0
  5. UD-Q6_K_XL/Llama-3.3-70B-Instruct-UD-Q6_K_XL-00001-of-00002.gguf +3 -0
  6. UD-Q6_K_XL/Llama-3.3-70B-Instruct-UD-Q6_K_XL-00002-of-00002.gguf +3 -0
  7. UD-Q8_K_XL/Llama-3.3-70B-Instruct-UD-Q8_K_XL-00001-of-00002.gguf +3 -0
  8. UD-Q8_K_XL/Llama-3.3-70B-Instruct-UD-Q8_K_XL-00002-of-00002.gguf +3 -0
.gitattributes CHANGED
@@ -61,3 +61,10 @@ Llama-3.3-70B-Instruct-Q2_K_L.gguf filter=lfs diff=lfs merge=lfs -text
61
  Llama-3.3-70B-Instruct-Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text
62
  Llama-3.3-70B-Instruct-Q4_0.gguf filter=lfs diff=lfs merge=lfs -text
63
  Llama-3.3-70B-Instruct-Q4_1.gguf filter=lfs diff=lfs merge=lfs -text
 
 
 
 
 
 
 
 
61
  Llama-3.3-70B-Instruct-Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text
62
  Llama-3.3-70B-Instruct-Q4_0.gguf filter=lfs diff=lfs merge=lfs -text
63
  Llama-3.3-70B-Instruct-Q4_1.gguf filter=lfs diff=lfs merge=lfs -text
64
+ Llama-3.3-70B-Instruct-Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text
65
+ Llama-3.3-70B-Instruct-Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text
66
+ Llama-3.3-70B-Instruct-UD-Q5_K_XL.gguf filter=lfs diff=lfs merge=lfs -text
67
+ UD-Q6_K_XL/Llama-3.3-70B-Instruct-UD-Q6_K_XL-00001-of-00002.gguf filter=lfs diff=lfs merge=lfs -text
68
+ UD-Q6_K_XL/Llama-3.3-70B-Instruct-UD-Q6_K_XL-00002-of-00002.gguf filter=lfs diff=lfs merge=lfs -text
69
+ UD-Q8_K_XL/Llama-3.3-70B-Instruct-UD-Q8_K_XL-00001-of-00002.gguf filter=lfs diff=lfs merge=lfs -text
70
+ UD-Q8_K_XL/Llama-3.3-70B-Instruct-UD-Q8_K_XL-00002-of-00002.gguf filter=lfs diff=lfs merge=lfs -text
Llama-3.3-70B-Instruct-Q4_K_S.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:6eb61290df54375ee22c9ff2009f3678c43ae21a9cabe238ed8101194a1c5f73
3
+ size 40347224672
Llama-3.3-70B-Instruct-Q5_K_S.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:b05b3f58b1d723db4a03c335a6bb848f7bb55868c4bcbb691ad5db15beffbb0c
3
+ size 48657451616
Llama-3.3-70B-Instruct-UD-Q5_K_XL.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:ce0884442f6f39d5ccedb9975405eb5c11e1fdcd65296b484cfb869975ef4884
3
+ size 49859709536
UD-Q6_K_XL/Llama-3.3-70B-Instruct-UD-Q6_K_XL-00001-of-00002.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:25d3f98fee5d332d2a9e2d67214b25bdf9b77323cc897bc11f0c0f3d10d32a1b
3
+ size 49993608096
UD-Q6_K_XL/Llama-3.3-70B-Instruct-UD-Q6_K_XL-00002-of-00002.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:382edf6828bafeb0936c3392bf5fa212ea9b5ed883f668e0203b5164f11a1c1a
3
+ size 11166457728
UD-Q8_K_XL/Llama-3.3-70B-Instruct-UD-Q8_K_XL-00001-of-00002.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:94d1e8d59892e53c40c36094c02f551cc2084ce92d6aae13ac37041bb8c263ee
3
+ size 49923737280
UD-Q8_K_XL/Llama-3.3-70B-Instruct-UD-Q8_K_XL-00002-of-00002.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:09ad3e51b68f256415d50859370e19fb9689d269b54e48c090084f971e4df408
3
+ size 31307383904