Hugging Face's logo

unsloth
/
Llama-3.3-70B-Instruct-GGUF

Text Generation
Transformers
GGUF
PyTorch
English
llama
llama-3
meta
facebook
unsloth
imatrix
conversational
Model card Files
xet
Community
5
danielhanchen commited on
Commit
98fda9c
·
verified ·
1 Parent(s): 5a603a1

Upload folder using huggingface_hub

Browse files
Files changed (8) hide show
  1. .gitattributes +3 -0
  2. Llama-3.3-70B-Instruct-Q2_K.gguf +2 -2
  3. Llama-3.3-70B-Instruct-Q3_K_M.gguf +2 -2
  4. Llama-3.3-70B-Instruct-Q4_K_M.gguf +2 -2
  5. Llama-3.3-70B-Instruct-Q5_K_M.gguf +2 -2
  6. Llama-3.3-70B-Instruct-UD-IQ2_XXS.gguf +3 -0
  7. Q6_K/Llama-3.3-70B-Instruct-Q6_K-00001-of-00002.gguf +3 -0
  8. Q6_K/Llama-3.3-70B-Instruct-Q6_K-00002-of-00002.gguf +3 -0
.gitattributes CHANGED
@@ -52,3 +52,6 @@ Llama-3.3-70B-Instruct-UD-IQ3_XXS.gguf filter=lfs diff=lfs merge=lfs -text
52
  Llama-3.3-70B-Instruct-UD-Q2_K_XL.gguf filter=lfs diff=lfs merge=lfs -text
53
  Llama-3.3-70B-Instruct-UD-Q3_K_XL.gguf filter=lfs diff=lfs merge=lfs -text
54
  Llama-3.3-70B-Instruct-UD-Q4_K_XL.gguf filter=lfs diff=lfs merge=lfs -text
 
 
 
 
52
  Llama-3.3-70B-Instruct-UD-Q2_K_XL.gguf filter=lfs diff=lfs merge=lfs -text
53
  Llama-3.3-70B-Instruct-UD-Q3_K_XL.gguf filter=lfs diff=lfs merge=lfs -text
54
  Llama-3.3-70B-Instruct-UD-Q4_K_XL.gguf filter=lfs diff=lfs merge=lfs -text
55
+ Llama-3.3-70B-Instruct-UD-IQ2_XXS.gguf filter=lfs diff=lfs merge=lfs -text
56
+ Q6_K/Llama-3.3-70B-Instruct-Q6_K-00001-of-00002.gguf filter=lfs diff=lfs merge=lfs -text
57
+ Q6_K/Llama-3.3-70B-Instruct-Q6_K-00002-of-00002.gguf filter=lfs diff=lfs merge=lfs -text
Llama-3.3-70B-Instruct-Q2_K.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:4fa84a8c3f769c1625174818101d7b778e987bc0dca278d7e8749b098a4d0608
3
- size 26375112928
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:06e2d2bfcf718aadc8a9c864503307be7c77931e6f363219c3fc6fb194332a08
3
+ size 26375113312
Llama-3.3-70B-Instruct-Q3_K_M.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:d349146cc31d4386ed5c8d5712327aac82785785b985cb4967201ab97b084745
3
- size 34267498720
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:7f13297f95a1d2284c5d5b90e2cf3ba6b33f97b408d2af43a89ff3a42178a2f1
3
+ size 34267499104
Llama-3.3-70B-Instruct-Q4_K_M.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:a8a91957083b43f4f8caaeea152cd2b6d028936a88a7ac2cef1975c379f07bd6
3
- size 42520398048
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:d7f4f209208f984fe95af82d014171f9d05427029746b1ae08297f102a6ddee4
3
+ size 42520398432
Llama-3.3-70B-Instruct-Q5_K_M.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:feb6c8a9f2342adb264726f17e6cc3196f0d5b012133b2c0f817f058f2786b78
3
- size 49949821152
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:ea8c6991077c3663b683d61eb166408bda4bba57cf890999a6e08ad6927e9fbf
3
+ size 49949821536
Llama-3.3-70B-Instruct-UD-IQ2_XXS.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:6da345a55f2da53268f5f781b8fc8dbd525243b076433329a5fb420b43d67c3a
3
+ size 19431115360
Q6_K/Llama-3.3-70B-Instruct-Q6_K-00001-of-00002.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:517cbbaccf3b3292d5137f25e952a08be6244c0b058489213aeab4b4e7c9badd
3
+ size 49973949280
Q6_K/Llama-3.3-70B-Instruct-Q6_K-00002-of-00002.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:09834f7182f0f63d6be92131459a48305b48a79cae5d2a91ccfeaafbf5b4f884
3
+ size 7914199008