Hugging Face's logo

unsloth
/
Llama-3_1-Nemotron-Ultra-253B-v1-GGUF

Text Generation
Transformers
GGUF
PyTorch
English
nemotron-nas
nvidia
llama-3
custom_code
conversational
Model card Files
xet
Community
2
danielhanchen commited on
Commit
081fa8d
·
verified ·
1 Parent(s): 6911ec5

Add files using upload-large-folder tool

Browse files
Files changed (20) hide show
  1. .gitattributes +10 -0
  2. IQ4_NL/Llama-3_1-Nemotron-Ultra-253B-v1-IQ4_NL-00001-of-00003.gguf +3 -0
  3. IQ4_NL/Llama-3_1-Nemotron-Ultra-253B-v1-IQ4_NL-00002-of-00003.gguf +3 -0
  4. IQ4_NL/Llama-3_1-Nemotron-Ultra-253B-v1-IQ4_NL-00003-of-00003.gguf +3 -0
  5. IQ4_XS/Llama-3_1-Nemotron-Ultra-253B-v1-IQ4_XS-00001-of-00003.gguf +3 -0
  6. IQ4_XS/Llama-3_1-Nemotron-Ultra-253B-v1-IQ4_XS-00002-of-00003.gguf +3 -0
  7. IQ4_XS/Llama-3_1-Nemotron-Ultra-253B-v1-IQ4_XS-00003-of-00003.gguf +3 -0
  8. Q2_K_L/Llama-3_1-Nemotron-Ultra-253B-v1-Q2_K_L-00001-of-00002.gguf +2 -2
  9. Q2_K_L/Llama-3_1-Nemotron-Ultra-253B-v1-Q2_K_L-00002-of-00002.gguf +2 -2
  10. Q3_K_M/Llama-3_1-Nemotron-Ultra-253B-v1-Q3_K_M-00001-of-00003.gguf +2 -2
  11. Q3_K_M/Llama-3_1-Nemotron-Ultra-253B-v1-Q3_K_M-00002-of-00003.gguf +2 -2
  12. Q3_K_M/Llama-3_1-Nemotron-Ultra-253B-v1-Q3_K_M-00003-of-00003.gguf +2 -2
  13. Q4_1/Llama-3_1-Nemotron-Ultra-253B-v1-Q4_1-00001-of-00004.gguf +3 -0
  14. Q4_1/Llama-3_1-Nemotron-Ultra-253B-v1-Q4_1-00002-of-00004.gguf +3 -0
  15. Q4_1/Llama-3_1-Nemotron-Ultra-253B-v1-Q4_1-00003-of-00004.gguf +3 -0
  16. Q4_1/Llama-3_1-Nemotron-Ultra-253B-v1-Q4_1-00004-of-00004.gguf +3 -0
  17. Q5_K_M/Llama-3_1-Nemotron-Ultra-253B-v1-Q5_K_M-00001-of-00004.gguf +2 -2
  18. Q5_K_M/Llama-3_1-Nemotron-Ultra-253B-v1-Q5_K_M-00002-of-00004.gguf +2 -2
  19. Q5_K_M/Llama-3_1-Nemotron-Ultra-253B-v1-Q5_K_M-00003-of-00004.gguf +2 -2
  20. Q5_K_M/Llama-3_1-Nemotron-Ultra-253B-v1-Q5_K_M-00004-of-00004.gguf +2 -2
.gitattributes CHANGED
@@ -100,3 +100,13 @@ UD-IQ2_M/Llama-3_1-Nemotron-Ultra-253B-v1-UD-IQ2_M-00002-of-00002.gguf filter=lf
100
  UD-IQ3_XXS/Llama-3_1-Nemotron-Ultra-253B-v1-UD-IQ3_XXS-00002-of-00002.gguf filter=lfs diff=lfs merge=lfs -text
101
  UD-IQ3_XXS/Llama-3_1-Nemotron-Ultra-253B-v1-UD-IQ3_XXS-00001-of-00002.gguf filter=lfs diff=lfs merge=lfs -text
102
  UD-IQ2_M/Llama-3_1-Nemotron-Ultra-253B-v1-UD-IQ2_M-00001-of-00002.gguf filter=lfs diff=lfs merge=lfs -text
 
 
 
 
 
 
 
 
 
 
 
100
  UD-IQ3_XXS/Llama-3_1-Nemotron-Ultra-253B-v1-UD-IQ3_XXS-00002-of-00002.gguf filter=lfs diff=lfs merge=lfs -text
101
  UD-IQ3_XXS/Llama-3_1-Nemotron-Ultra-253B-v1-UD-IQ3_XXS-00001-of-00002.gguf filter=lfs diff=lfs merge=lfs -text
102
  UD-IQ2_M/Llama-3_1-Nemotron-Ultra-253B-v1-UD-IQ2_M-00001-of-00002.gguf filter=lfs diff=lfs merge=lfs -text
103
+ Q4_1/Llama-3_1-Nemotron-Ultra-253B-v1-Q4_1-00004-of-00004.gguf filter=lfs diff=lfs merge=lfs -text
104
+ IQ4_NL/Llama-3_1-Nemotron-Ultra-253B-v1-IQ4_NL-00003-of-00003.gguf filter=lfs diff=lfs merge=lfs -text
105
+ Q4_1/Llama-3_1-Nemotron-Ultra-253B-v1-Q4_1-00001-of-00004.gguf filter=lfs diff=lfs merge=lfs -text
106
+ IQ4_NL/Llama-3_1-Nemotron-Ultra-253B-v1-IQ4_NL-00001-of-00003.gguf filter=lfs diff=lfs merge=lfs -text
107
+ Q4_1/Llama-3_1-Nemotron-Ultra-253B-v1-Q4_1-00002-of-00004.gguf filter=lfs diff=lfs merge=lfs -text
108
+ Q4_1/Llama-3_1-Nemotron-Ultra-253B-v1-Q4_1-00003-of-00004.gguf filter=lfs diff=lfs merge=lfs -text
109
+ IQ4_NL/Llama-3_1-Nemotron-Ultra-253B-v1-IQ4_NL-00002-of-00003.gguf filter=lfs diff=lfs merge=lfs -text
110
+ IQ4_XS/Llama-3_1-Nemotron-Ultra-253B-v1-IQ4_XS-00003-of-00003.gguf filter=lfs diff=lfs merge=lfs -text
111
+ IQ4_XS/Llama-3_1-Nemotron-Ultra-253B-v1-IQ4_XS-00002-of-00003.gguf filter=lfs diff=lfs merge=lfs -text
112
+ IQ4_XS/Llama-3_1-Nemotron-Ultra-253B-v1-IQ4_XS-00001-of-00003.gguf filter=lfs diff=lfs merge=lfs -text
IQ4_NL/Llama-3_1-Nemotron-Ultra-253B-v1-IQ4_NL-00001-of-00003.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:12615762ad3447710bd047ec205a18808cc17685f4cb3fd7082f9695760a000b
3
+ size 49993820032
IQ4_NL/Llama-3_1-Nemotron-Ultra-253B-v1-IQ4_NL-00002-of-00003.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:b91413c38f33377c937c29bf144de88c23e50c134e95fe3376734d4ab798afe3
3
+ size 49364022592
IQ4_NL/Llama-3_1-Nemotron-Ultra-253B-v1-IQ4_NL-00003-of-00003.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:89cec41cca91df1636afe6aa44bbbf291f701ed043f15be65e46f7d4f10ebb97
3
+ size 43872426400
IQ4_XS/Llama-3_1-Nemotron-Ultra-253B-v1-IQ4_XS-00001-of-00003.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:fe9dba722183246b10ea0790228605a92fefbcc81d8ca392792cb350f77878c5
3
+ size 49865698048
IQ4_XS/Llama-3_1-Nemotron-Ultra-253B-v1-IQ4_XS-00002-of-00003.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:fbe8a8db3d9e2781839f9a8598c33a95f448a943dcc5acca3a027770857e0123
3
+ size 47876944384
IQ4_XS/Llama-3_1-Nemotron-Ultra-253B-v1-IQ4_XS-00003-of-00003.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:e44566be2d15ebeb3b5b999e560891f0fbb0170ffec23c5ecc0a06fae90409d8
3
+ size 37733800288
Q2_K_L/Llama-3_1-Nemotron-Ultra-253B-v1-Q2_K_L-00001-of-00002.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:7fd30c58ae47d3df44bb35b68d6796b907e5f3f1127c9a5d0a87ebc5aa78fdab
3
- size 49911545760
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:b440afd572d370f02748964cc7f7655f9b0f1047ea63e755c0039b66d2afc94f
3
+ size 49894148672
Q2_K_L/Llama-3_1-Nemotron-Ultra-253B-v1-Q2_K_L-00002-of-00002.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:df0c2afa573dd653cf8ddedca68a1ea2093317d7f1b119608099f57a2912b608
3
- size 48429708416
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:e97708ac30bdd7bf8494032fb699f8daebb91a71e9d9650990e10406cfaa82bf
3
+ size 43993443232
Q3_K_M/Llama-3_1-Nemotron-Ultra-253B-v1-Q3_K_M-00001-of-00003.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:54875e63c208a6b383b1652eb4f850205c279b576d4f08ead019cc9743f2e650
3
- size 49704119648
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:63147824cdb70ac125794e7e32c5509a5f96bdc3baca27cb36ab2fa138007951
3
+ size 49788268896
Q3_K_M/Llama-3_1-Nemotron-Ultra-253B-v1-Q3_K_M-00002-of-00003.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:e81c6395cefb3c49bda7efade3d68b8700d80c4b5dfe37aff2f1190244fea28d
3
- size 47074061952
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:f095a79273ab8e63c76a80319bb930e17ed92c1978324e7faea0f1b86f676c58
3
+ size 48105860256
Q3_K_M/Llama-3_1-Nemotron-Ultra-253B-v1-Q3_K_M-00003-of-00003.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:c7acab0b3385ec0d0bbcc8af9a87547e7400459cdc6362de5300d1ddbe4ef813
3
- size 27530434720
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:0bba5123b2bc01e796599de57618410f93aac5714e7737ccd7e44454ec03eb32
3
+ size 23990179936
Q4_1/Llama-3_1-Nemotron-Ultra-253B-v1-Q4_1-00001-of-00004.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:54b1475823b7a255c269edee7f5b83d85091b9845180e4fa07110d0c3b7bb386
3
+ size 49855078880
Q4_1/Llama-3_1-Nemotron-Ultra-253B-v1-Q4_1-00002-of-00004.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:6c2c001079e237782b3d214b77862ae7b8664a6e88b3fb6d1b2fe497941fd858
3
+ size 47954999776
Q4_1/Llama-3_1-Nemotron-Ultra-253B-v1-Q4_1-00003-of-00004.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:c318c780bd90a14f3a53b9020c33396306bbd6b4b53ae0ac00f2b07a7e091d37
3
+ size 49797664000
Q4_1/Llama-3_1-Nemotron-Ultra-253B-v1-Q4_1-00004-of-00004.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:02ff5d020457ed62b945670a2248b421e041e80fa291164d3bfba9a6775a2359
3
+ size 11194404352
Q5_K_M/Llama-3_1-Nemotron-Ultra-253B-v1-Q5_K_M-00001-of-00004.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:8acf5780e6e9d9dd610fe5af615bb074c0947a3a930fdfb3b56e73ecae6b0bb8
3
- size 49710275264
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:881a80592b8732de92b804ac3a020531f8b34795b7be54a37d213d9c3d3a779c
3
+ size 49946074080
Q5_K_M/Llama-3_1-Nemotron-Ultra-253B-v1-Q5_K_M-00002-of-00004.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:90b6faf65210b83ee5ec2d4199c2f622c0f41b132a67f0301ebb0a01dcaa55bb
3
- size 49912231680
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:108f22124f27f84c0e1b6ae173ff6a4e02439eaa3ae35d5a883f21d335a89da0
3
+ size 49902794048
Q5_K_M/Llama-3_1-Nemotron-Ultra-253B-v1-Q5_K_M-00003-of-00004.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:ee6ed6b8eed643a65f87ddcbfb136157bea56e225c0d9a9df7357261ae4de0a5
3
- size 49034365856
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:0ccdf7b06107d413ea95058a05228ff0d95350fa0e5c4e9d55c0f555b2d8ff47
3
+ size 46869188032
Q5_K_M/Llama-3_1-Nemotron-Ultra-253B-v1-Q5_K_M-00004-of-00004.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:ecb0acf943f43b78e94876ca9ee2d41b1673f8b69cbcd260b9023db5635a02c5
3
- size 27608881088
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:d933df5436fe5c58f9a7f388c47a2f8c24a6b32068f8927bb2a859ed69a41de5
3
+ size 31829399552