Hugging Face's logo

unsloth
/
Llama-3_1-Nemotron-Ultra-253B-v1-GGUF

Text Generation
Transformers
GGUF
PyTorch
English
nemotron-nas
nvidia
llama-3
custom_code
conversational
Model card Files
xet
Community
2
danielhanchen commited on
Commit
1681cef
·
verified ·
1 Parent(s): c39773c

Add files using upload-large-folder tool

Browse files
Files changed (20) hide show
  1. .gitattributes +4 -0
  2. Q4_K_M/Llama-3_1-Nemotron-Ultra-253B-v1-Q4_K_M-00001-of-00004.gguf +2 -2
  3. Q4_K_M/Llama-3_1-Nemotron-Ultra-253B-v1-Q4_K_M-00002-of-00004.gguf +1 -1
  4. Q4_K_M/Llama-3_1-Nemotron-Ultra-253B-v1-Q4_K_M-00003-of-00004.gguf +1 -1
  5. Q4_K_M/Llama-3_1-Nemotron-Ultra-253B-v1-Q4_K_M-00004-of-00004.gguf +1 -1
  6. UD-IQ1_S/Llama-3_1-Nemotron-Ultra-253B-v1-UD-IQ1_S-00001-of-00002.gguf +2 -2
  7. UD-IQ1_S/Llama-3_1-Nemotron-Ultra-253B-v1-UD-IQ1_S-00002-of-00002.gguf +2 -2
  8. UD-Q2_K_XL/Llama-3_1-Nemotron-Ultra-253B-v1-UD-Q2_K_XL-00001-of-00002.gguf +2 -2
  9. UD-Q2_K_XL/Llama-3_1-Nemotron-Ultra-253B-v1-UD-Q2_K_XL-00002-of-00002.gguf +2 -2
  10. UD-Q3_K_XL/Llama-3_1-Nemotron-Ultra-253B-v1-UD-Q3_K_XL-00001-of-00003.gguf +2 -2
  11. UD-Q3_K_XL/Llama-3_1-Nemotron-Ultra-253B-v1-UD-Q3_K_XL-00002-of-00003.gguf +2 -2
  12. UD-Q3_K_XL/Llama-3_1-Nemotron-Ultra-253B-v1-UD-Q3_K_XL-00003-of-00003.gguf +2 -2
  13. UD-Q4_K_XL/Llama-3_1-Nemotron-Ultra-253B-v1-UD-Q4_K_XL-00001-of-00004.gguf +2 -2
  14. UD-Q4_K_XL/Llama-3_1-Nemotron-Ultra-253B-v1-UD-Q4_K_XL-00002-of-00004.gguf +2 -2
  15. UD-Q4_K_XL/Llama-3_1-Nemotron-Ultra-253B-v1-UD-Q4_K_XL-00003-of-00004.gguf +2 -2
  16. UD-Q4_K_XL/Llama-3_1-Nemotron-Ultra-253B-v1-UD-Q4_K_XL-00004-of-00004.gguf +2 -2
  17. UD-Q5_K_XL/Llama-3_1-Nemotron-Ultra-253B-v1-UD-Q5_K_XL-00001-of-00004.gguf +3 -0
  18. UD-Q5_K_XL/Llama-3_1-Nemotron-Ultra-253B-v1-UD-Q5_K_XL-00002-of-00004.gguf +3 -0
  19. UD-Q5_K_XL/Llama-3_1-Nemotron-Ultra-253B-v1-UD-Q5_K_XL-00003-of-00004.gguf +3 -0
  20. UD-Q5_K_XL/Llama-3_1-Nemotron-Ultra-253B-v1-UD-Q5_K_XL-00004-of-00004.gguf +3 -0
.gitattributes CHANGED
@@ -92,3 +92,7 @@ UD-Q3_K_XL/Llama-3_1-Nemotron-Ultra-253B-v1-UD-Q3_K_XL-00002-of-00003.gguf filte
92
  UD-Q2_K_XL/Llama-3_1-Nemotron-Ultra-253B-v1-UD-Q2_K_XL-00002-of-00002.gguf filter=lfs diff=lfs merge=lfs -text
93
  UD-Q3_K_XL/Llama-3_1-Nemotron-Ultra-253B-v1-UD-Q3_K_XL-00001-of-00003.gguf filter=lfs diff=lfs merge=lfs -text
94
  UD-Q2_K_XL/Llama-3_1-Nemotron-Ultra-253B-v1-UD-Q2_K_XL-00001-of-00002.gguf filter=lfs diff=lfs merge=lfs -text
 
 
 
 
 
92
  UD-Q2_K_XL/Llama-3_1-Nemotron-Ultra-253B-v1-UD-Q2_K_XL-00002-of-00002.gguf filter=lfs diff=lfs merge=lfs -text
93
  UD-Q3_K_XL/Llama-3_1-Nemotron-Ultra-253B-v1-UD-Q3_K_XL-00001-of-00003.gguf filter=lfs diff=lfs merge=lfs -text
94
  UD-Q2_K_XL/Llama-3_1-Nemotron-Ultra-253B-v1-UD-Q2_K_XL-00001-of-00002.gguf filter=lfs diff=lfs merge=lfs -text
95
+ UD-Q5_K_XL/Llama-3_1-Nemotron-Ultra-253B-v1-UD-Q5_K_XL-00004-of-00004.gguf filter=lfs diff=lfs merge=lfs -text
96
+ UD-Q5_K_XL/Llama-3_1-Nemotron-Ultra-253B-v1-UD-Q5_K_XL-00003-of-00004.gguf filter=lfs diff=lfs merge=lfs -text
97
+ UD-Q5_K_XL/Llama-3_1-Nemotron-Ultra-253B-v1-UD-Q5_K_XL-00001-of-00004.gguf filter=lfs diff=lfs merge=lfs -text
98
+ UD-Q5_K_XL/Llama-3_1-Nemotron-Ultra-253B-v1-UD-Q5_K_XL-00002-of-00004.gguf filter=lfs diff=lfs merge=lfs -text
Q4_K_M/Llama-3_1-Nemotron-Ultra-253B-v1-Q4_K_M-00001-of-00004.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:d58acd2563792fb45392626f441cfbd0b6fecdd58184644fc28f7670e04ef23a
3
- size 49810481536
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:3aa4b07d5ce2216b0c986f96f29e468c4a03a473e282613ad4ef3bf5c3c6a864
3
+ size 49810481984
Q4_K_M/Llama-3_1-Nemotron-Ultra-253B-v1-Q4_K_M-00002-of-00004.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:ab0a2d30ca5ba129f910dbe63ec44f30b80d92bcb76a04bc2bda1bf6a67cbb02
3
  size 47422453952
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:0321203e8f3444fd882ddb4bad79e6658e1e15b7e103f25c87f4a2bbee8a951f
3
  size 47422453952
Q4_K_M/Llama-3_1-Nemotron-Ultra-253B-v1-Q4_K_M-00003-of-00004.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:12db9d81a7a44e7e8daa3df9cf8d8224c9548b2b9834cf4c95c9b0c2b12c3750
3
  size 49638544736
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:2c040a0cc22768683e713685f98dda640a316cd16b5e3c7bd841e31238020aab
3
  size 49638544736
Q4_K_M/Llama-3_1-Nemotron-Ultra-253B-v1-Q4_K_M-00004-of-00004.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:d96818157c94abfee9cfe22436deeea3c9fb1391ee25133c8a09a9020f61e6a0
3
  size 4065396096
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:0a5e19df91133715daa510d8b58b2a154e7261e2f5cffd9dd97bb433e7741fc3
3
  size 4065396096
UD-IQ1_S/Llama-3_1-Nemotron-Ultra-253B-v1-UD-IQ1_S-00001-of-00002.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:b5bd0e1345dce1c4443576968e9075a821234059ff9a655d2384272105cfad6a
3
- size 49967748736
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:b946196b522a05e13f8cd5c42a1df8bef9dce4060c8644f8141ebe0b8be80e3f
3
+ size 49949959008
UD-IQ1_S/Llama-3_1-Nemotron-Ultra-253B-v1-UD-IQ1_S-00002-of-00002.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:df173bee10ae1ffb9c4cc95bc8d6f5bb7d620ee22bba90dd30893189a913efbc
3
- size 29694041504
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:7c174c733be9850c2d4f3698957ef5c11a863ba605c9ebc42b4e4b0429644d79
3
+ size 4901048960
UD-Q2_K_XL/Llama-3_1-Nemotron-Ultra-253B-v1-UD-Q2_K_XL-00001-of-00002.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:db55d8cc569df1c2ab9d7df329e895e80a4b33eebb709bddbe720cf61f4039c6
3
- size 49908236384
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:b4282cb781d5be7613c4f25ca14b05761eb423f84fbf3841a8a2d026175c2b55
3
+ size 49869998304
UD-Q2_K_XL/Llama-3_1-Nemotron-Ultra-253B-v1-UD-Q2_K_XL-00002-of-00002.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:03c3dc53130c2835b51b3adf329429809bdeedc1415e48ea7fc386409e796bac
3
- size 48153932736
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:da4432f36aebef3b6349f970e35c350da3ee8ae92849177b3e3ea0bfb469b8d7
3
+ size 44816379136
UD-Q3_K_XL/Llama-3_1-Nemotron-Ultra-253B-v1-UD-Q3_K_XL-00001-of-00003.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:c44a795486b92e2238f8854a0d0e7dea2c88f86c7403a51c31cf758449469e4c
3
- size 49704119648
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:569c148ed0abdc0625bde8dfb2c6343a372e87677ba3118828fb2f83e504468e
3
+ size 49816842208
UD-Q3_K_XL/Llama-3_1-Nemotron-Ultra-253B-v1-UD-Q3_K_XL-00002-of-00003.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:e81c6395cefb3c49bda7efade3d68b8700d80c4b5dfe37aff2f1190244fea28d
3
- size 47074061952
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:ef276b8aa849b5b0c159c9d9f0e1d4fbaeddad98985128aad3aac68b739bc248
3
+ size 48832982528
UD-Q3_K_XL/Llama-3_1-Nemotron-Ultra-253B-v1-UD-Q3_K_XL-00003-of-00003.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:c7acab0b3385ec0d0bbcc8af9a87547e7400459cdc6362de5300d1ddbe4ef813
3
- size 27530434720
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:0eea2cf3c44fd409cdb9ad8cdbb80f3293e9f658c9e36c91ef91d5dd61c3398d
3
+ size 24520759392
UD-Q4_K_XL/Llama-3_1-Nemotron-Ultra-253B-v1-UD-Q4_K_XL-00001-of-00004.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:d58acd2563792fb45392626f441cfbd0b6fecdd58184644fc28f7670e04ef23a
3
- size 49810481536
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:821b8c855cc2507d3e66c665a0204cf63382e9286100e8b14756b983a18c5309
3
+ size 49649984224
UD-Q4_K_XL/Llama-3_1-Nemotron-Ultra-253B-v1-UD-Q4_K_XL-00002-of-00004.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:ab0a2d30ca5ba129f910dbe63ec44f30b80d92bcb76a04bc2bda1bf6a67cbb02
3
- size 47422453952
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:182f454a62400f4caa9a902e19c8349b18742847cab35c299c227e0161ae514f
3
+ size 47978133824
UD-Q4_K_XL/Llama-3_1-Nemotron-Ultra-253B-v1-UD-Q4_K_XL-00003-of-00004.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:12db9d81a7a44e7e8daa3df9cf8d8224c9548b2b9834cf4c95c9b0c2b12c3750
3
- size 49638544736
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:c6690fdb083de245fb8545140c794754ca6e777c2198c0c77bbb8a3593211bd5
3
+ size 49642870112
UD-Q4_K_XL/Llama-3_1-Nemotron-Ultra-253B-v1-UD-Q4_K_XL-00004-of-00004.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:d96818157c94abfee9cfe22436deeea3c9fb1391ee25133c8a09a9020f61e6a0
3
- size 4065396096
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:5da2ad0880f294f51967c45f04ffdd53f8ae658e80cc1ede031f9e0f67e44691
3
+ size 4576314752
UD-Q5_K_XL/Llama-3_1-Nemotron-Ultra-253B-v1-UD-Q5_K_XL-00001-of-00004.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:29d9947cb6c0fe28ba4721f817bb4dd1557e2f9848c2de263d0849d7e11c1924
3
+ size 49522744032
UD-Q5_K_XL/Llama-3_1-Nemotron-Ultra-253B-v1-UD-Q5_K_XL-00002-of-00004.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:c17ca499a10f748e4816c78d0d6b42fbd99859f3ded1c287ca233fbef0243206
3
+ size 49830180160
UD-Q5_K_XL/Llama-3_1-Nemotron-Ultra-253B-v1-UD-Q5_K_XL-00003-of-00004.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:2c62ad41774dd1eae64bbfefdc0575491cc1d10b0d389df2242b6832bb162a14
3
+ size 47775616704
UD-Q5_K_XL/Llama-3_1-Nemotron-Ultra-253B-v1-UD-Q5_K_XL-00004-of-00004.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:ab55d6102ceb0ef913f97cf55ba5054df580450ea6786dae3f0fdf1a517c87fc
3
+ size 32312924160