Hugging Face's logo

unsloth
/
Llama-3_1-Nemotron-Ultra-253B-v1-GGUF

Text Generation
Transformers
GGUF
PyTorch
English
nemotron-nas
nvidia
llama-3
custom_code
conversational
Model card Files
xet
Community
2
danielhanchen commited on
Commit
6911ec5
·
verified ·
1 Parent(s): 1681cef

Add files using upload-large-folder tool

Browse files
Files changed (16) hide show
  1. .gitattributes +4 -0
  2. Q2_K/Llama-3_1-Nemotron-Ultra-253B-v1-Q2_K-00001-of-00002.gguf +2 -2
  3. Q2_K/Llama-3_1-Nemotron-Ultra-253B-v1-Q2_K-00002-of-00002.gguf +2 -2
  4. Q6_K/Llama-3_1-Nemotron-Ultra-253B-v1-Q6_K-00001-of-00005.gguf +2 -2
  5. Q6_K/Llama-3_1-Nemotron-Ultra-253B-v1-Q6_K-00002-of-00005.gguf +2 -2
  6. Q6_K/Llama-3_1-Nemotron-Ultra-253B-v1-Q6_K-00003-of-00005.gguf +2 -2
  7. Q6_K/Llama-3_1-Nemotron-Ultra-253B-v1-Q6_K-00004-of-00005.gguf +2 -2
  8. Q6_K/Llama-3_1-Nemotron-Ultra-253B-v1-Q6_K-00005-of-00005.gguf +2 -2
  9. UD-IQ1_M/Llama-3_1-Nemotron-Ultra-253B-v1-UD-IQ1_M-00001-of-00002.gguf +2 -2
  10. UD-IQ1_M/Llama-3_1-Nemotron-Ultra-253B-v1-UD-IQ1_M-00002-of-00002.gguf +2 -2
  11. UD-IQ2_M/Llama-3_1-Nemotron-Ultra-253B-v1-UD-IQ2_M-00001-of-00002.gguf +3 -0
  12. UD-IQ2_M/Llama-3_1-Nemotron-Ultra-253B-v1-UD-IQ2_M-00002-of-00002.gguf +3 -0
  13. UD-IQ2_XXS/Llama-3_1-Nemotron-Ultra-253B-v1-UD-IQ2_XXS-00001-of-00002.gguf +2 -2
  14. UD-IQ2_XXS/Llama-3_1-Nemotron-Ultra-253B-v1-UD-IQ2_XXS-00002-of-00002.gguf +2 -2
  15. UD-IQ3_XXS/Llama-3_1-Nemotron-Ultra-253B-v1-UD-IQ3_XXS-00001-of-00002.gguf +3 -0
  16. UD-IQ3_XXS/Llama-3_1-Nemotron-Ultra-253B-v1-UD-IQ3_XXS-00002-of-00002.gguf +3 -0
.gitattributes CHANGED
@@ -96,3 +96,7 @@ UD-Q5_K_XL/Llama-3_1-Nemotron-Ultra-253B-v1-UD-Q5_K_XL-00004-of-00004.gguf filte
96
  UD-Q5_K_XL/Llama-3_1-Nemotron-Ultra-253B-v1-UD-Q5_K_XL-00003-of-00004.gguf filter=lfs diff=lfs merge=lfs -text
97
  UD-Q5_K_XL/Llama-3_1-Nemotron-Ultra-253B-v1-UD-Q5_K_XL-00001-of-00004.gguf filter=lfs diff=lfs merge=lfs -text
98
  UD-Q5_K_XL/Llama-3_1-Nemotron-Ultra-253B-v1-UD-Q5_K_XL-00002-of-00004.gguf filter=lfs diff=lfs merge=lfs -text
 
 
 
 
 
96
  UD-Q5_K_XL/Llama-3_1-Nemotron-Ultra-253B-v1-UD-Q5_K_XL-00003-of-00004.gguf filter=lfs diff=lfs merge=lfs -text
97
  UD-Q5_K_XL/Llama-3_1-Nemotron-Ultra-253B-v1-UD-Q5_K_XL-00001-of-00004.gguf filter=lfs diff=lfs merge=lfs -text
98
  UD-Q5_K_XL/Llama-3_1-Nemotron-Ultra-253B-v1-UD-Q5_K_XL-00002-of-00004.gguf filter=lfs diff=lfs merge=lfs -text
99
+ UD-IQ2_M/Llama-3_1-Nemotron-Ultra-253B-v1-UD-IQ2_M-00002-of-00002.gguf filter=lfs diff=lfs merge=lfs -text
100
+ UD-IQ3_XXS/Llama-3_1-Nemotron-Ultra-253B-v1-UD-IQ3_XXS-00002-of-00002.gguf filter=lfs diff=lfs merge=lfs -text
101
+ UD-IQ3_XXS/Llama-3_1-Nemotron-Ultra-253B-v1-UD-IQ3_XXS-00001-of-00002.gguf filter=lfs diff=lfs merge=lfs -text
102
+ UD-IQ2_M/Llama-3_1-Nemotron-Ultra-253B-v1-UD-IQ2_M-00001-of-00002.gguf filter=lfs diff=lfs merge=lfs -text
Q2_K/Llama-3_1-Nemotron-Ultra-253B-v1-Q2_K-00001-of-00002.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:e5109d921cd11e5816152bc4fecb4bbfb951621f1ae814554371a86d52b406b5
3
- size 49882251424
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:e2fc1fd602161c911814d07e3453ec6720c30689ce428774e8203a8bc7bf4cfc
3
+ size 49875405632
Q2_K/Llama-3_1-Nemotron-Ultra-253B-v1-Q2_K-00002-of-00002.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:a30af1078143b183786604d50686344fc64dcef9c6a35967d4d1155d3c7d8f84
3
- size 47966499712
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:e1a4f2a9e6decaacc06a144e7eda6d708b80aef1c93885019d983f7ebe02b46f
3
+ size 43519683232
Q6_K/Llama-3_1-Nemotron-Ultra-253B-v1-Q6_K-00001-of-00005.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:259829d2bdf37846709409858cbffa2e5fb63e484b3fb8859cda84277fc696e3
3
- size 49901082016
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:1b193fb3eb5e39e6af30ab6825e5701f8ae190001dbe517cf2cdec8451e1e9ac
3
+ size 49656370688
Q6_K/Llama-3_1-Nemotron-Ultra-253B-v1-Q6_K-00002-of-00005.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:bd31673f6669ea9ea65683e6906827a003de3741199b9de144c4c3bea2e92151
3
- size 49906101600
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:995bf9dfbd25e1dabb6c6c441727661514887fce08172c9db0e319d88310b080
3
+ size 49926318528
Q6_K/Llama-3_1-Nemotron-Ultra-253B-v1-Q6_K-00003-of-00005.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:702a731ce6f52cc479d0e131d59c00d375d99f352b22256b43437700712144a1
3
- size 45881727168
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:ba0238dc4fa5472219ce2709e7c9a44b48b15fc44096a19006035d0342580597
3
+ size 44351692160
Q6_K/Llama-3_1-Nemotron-Ultra-253B-v1-Q6_K-00004-of-00005.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:2f51b6eb56837ec9f3cb75e9b787aa43590b33a4d168d6c4a3f7ca8ac17c53e2
3
- size 49506423360
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:982dec54efc6ff8a9594f1b3a944eddba86d31590de67487d3bd1732f29c64f5
3
+ size 49986473280
Q6_K/Llama-3_1-Nemotron-Ultra-253B-v1-Q6_K-00005-of-00005.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:908dbb49f218867f4dcb4aca645d13d87ab829c5659fbaa62f8a94848e6a012f
3
- size 7982352288
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:13771f72c3d5805a3a1b71e59263fba7f901a9cabe9eb46c19998043316e2b17
3
+ size 13962841312
UD-IQ1_M/Llama-3_1-Nemotron-Ultra-253B-v1-UD-IQ1_M-00001-of-00002.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:0594bf96a9dc85066b298ceb357db653409f44e3295601284c817bc2889f2390
3
- size 49964044960
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:f426e3c443050d18193e8bef776404234c6f7f04163cd3000373b22db93ed593
3
+ size 49116536288
UD-IQ1_M/Llama-3_1-Nemotron-Ultra-253B-v1-UD-IQ1_M-00002-of-00002.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:a47e896453a62a6ab1c496f1f188c2d7a2dcbaa9ed531e6ea5d61e198e07d864
3
- size 32983851392
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:8b743101cacc8ecbeba197bb40fc16248b9018e63356ae06eedfef11e384ee6e
3
+ size 10599143424
UD-IQ2_M/Llama-3_1-Nemotron-Ultra-253B-v1-UD-IQ2_M-00001-of-00002.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:80d6ed7a9aef815adba4c8639488ffc47f484fc141d011d4bd17c68749db1e1d
3
+ size 49931014784
UD-IQ2_M/Llama-3_1-Nemotron-Ultra-253B-v1-UD-IQ2_M-00002-of-00002.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:294da1e43353148dcc40c9816eb9d8d04d9ce1c0e05691ea561e51f48e36a70a
3
+ size 36147536736
UD-IQ2_XXS/Llama-3_1-Nemotron-Ultra-253B-v1-UD-IQ2_XXS-00001-of-00002.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:a30c9eed73f1d3af49d44c37b3f7b9494011d0e6e1bc7e7efce7fe2e2dd9be57
3
- size 49866719200
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:17576e655fd1bd586e9093dcb67640335c8889424f0d9b4bf46d78f42cf4330e
3
+ size 49482620032
UD-IQ2_XXS/Llama-3_1-Nemotron-Ultra-253B-v1-UD-IQ2_XXS-00002-of-00002.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:982c2fc37e312fe2cbf0bb45371589ef713ce7b71a814644d6e6165e24310ef4
3
- size 48002839616
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:e357b21d1ac92db3ddd14cce226a4b361c1758e027319108c17fac38feab1e8c
3
+ size 18597091680
UD-IQ3_XXS/Llama-3_1-Nemotron-Ultra-253B-v1-UD-IQ3_XXS-00001-of-00002.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:526fda078614a98a416d93f861330a6de013cdc859d399bbbbee3dae9467e7d8
3
+ size 49995171488
UD-IQ3_XXS/Llama-3_1-Nemotron-Ultra-253B-v1-UD-IQ3_XXS-00002-of-00002.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:208b180c654387f2653f76b81130ee9eeae3ae1c68bf1286ca31b49209426348
3
+ size 48131780448