Hugging Face's logo

unsloth
/
Llama-3_1-Nemotron-Ultra-253B-v1-GGUF

Text Generation
Transformers
GGUF
PyTorch
English
nemotron-nas
nvidia
llama-3
custom_code
conversational
Model card Files
xet
Community
2
danielhanchen commited on
Commit
d78d409
·
verified ·
1 Parent(s): 6843dfb

Add files using upload-large-folder tool

Browse files
Files changed (20) hide show
  1. .gitattributes +19 -0
  2. BF16/Llama-3_1-Nemotron-Ultra-253B-v1-BF16-00001-of-00011.gguf +3 -0
  3. BF16/Llama-3_1-Nemotron-Ultra-253B-v1-BF16-00002-of-00011.gguf +3 -0
  4. BF16/Llama-3_1-Nemotron-Ultra-253B-v1-BF16-00003-of-00011.gguf +3 -0
  5. BF16/Llama-3_1-Nemotron-Ultra-253B-v1-BF16-00004-of-00011.gguf +3 -0
  6. BF16/Llama-3_1-Nemotron-Ultra-253B-v1-BF16-00005-of-00011.gguf +3 -0
  7. BF16/Llama-3_1-Nemotron-Ultra-253B-v1-BF16-00006-of-00011.gguf +3 -0
  8. BF16/Llama-3_1-Nemotron-Ultra-253B-v1-BF16-00007-of-00011.gguf +3 -0
  9. BF16/Llama-3_1-Nemotron-Ultra-253B-v1-BF16-00008-of-00011.gguf +3 -0
  10. BF16/Llama-3_1-Nemotron-Ultra-253B-v1-BF16-00009-of-00011.gguf +3 -0
  11. BF16/Llama-3_1-Nemotron-Ultra-253B-v1-BF16-00010-of-00011.gguf +3 -0
  12. BF16/Llama-3_1-Nemotron-Ultra-253B-v1-BF16-00011-of-00011.gguf +3 -0
  13. UD-IQ1_M/Llama-3_1-Nemotron-Ultra-253B-v1-UD-IQ1_M-00001-of-00002.gguf +3 -0
  14. UD-IQ1_M/Llama-3_1-Nemotron-Ultra-253B-v1-UD-IQ1_M-00002-of-00002.gguf +3 -0
  15. UD-IQ2_XXS/Llama-3_1-Nemotron-Ultra-253B-v1-UD-IQ2_XXS-00001-of-00002.gguf +3 -0
  16. UD-IQ2_XXS/Llama-3_1-Nemotron-Ultra-253B-v1-UD-IQ2_XXS-00002-of-00002.gguf +3 -0
  17. UD-IQ3_XXS/Llama-3_1-Nemotron-Ultra-253B-v1-UD-IQ3_XXS-00001-of-00003.gguf +3 -0
  18. UD-IQ3_XXS/Llama-3_1-Nemotron-Ultra-253B-v1-UD-IQ3_XXS-00002-of-00003.gguf +3 -0
  19. UD-IQ3_XXS/Llama-3_1-Nemotron-Ultra-253B-v1-UD-IQ3_XXS-00003-of-00003.gguf +3 -0
  20. imatrix_unsloth.dat +3 -0
.gitattributes CHANGED
@@ -68,3 +68,22 @@ Q5_K_M/Llama-3_1-Nemotron-Ultra-253B-v1-Q5_K_M-00001-of-00004.gguf filter=lfs di
68
  Q3_K_M/Llama-3_1-Nemotron-Ultra-253B-v1-Q3_K_M-00001-of-00003.gguf filter=lfs diff=lfs merge=lfs -text
69
  Q2_K_L/Llama-3_1-Nemotron-Ultra-253B-v1-Q2_K_L-00002-of-00002.gguf filter=lfs diff=lfs merge=lfs -text
70
  Q2_K_L/Llama-3_1-Nemotron-Ultra-253B-v1-Q2_K_L-00001-of-00002.gguf filter=lfs diff=lfs merge=lfs -text
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
68
  Q3_K_M/Llama-3_1-Nemotron-Ultra-253B-v1-Q3_K_M-00001-of-00003.gguf filter=lfs diff=lfs merge=lfs -text
69
  Q2_K_L/Llama-3_1-Nemotron-Ultra-253B-v1-Q2_K_L-00002-of-00002.gguf filter=lfs diff=lfs merge=lfs -text
70
  Q2_K_L/Llama-3_1-Nemotron-Ultra-253B-v1-Q2_K_L-00001-of-00002.gguf filter=lfs diff=lfs merge=lfs -text
71
+ imatrix_unsloth.dat filter=lfs diff=lfs merge=lfs -text
72
+ UD-IQ3_XXS/Llama-3_1-Nemotron-Ultra-253B-v1-UD-IQ3_XXS-00003-of-00003.gguf filter=lfs diff=lfs merge=lfs -text
73
+ BF16/Llama-3_1-Nemotron-Ultra-253B-v1-BF16-00011-of-00011.gguf filter=lfs diff=lfs merge=lfs -text
74
+ UD-IQ1_M/Llama-3_1-Nemotron-Ultra-253B-v1-UD-IQ1_M-00002-of-00002.gguf filter=lfs diff=lfs merge=lfs -text
75
+ BF16/Llama-3_1-Nemotron-Ultra-253B-v1-BF16-00008-of-00011.gguf filter=lfs diff=lfs merge=lfs -text
76
+ BF16/Llama-3_1-Nemotron-Ultra-253B-v1-BF16-00009-of-00011.gguf filter=lfs diff=lfs merge=lfs -text
77
+ BF16/Llama-3_1-Nemotron-Ultra-253B-v1-BF16-00007-of-00011.gguf filter=lfs diff=lfs merge=lfs -text
78
+ UD-IQ3_XXS/Llama-3_1-Nemotron-Ultra-253B-v1-UD-IQ3_XXS-00002-of-00003.gguf filter=lfs diff=lfs merge=lfs -text
79
+ UD-IQ2_XXS/Llama-3_1-Nemotron-Ultra-253B-v1-UD-IQ2_XXS-00002-of-00002.gguf filter=lfs diff=lfs merge=lfs -text
80
+ BF16/Llama-3_1-Nemotron-Ultra-253B-v1-BF16-00002-of-00011.gguf filter=lfs diff=lfs merge=lfs -text
81
+ BF16/Llama-3_1-Nemotron-Ultra-253B-v1-BF16-00010-of-00011.gguf filter=lfs diff=lfs merge=lfs -text
82
+ BF16/Llama-3_1-Nemotron-Ultra-253B-v1-BF16-00001-of-00011.gguf filter=lfs diff=lfs merge=lfs -text
83
+ BF16/Llama-3_1-Nemotron-Ultra-253B-v1-BF16-00006-of-00011.gguf filter=lfs diff=lfs merge=lfs -text
84
+ BF16/Llama-3_1-Nemotron-Ultra-253B-v1-BF16-00004-of-00011.gguf filter=lfs diff=lfs merge=lfs -text
85
+ UD-IQ3_XXS/Llama-3_1-Nemotron-Ultra-253B-v1-UD-IQ3_XXS-00001-of-00003.gguf filter=lfs diff=lfs merge=lfs -text
86
+ UD-IQ2_XXS/Llama-3_1-Nemotron-Ultra-253B-v1-UD-IQ2_XXS-00001-of-00002.gguf filter=lfs diff=lfs merge=lfs -text
87
+ BF16/Llama-3_1-Nemotron-Ultra-253B-v1-BF16-00005-of-00011.gguf filter=lfs diff=lfs merge=lfs -text
88
+ BF16/Llama-3_1-Nemotron-Ultra-253B-v1-BF16-00003-of-00011.gguf filter=lfs diff=lfs merge=lfs -text
89
+ UD-IQ1_M/Llama-3_1-Nemotron-Ultra-253B-v1-UD-IQ1_M-00001-of-00002.gguf filter=lfs diff=lfs merge=lfs -text
BF16/Llama-3_1-Nemotron-Ultra-253B-v1-BF16-00001-of-00011.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:994139aa250cd9d6cc16faf46cef439a5faa4bf4d0a73d835962f507867c28bb
3
+ size 49636669440
BF16/Llama-3_1-Nemotron-Ultra-253B-v1-BF16-00002-of-00011.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:9b6e163dbd72ac5483ae31618d1e5f59022411d3816022ca9c05bd17e389c11e
3
+ size 48285749696
BF16/Llama-3_1-Nemotron-Ultra-253B-v1-BF16-00003-of-00011.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:e70c1b2d6f49ca5815db13a3673c1f01ca86e42708a831c8a0adac61f213ba3f
3
+ size 49661940544
BF16/Llama-3_1-Nemotron-Ultra-253B-v1-BF16-00004-of-00011.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:1e9589b98be736c6270cd87f64ff128dbdf58658b08d4cefae5009ecc63f26f3
3
+ size 49258959104
BF16/Llama-3_1-Nemotron-Ultra-253B-v1-BF16-00005-of-00011.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:9dccf0bc344ac979776a8bd279e417563fe0503723d5348cdc28c997a7f7d94a
3
+ size 49627861760
BF16/Llama-3_1-Nemotron-Ultra-253B-v1-BF16-00006-of-00011.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:533366f818732b4372ee92e45e046a97a71750e28d960e647f8d3149a7e93909
3
+ size 49612068288
BF16/Llama-3_1-Nemotron-Ultra-253B-v1-BF16-00007-of-00011.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:e2cce932239d1f335ace8fb38a00ec6684f82225ff0f5fb18c4431e72a2851eb
3
+ size 44937773792
BF16/Llama-3_1-Nemotron-Ultra-253B-v1-BF16-00008-of-00011.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:65f3b5a5aec0de204789568471ae688a75452a7f691801442ee656064d134f18
3
+ size 41875931456
BF16/Llama-3_1-Nemotron-Ultra-253B-v1-BF16-00009-of-00011.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:7695b021677abbf88ce85768f8753a02267404e3cec6632c7855f3d3effe9efb
3
+ size 43587207552
BF16/Llama-3_1-Nemotron-Ultra-253B-v1-BF16-00010-of-00011.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:8a1e935f3b5d6e73e2b13808542dd8c08946012f964aa123f22b16b4b416a5de
3
+ size 49577594272
BF16/Llama-3_1-Nemotron-Ultra-253B-v1-BF16-00011-of-00011.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:296bd69c5934754de9a0e9d087730dee8a4ead0c8ee4f192b556b5ccf8d16987
3
+ size 30753426688
UD-IQ1_M/Llama-3_1-Nemotron-Ultra-253B-v1-UD-IQ1_M-00001-of-00002.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:0594bf96a9dc85066b298ceb357db653409f44e3295601284c817bc2889f2390
3
+ size 49964044960
UD-IQ1_M/Llama-3_1-Nemotron-Ultra-253B-v1-UD-IQ1_M-00002-of-00002.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:a47e896453a62a6ab1c496f1f188c2d7a2dcbaa9ed531e6ea5d61e198e07d864
3
+ size 32983851392
UD-IQ2_XXS/Llama-3_1-Nemotron-Ultra-253B-v1-UD-IQ2_XXS-00001-of-00002.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:a30c9eed73f1d3af49d44c37b3f7b9494011d0e6e1bc7e7efce7fe2e2dd9be57
3
+ size 49866719200
UD-IQ2_XXS/Llama-3_1-Nemotron-Ultra-253B-v1-UD-IQ2_XXS-00002-of-00002.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:982c2fc37e312fe2cbf0bb45371589ef713ce7b71a814644d6e6165e24310ef4
3
+ size 48002839616
UD-IQ3_XXS/Llama-3_1-Nemotron-Ultra-253B-v1-UD-IQ3_XXS-00001-of-00003.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:4865210341bb10f478515809bf726a9cce9fb390fe0fec8827defa6c3c0d4d0e
3
+ size 49678332384
UD-IQ3_XXS/Llama-3_1-Nemotron-Ultra-253B-v1-UD-IQ3_XXS-00002-of-00003.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:5fcd0b75988140115601540f3556d4976d5862fe921917b45b96971c5a77b300
3
+ size 47824382720
UD-IQ3_XXS/Llama-3_1-Nemotron-Ultra-253B-v1-UD-IQ3_XXS-00003-of-00003.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:3cf07f1ebeb3301e48f9259829f347719ca2a213b373b7d5a4b8abb2b697ccba
3
+ size 18105767872
imatrix_unsloth.dat ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:fc5ce957d2c1c2e5af83b69785adc405a5aff92af205c1ae0d6a5839ede29bc8
3
+ size 44719474