Hugging Face's logo

unsloth
/
Llama-3_1-Nemotron-Ultra-253B-v1-GGUF

Text Generation
Transformers
GGUF
PyTorch
English
nemotron-nas
nvidia
llama-3
custom_code
conversational
Model card Files
xet
Community
2
danielhanchen commited on
Commit
364e8bb
·
verified ·
1 Parent(s): 7e5d352

Add files using upload-large-folder tool

Browse files
Files changed (12) hide show
  1. .gitattributes +11 -0
  2. Q2_K/Llama-3_1-Nemotron-Ultra-253B-v1-Q2_K-00001-of-00002.gguf +3 -0
  3. Q2_K/Llama-3_1-Nemotron-Ultra-253B-v1-Q2_K-00002-of-00002.gguf +3 -0
  4. Q4_K_M/Llama-3_1-Nemotron-Ultra-253B-v1-Q4_K_M-00001-of-00004.gguf +3 -0
  5. Q4_K_M/Llama-3_1-Nemotron-Ultra-253B-v1-Q4_K_M-00002-of-00004.gguf +3 -0
  6. Q4_K_M/Llama-3_1-Nemotron-Ultra-253B-v1-Q4_K_M-00003-of-00004.gguf +3 -0
  7. Q4_K_M/Llama-3_1-Nemotron-Ultra-253B-v1-Q4_K_M-00004-of-00004.gguf +3 -0
  8. Q6_K/Llama-3_1-Nemotron-Ultra-253B-v1-Q6_K-00001-of-00005.gguf +3 -0
  9. Q6_K/Llama-3_1-Nemotron-Ultra-253B-v1-Q6_K-00002-of-00005.gguf +3 -0
  10. Q6_K/Llama-3_1-Nemotron-Ultra-253B-v1-Q6_K-00003-of-00005.gguf +3 -0
  11. Q6_K/Llama-3_1-Nemotron-Ultra-253B-v1-Q6_K-00004-of-00005.gguf +3 -0
  12. Q6_K/Llama-3_1-Nemotron-Ultra-253B-v1-Q6_K-00005-of-00005.gguf +3 -0
.gitattributes CHANGED
@@ -48,3 +48,14 @@ UD-IQ2_M/Llama-3_1-Nemotron-Ultra-253B-v1-UD-IQ2_M-00002-of-00003.gguf filter=lf
48
  UD-IQ1_S/Llama-3_1-Nemotron-Ultra-253B-v1-UD-IQ1_S-00001-of-00002.gguf filter=lfs diff=lfs merge=lfs -text
49
  Q8_0/Llama-3_1-Nemotron-Ultra-253B-v1-Q8_0-00001-of-00006.gguf filter=lfs diff=lfs merge=lfs -text
50
  Q8_0/Llama-3_1-Nemotron-Ultra-253B-v1-Q8_0-00003-of-00006.gguf filter=lfs diff=lfs merge=lfs -text
 
 
 
 
 
 
 
 
 
 
 
 
48
  UD-IQ1_S/Llama-3_1-Nemotron-Ultra-253B-v1-UD-IQ1_S-00001-of-00002.gguf filter=lfs diff=lfs merge=lfs -text
49
  Q8_0/Llama-3_1-Nemotron-Ultra-253B-v1-Q8_0-00001-of-00006.gguf filter=lfs diff=lfs merge=lfs -text
50
  Q8_0/Llama-3_1-Nemotron-Ultra-253B-v1-Q8_0-00003-of-00006.gguf filter=lfs diff=lfs merge=lfs -text
51
+ Q4_K_M/Llama-3_1-Nemotron-Ultra-253B-v1-Q4_K_M-00004-of-00004.gguf filter=lfs diff=lfs merge=lfs -text
52
+ Q6_K/Llama-3_1-Nemotron-Ultra-253B-v1-Q6_K-00005-of-00005.gguf filter=lfs diff=lfs merge=lfs -text
53
+ Q6_K/Llama-3_1-Nemotron-Ultra-253B-v1-Q6_K-00003-of-00005.gguf filter=lfs diff=lfs merge=lfs -text
54
+ Q4_K_M/Llama-3_1-Nemotron-Ultra-253B-v1-Q4_K_M-00002-of-00004.gguf filter=lfs diff=lfs merge=lfs -text
55
+ Q4_K_M/Llama-3_1-Nemotron-Ultra-253B-v1-Q4_K_M-00003-of-00004.gguf filter=lfs diff=lfs merge=lfs -text
56
+ Q6_K/Llama-3_1-Nemotron-Ultra-253B-v1-Q6_K-00002-of-00005.gguf filter=lfs diff=lfs merge=lfs -text
57
+ Q4_K_M/Llama-3_1-Nemotron-Ultra-253B-v1-Q4_K_M-00001-of-00004.gguf filter=lfs diff=lfs merge=lfs -text
58
+ Q2_K/Llama-3_1-Nemotron-Ultra-253B-v1-Q2_K-00001-of-00002.gguf filter=lfs diff=lfs merge=lfs -text
59
+ Q6_K/Llama-3_1-Nemotron-Ultra-253B-v1-Q6_K-00004-of-00005.gguf filter=lfs diff=lfs merge=lfs -text
60
+ Q6_K/Llama-3_1-Nemotron-Ultra-253B-v1-Q6_K-00001-of-00005.gguf filter=lfs diff=lfs merge=lfs -text
61
+ Q2_K/Llama-3_1-Nemotron-Ultra-253B-v1-Q2_K-00002-of-00002.gguf filter=lfs diff=lfs merge=lfs -text
Q2_K/Llama-3_1-Nemotron-Ultra-253B-v1-Q2_K-00001-of-00002.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:e5109d921cd11e5816152bc4fecb4bbfb951621f1ae814554371a86d52b406b5
3
+ size 49882251424
Q2_K/Llama-3_1-Nemotron-Ultra-253B-v1-Q2_K-00002-of-00002.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:a30af1078143b183786604d50686344fc64dcef9c6a35967d4d1155d3c7d8f84
3
+ size 47966499712
Q4_K_M/Llama-3_1-Nemotron-Ultra-253B-v1-Q4_K_M-00001-of-00004.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:d58acd2563792fb45392626f441cfbd0b6fecdd58184644fc28f7670e04ef23a
3
+ size 49810481536
Q4_K_M/Llama-3_1-Nemotron-Ultra-253B-v1-Q4_K_M-00002-of-00004.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:ab0a2d30ca5ba129f910dbe63ec44f30b80d92bcb76a04bc2bda1bf6a67cbb02
3
+ size 47422453952
Q4_K_M/Llama-3_1-Nemotron-Ultra-253B-v1-Q4_K_M-00003-of-00004.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:12db9d81a7a44e7e8daa3df9cf8d8224c9548b2b9834cf4c95c9b0c2b12c3750
3
+ size 49638544736
Q4_K_M/Llama-3_1-Nemotron-Ultra-253B-v1-Q4_K_M-00004-of-00004.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:d96818157c94abfee9cfe22436deeea3c9fb1391ee25133c8a09a9020f61e6a0
3
+ size 4065396096
Q6_K/Llama-3_1-Nemotron-Ultra-253B-v1-Q6_K-00001-of-00005.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:259829d2bdf37846709409858cbffa2e5fb63e484b3fb8859cda84277fc696e3
3
+ size 49901082016
Q6_K/Llama-3_1-Nemotron-Ultra-253B-v1-Q6_K-00002-of-00005.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:bd31673f6669ea9ea65683e6906827a003de3741199b9de144c4c3bea2e92151
3
+ size 49906101600
Q6_K/Llama-3_1-Nemotron-Ultra-253B-v1-Q6_K-00003-of-00005.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:702a731ce6f52cc479d0e131d59c00d375d99f352b22256b43437700712144a1
3
+ size 45881727168
Q6_K/Llama-3_1-Nemotron-Ultra-253B-v1-Q6_K-00004-of-00005.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:2f51b6eb56837ec9f3cb75e9b787aa43590b33a4d168d6c4a3f7ca8ac17c53e2
3
+ size 49506423360
Q6_K/Llama-3_1-Nemotron-Ultra-253B-v1-Q6_K-00005-of-00005.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:908dbb49f218867f4dcb4aca645d13d87ab829c5659fbaa62f8a94848e6a012f
3
+ size 7982352288