Hugging Face's logo

gabriellarson
/
NFT-7B-GGUF

Text Generation
Transformers
GGUF
English
nvidia
math
reasoning
post-training
qwen
imatrix
conversational
Model card Files
xet
Community
gabriellarson commited on
Commit
072e87a
·
verified ·
1 Parent(s): 3d8c7af

Upload folder using huggingface_hub

Browse files
Files changed (10) hide show
  1. .gitattributes +9 -0
  2. NFT-7B-IQ3_S.gguf +3 -0
  3. NFT-7B-IQ4_XS.gguf +3 -0
  4. NFT-7B-Q3_K_L.gguf +3 -0
  5. NFT-7B-Q3_K_M.gguf +3 -0
  6. NFT-7B-Q3_K_S.gguf +3 -0
  7. NFT-7B-Q4_K_M.gguf +3 -0
  8. NFT-7B-Q5_K_S.gguf +3 -0
  9. NFT-7B-Q6_K.gguf +3 -0
  10. NFT-7B-Q8_0.gguf +3 -0
.gitattributes CHANGED
@@ -54,3 +54,12 @@ NFT-7B-IQ3_XXS.gguf filter=lfs diff=lfs merge=lfs -text
54
  NFT-7B-IQ4_NL.gguf filter=lfs diff=lfs merge=lfs -text
55
  NFT-7B-Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text
56
  NFT-7B-Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text
 
 
 
 
 
 
 
 
 
 
54
  NFT-7B-IQ4_NL.gguf filter=lfs diff=lfs merge=lfs -text
55
  NFT-7B-Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text
56
  NFT-7B-Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text
57
+ NFT-7B-IQ3_S.gguf filter=lfs diff=lfs merge=lfs -text
58
+ NFT-7B-IQ4_XS.gguf filter=lfs diff=lfs merge=lfs -text
59
+ NFT-7B-Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text
60
+ NFT-7B-Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text
61
+ NFT-7B-Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text
62
+ NFT-7B-Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
63
+ NFT-7B-Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text
64
+ NFT-7B-Q6_K.gguf filter=lfs diff=lfs merge=lfs -text
65
+ NFT-7B-Q8_0.gguf filter=lfs diff=lfs merge=lfs -text
NFT-7B-IQ3_S.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:b9505a2b5898ace517dd28cc8d0ea01eba57ecd614402fd9e62cc6e2564341da
3
+ size 3499193248
NFT-7B-IQ4_XS.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:9e5ab39a7e9add2e024e47d87814703904a403bfc01e552fb6148c2145514e7d
3
+ size 4218473376
NFT-7B-Q3_K_L.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:5b88f5455839ea1b696e7f1d16768b6302a0c1fb4537560ee117b97f7d4b5cc0
3
+ size 4088460192
NFT-7B-Q3_K_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:f3fd9fb9004fdac5013e7f1b2639c47f3ff11958fb6ae133958cee6a2849ae8e
3
+ size 3808392096
NFT-7B-Q3_K_S.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:fea31c699f9d708e89675507691d116c8cec3b3be3a57e40e1ffcf4e44876782
3
+ size 3492369312
NFT-7B-Q4_K_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:c76171a5ac6d7b4f363f73814874a449b5ebaae562e4d0a04abf307f6a58334e
3
+ size 4683074464
NFT-7B-Q5_K_S.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:586aa6569a7f965ee175d7fddfe77714a065b66960cb3e745d682028f402f316
3
+ size 5315177376
NFT-7B-Q6_K.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:77b0257571ea9e7ecafeb9cbfcbaf1a9a3a0160973397bbd819111232f16a40a
3
+ size 6254199712
NFT-7B-Q8_0.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:631c3e4d0b394518de0af024b6d9fd18b156cbd8e99c3e4f48896dcaf9e921a9
3
+ size 8098526112