morriszms commited on
Commit
4d1af25
·
verified ·
1 Parent(s): 6faa422

Upload folder using huggingface_hub

Browse files
.gitattributes CHANGED
@@ -33,3 +33,15 @@ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
33
  *.zip filter=lfs diff=lfs merge=lfs -text
34
  *.zst filter=lfs diff=lfs merge=lfs -text
35
  *tfevents* filter=lfs diff=lfs merge=lfs -text
 
 
 
 
 
 
 
 
 
 
 
 
 
33
  *.zip filter=lfs diff=lfs merge=lfs -text
34
  *.zst filter=lfs diff=lfs merge=lfs -text
35
  *tfevents* filter=lfs diff=lfs merge=lfs -text
36
+ sparql-model-era-lora-128-qwen3-0.6b-Q2_K.gguf filter=lfs diff=lfs merge=lfs -text
37
+ sparql-model-era-lora-128-qwen3-0.6b-Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text
38
+ sparql-model-era-lora-128-qwen3-0.6b-Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text
39
+ sparql-model-era-lora-128-qwen3-0.6b-Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text
40
+ sparql-model-era-lora-128-qwen3-0.6b-Q4_0.gguf filter=lfs diff=lfs merge=lfs -text
41
+ sparql-model-era-lora-128-qwen3-0.6b-Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
42
+ sparql-model-era-lora-128-qwen3-0.6b-Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text
43
+ sparql-model-era-lora-128-qwen3-0.6b-Q5_0.gguf filter=lfs diff=lfs merge=lfs -text
44
+ sparql-model-era-lora-128-qwen3-0.6b-Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text
45
+ sparql-model-era-lora-128-qwen3-0.6b-Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text
46
+ sparql-model-era-lora-128-qwen3-0.6b-Q6_K.gguf filter=lfs diff=lfs merge=lfs -text
47
+ sparql-model-era-lora-128-qwen3-0.6b-Q8_0.gguf filter=lfs diff=lfs merge=lfs -text
README.md ADDED
@@ -0,0 +1,148 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ base_model: daniel-dona/sparql-model-era-lora-128-qwen3-0.6b
3
+ library_name: transformers
4
+ tags:
5
+ - TensorBlock
6
+ - GGUF
7
+ ---
8
+
9
+ <div style="width: auto; margin-left: auto; margin-right: auto">
10
+ <img src="https://i.imgur.com/jC7kdl8.jpeg" alt="TensorBlock" style="width: 100%; min-width: 400px; display: block; margin: auto;">
11
+ </div>
12
+
13
+ [![Website](https://img.shields.io/badge/Website-tensorblock.co-blue?logo=google-chrome&logoColor=white)](https://tensorblock.co)
14
+ [![Twitter](https://img.shields.io/twitter/follow/tensorblock_aoi?style=social)](https://twitter.com/tensorblock_aoi)
15
+ [![Discord](https://img.shields.io/badge/Discord-Join%20Us-5865F2?logo=discord&logoColor=white)](https://discord.gg/Ej5NmeHFf2)
16
+ [![GitHub](https://img.shields.io/badge/GitHub-TensorBlock-black?logo=github&logoColor=white)](https://github.com/TensorBlock)
17
+ [![Telegram](https://img.shields.io/badge/Telegram-Group-blue?logo=telegram)](https://t.me/TensorBlock)
18
+
19
+
20
+ ## daniel-dona/sparql-model-era-lora-128-qwen3-0.6b - GGUF
21
+
22
+ <div style="text-align: left; margin: 20px 0;">
23
+ <a href="https://discord.com/invite/Ej5NmeHFf2" style="display: inline-block; padding: 10px 20px; background-color: #5865F2; color: white; text-decoration: none; border-radius: 5px; font-weight: bold;">
24
+ Join our Discord to learn more about what we're building ↗
25
+ </a>
26
+ </div>
27
+
28
+ This repo contains GGUF format model files for [daniel-dona/sparql-model-era-lora-128-qwen3-0.6b](https://huggingface.co/daniel-dona/sparql-model-era-lora-128-qwen3-0.6b).
29
+
30
+ The files were quantized using machines provided by [TensorBlock](https://tensorblock.co/), and they are compatible with llama.cpp as of [commit b5753](https://github.com/ggml-org/llama.cpp/commit/73e53dc834c0a2336cd104473af6897197b96277).
31
+
32
+ ## Our projects
33
+ <table border="1" cellspacing="0" cellpadding="10">
34
+ <tr>
35
+ <th colspan="2" style="font-size: 25px;">Forge</th>
36
+ </tr>
37
+ <tr>
38
+ <th colspan="2">
39
+ <img src="https://imgur.com/faI5UKh.jpeg" alt="Forge Project" width="900"/>
40
+ </th>
41
+ </tr>
42
+ <tr>
43
+ <th colspan="2">An OpenAI-compatible multi-provider routing layer.</th>
44
+ </tr>
45
+ <tr>
46
+ <th colspan="2">
47
+ <a href="https://github.com/TensorBlock/forge" target="_blank" style="
48
+ display: inline-block;
49
+ padding: 8px 16px;
50
+ background-color: #FF7F50;
51
+ color: white;
52
+ text-decoration: none;
53
+ border-radius: 6px;
54
+ font-weight: bold;
55
+ font-family: sans-serif;
56
+ ">🚀 Try it now! 🚀</a>
57
+ </th>
58
+ </tr>
59
+
60
+ <tr>
61
+ <th style="font-size: 25px;">Awesome MCP Servers</th>
62
+ <th style="font-size: 25px;">TensorBlock Studio</th>
63
+ </tr>
64
+ <tr>
65
+ <th><img src="https://imgur.com/2Xov7B7.jpeg" alt="MCP Servers" width="450"/></th>
66
+ <th><img src="https://imgur.com/pJcmF5u.jpeg" alt="Studio" width="450"/></th>
67
+ </tr>
68
+ <tr>
69
+ <th>A comprehensive collection of Model Context Protocol (MCP) servers.</th>
70
+ <th>A lightweight, open, and extensible multi-LLM interaction studio.</th>
71
+ </tr>
72
+ <tr>
73
+ <th>
74
+ <a href="https://github.com/TensorBlock/awesome-mcp-servers" target="_blank" style="
75
+ display: inline-block;
76
+ padding: 8px 16px;
77
+ background-color: #FF7F50;
78
+ color: white;
79
+ text-decoration: none;
80
+ border-radius: 6px;
81
+ font-weight: bold;
82
+ font-family: sans-serif;
83
+ ">👀 See what we built 👀</a>
84
+ </th>
85
+ <th>
86
+ <a href="https://github.com/TensorBlock/TensorBlock-Studio" target="_blank" style="
87
+ display: inline-block;
88
+ padding: 8px 16px;
89
+ background-color: #FF7F50;
90
+ color: white;
91
+ text-decoration: none;
92
+ border-radius: 6px;
93
+ font-weight: bold;
94
+ font-family: sans-serif;
95
+ ">👀 See what we built 👀</a>
96
+ </th>
97
+ </tr>
98
+ </table>
99
+
100
+ ## Prompt template
101
+
102
+ ```
103
+ <|im_start|>system
104
+ {system_prompt}<|im_end|>
105
+ <|im_start|>user
106
+ {prompt}<|im_end|>
107
+ <|im_start|>assistant
108
+ ```
109
+
110
+ ## Model file specification
111
+
112
+ | Filename | Quant type | File Size | Description |
113
+ | -------- | ---------- | --------- | ----------- |
114
+ | [sparql-model-era-lora-128-qwen3-0.6b-Q2_K.gguf](https://huggingface.co/tensorblock/daniel-dona_sparql-model-era-lora-128-qwen3-0.6b-GGUF/blob/main/sparql-model-era-lora-128-qwen3-0.6b-Q2_K.gguf) | Q2_K | 0.296 GB | smallest, significant quality loss - not recommended for most purposes |
115
+ | [sparql-model-era-lora-128-qwen3-0.6b-Q3_K_S.gguf](https://huggingface.co/tensorblock/daniel-dona_sparql-model-era-lora-128-qwen3-0.6b-GGUF/blob/main/sparql-model-era-lora-128-qwen3-0.6b-Q3_K_S.gguf) | Q3_K_S | 0.323 GB | very small, high quality loss |
116
+ | [sparql-model-era-lora-128-qwen3-0.6b-Q3_K_M.gguf](https://huggingface.co/tensorblock/daniel-dona_sparql-model-era-lora-128-qwen3-0.6b-GGUF/blob/main/sparql-model-era-lora-128-qwen3-0.6b-Q3_K_M.gguf) | Q3_K_M | 0.347 GB | very small, high quality loss |
117
+ | [sparql-model-era-lora-128-qwen3-0.6b-Q3_K_L.gguf](https://huggingface.co/tensorblock/daniel-dona_sparql-model-era-lora-128-qwen3-0.6b-GGUF/blob/main/sparql-model-era-lora-128-qwen3-0.6b-Q3_K_L.gguf) | Q3_K_L | 0.368 GB | small, substantial quality loss |
118
+ | [sparql-model-era-lora-128-qwen3-0.6b-Q4_0.gguf](https://huggingface.co/tensorblock/daniel-dona_sparql-model-era-lora-128-qwen3-0.6b-GGUF/blob/main/sparql-model-era-lora-128-qwen3-0.6b-Q4_0.gguf) | Q4_0 | 0.382 GB | legacy; small, very high quality loss - prefer using Q3_K_M |
119
+ | [sparql-model-era-lora-128-qwen3-0.6b-Q4_K_S.gguf](https://huggingface.co/tensorblock/daniel-dona_sparql-model-era-lora-128-qwen3-0.6b-GGUF/blob/main/sparql-model-era-lora-128-qwen3-0.6b-Q4_K_S.gguf) | Q4_K_S | 0.383 GB | small, greater quality loss |
120
+ | [sparql-model-era-lora-128-qwen3-0.6b-Q4_K_M.gguf](https://huggingface.co/tensorblock/daniel-dona_sparql-model-era-lora-128-qwen3-0.6b-GGUF/blob/main/sparql-model-era-lora-128-qwen3-0.6b-Q4_K_M.gguf) | Q4_K_M | 0.397 GB | medium, balanced quality - recommended |
121
+ | [sparql-model-era-lora-128-qwen3-0.6b-Q5_0.gguf](https://huggingface.co/tensorblock/daniel-dona_sparql-model-era-lora-128-qwen3-0.6b-GGUF/blob/main/sparql-model-era-lora-128-qwen3-0.6b-Q5_0.gguf) | Q5_0 | 0.437 GB | legacy; medium, balanced quality - prefer using Q4_K_M |
122
+ | [sparql-model-era-lora-128-qwen3-0.6b-Q5_K_S.gguf](https://huggingface.co/tensorblock/daniel-dona_sparql-model-era-lora-128-qwen3-0.6b-GGUF/blob/main/sparql-model-era-lora-128-qwen3-0.6b-Q5_K_S.gguf) | Q5_K_S | 0.437 GB | large, low quality loss - recommended |
123
+ | [sparql-model-era-lora-128-qwen3-0.6b-Q5_K_M.gguf](https://huggingface.co/tensorblock/daniel-dona_sparql-model-era-lora-128-qwen3-0.6b-GGUF/blob/main/sparql-model-era-lora-128-qwen3-0.6b-Q5_K_M.gguf) | Q5_K_M | 0.444 GB | large, very low quality loss - recommended |
124
+ | [sparql-model-era-lora-128-qwen3-0.6b-Q6_K.gguf](https://huggingface.co/tensorblock/daniel-dona_sparql-model-era-lora-128-qwen3-0.6b-GGUF/blob/main/sparql-model-era-lora-128-qwen3-0.6b-Q6_K.gguf) | Q6_K | 0.495 GB | very large, extremely low quality loss |
125
+ | [sparql-model-era-lora-128-qwen3-0.6b-Q8_0.gguf](https://huggingface.co/tensorblock/daniel-dona_sparql-model-era-lora-128-qwen3-0.6b-GGUF/blob/main/sparql-model-era-lora-128-qwen3-0.6b-Q8_0.gguf) | Q8_0 | 0.639 GB | very large, extremely low quality loss - not recommended |
126
+
127
+
128
+ ## Downloading instruction
129
+
130
+ ### Command line
131
+
132
+ Firstly, install Huggingface Client
133
+
134
+ ```shell
135
+ pip install -U "huggingface_hub[cli]"
136
+ ```
137
+
138
+ Then, downoad the individual model file the a local directory
139
+
140
+ ```shell
141
+ huggingface-cli download tensorblock/daniel-dona_sparql-model-era-lora-128-qwen3-0.6b-GGUF --include "sparql-model-era-lora-128-qwen3-0.6b-Q2_K.gguf" --local-dir MY_LOCAL_DIR
142
+ ```
143
+
144
+ If you wanna download multiple model files with a pattern (e.g., `*Q4_K*gguf`), you can try:
145
+
146
+ ```shell
147
+ huggingface-cli download tensorblock/daniel-dona_sparql-model-era-lora-128-qwen3-0.6b-GGUF --local-dir MY_LOCAL_DIR --local-dir-use-symlinks False --include='*Q4_K*gguf'
148
+ ```
sparql-model-era-lora-128-qwen3-0.6b-Q2_K.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:8091c7dc9ce7ad8c81cf7f8c5bbbea03f002a9de4b6fbd045628bf268c533642
3
+ size 296238848
sparql-model-era-lora-128-qwen3-0.6b-Q3_K_L.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:86537896e2ffe14ad4a04d4f55dcb45cf623b4ecd0767aeca6cac12d4628a2dd
3
+ size 368492288
sparql-model-era-lora-128-qwen3-0.6b-Q3_K_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:2ac985fb229e4bd406d01a6c11870fdbbf88d1c1f24cbcd99aa7876b2b6c117d
3
+ size 347127552
sparql-model-era-lora-128-qwen3-0.6b-Q3_K_S.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:bb10b9d18b0245bc7d2bd3cb5626653841be827fafde3fc29275580d8aac0a9b
3
+ size 323075840
sparql-model-era-lora-128-qwen3-0.6b-Q4_0.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:a4858736cb63b0010244a99370fd4bcea6f54e2859ee701200d5566465868011
3
+ size 381566720
sparql-model-era-lora-128-qwen3-0.6b-Q4_K_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:6dab869f40bf33fb19a07249cedb69358b521cc3583132af2dc129615c824ea8
3
+ size 396705536
sparql-model-era-lora-128-qwen3-0.6b-Q4_K_S.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:0ac42ccbea7b37be5541c2c7a082120a2fcb23bc8e93da5ab10eed83bd13bb46
3
+ size 383270656
sparql-model-era-lora-128-qwen3-0.6b-Q5_0.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:2234199974f9de5991ba9cf03e7e89e56e2940dc5e019f2aaf50b97215589573
3
+ size 436616960
sparql-model-era-lora-128-qwen3-0.6b-Q5_K_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:3cd485d7266ea3a8c86eaf7a4ef7e03765319d6abd146e71cd9e897c0a8770e6
3
+ size 444415744
sparql-model-era-lora-128-qwen3-0.6b-Q5_K_S.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:bdcd2d32fdbfa857091b3e482ef6100c42277065792ebf4a12b0f1277c97643a
3
+ size 436616960
sparql-model-era-lora-128-qwen3-0.6b-Q6_K.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:a68a238b5220a2ce212743af099c8286b98e8f17956f94e4c1eab9801402cc9d
3
+ size 495107840
sparql-model-era-lora-128-qwen3-0.6b-Q8_0.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:f2913f5ddf6dc3f343f7297693c7b87fa5a23e35282321295bd45749c2efec93
3
+ size 639447808