Upload folder using huggingface_hub

.gitattributes

@@ -33,3 +33,15 @@ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
 *.zip filter=lfs diff=lfs merge=lfs -text
 *.zst filter=lfs diff=lfs merge=lfs -text
 *tfevents* filter=lfs diff=lfs merge=lfs -text
+shieldgemma-9b-Q2_K.gguf filter=lfs diff=lfs merge=lfs -text
+shieldgemma-9b-Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text
+shieldgemma-9b-Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text
+shieldgemma-9b-Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text
+shieldgemma-9b-Q4_0.gguf filter=lfs diff=lfs merge=lfs -text
+shieldgemma-9b-Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
+shieldgemma-9b-Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text
+shieldgemma-9b-Q5_0.gguf filter=lfs diff=lfs merge=lfs -text
+shieldgemma-9b-Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text
+shieldgemma-9b-Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text
+shieldgemma-9b-Q6_K.gguf filter=lfs diff=lfs merge=lfs -text
+shieldgemma-9b-Q8_0.gguf filter=lfs diff=lfs merge=lfs -text

README.md

@@ -0,0 +1,95 @@
+---
+license: gemma
+library_name: transformers
+pipeline_tag: text-generation
+extra_gated_heading: Access Gemma on Hugging Face
+extra_gated_prompt: To access Gemma on Hugging Face, you’re required to review and
+  agree to Google’s usage license. To do this, please ensure you’re logged in to Hugging
+  Face and click below. Requests are processed immediately.
+extra_gated_button_content: Acknowledge license
+tags:
+- TensorBlock
+- GGUF
+base_model: google/shieldgemma-9b
+---
+
+<div style="width: auto; margin-left: auto; margin-right: auto">
+<img src="https://i.imgur.com/jC7kdl8.jpeg" alt="TensorBlock" style="width: 100%; min-width: 400px; display: block; margin: auto;">
+</div>
+<div style="display: flex; justify-content: space-between; width: 100%;">
+    <div style="display: flex; flex-direction: column; align-items: flex-start;">
+        <p style="margin-top: 0.5em; margin-bottom: 0em;">
+            Feedback and support: TensorBlock's  <a href="https://x.com/tensorblock_aoi">Twitter/X</a>, <a href="https://t.me/TensorBlock">Telegram Group</a> and <a href="https://x.com/tensorblock_aoi">Discord server</a>
+        </p>
+    </div>
+</div>
+
+## google/shieldgemma-9b - GGUF
+
+This repo contains GGUF format model files for [google/shieldgemma-9b](https://huggingface.co/google/shieldgemma-9b).
+
+The files were quantized using machines provided by [TensorBlock](https://tensorblock.co/), and they are compatible with llama.cpp as of [commit b4011](https://github.com/ggerganov/llama.cpp/commit/a6744e43e80f4be6398fc7733a01642c846dce1d).
+
+<div style="text-align: left; margin: 20px 0;">
+    <a href="https://tensorblock.co/waitlist/client" style="display: inline-block; padding: 10px 20px; background-color: #007bff; color: white; text-decoration: none; border-radius: 5px; font-weight: bold;">
+        Run them on the TensorBlock client using your local machine ↗
+    </a>
+</div>
+
+## Prompt template
+
+```
+<bos>You are a policy expert trying to help determine whether a user prompt is in violation of the defined safety policies.
+
+<start_of_turn>
+Human Question: {prompt}
+<end_of_turn>
+
+Our safety principle is defined in the below:
+
+* {system_prompt}
+
+===
+
+Does the human question violate the above principle? Your answer must start with 'Yes' or 'No'. And then walk through step by step to be sure we answer correctly.
+```
+
+## Model file specification
+
+| Filename | Quant type | File Size | Description |
+| -------- | ---------- | --------- | ----------- |
+| [shieldgemma-9b-Q2_K.gguf](https://huggingface.co/tensorblock/shieldgemma-9b-GGUF/blob/main/shieldgemma-9b-Q2_K.gguf) | Q2_K | 3.805 GB | smallest, significant quality loss - not recommended for most purposes |
+| [shieldgemma-9b-Q3_K_S.gguf](https://huggingface.co/tensorblock/shieldgemma-9b-GGUF/blob/main/shieldgemma-9b-Q3_K_S.gguf) | Q3_K_S | 4.338 GB | very small, high quality loss |
+| [shieldgemma-9b-Q3_K_M.gguf](https://huggingface.co/tensorblock/shieldgemma-9b-GGUF/blob/main/shieldgemma-9b-Q3_K_M.gguf) | Q3_K_M | 4.762 GB | very small, high quality loss |
+| [shieldgemma-9b-Q3_K_L.gguf](https://huggingface.co/tensorblock/shieldgemma-9b-GGUF/blob/main/shieldgemma-9b-Q3_K_L.gguf) | Q3_K_L | 5.132 GB | small, substantial quality loss |
+| [shieldgemma-9b-Q4_0.gguf](https://huggingface.co/tensorblock/shieldgemma-9b-GGUF/blob/main/shieldgemma-9b-Q4_0.gguf) | Q4_0 | 5.443 GB | legacy; small, very high quality loss - prefer using Q3_K_M |
+| [shieldgemma-9b-Q4_K_S.gguf](https://huggingface.co/tensorblock/shieldgemma-9b-GGUF/blob/main/shieldgemma-9b-Q4_K_S.gguf) | Q4_K_S | 5.479 GB | small, greater quality loss |
+| [shieldgemma-9b-Q4_K_M.gguf](https://huggingface.co/tensorblock/shieldgemma-9b-GGUF/blob/main/shieldgemma-9b-Q4_K_M.gguf) | Q4_K_M | 5.761 GB | medium, balanced quality - recommended |
+| [shieldgemma-9b-Q5_0.gguf](https://huggingface.co/tensorblock/shieldgemma-9b-GGUF/blob/main/shieldgemma-9b-Q5_0.gguf) | Q5_0 | 6.484 GB | legacy; medium, balanced quality - prefer using Q4_K_M |
+| [shieldgemma-9b-Q5_K_S.gguf](https://huggingface.co/tensorblock/shieldgemma-9b-GGUF/blob/main/shieldgemma-9b-Q5_K_S.gguf) | Q5_K_S | 6.484 GB | large, low quality loss - recommended |
+| [shieldgemma-9b-Q5_K_M.gguf](https://huggingface.co/tensorblock/shieldgemma-9b-GGUF/blob/main/shieldgemma-9b-Q5_K_M.gguf) | Q5_K_M | 6.647 GB | large, very low quality loss - recommended |
+| [shieldgemma-9b-Q6_K.gguf](https://huggingface.co/tensorblock/shieldgemma-9b-GGUF/blob/main/shieldgemma-9b-Q6_K.gguf) | Q6_K | 7.589 GB | very large, extremely low quality loss |
+| [shieldgemma-9b-Q8_0.gguf](https://huggingface.co/tensorblock/shieldgemma-9b-GGUF/blob/main/shieldgemma-9b-Q8_0.gguf) | Q8_0 | 9.827 GB | very large, extremely low quality loss - not recommended |
+
+
+## Downloading instruction
+
+### Command line
+
+Firstly, install Huggingface Client
+
+```shell
+pip install -U "huggingface_hub[cli]"
+```
+
+Then, downoad the individual model file the a local directory
+
+```shell
+huggingface-cli download tensorblock/shieldgemma-9b-GGUF --include "shieldgemma-9b-Q2_K.gguf" --local-dir MY_LOCAL_DIR
+```
+
+If you wanna download multiple model files with a pattern (e.g., `*Q4_K*gguf`), you can try:
+
+```shell
+huggingface-cli download tensorblock/shieldgemma-9b-GGUF --local-dir MY_LOCAL_DIR --local-dir-use-symlinks False --include='*Q4_K*gguf'
+```

shieldgemma-9b-Q2_K.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:f1268aca5585431cb2dfd8bbbd798eee99b030081a51620cd25b6f60e79df7fc
+size 3805398784

shieldgemma-9b-Q3_K_L.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:df4861ab1c6d373ac642aa9c1bf5fea3fa356040cba07d89188f529b68b4a795
+size 5132453632

shieldgemma-9b-Q3_K_M.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:f89147ec73f7b8194cc5198842c0086d150c993996beb8b4810ca85a2b0b0c4f
+size 4761782016

shieldgemma-9b-Q3_K_S.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:a4c1e8bf055ffc19731cea43ca44372346e3b27fca6e5171475c5783856d4815
+size 4337665792

shieldgemma-9b-Q4_0.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:b659942b2c153ad57b2b162199cad66c4be170f114ce1dc5af18b072bf972a9e
+size 5443143424

shieldgemma-9b-Q4_K_M.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:0d9f59a2e5b3c81d2af73c14b9915796ac89830c78fb681ce7c1c94fb0325880
+size 5761058560

shieldgemma-9b-Q4_K_S.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:967627827f086fcf69e0ae63e2b1b8f5b5ea2abfb2e14aa71b4d7c9247f3325d
+size 5478926080

shieldgemma-9b-Q5_0.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:664512167e494e68bd1f9743caa752ebf04eeb57e284d3f773149dc87c0d637a
+size 6483592960

shieldgemma-9b-Q5_K_M.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:ace1989b063f07ca3ebab84a26ef18d3909a2ec37c80d703c5bfdeb7eb403091
+size 6647367424

shieldgemma-9b-Q5_K_S.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:32e410ffe3c06f03dc4ecd28f0a79e4090ce170e7f3fd7d1a4910e3133601ab6
+size 6483592960

shieldgemma-9b-Q6_K.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:6a77e59a3afc59806e112698eaffea1c7eb23c1b405c8d5007069bb38af47383
+size 7589070592

shieldgemma-9b-Q8_0.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:4bee36b091fb4d8e7e5e0aaad687ac223311505ef6486b0a4fe9167701c2d4ad
+size 9827149568