vinimuchulski commited on
Commit
77359cd
·
verified ·
1 Parent(s): cc69714

Upload 3 files

Browse files
Files changed (4) hide show
  1. .gitattributes +1 -0
  2. README.md +466 -3
  3. gemma-3-1b-it-q4_0.gguf +3 -0
  4. gitattributes +40 -0
.gitattributes CHANGED
@@ -33,3 +33,4 @@ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
33
  *.zip filter=lfs diff=lfs merge=lfs -text
34
  *.zst filter=lfs diff=lfs merge=lfs -text
35
  *tfevents* filter=lfs diff=lfs merge=lfs -text
 
 
33
  *.zip filter=lfs diff=lfs merge=lfs -text
34
  *.zst filter=lfs diff=lfs merge=lfs -text
35
  *tfevents* filter=lfs diff=lfs merge=lfs -text
36
+ gemma-3-1b-it-q4_0.gguf filter=lfs diff=lfs merge=lfs -text
README.md CHANGED
@@ -1,3 +1,466 @@
1
- ---
2
- license: gemma
3
- ---
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ license: gemma
3
+ pipeline_tag: text-generation
4
+ extra_gated_heading: Access Gemma on Hugging Face
5
+ extra_gated_prompt: >-
6
+ To access Gemma on Hugging Face, you’re required to review and agree to
7
+ Google’s usage license. To do this, please ensure you’re logged in to Hugging
8
+ Face and click below. Requests are processed immediately.
9
+ extra_gated_button_content: Acknowledge license
10
+ base_model: google/gemma-3-1b-it
11
+ tags:
12
+ - gemma
13
+ - gemma3
14
+ ---
15
+
16
+
17
+ # Gemma 3 model card
18
+
19
+ **Model Page**: [Gemma](https://ai.google.dev/gemma/docs/core)
20
+
21
+ > [!Note]
22
+ > This repository corresponds to the 1B **instruction-tuned** version of the Gemma 3 model in GGUF format using Quantization Aware Training (QAT).
23
+ > The GGUF corresponds to Q4_0 quantization.
24
+ >
25
+ > Thanks to QAT, the model is able to preserve similar quality as `bfloat16` while significantly reducing the memory requirements
26
+ > to load the model.
27
+ >
28
+ > You can find the half-precision version [here](https://huggingface.co/google/gemma-3-1b-it).
29
+
30
+
31
+ **Resources and Technical Documentation**:
32
+
33
+ * [Gemma 3 Technical Report][g3-tech-report]
34
+ * [Responsible Generative AI Toolkit][rai-toolkit]
35
+ * [Gemma on Kaggle][kaggle-gemma]
36
+ * [Gemma on Vertex Model Garden][vertex-mg-gemma3]
37
+
38
+ **Terms of Use**: [Terms][terms]
39
+
40
+ **Authors**: Google DeepMind
41
+
42
+ ## Model Information
43
+
44
+ Summary description and brief definition of inputs and outputs.
45
+
46
+ ### Description
47
+
48
+ Gemma is a family of lightweight, state-of-the-art open models from Google,
49
+ built from the same research and technology used to create the Gemini models.
50
+ Gemma 3 models are multimodal, handling text and image input and generating text
51
+ output, with open weights for both pre-trained variants and instruction-tuned
52
+ variants. Gemma 3 has a large, 128K context window, multilingual support in over
53
+ 140 languages, and is available in more sizes than previous versions. Gemma 3
54
+ models are well-suited for a variety of text generation and image understanding
55
+ tasks, including question answering, summarization, and reasoning. Their
56
+ relatively small size makes it possible to deploy them in environments with
57
+ limited resources such as laptops, desktops or your own cloud infrastructure,
58
+ democratizing access to state of the art AI models and helping foster innovation
59
+ for everyone.
60
+
61
+ ### Inputs and outputs
62
+
63
+ - **Input:**
64
+ - Text string, such as a question, a prompt, or a document to be summarized
65
+ - Images, normalized to 896 x 896 resolution and encoded to 256 tokens
66
+ each
67
+ - Total input context of 128K tokens for the 4B, 12B, and 27B sizes, and
68
+ 32K tokens for the 1B size
69
+
70
+ - **Output:**
71
+ - Generated text in response to the input, such as an answer to a
72
+ question, analysis of image content, or a summary of a document
73
+ - Total output context of 8192 tokens
74
+
75
+ ### Usage
76
+
77
+ Below, there are some code snippets on how to get quickly started with running the model.
78
+
79
+ **llama.cpp (text-only)**
80
+
81
+ ```sh
82
+ ./llama-cli -hf google/gemma-3-1b-it-qat-q4_0-gguf -p "Write a poem about the Kraken."
83
+ ```
84
+
85
+ **ollama (text only)**
86
+
87
+ Using GGUFs with Ollama via Hugging Face does not support image inputs at the moment. Please check the [docs on running gated repositories](https://huggingface.co/docs/hub/en/ollama#run-private-ggufs-from-the-hugging-face-hub).
88
+
89
+ ```sh
90
+ ollama run hf.co/google/gemma-3-1b-it-qat-q4_0-gguf
91
+ ```
92
+
93
+ ### Citation
94
+
95
+ ```none
96
+ @article{gemma_2025,
97
+ title={Gemma 3},
98
+ url={https://goo.gle/Gemma3Report},
99
+ publisher={Kaggle},
100
+ author={Gemma Team},
101
+ year={2025}
102
+ }
103
+ ```
104
+
105
+ ## Model Data
106
+
107
+ Data used for model training and how the data was processed.
108
+
109
+ ### Training Dataset
110
+
111
+ These models were trained on a dataset of text data that includes a wide variety
112
+ of sources. The 27B model was trained with 14 trillion tokens, the 12B model was
113
+ trained with 12 trillion tokens, 4B model was trained with 4 trillion tokens and
114
+ 1B with 2 trillion tokens. Here are the key components:
115
+
116
+ - Web Documents: A diverse collection of web text ensures the model is
117
+ exposed to a broad range of linguistic styles, topics, and vocabulary. The
118
+ training dataset includes content in over 140 languages.
119
+ - Code: Exposing the model to code helps it to learn the syntax and
120
+ patterns of programming languages, which improves its ability to generate
121
+ code and understand code-related questions.
122
+ - Mathematics: Training on mathematical text helps the model learn logical
123
+ reasoning, symbolic representation, and to address mathematical queries.
124
+ - Images: A wide range of images enables the model to perform image
125
+ analysis and visual data extraction tasks.
126
+
127
+ The combination of these diverse data sources is crucial for training a powerful
128
+ multimodal model that can handle a wide variety of different tasks and data
129
+ formats.
130
+
131
+ ### Data Preprocessing
132
+
133
+ Here are the key data cleaning and filtering methods applied to the training
134
+ data:
135
+
136
+ - CSAM Filtering: Rigorous CSAM (Child Sexual Abuse Material) filtering
137
+ was applied at multiple stages in the data preparation process to ensure
138
+ the exclusion of harmful and illegal content.
139
+ - Sensitive Data Filtering: As part of making Gemma pre-trained models
140
+ safe and reliable, automated techniques were used to filter out certain
141
+ personal information and other sensitive data from training sets.
142
+ - Additional methods: Filtering based on content quality and safety in
143
+ line with [our policies][safety-policies].
144
+
145
+ ## Implementation Information
146
+
147
+ Details about the model internals.
148
+
149
+ ### Hardware
150
+
151
+ Gemma was trained using [Tensor Processing Unit (TPU)][tpu] hardware (TPUv4p,
152
+ TPUv5p and TPUv5e). Training vision-language models (VLMS) requires significant
153
+ computational power. TPUs, designed specifically for matrix operations common in
154
+ machine learning, offer several advantages in this domain:
155
+
156
+ - Performance: TPUs are specifically designed to handle the massive
157
+ computations involved in training VLMs. They can speed up training
158
+ considerably compared to CPUs.
159
+ - Memory: TPUs often come with large amounts of high-bandwidth memory,
160
+ allowing for the handling of large models and batch sizes during training.
161
+ This can lead to better model quality.
162
+ - Scalability: TPU Pods (large clusters of TPUs) provide a scalable
163
+ solution for handling the growing complexity of large foundation models.
164
+ You can distribute training across multiple TPU devices for faster and more
165
+ efficient processing.
166
+ - Cost-effectiveness: In many scenarios, TPUs can provide a more
167
+ cost-effective solution for training large models compared to CPU-based
168
+ infrastructure, especially when considering the time and resources saved
169
+ due to faster training.
170
+ - These advantages are aligned with
171
+ [Google's commitments to operate sustainably][sustainability].
172
+
173
+ ### Software
174
+
175
+ Training was done using [JAX][jax] and [ML Pathways][ml-pathways].
176
+
177
+ JAX allows researchers to take advantage of the latest generation of hardware,
178
+ including TPUs, for faster and more efficient training of large models. ML
179
+ Pathways is Google's latest effort to build artificially intelligent systems
180
+ capable of generalizing across multiple tasks. This is specially suitable for
181
+ foundation models, including large language models like these ones.
182
+
183
+ Together, JAX and ML Pathways are used as described in the
184
+ [paper about the Gemini family of models][gemini-2-paper]; *"the 'single
185
+ controller' programming model of Jax and Pathways allows a single Python
186
+ process to orchestrate the entire training run, dramatically simplifying the
187
+ development workflow."*
188
+
189
+ ## Evaluation
190
+
191
+ Model evaluation metrics and results.
192
+
193
+ ### Benchmark Results
194
+
195
+ These models were evaluated against a large collection of different datasets and
196
+ metrics to cover different aspects of text generation:
197
+
198
+ #### Reasoning and factuality
199
+
200
+ | Benchmark | Metric | Gemma 3 PT 1B | Gemma 3 PT 4B | Gemma 3 PT 12B | Gemma 3 PT 27B |
201
+ | ------------------------------ |----------------|:--------------:|:-------------:|:--------------:|:--------------:|
202
+ | [HellaSwag][hellaswag] | 10-shot | 62.3 | 77.2 | 84.2 | 85.6 |
203
+ | [BoolQ][boolq] | 0-shot | 63.2 | 72.3 | 78.8 | 82.4 |
204
+ | [PIQA][piqa] | 0-shot | 73.8 | 79.6 | 81.8 | 83.3 |
205
+ | [SocialIQA][socialiqa] | 0-shot | 48.9 | 51.9 | 53.4 | 54.9 |
206
+ | [TriviaQA][triviaqa] | 5-shot | 39.8 | 65.8 | 78.2 | 85.5 |
207
+ | [Natural Questions][naturalq] | 5-shot | 9.48 | 20.0 | 31.4 | 36.1 |
208
+ | [ARC-c][arc] | 25-shot | 38.4 | 56.2 | 68.9 | 70.6 |
209
+ | [ARC-e][arc] | 0-shot | 73.0 | 82.4 | 88.3 | 89.0 |
210
+ | [WinoGrande][winogrande] | 5-shot | 58.2 | 64.7 | 74.3 | 78.8 |
211
+ | [BIG-Bench Hard][bbh] | few-shot | 28.4 | 50.9 | 72.6 | 77.7 |
212
+ | [DROP][drop] | 1-shot | 42.4 | 60.1 | 72.2 | 77.2 |
213
+
214
+ [hellaswag]: https://arxiv.org/abs/1905.07830
215
+ [boolq]: https://arxiv.org/abs/1905.10044
216
+ [piqa]: https://arxiv.org/abs/1911.11641
217
+ [socialiqa]: https://arxiv.org/abs/1904.09728
218
+ [triviaqa]: https://arxiv.org/abs/1705.03551
219
+ [naturalq]: https://github.com/google-research-datasets/natural-questions
220
+ [arc]: https://arxiv.org/abs/1911.01547
221
+ [winogrande]: https://arxiv.org/abs/1907.10641
222
+ [bbh]: https://paperswithcode.com/dataset/bbh
223
+ [drop]: https://arxiv.org/abs/1903.00161
224
+
225
+ #### STEM and code
226
+
227
+ | Benchmark | Metric | Gemma 3 PT 4B | Gemma 3 PT 12B | Gemma 3 PT 27B |
228
+ | ------------------------------ |----------------|:-------------:|:--------------:|:--------------:|
229
+ | [MMLU][mmlu] | 5-shot | 59.6 | 74.5 | 78.6 |
230
+ | [MMLU][mmlu] (Pro COT) | 5-shot | 29.2 | 45.3 | 52.2 |
231
+ | [AGIEval][agieval] | 3-5-shot | 42.1 | 57.4 | 66.2 |
232
+ | [MATH][math] | 4-shot | 24.2 | 43.3 | 50.0 |
233
+ | [GSM8K][gsm8k] | 8-shot | 38.4 | 71.0 | 82.6 |
234
+ | [GPQA][gpqa] | 5-shot | 15.0 | 25.4 | 24.3 |
235
+ | [MBPP][mbpp] | 3-shot | 46.0 | 60.4 | 65.6 |
236
+ | [HumanEval][humaneval] | 0-shot | 36.0 | 45.7 | 48.8 |
237
+
238
+ [mmlu]: https://arxiv.org/abs/2009.03300
239
+ [agieval]: https://arxiv.org/abs/2304.06364
240
+ [math]: https://arxiv.org/abs/2103.03874
241
+ [gsm8k]: https://arxiv.org/abs/2110.14168
242
+ [gpqa]: https://arxiv.org/abs/2311.12022
243
+ [mbpp]: https://arxiv.org/abs/2108.07732
244
+ [humaneval]: https://arxiv.org/abs/2107.03374
245
+
246
+ #### Multilingual
247
+
248
+ | Benchmark | Gemma 3 PT 1B | Gemma 3 PT 4B | Gemma 3 PT 12B | Gemma 3 PT 27B |
249
+ | ------------------------------------ |:-------------:|:-------------:|:--------------:|:--------------:|
250
+ | [MGSM][mgsm] | 2.04 | 34.7 | 64.3 | 74.3 |
251
+ | [Global-MMLU-Lite][global-mmlu-lite] | 24.9 | 57.0 | 69.4 | 75.7 |
252
+ | [WMT24++][wmt24pp] (ChrF) | 36.7 | 48.4 | 53.9 | 55.7 |
253
+ | [FloRes][flores] | 29.5 | 39.2 | 46.0 | 48.8 |
254
+ | [XQuAD][xquad] (all) | 43.9 | 68.0 | 74.5 | 76.8 |
255
+ | [ECLeKTic][eclektic] | 4.69 | 11.0 | 17.2 | 24.4 |
256
+ | [IndicGenBench][indicgenbench] | 41.4 | 57.2 | 61.7 | 63.4 |
257
+
258
+ [mgsm]: https://arxiv.org/abs/2210.03057
259
+ [flores]: https://arxiv.org/abs/2106.03193
260
+ [xquad]: https://arxiv.org/abs/1910.11856v3
261
+ [global-mmlu-lite]: https://huggingface.co/datasets/CohereForAI/Global-MMLU-Lite
262
+ [wmt24pp]: https://arxiv.org/abs/2502.12404v1
263
+ [eclektic]: https://arxiv.org/abs/2502.21228
264
+ [indicgenbench]: https://arxiv.org/abs/2404.16816
265
+
266
+ #### Multimodal
267
+
268
+ | Benchmark | Gemma 3 PT 4B | Gemma 3 PT 12B | Gemma 3 PT 27B |
269
+ | ------------------------------ |:-------------:|:--------------:|:--------------:|
270
+ | [COCOcap][coco-cap] | 102 | 111 | 116 |
271
+ | [DocVQA][docvqa] (val) | 72.8 | 82.3 | 85.6 |
272
+ | [InfoVQA][info-vqa] (val) | 44.1 | 54.8 | 59.4 |
273
+ | [MMMU][mmmu] (pt) | 39.2 | 50.3 | 56.1 |
274
+ | [TextVQA][textvqa] (val) | 58.9 | 66.5 | 68.6 |
275
+ | [RealWorldQA][realworldqa] | 45.5 | 52.2 | 53.9 |
276
+ | [ReMI][remi] | 27.3 | 38.5 | 44.8 |
277
+ | [AI2D][ai2d] | 63.2 | 75.2 | 79.0 |
278
+ | [ChartQA][chartqa] | 63.6 | 74.7 | 76.3 |
279
+ | [VQAv2][vqav2] | 63.9 | 71.2 | 72.9 |
280
+ | [BLINK][blinkvqa] | 38.0 | 35.9 | 39.6 |
281
+ | [OKVQA][okvqa] | 51.0 | 58.7 | 60.2 |
282
+ | [TallyQA][tallyqa] | 42.5 | 51.8 | 54.3 |
283
+ | [SpatialSense VQA][ss-vqa] | 50.9 | 60.0 | 59.4 |
284
+ | [CountBenchQA][countbenchqa] | 26.1 | 17.8 | 68.0 |
285
+
286
+ [coco-cap]: https://cocodataset.org/#home
287
+ [docvqa]: https://www.docvqa.org/
288
+ [info-vqa]: https://arxiv.org/abs/2104.12756
289
+ [mmmu]: https://arxiv.org/abs/2311.16502
290
+ [textvqa]: https://textvqa.org/
291
+ [realworldqa]: https://paperswithcode.com/dataset/realworldqa
292
+ [remi]: https://arxiv.org/html/2406.09175v1
293
+ [ai2d]: https://allenai.org/data/diagrams
294
+ [chartqa]: https://arxiv.org/abs/2203.10244
295
+ [vqav2]: https://visualqa.org/index.html
296
+ [blinkvqa]: https://arxiv.org/abs/2404.12390
297
+ [okvqa]: https://okvqa.allenai.org/
298
+ [tallyqa]: https://arxiv.org/abs/1810.12440
299
+ [ss-vqa]: https://arxiv.org/abs/1908.02660
300
+ [countbenchqa]: https://github.com/google-research/big_vision/blob/main/big_vision/datasets/countbenchqa/
301
+
302
+ ## Ethics and Safety
303
+
304
+ Ethics and safety evaluation approach and results.
305
+
306
+ ### Evaluation Approach
307
+
308
+ Our evaluation methods include structured evaluations and internal red-teaming
309
+ testing of relevant content policies. Red-teaming was conducted by a number of
310
+ different teams, each with different goals and human evaluation metrics. These
311
+ models were evaluated against a number of different categories relevant to
312
+ ethics and safety, including:
313
+
314
+ - **Child Safety**: Evaluation of text-to-text and image to text prompts
315
+ covering child safety policies, including child sexual abuse and
316
+ exploitation.
317
+ - **Content Safety:** Evaluation of text-to-text and image to text prompts
318
+ covering safety policies including, harassment, violence and gore, and hate
319
+ speech.
320
+ - **Representational Harms**: Evaluation of text-to-text and image to text
321
+ prompts covering safety policies including bias, stereotyping, and harmful
322
+ associations or inaccuracies.
323
+
324
+ In addition to development level evaluations, we conduct "assurance
325
+ evaluations" which are our 'arms-length' internal evaluations for responsibility
326
+ governance decision making. They are conducted separately from the model
327
+ development team, to inform decision making about release. High level findings
328
+ are fed back to the model team, but prompt sets are held-out to prevent
329
+ overfitting and preserve the results' ability to inform decision making.
330
+ Assurance evaluation results are reported to our Responsibility & Safety Council
331
+ as part of release review.
332
+
333
+ ### Evaluation Results
334
+
335
+ For all areas of safety testing, we saw major improvements in the categories of
336
+ child safety, content safety, and representational harms relative to previous
337
+ Gemma models. All testing was conducted without safety filters to evaluate the
338
+ model capabilities and behaviors. For both text-to-text and image-to-text, and
339
+ across all model sizes, the model produced minimal policy violations, and showed
340
+ significant improvements over previous Gemma models' performance with respect
341
+ to ungrounded inferences. A limitation of our evaluations was they included only
342
+ English language prompts.
343
+
344
+ ## Usage and Limitations
345
+
346
+ These models have certain limitations that users should be aware of.
347
+
348
+ ### Intended Usage
349
+
350
+ Open vision-language models (VLMs) models have a wide range of applications
351
+ across various industries and domains. The following list of potential uses is
352
+ not comprehensive. The purpose of this list is to provide contextual information
353
+ about the possible use-cases that the model creators considered as part of model
354
+ training and development.
355
+
356
+ - Content Creation and Communication
357
+ - Text Generation: These models can be used to generate creative text
358
+ formats such as poems, scripts, code, marketing copy, and email drafts.
359
+ - Chatbots and Conversational AI: Power conversational interfaces
360
+ for customer service, virtual assistants, or interactive applications.
361
+ - Text Summarization: Generate concise summaries of a text corpus,
362
+ research papers, or reports.
363
+ - Image Data Extraction: These models can be used to extract,
364
+ interpret, and summarize visual data for text communications.
365
+ - Research and Education
366
+ - Natural Language Processing (NLP) and VLM Research: These
367
+ models can serve as a foundation for researchers to experiment with VLM
368
+ and NLP techniques, develop algorithms, and contribute to the
369
+ advancement of the field.
370
+ - Language Learning Tools: Support interactive language learning
371
+ experiences, aiding in grammar correction or providing writing practice.
372
+ - Knowledge Exploration: Assist researchers in exploring large
373
+ bodies of text by generating summaries or answering questions about
374
+ specific topics.
375
+
376
+ ### Limitations
377
+
378
+ - Training Data
379
+ - The quality and diversity of the training data significantly
380
+ influence the model's capabilities. Biases or gaps in the training data
381
+ can lead to limitations in the model's responses.
382
+ - The scope of the training dataset determines the subject areas
383
+ the model can handle effectively.
384
+ - Context and Task Complexity
385
+ - Models are better at tasks that can be framed with clear
386
+ prompts and instructions. Open-ended or highly complex tasks might be
387
+ challenging.
388
+ - A model's performance can be influenced by the amount of context
389
+ provided (longer context generally leads to better outputs, up to a
390
+ certain point).
391
+ - Language Ambiguity and Nuance
392
+ - Natural language is inherently complex. Models might struggle
393
+ to grasp subtle nuances, sarcasm, or figurative language.
394
+ - Factual Accuracy
395
+ - Models generate responses based on information they learned
396
+ from their training datasets, but they are not knowledge bases. They
397
+ may generate incorrect or outdated factual statements.
398
+ - Common Sense
399
+ - Models rely on statistical patterns in language. They might
400
+ lack the ability to apply common sense reasoning in certain situations.
401
+
402
+ ### Ethical Considerations and Risks
403
+
404
+ The development of vision-language models (VLMs) raises several ethical
405
+ concerns. In creating an open model, we have carefully considered the following:
406
+
407
+ - Bias and Fairness
408
+ - VLMs trained on large-scale, real-world text and image data can
409
+ reflect socio-cultural biases embedded in the training material. These
410
+ models underwent careful scrutiny, input data pre-processing described
411
+ and posterior evaluations reported in this card.
412
+ - Misinformation and Misuse
413
+ - VLMs can be misused to generate text that is false, misleading,
414
+ or harmful.
415
+ - Guidelines are provided for responsible use with the model, see the
416
+ [Responsible Generative AI Toolkit][rai-toolkit].
417
+ - Transparency and Accountability:
418
+ - This model card summarizes details on the models' architecture,
419
+ capabilities, limitations, and evaluation processes.
420
+ - A responsibly developed open model offers the opportunity to
421
+ share innovation by making VLM technology accessible to developers and
422
+ researchers across the AI ecosystem.
423
+
424
+ Risks identified and mitigations:
425
+
426
+ - **Perpetuation of biases**: It's encouraged to perform continuous
427
+ monitoring (using evaluation metrics, human review) and the exploration of
428
+ de-biasing techniques during model training, fine-tuning, and other use
429
+ cases.
430
+ - **Generation of harmful content**: Mechanisms and guidelines for content
431
+ safety are essential. Developers are encouraged to exercise caution and
432
+ implement appropriate content safety safeguards based on their specific
433
+ product policies and application use cases.
434
+ - **Misuse for malicious purposes**: Technical limitations and developer
435
+ and end-user education can help mitigate against malicious applications of
436
+ VLMs. Educational resources and reporting mechanisms for users to flag
437
+ misuse are provided. Prohibited uses of Gemma models are outlined in the
438
+ [Gemma Prohibited Use Policy][prohibited-use].
439
+ - **Privacy violations**: Models were trained on data filtered for removal
440
+ of certain personal information and other sensitive data. Developers are
441
+ encouraged to adhere to privacy regulations with privacy-preserving
442
+ techniques.
443
+
444
+ ### Benefits
445
+
446
+ At the time of release, this family of models provides high-performance open
447
+ vision-language model implementations designed from the ground up for
448
+ responsible AI development compared to similarly sized models.
449
+
450
+ Using the benchmark evaluation metrics described in this document, these models
451
+ have shown to provide superior performance to other, comparably-sized open model
452
+ alternatives.
453
+
454
+ [g3-tech-report]: https://goo.gle/Gemma3Report
455
+ [rai-toolkit]: https://ai.google.dev/responsible
456
+ [kaggle-gemma]: https://www.kaggle.com/models/google/gemma-3
457
+ [vertex-mg-gemma3]: https://console.cloud.google.com/vertex-ai/publishers/google/model-garden/gemma3
458
+ [terms]: https://ai.google.dev/gemma/terms
459
+ [safety-policies]: https://ai.google/static/documents/ai-responsibility-update-published-february-2025.pdf
460
+ [prohibited-use]: https://ai.google.dev/gemma/prohibited_use_policy
461
+ [tpu]: https://cloud.google.com/tpu/docs/intro-to-tpu
462
+ [sustainability]: https://sustainability.google/operating-sustainably/
463
+ [jax]: https://github.com/jax-ml/jax
464
+ [ml-pathways]: https://blog.google/technology/ai/introducing-pathways-next-generation-ai-architecture/
465
+ [sustainability]: https://sustainability.google/operating-sustainably/
466
+ [gemini-2-paper]: https://arxiv.org/abs/2312.11805
gemma-3-1b-it-q4_0.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:cd2a46a3581fd385ee72688490370ef3e025b7e2daf016615593241b18bd6166
3
+ size 1003541152
gitattributes ADDED
@@ -0,0 +1,40 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ *.7z filter=lfs diff=lfs merge=lfs -text
2
+ *.arrow filter=lfs diff=lfs merge=lfs -text
3
+ *.bin filter=lfs diff=lfs merge=lfs -text
4
+ *.bz2 filter=lfs diff=lfs merge=lfs -text
5
+ *.ckpt filter=lfs diff=lfs merge=lfs -text
6
+ *.ftz filter=lfs diff=lfs merge=lfs -text
7
+ *.gz filter=lfs diff=lfs merge=lfs -text
8
+ *.h5 filter=lfs diff=lfs merge=lfs -text
9
+ *.joblib filter=lfs diff=lfs merge=lfs -text
10
+ *.lfs.* filter=lfs diff=lfs merge=lfs -text
11
+ *.mlmodel filter=lfs diff=lfs merge=lfs -text
12
+ *.model filter=lfs diff=lfs merge=lfs -text
13
+ *.msgpack filter=lfs diff=lfs merge=lfs -text
14
+ *.npy filter=lfs diff=lfs merge=lfs -text
15
+ *.npz filter=lfs diff=lfs merge=lfs -text
16
+ *.onnx filter=lfs diff=lfs merge=lfs -text
17
+ *.ot filter=lfs diff=lfs merge=lfs -text
18
+ *.parquet filter=lfs diff=lfs merge=lfs -text
19
+ *.pb filter=lfs diff=lfs merge=lfs -text
20
+ *.pickle filter=lfs diff=lfs merge=lfs -text
21
+ *.pkl filter=lfs diff=lfs merge=lfs -text
22
+ *.pt filter=lfs diff=lfs merge=lfs -text
23
+ *.pth filter=lfs diff=lfs merge=lfs -text
24
+ *.rar filter=lfs diff=lfs merge=lfs -text
25
+ *.safetensors filter=lfs diff=lfs merge=lfs -text
26
+ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
27
+ *.tar.* filter=lfs diff=lfs merge=lfs -text
28
+ *.tar filter=lfs diff=lfs merge=lfs -text
29
+ *.tflite filter=lfs diff=lfs merge=lfs -text
30
+ *.tgz filter=lfs diff=lfs merge=lfs -text
31
+ *.wasm filter=lfs diff=lfs merge=lfs -text
32
+ *.xz filter=lfs diff=lfs merge=lfs -text
33
+ *.zip filter=lfs diff=lfs merge=lfs -text
34
+ *.zst filter=lfs diff=lfs merge=lfs -text
35
+ *tfevents* filter=lfs diff=lfs merge=lfs -text
36
+ IT_1B_Q4_0_final/ocdbt.process_0/d/1cf008f144d2797a4c77924d92aaef0b filter=lfs diff=lfs merge=lfs -text
37
+ IT_1B_Q4_0_final/ocdbt.process_0/d/5e146745d996e26d9e51c6eb5fda6e49 filter=lfs diff=lfs merge=lfs -text
38
+ IT_1B_Q4_0_final/ocdbt.process_0/d/b631735f1cd951bd2b01b56ecaee3998 filter=lfs diff=lfs merge=lfs -text
39
+ IT_1B_Q4_0_final_q4_0.gguf filter=lfs diff=lfs merge=lfs -text
40
+ gemma-3-1b-it-q4_0.gguf filter=lfs diff=lfs merge=lfs -text