vinimuchulski commited on
Commit
a98c6c6
·
verified ·
1 Parent(s): f3a481d

Upload 2 files

Browse files
Files changed (2) hide show
  1. README.md +471 -3
  2. gitattributes +56 -0
README.md CHANGED
@@ -1,3 +1,471 @@
1
- ---
2
- license: gemma
3
- ---
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ base_model: google/gemma-3-4b-it
3
+ license: gemma
4
+ tags:
5
+ - gemma3
6
+ - gemma
7
+ - google
8
+ pipeline_tag: image-text-to-text
9
+ ---
10
+
11
+ # Gemma 3 model card
12
+
13
+ **Model Page**: [Gemma](https://ai.google.dev/gemma/docs/core)
14
+
15
+ > [!Note]
16
+ > This repository corresponds to the 4B **instruction-tuned** version of the Gemma 3 model in GGUF format using Quantization Aware Training (QAT).
17
+ > The GGUF corresponds to Q4_0 quantization.
18
+ >
19
+ > Thanks to QAT, the model is able to preserve similar quality as `bfloat16` while significantly reducing the memory requirements
20
+ > to load the model.
21
+ >
22
+ > You can find the half-precision version [here](https://huggingface.co/google/gemma-3-4b-it).
23
+
24
+
25
+ **Resources and Technical Documentation**:
26
+
27
+ * [Gemma 3 Technical Report][g3-tech-report]
28
+ * [Responsible Generative AI Toolkit][rai-toolkit]
29
+ * [Gemma on Kaggle][kaggle-gemma]
30
+ * [Gemma on Vertex Model Garden][vertex-mg-gemma3]
31
+
32
+ **Terms of Use**: [Terms][terms]
33
+
34
+ **Authors**: Google DeepMind
35
+
36
+ ## Model Information
37
+
38
+ Summary description and brief definition of inputs and outputs.
39
+
40
+ ### Description
41
+
42
+ Gemma is a family of lightweight, state-of-the-art open models from Google,
43
+ built from the same research and technology used to create the Gemini models.
44
+ Gemma 3 models are multimodal, handling text and image input and generating text
45
+ output, with open weights for both pre-trained variants and instruction-tuned
46
+ variants. Gemma 3 has a large, 128K context window, multilingual support in over
47
+ 140 languages, and is available in more sizes than previous versions. Gemma 3
48
+ models are well-suited for a variety of text generation and image understanding
49
+ tasks, including question answering, summarization, and reasoning. Their
50
+ relatively small size makes it possible to deploy them in environments with
51
+ limited resources such as laptops, desktops or your own cloud infrastructure,
52
+ democratizing access to state of the art AI models and helping foster innovation
53
+ for everyone.
54
+
55
+ ### Inputs and outputs
56
+
57
+ - **Input:**
58
+ - Text string, such as a question, a prompt, or a document to be summarized
59
+ - Images, normalized to 896 x 896 resolution and encoded to 256 tokens
60
+ each
61
+ - Total input context of 128K tokens for the 4B, 12B, and 27B sizes, and
62
+ 32K tokens for the 1B size
63
+
64
+ - **Output:**
65
+ - Generated text in response to the input, such as an answer to a
66
+ question, analysis of image content, or a summary of a document
67
+ - Total output context of 8192 tokens
68
+
69
+ ### Usage
70
+
71
+ Below, there are some code snippets on how to get quickly started with running the model.
72
+
73
+ **llama.cpp (text-only)**
74
+
75
+ ```sh
76
+ ./llama-cli -hf google/gemma-3-4b-it-qat-q4_0-gguf -p "Write a poem about the Kraken."
77
+ ```
78
+
79
+ **llama.cpp (image input)**
80
+
81
+ ```sh
82
+ wget https://github.com/bebechien/gemma/blob/main/surprise.png?raw=true -O ~/Downloads/surprise.png
83
+ ./llama-gemma3-cli -hf google/gemma-3-4b-it-qat-q4_0-gguf -p "Describe this image." --image ~/Downloads/surprise.png
84
+ ```
85
+
86
+ **ollama (text only)**
87
+
88
+ Using GGUFs with Ollama via Hugging Face does not support image inputs at the moment. Please check the [docs on running gated repositories](https://huggingface.co/docs/hub/en/ollama#run-private-ggufs-from-the-hugging-face-hub).
89
+
90
+ ```sh
91
+ ollama run hf.co/google/gemma-3-4b-it-qat-q4_0-gguf
92
+ ```
93
+
94
+ ### Citation
95
+
96
+ ```none
97
+ @article{gemma_2025,
98
+ title={Gemma 3},
99
+ url={https://goo.gle/Gemma3Report},
100
+ publisher={Kaggle},
101
+ author={Gemma Team},
102
+ year={2025}
103
+ }
104
+ ```
105
+
106
+ ## Model Data
107
+
108
+ Data used for model training and how the data was processed.
109
+
110
+ ### Training Dataset
111
+
112
+ These models were trained on a dataset of text data that includes a wide variety
113
+ of sources. The 27B model was trained with 14 trillion tokens, the 12B model was
114
+ trained with 12 trillion tokens, 4B model was trained with 4 trillion tokens and
115
+ 1B with 2 trillion tokens. Here are the key components:
116
+
117
+ - Web Documents: A diverse collection of web text ensures the model is
118
+ exposed to a broad range of linguistic styles, topics, and vocabulary. The
119
+ training dataset includes content in over 140 languages.
120
+ - Code: Exposing the model to code helps it to learn the syntax and
121
+ patterns of programming languages, which improves its ability to generate
122
+ code and understand code-related questions.
123
+ - Mathematics: Training on mathematical text helps the model learn logical
124
+ reasoning, symbolic representation, and to address mathematical queries.
125
+ - Images: A wide range of images enables the model to perform image
126
+ analysis and visual data extraction tasks.
127
+
128
+ The combination of these diverse data sources is crucial for training a powerful
129
+ multimodal model that can handle a wide variety of different tasks and data
130
+ formats.
131
+
132
+ ### Data Preprocessing
133
+
134
+ Here are the key data cleaning and filtering methods applied to the training
135
+ data:
136
+
137
+ - CSAM Filtering: Rigorous CSAM (Child Sexual Abuse Material) filtering
138
+ was applied at multiple stages in the data preparation process to ensure
139
+ the exclusion of harmful and illegal content.
140
+ - Sensitive Data Filtering: As part of making Gemma pre-trained models
141
+ safe and reliable, automated techniques were used to filter out certain
142
+ personal information and other sensitive data from training sets.
143
+ - Additional methods: Filtering based on content quality and safety in
144
+ line with [our policies][safety-policies].
145
+
146
+ ## Implementation Information
147
+
148
+ Details about the model internals.
149
+
150
+ ### Hardware
151
+
152
+ Gemma was trained using [Tensor Processing Unit (TPU)][tpu] hardware (TPUv4p,
153
+ TPUv5p and TPUv5e). Training vision-language models (VLMS) requires significant
154
+ computational power. TPUs, designed specifically for matrix operations common in
155
+ machine learning, offer several advantages in this domain:
156
+
157
+ - Performance: TPUs are specifically designed to handle the massive
158
+ computations involved in training VLMs. They can speed up training
159
+ considerably compared to CPUs.
160
+ - Memory: TPUs often come with large amounts of high-bandwidth memory,
161
+ allowing for the handling of large models and batch sizes during training.
162
+ This can lead to better model quality.
163
+ - Scalability: TPU Pods (large clusters of TPUs) provide a scalable
164
+ solution for handling the growing complexity of large foundation models.
165
+ You can distribute training across multiple TPU devices for faster and more
166
+ efficient processing.
167
+ - Cost-effectiveness: In many scenarios, TPUs can provide a more
168
+ cost-effective solution for training large models compared to CPU-based
169
+ infrastructure, especially when considering the time and resources saved
170
+ due to faster training.
171
+ - These advantages are aligned with
172
+ [Google's commitments to operate sustainably][sustainability].
173
+
174
+ ### Software
175
+
176
+ Training was done using [JAX][jax] and [ML Pathways][ml-pathways].
177
+
178
+ JAX allows researchers to take advantage of the latest generation of hardware,
179
+ including TPUs, for faster and more efficient training of large models. ML
180
+ Pathways is Google's latest effort to build artificially intelligent systems
181
+ capable of generalizing across multiple tasks. This is specially suitable for
182
+ foundation models, including large language models like these ones.
183
+
184
+ Together, JAX and ML Pathways are used as described in the
185
+ [paper about the Gemini family of models][gemini-2-paper]; *"the 'single
186
+ controller' programming model of Jax and Pathways allows a single Python
187
+ process to orchestrate the entire training run, dramatically simplifying the
188
+ development workflow."*
189
+
190
+ ## Evaluation
191
+
192
+ > [!Note]
193
+ > The evaluation in this section correspond to the original checkpoint, not the QAT checkpoint.
194
+ >
195
+
196
+ Model evaluation metrics and results.
197
+
198
+ ### Benchmark Results
199
+
200
+ These models were evaluated against a large collection of different datasets and
201
+ metrics to cover different aspects of text generation:
202
+
203
+ #### Reasoning and factuality
204
+
205
+ | Benchmark | Metric | Gemma 3 PT 1B | Gemma 3 PT 4B | Gemma 3 PT 12B | Gemma 3 PT 27B |
206
+ | ------------------------------ |----------------|:--------------:|:-------------:|:--------------:|:--------------:|
207
+ | [HellaSwag][hellaswag] | 10-shot | 62.3 | 77.2 | 84.2 | 85.6 |
208
+ | [BoolQ][boolq] | 0-shot | 63.2 | 72.3 | 78.8 | 82.4 |
209
+ | [PIQA][piqa] | 0-shot | 73.8 | 79.6 | 81.8 | 83.3 |
210
+ | [SocialIQA][socialiqa] | 0-shot | 48.9 | 51.9 | 53.4 | 54.9 |
211
+ | [TriviaQA][triviaqa] | 5-shot | 39.8 | 65.8 | 78.2 | 85.5 |
212
+ | [Natural Questions][naturalq] | 5-shot | 9.48 | 20.0 | 31.4 | 36.1 |
213
+ | [ARC-c][arc] | 25-shot | 38.4 | 56.2 | 68.9 | 70.6 |
214
+ | [ARC-e][arc] | 0-shot | 73.0 | 82.4 | 88.3 | 89.0 |
215
+ | [WinoGrande][winogrande] | 5-shot | 58.2 | 64.7 | 74.3 | 78.8 |
216
+ | [BIG-Bench Hard][bbh] | few-shot | 28.4 | 50.9 | 72.6 | 77.7 |
217
+ | [DROP][drop] | 1-shot | 42.4 | 60.1 | 72.2 | 77.2 |
218
+
219
+ [hellaswag]: https://arxiv.org/abs/1905.07830
220
+ [boolq]: https://arxiv.org/abs/1905.10044
221
+ [piqa]: https://arxiv.org/abs/1911.11641
222
+ [socialiqa]: https://arxiv.org/abs/1904.09728
223
+ [triviaqa]: https://arxiv.org/abs/1705.03551
224
+ [naturalq]: https://github.com/google-research-datasets/natural-questions
225
+ [arc]: https://arxiv.org/abs/1911.01547
226
+ [winogrande]: https://arxiv.org/abs/1907.10641
227
+ [bbh]: https://paperswithcode.com/dataset/bbh
228
+ [drop]: https://arxiv.org/abs/1903.00161
229
+
230
+ #### STEM and code
231
+
232
+ | Benchmark | Metric | Gemma 3 PT 4B | Gemma 3 PT 12B | Gemma 3 PT 27B |
233
+ | ------------------------------ |----------------|:-------------:|:--------------:|:--------------:|
234
+ | [MMLU][mmlu] | 5-shot | 59.6 | 74.5 | 78.6 |
235
+ | [MMLU][mmlu] (Pro COT) | 5-shot | 29.2 | 45.3 | 52.2 |
236
+ | [AGIEval][agieval] | 3-5-shot | 42.1 | 57.4 | 66.2 |
237
+ | [MATH][math] | 4-shot | 24.2 | 43.3 | 50.0 |
238
+ | [GSM8K][gsm8k] | 8-shot | 38.4 | 71.0 | 82.6 |
239
+ | [GPQA][gpqa] | 5-shot | 15.0 | 25.4 | 24.3 |
240
+ | [MBPP][mbpp] | 3-shot | 46.0 | 60.4 | 65.6 |
241
+ | [HumanEval][humaneval] | 0-shot | 36.0 | 45.7 | 48.8 |
242
+
243
+ [mmlu]: https://arxiv.org/abs/2009.03300
244
+ [agieval]: https://arxiv.org/abs/2304.06364
245
+ [math]: https://arxiv.org/abs/2103.03874
246
+ [gsm8k]: https://arxiv.org/abs/2110.14168
247
+ [gpqa]: https://arxiv.org/abs/2311.12022
248
+ [mbpp]: https://arxiv.org/abs/2108.07732
249
+ [humaneval]: https://arxiv.org/abs/2107.03374
250
+
251
+ #### Multilingual
252
+
253
+ | Benchmark | Gemma 3 PT 1B | Gemma 3 PT 4B | Gemma 3 PT 12B | Gemma 3 PT 27B |
254
+ | ------------------------------------ |:-------------:|:-------------:|:--------------:|:--------------:|
255
+ | [MGSM][mgsm] | 2.04 | 34.7 | 64.3 | 74.3 |
256
+ | [Global-MMLU-Lite][global-mmlu-lite] | 24.9 | 57.0 | 69.4 | 75.7 |
257
+ | [WMT24++][wmt24pp] (ChrF) | 36.7 | 48.4 | 53.9 | 55.7 |
258
+ | [FloRes][flores] | 29.5 | 39.2 | 46.0 | 48.8 |
259
+ | [XQuAD][xquad] (all) | 43.9 | 68.0 | 74.5 | 76.8 |
260
+ | [ECLeKTic][eclektic] | 4.69 | 11.0 | 17.2 | 24.4 |
261
+ | [IndicGenBench][indicgenbench] | 41.4 | 57.2 | 61.7 | 63.4 |
262
+
263
+ [mgsm]: https://arxiv.org/abs/2210.03057
264
+ [flores]: https://arxiv.org/abs/2106.03193
265
+ [xquad]: https://arxiv.org/abs/1910.11856v3
266
+ [global-mmlu-lite]: https://huggingface.co/datasets/CohereForAI/Global-MMLU-Lite
267
+ [wmt24pp]: https://arxiv.org/abs/2502.12404v1
268
+ [eclektic]: https://arxiv.org/abs/2502.21228
269
+ [indicgenbench]: https://arxiv.org/abs/2404.16816
270
+
271
+ #### Multimodal
272
+
273
+ | Benchmark | Gemma 3 PT 4B | Gemma 3 PT 12B | Gemma 3 PT 27B |
274
+ | ------------------------------ |:-------------:|:--------------:|:--------------:|
275
+ | [COCOcap][coco-cap] | 102 | 111 | 116 |
276
+ | [DocVQA][docvqa] (val) | 72.8 | 82.3 | 85.6 |
277
+ | [InfoVQA][info-vqa] (val) | 44.1 | 54.8 | 59.4 |
278
+ | [MMMU][mmmu] (pt) | 39.2 | 50.3 | 56.1 |
279
+ | [TextVQA][textvqa] (val) | 58.9 | 66.5 | 68.6 |
280
+ | [RealWorldQA][realworldqa] | 45.5 | 52.2 | 53.9 |
281
+ | [ReMI][remi] | 27.3 | 38.5 | 44.8 |
282
+ | [AI2D][ai2d] | 63.2 | 75.2 | 79.0 |
283
+ | [ChartQA][chartqa] | 63.6 | 74.7 | 76.3 |
284
+ | [VQAv2][vqav2] | 63.9 | 71.2 | 72.9 |
285
+ | [BLINK][blinkvqa] | 38.0 | 35.9 | 39.6 |
286
+ | [OKVQA][okvqa] | 51.0 | 58.7 | 60.2 |
287
+ | [TallyQA][tallyqa] | 42.5 | 51.8 | 54.3 |
288
+ | [SpatialSense VQA][ss-vqa] | 50.9 | 60.0 | 59.4 |
289
+ | [CountBenchQA][countbenchqa] | 26.1 | 17.8 | 68.0 |
290
+
291
+ [coco-cap]: https://cocodataset.org/#home
292
+ [docvqa]: https://www.docvqa.org/
293
+ [info-vqa]: https://arxiv.org/abs/2104.12756
294
+ [mmmu]: https://arxiv.org/abs/2311.16502
295
+ [textvqa]: https://textvqa.org/
296
+ [realworldqa]: https://paperswithcode.com/dataset/realworldqa
297
+ [remi]: https://arxiv.org/html/2406.09175v1
298
+ [ai2d]: https://allenai.org/data/diagrams
299
+ [chartqa]: https://arxiv.org/abs/2203.10244
300
+ [vqav2]: https://visualqa.org/index.html
301
+ [blinkvqa]: https://arxiv.org/abs/2404.12390
302
+ [okvqa]: https://okvqa.allenai.org/
303
+ [tallyqa]: https://arxiv.org/abs/1810.12440
304
+ [ss-vqa]: https://arxiv.org/abs/1908.02660
305
+ [countbenchqa]: https://github.com/google-research/big_vision/blob/main/big_vision/datasets/countbenchqa/
306
+
307
+ ## Ethics and Safety
308
+
309
+ Ethics and safety evaluation approach and results.
310
+
311
+ ### Evaluation Approach
312
+
313
+ Our evaluation methods include structured evaluations and internal red-teaming
314
+ testing of relevant content policies. Red-teaming was conducted by a number of
315
+ different teams, each with different goals and human evaluation metrics. These
316
+ models were evaluated against a number of different categories relevant to
317
+ ethics and safety, including:
318
+
319
+ - **Child Safety**: Evaluation of text-to-text and image to text prompts
320
+ covering child safety policies, including child sexual abuse and
321
+ exploitation.
322
+ - **Content Safety:** Evaluation of text-to-text and image to text prompts
323
+ covering safety policies including, harassment, violence and gore, and hate
324
+ speech.
325
+ - **Representational Harms**: Evaluation of text-to-text and image to text
326
+ prompts covering safety policies including bias, stereotyping, and harmful
327
+ associations or inaccuracies.
328
+
329
+ In addition to development level evaluations, we conduct "assurance
330
+ evaluations" which are our 'arms-length' internal evaluations for responsibility
331
+ governance decision making. They are conducted separately from the model
332
+ development team, to inform decision making about release. High level findings
333
+ are fed back to the model team, but prompt sets are held-out to prevent
334
+ overfitting and preserve the results' ability to inform decision making.
335
+ Assurance evaluation results are reported to our Responsibility & Safety Council
336
+ as part of release review.
337
+
338
+ ### Evaluation Results
339
+
340
+ For all areas of safety testing, we saw major improvements in the categories of
341
+ child safety, content safety, and representational harms relative to previous
342
+ Gemma models. All testing was conducted without safety filters to evaluate the
343
+ model capabilities and behaviors. For both text-to-text and image-to-text, and
344
+ across all model sizes, the model produced minimal policy violations, and showed
345
+ significant improvements over previous Gemma models' performance with respect
346
+ to ungrounded inferences. A limitation of our evaluations was they included only
347
+ English language prompts.
348
+
349
+ ## Usage and Limitations
350
+
351
+ These models have certain limitations that users should be aware of.
352
+
353
+ ### Intended Usage
354
+
355
+ Open vision-language models (VLMs) models have a wide range of applications
356
+ across various industries and domains. The following list of potential uses is
357
+ not comprehensive. The purpose of this list is to provide contextual information
358
+ about the possible use-cases that the model creators considered as part of model
359
+ training and development.
360
+
361
+ - Content Creation and Communication
362
+ - Text Generation: These models can be used to generate creative text
363
+ formats such as poems, scripts, code, marketing copy, and email drafts.
364
+ - Chatbots and Conversational AI: Power conversational interfaces
365
+ for customer service, virtual assistants, or interactive applications.
366
+ - Text Summarization: Generate concise summaries of a text corpus,
367
+ research papers, or reports.
368
+ - Image Data Extraction: These models can be used to extract,
369
+ interpret, and summarize visual data for text communications.
370
+ - Research and Education
371
+ - Natural Language Processing (NLP) and VLM Research: These
372
+ models can serve as a foundation for researchers to experiment with VLM
373
+ and NLP techniques, develop algorithms, and contribute to the
374
+ advancement of the field.
375
+ - Language Learning Tools: Support interactive language learning
376
+ experiences, aiding in grammar correction or providing writing practice.
377
+ - Knowledge Exploration: Assist researchers in exploring large
378
+ bodies of text by generating summaries or answering questions about
379
+ specific topics.
380
+
381
+ ### Limitations
382
+
383
+ - Training Data
384
+ - The quality and diversity of the training data significantly
385
+ influence the model's capabilities. Biases or gaps in the training data
386
+ can lead to limitations in the model's responses.
387
+ - The scope of the training dataset determines the subject areas
388
+ the model can handle effectively.
389
+ - Context and Task Complexity
390
+ - Models are better at tasks that can be framed with clear
391
+ prompts and instructions. Open-ended or highly complex tasks might be
392
+ challenging.
393
+ - A model's performance can be influenced by the amount of context
394
+ provided (longer context generally leads to better outputs, up to a
395
+ certain point).
396
+ - Language Ambiguity and Nuance
397
+ - Natural language is inherently complex. Models might struggle
398
+ to grasp subtle nuances, sarcasm, or figurative language.
399
+ - Factual Accuracy
400
+ - Models generate responses based on information they learned
401
+ from their training datasets, but they are not knowledge bases. They
402
+ may generate incorrect or outdated factual statements.
403
+ - Common Sense
404
+ - Models rely on statistical patterns in language. They might
405
+ lack the ability to apply common sense reasoning in certain situations.
406
+
407
+ ### Ethical Considerations and Risks
408
+
409
+ The development of vision-language models (VLMs) raises several ethical
410
+ concerns. In creating an open model, we have carefully considered the following:
411
+
412
+ - Bias and Fairness
413
+ - VLMs trained on large-scale, real-world text and image data can
414
+ reflect socio-cultural biases embedded in the training material. These
415
+ models underwent careful scrutiny, input data pre-processing described
416
+ and posterior evaluations reported in this card.
417
+ - Misinformation and Misuse
418
+ - VLMs can be misused to generate text that is false, misleading,
419
+ or harmful.
420
+ - Guidelines are provided for responsible use with the model, see the
421
+ [Responsible Generative AI Toolkit][rai-toolkit].
422
+ - Transparency and Accountability:
423
+ - This model card summarizes details on the models' architecture,
424
+ capabilities, limitations, and evaluation processes.
425
+ - A responsibly developed open model offers the opportunity to
426
+ share innovation by making VLM technology accessible to developers and
427
+ researchers across the AI ecosystem.
428
+
429
+ Risks identified and mitigations:
430
+
431
+ - **Perpetuation of biases**: It's encouraged to perform continuous
432
+ monitoring (using evaluation metrics, human review) and the exploration of
433
+ de-biasing techniques during model training, fine-tuning, and other use
434
+ cases.
435
+ - **Generation of harmful content**: Mechanisms and guidelines for content
436
+ safety are essential. Developers are encouraged to exercise caution and
437
+ implement appropriate content safety safeguards based on their specific
438
+ product policies and application use cases.
439
+ - **Misuse for malicious purposes**: Technical limitations and developer
440
+ and end-user education can help mitigate against malicious applications of
441
+ VLMs. Educational resources and reporting mechanisms for users to flag
442
+ misuse are provided. Prohibited uses of Gemma models are outlined in the
443
+ [Gemma Prohibited Use Policy][prohibited-use].
444
+ - **Privacy violations**: Models were trained on data filtered for removal
445
+ of certain personal information and other sensitive data. Developers are
446
+ encouraged to adhere to privacy regulations with privacy-preserving
447
+ techniques.
448
+
449
+ ### Benefits
450
+
451
+ At the time of release, this family of models provides high-performance open
452
+ vision-language model implementations designed from the ground up for
453
+ responsible AI development compared to similarly sized models.
454
+
455
+ Using the benchmark evaluation metrics described in this document, these models
456
+ have shown to provide superior performance to other, comparably-sized open model
457
+ alternatives.
458
+
459
+ [g3-tech-report]: https://goo.gle/Gemma3Report
460
+ [rai-toolkit]: https://ai.google.dev/responsible
461
+ [kaggle-gemma]: https://www.kaggle.com/models/google/gemma-3
462
+ [vertex-mg-gemma3]: https://console.cloud.google.com/vertex-ai/publishers/google/model-garden/gemma3
463
+ [terms]: https://ai.google.dev/gemma/terms
464
+ [safety-policies]: https://ai.google/static/documents/ai-responsibility-update-published-february-2025.pdf
465
+ [prohibited-use]: https://ai.google.dev/gemma/prohibited_use_policy
466
+ [tpu]: https://cloud.google.com/tpu/docs/intro-to-tpu
467
+ [sustainability]: https://sustainability.google/operating-sustainably/
468
+ [jax]: https://github.com/jax-ml/jax
469
+ [ml-pathways]: https://blog.google/technology/ai/introducing-pathways-next-generation-ai-architecture/
470
+ [sustainability]: https://sustainability.google/operating-sustainably/
471
+ [gemini-2-paper]: https://arxiv.org/abs/2312.11805
gitattributes ADDED
@@ -0,0 +1,56 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ *.7z filter=lfs diff=lfs merge=lfs -text
2
+ *.arrow filter=lfs diff=lfs merge=lfs -text
3
+ *.bin filter=lfs diff=lfs merge=lfs -text
4
+ *.bz2 filter=lfs diff=lfs merge=lfs -text
5
+ *.ckpt filter=lfs diff=lfs merge=lfs -text
6
+ *.ftz filter=lfs diff=lfs merge=lfs -text
7
+ *.gz filter=lfs diff=lfs merge=lfs -text
8
+ *.h5 filter=lfs diff=lfs merge=lfs -text
9
+ *.joblib filter=lfs diff=lfs merge=lfs -text
10
+ *.lfs.* filter=lfs diff=lfs merge=lfs -text
11
+ *.mlmodel filter=lfs diff=lfs merge=lfs -text
12
+ *.model filter=lfs diff=lfs merge=lfs -text
13
+ *.msgpack filter=lfs diff=lfs merge=lfs -text
14
+ *.npy filter=lfs diff=lfs merge=lfs -text
15
+ *.npz filter=lfs diff=lfs merge=lfs -text
16
+ *.onnx filter=lfs diff=lfs merge=lfs -text
17
+ *.ot filter=lfs diff=lfs merge=lfs -text
18
+ *.parquet filter=lfs diff=lfs merge=lfs -text
19
+ *.pb filter=lfs diff=lfs merge=lfs -text
20
+ *.pickle filter=lfs diff=lfs merge=lfs -text
21
+ *.pkl filter=lfs diff=lfs merge=lfs -text
22
+ *.pt filter=lfs diff=lfs merge=lfs -text
23
+ *.pth filter=lfs diff=lfs merge=lfs -text
24
+ *.rar filter=lfs diff=lfs merge=lfs -text
25
+ *.safetensors filter=lfs diff=lfs merge=lfs -text
26
+ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
27
+ *.tar.* filter=lfs diff=lfs merge=lfs -text
28
+ *.tar filter=lfs diff=lfs merge=lfs -text
29
+ *.tflite filter=lfs diff=lfs merge=lfs -text
30
+ *.tgz filter=lfs diff=lfs merge=lfs -text
31
+ *.wasm filter=lfs diff=lfs merge=lfs -text
32
+ *.xz filter=lfs diff=lfs merge=lfs -text
33
+ *.zip filter=lfs diff=lfs merge=lfs -text
34
+ *.zst filter=lfs diff=lfs merge=lfs -text
35
+ *tfevents* filter=lfs diff=lfs merge=lfs -text
36
+ IT_4B_Q4_0_final/ocdbt.process_0/d/137746ef087f884f4038e4ac96a1ba87 filter=lfs diff=lfs merge=lfs -text
37
+ IT_4B_Q4_0_final/ocdbt.process_0/d/27c8d90732fa2c15cabe547a1e3cfe4d filter=lfs diff=lfs merge=lfs -text
38
+ IT_4B_Q4_0_final/ocdbt.process_0/d/62c4fcaf4ef12e47ef610b783e4fa30a filter=lfs diff=lfs merge=lfs -text
39
+ IT_4B_Q4_0_final/ocdbt.process_0/d/8337cfebb42bc613e674a77bb1ee2886 filter=lfs diff=lfs merge=lfs -text
40
+ IT_4B_Q4_0_final/ocdbt.process_0/d/b53d684b2a04cfce479683072ddc4600 filter=lfs diff=lfs merge=lfs -text
41
+ IT_4B_Q4_0_final/ocdbt.process_0/d/34523b22cfe9de526a785e2424a87b0a filter=lfs diff=lfs merge=lfs -text
42
+ IT_4B_Q4_0_final/ocdbt.process_0/d/b2b23d48e910e10612ec3fca7cfe53f9 filter=lfs diff=lfs merge=lfs -text
43
+ IT_4B_Q4_0_final/ocdbt.process_0/d/b81f01a7e46988615514b627bb6ae1cd filter=lfs diff=lfs merge=lfs -text
44
+ IT_4B_Q4_0_final/ocdbt.process_0/d/c2ddd1b999ba032a837b9f4198b6451e filter=lfs diff=lfs merge=lfs -text
45
+ IT_4B_Q4_0_final/ocdbt.process_0/d/cdd5f639948d07d490eb8acc9150e45b filter=lfs diff=lfs merge=lfs -text
46
+ IT_4B_Q4_0_final/ocdbt.process_0/d/090389b872b234532618ddc2a09656bd filter=lfs diff=lfs merge=lfs -text
47
+ IT_4B_Q4_0_final/ocdbt.process_0/d/aede547175f7314c0ed705497e9d0f53 filter=lfs diff=lfs merge=lfs -text
48
+ IT_4B_Q4_0_final/ocdbt.process_0/d/cc5acff853e6b18bd77825bd986783d6 filter=lfs diff=lfs merge=lfs -text
49
+ IT_4B_Q4_0_final/ocdbt.process_0/d/d8b694d6b83dcdda095d6c728719adda filter=lfs diff=lfs merge=lfs -text
50
+ IT_4B_Q4_0_final/ocdbt.process_0/d/d8c905637523d82d630766cf3a7a01de filter=lfs diff=lfs merge=lfs -text
51
+ IT_4B_Q4_0_final/ocdbt.process_0/d/e8abce030d2470cdb72ba6cac6a05dab filter=lfs diff=lfs merge=lfs -text
52
+ IT_4B_Q4_0_final/ocdbt.process_0/d/fdfd0851e3e6d2b7d058402468a49458 filter=lfs diff=lfs merge=lfs -text
53
+ IT_4B_Q4_0_final_q4_0.gguf filter=lfs diff=lfs merge=lfs -text
54
+ mmproj-model-f16.gguf filter=lfs diff=lfs merge=lfs -text
55
+ mmproj-model-f16-4B.gguf filter=lfs diff=lfs merge=lfs -text
56
+ gemma-3-4b-it-q4_0.gguf filter=lfs diff=lfs merge=lfs -text