vinimuchulski commited on
Commit
877c113
·
verified ·
1 Parent(s): 810b4ab

Upload 4 files

Browse files
.gitattributes CHANGED
@@ -33,3 +33,5 @@ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
33
  *.zip filter=lfs diff=lfs merge=lfs -text
34
  *.zst filter=lfs diff=lfs merge=lfs -text
35
  *tfevents* filter=lfs diff=lfs merge=lfs -text
 
 
 
33
  *.zip filter=lfs diff=lfs merge=lfs -text
34
  *.zst filter=lfs diff=lfs merge=lfs -text
35
  *tfevents* filter=lfs diff=lfs merge=lfs -text
36
+ gemma-3-27b-it-q4_0.gguf filter=lfs diff=lfs merge=lfs -text
37
+ mmproj-model-f16-27B.gguf filter=lfs diff=lfs merge=lfs -text
README.md CHANGED
@@ -1,3 +1,473 @@
1
- ---
2
- license: gemma
3
- ---
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ license: gemma
3
+ pipeline_tag: image-text-to-text
4
+ extra_gated_heading: Access Gemma on Hugging Face
5
+ extra_gated_prompt: >-
6
+ To access Gemma on Hugging Face, you’re required to review and agree to
7
+ Google’s usage license. To do this, please ensure you’re logged in to Hugging
8
+ Face and click below. Requests are processed immediately.
9
+ extra_gated_button_content: Acknowledge license
10
+ base_model: google/gemma-3-27b-it
11
+ tags:
12
+ - gemma
13
+ - gemma3
14
+ ---
15
+
16
+ # Gemma 3 model card
17
+
18
+ **Model Page**: [Gemma](https://ai.google.dev/gemma/docs/core)
19
+
20
+ > [!Note]
21
+ > This repository corresponds to the 27 **instruction-tuned** version of the Gemma 3 model in GGUF format using Quantization Aware Training (QAT).
22
+ > The GGUF corresponds to Q4_0 quantization.
23
+ >
24
+ > Thanks to QAT, the model is able to preserve similar quality as `bfloat16` while significantly reducing the memory requirements
25
+ > to load the model.
26
+ >
27
+ > You can find the half-precision version [here](https://huggingface.co/google/gemma-3-27b-it).
28
+
29
+
30
+ **Resources and Technical Documentation**:
31
+
32
+ * [Gemma 3 Technical Report][g3-tech-report]
33
+ * [Responsible Generative AI Toolkit][rai-toolkit]
34
+ * [Gemma on Kaggle][kaggle-gemma]
35
+ * [Gemma on Vertex Model Garden][vertex-mg-gemma3]
36
+
37
+ **Terms of Use**: [Terms][terms]
38
+
39
+ **Authors**: Google DeepMind
40
+
41
+ ## Model Information
42
+
43
+ Summary description and brief definition of inputs and outputs.
44
+
45
+ ### Description
46
+
47
+ Gemma is a family of lightweight, state-of-the-art open models from Google,
48
+ built from the same research and technology used to create the Gemini models.
49
+ Gemma 3 models are multimodal, handling text and image input and generating text
50
+ output, with open weights for both pre-trained variants and instruction-tuned
51
+ variants. Gemma 3 has a large, 128K context window, multilingual support in over
52
+ 140 languages, and is available in more sizes than previous versions. Gemma 3
53
+ models are well-suited for a variety of text generation and image understanding
54
+ tasks, including question answering, summarization, and reasoning. Their
55
+ relatively small size makes it possible to deploy them in environments with
56
+ limited resources such as laptops, desktops or your own cloud infrastructure,
57
+ democratizing access to state of the art AI models and helping foster innovation
58
+ for everyone.
59
+
60
+ ### Inputs and outputs
61
+
62
+ - **Input:**
63
+ - Text string, such as a question, a prompt, or a document to be summarized
64
+ - Images, normalized to 896 x 896 resolution and encoded to 256 tokens
65
+ each
66
+ - Total input context of 128K tokens for the 4B, 12B, and 27B sizes, and
67
+ 32K tokens for the 1B size
68
+
69
+ - **Output:**
70
+ - Generated text in response to the input, such as an answer to a
71
+ question, analysis of image content, or a summary of a document
72
+ - Total output context of 8192 tokens
73
+
74
+ ### Usage
75
+
76
+ Below, there are some code snippets on how to get quickly started with running the model.
77
+
78
+ **llama.cpp (text-only)**
79
+
80
+ ```sh
81
+ ./llama-cli -hf google/gemma-3-27b-it-qat-q4_0-gguf -p "Write a poem about the Kraken."
82
+ ```
83
+
84
+ **llama.cpp (image input)**
85
+
86
+ ```sh
87
+ wget https://github.com/bebechien/gemma/blob/main/surprise.png?raw=true -O ~/Downloads/surprise.png
88
+ ./llama-gemma3-cli -hf google/gemma-3-27b-it-qat-q4_0-gguf -p "Describe this image." --image ~/Downloads/surprise.png
89
+ ```
90
+
91
+ **ollama (text only)**
92
+
93
+ Using GGUFs with Ollama via Hugging Face does not support image inputs at the moment. Please check the [docs on running gated repositories](https://huggingface.co/docs/hub/en/ollama#run-private-ggufs-from-the-hugging-face-hub).
94
+
95
+
96
+ ```sh
97
+ ollama run hf.co/google/gemma-3-27b-it-qat-q4_0-gguf
98
+ ```
99
+
100
+ ### Citation
101
+
102
+ ```none
103
+ @article{gemma_2025,
104
+ title={Gemma 3},
105
+ url={https://goo.gle/Gemma3Report},
106
+ publisher={Kaggle},
107
+ author={Gemma Team},
108
+ year={2025}
109
+ }
110
+ ```
111
+
112
+ ## Model Data
113
+
114
+ Data used for model training and how the data was processed.
115
+
116
+ ### Training Dataset
117
+
118
+ These models were trained on a dataset of text data that includes a wide variety
119
+ of sources. The 27B model was trained with 14 trillion tokens, the 12B model was
120
+ trained with 12 trillion tokens, 4B model was trained with 4 trillion tokens and
121
+ 1B with 2 trillion tokens. Here are the key components:
122
+
123
+ - Web Documents: A diverse collection of web text ensures the model is
124
+ exposed to a broad range of linguistic styles, topics, and vocabulary. The
125
+ training dataset includes content in over 140 languages.
126
+ - Code: Exposing the model to code helps it to learn the syntax and
127
+ patterns of programming languages, which improves its ability to generate
128
+ code and understand code-related questions.
129
+ - Mathematics: Training on mathematical text helps the model learn logical
130
+ reasoning, symbolic representation, and to address mathematical queries.
131
+ - Images: A wide range of images enables the model to perform image
132
+ analysis and visual data extraction tasks.
133
+
134
+ The combination of these diverse data sources is crucial for training a powerful
135
+ multimodal model that can handle a wide variety of different tasks and data
136
+ formats.
137
+
138
+ ### Data Preprocessing
139
+
140
+ Here are the key data cleaning and filtering methods applied to the training
141
+ data:
142
+
143
+ - CSAM Filtering: Rigorous CSAM (Child Sexual Abuse Material) filtering
144
+ was applied at multiple stages in the data preparation process to ensure
145
+ the exclusion of harmful and illegal content.
146
+ - Sensitive Data Filtering: As part of making Gemma pre-trained models
147
+ safe and reliable, automated techniques were used to filter out certain
148
+ personal information and other sensitive data from training sets.
149
+ - Additional methods: Filtering based on content quality and safety in
150
+ line with [our policies][safety-policies].
151
+
152
+ ## Implementation Information
153
+
154
+ Details about the model internals.
155
+
156
+ ### Hardware
157
+
158
+ Gemma was trained using [Tensor Processing Unit (TPU)][tpu] hardware (TPUv4p,
159
+ TPUv5p and TPUv5e). Training vision-language models (VLMS) requires significant
160
+ computational power. TPUs, designed specifically for matrix operations common in
161
+ machine learning, offer several advantages in this domain:
162
+
163
+ - Performance: TPUs are specifically designed to handle the massive
164
+ computations involved in training VLMs. They can speed up training
165
+ considerably compared to CPUs.
166
+ - Memory: TPUs often come with large amounts of high-bandwidth memory,
167
+ allowing for the handling of large models and batch sizes during training.
168
+ This can lead to better model quality.
169
+ - Scalability: TPU Pods (large clusters of TPUs) provide a scalable
170
+ solution for handling the growing complexity of large foundation models.
171
+ You can distribute training across multiple TPU devices for faster and more
172
+ efficient processing.
173
+ - Cost-effectiveness: In many scenarios, TPUs can provide a more
174
+ cost-effective solution for training large models compared to CPU-based
175
+ infrastructure, especially when considering the time and resources saved
176
+ due to faster training.
177
+ - These advantages are aligned with
178
+ [Google's commitments to operate sustainably][sustainability].
179
+
180
+ ### Software
181
+
182
+ Training was done using [JAX][jax] and [ML Pathways][ml-pathways].
183
+
184
+ JAX allows researchers to take advantage of the latest generation of hardware,
185
+ including TPUs, for faster and more efficient training of large models. ML
186
+ Pathways is Google's latest effort to build artificially intelligent systems
187
+ capable of generalizing across multiple tasks. This is specially suitable for
188
+ foundation models, including large language models like these ones.
189
+
190
+ Together, JAX and ML Pathways are used as described in the
191
+ [paper about the Gemini family of models][gemini-2-paper]; *"the 'single
192
+ controller' programming model of Jax and Pathways allows a single Python
193
+ process to orchestrate the entire training run, dramatically simplifying the
194
+ development workflow."*
195
+
196
+ ## Evaluation
197
+
198
+ Model evaluation metrics and results.
199
+
200
+ ### Benchmark Results
201
+
202
+ These models were evaluated against a large collection of different datasets and
203
+ metrics to cover different aspects of text generation:
204
+
205
+ #### Reasoning and factuality
206
+
207
+ | Benchmark | Metric | Gemma 3 PT 1B | Gemma 3 PT 4B | Gemma 3 PT 12B | Gemma 3 PT 27B |
208
+ | ------------------------------ |----------------|:--------------:|:-------------:|:--------------:|:--------------:|
209
+ | [HellaSwag][hellaswag] | 10-shot | 62.3 | 77.2 | 84.2 | 85.6 |
210
+ | [BoolQ][boolq] | 0-shot | 63.2 | 72.3 | 78.8 | 82.4 |
211
+ | [PIQA][piqa] | 0-shot | 73.8 | 79.6 | 81.8 | 83.3 |
212
+ | [SocialIQA][socialiqa] | 0-shot | 48.9 | 51.9 | 53.4 | 54.9 |
213
+ | [TriviaQA][triviaqa] | 5-shot | 39.8 | 65.8 | 78.2 | 85.5 |
214
+ | [Natural Questions][naturalq] | 5-shot | 9.48 | 20.0 | 31.4 | 36.1 |
215
+ | [ARC-c][arc] | 25-shot | 38.4 | 56.2 | 68.9 | 70.6 |
216
+ | [ARC-e][arc] | 0-shot | 73.0 | 82.4 | 88.3 | 89.0 |
217
+ | [WinoGrande][winogrande] | 5-shot | 58.2 | 64.7 | 74.3 | 78.8 |
218
+ | [BIG-Bench Hard][bbh] | few-shot | 28.4 | 50.9 | 72.6 | 77.7 |
219
+ | [DROP][drop] | 1-shot | 42.4 | 60.1 | 72.2 | 77.2 |
220
+
221
+ [hellaswag]: https://arxiv.org/abs/1905.07830
222
+ [boolq]: https://arxiv.org/abs/1905.10044
223
+ [piqa]: https://arxiv.org/abs/1911.11641
224
+ [socialiqa]: https://arxiv.org/abs/1904.09728
225
+ [triviaqa]: https://arxiv.org/abs/1705.03551
226
+ [naturalq]: https://github.com/google-research-datasets/natural-questions
227
+ [arc]: https://arxiv.org/abs/1911.01547
228
+ [winogrande]: https://arxiv.org/abs/1907.10641
229
+ [bbh]: https://paperswithcode.com/dataset/bbh
230
+ [drop]: https://arxiv.org/abs/1903.00161
231
+
232
+ #### STEM and code
233
+
234
+ | Benchmark | Metric | Gemma 3 PT 4B | Gemma 3 PT 12B | Gemma 3 PT 27B |
235
+ | ------------------------------ |----------------|:-------------:|:--------------:|:--------------:|
236
+ | [MMLU][mmlu] | 5-shot | 59.6 | 74.5 | 78.6 |
237
+ | [MMLU][mmlu] (Pro COT) | 5-shot | 29.2 | 45.3 | 52.2 |
238
+ | [AGIEval][agieval] | 3-5-shot | 42.1 | 57.4 | 66.2 |
239
+ | [MATH][math] | 4-shot | 24.2 | 43.3 | 50.0 |
240
+ | [GSM8K][gsm8k] | 8-shot | 38.4 | 71.0 | 82.6 |
241
+ | [GPQA][gpqa] | 5-shot | 15.0 | 25.4 | 24.3 |
242
+ | [MBPP][mbpp] | 3-shot | 46.0 | 60.4 | 65.6 |
243
+ | [HumanEval][humaneval] | 0-shot | 36.0 | 45.7 | 48.8 |
244
+
245
+ [mmlu]: https://arxiv.org/abs/2009.03300
246
+ [agieval]: https://arxiv.org/abs/2304.06364
247
+ [math]: https://arxiv.org/abs/2103.03874
248
+ [gsm8k]: https://arxiv.org/abs/2110.14168
249
+ [gpqa]: https://arxiv.org/abs/2311.12022
250
+ [mbpp]: https://arxiv.org/abs/2108.07732
251
+ [humaneval]: https://arxiv.org/abs/2107.03374
252
+
253
+ #### Multilingual
254
+
255
+ | Benchmark | Gemma 3 PT 1B | Gemma 3 PT 4B | Gemma 3 PT 12B | Gemma 3 PT 27B |
256
+ | ------------------------------------ |:-------------:|:-------------:|:--------------:|:--------------:|
257
+ | [MGSM][mgsm] | 2.04 | 34.7 | 64.3 | 74.3 |
258
+ | [Global-MMLU-Lite][global-mmlu-lite] | 24.9 | 57.0 | 69.4 | 75.7 |
259
+ | [WMT24++][wmt24pp] (ChrF) | 36.7 | 48.4 | 53.9 | 55.7 |
260
+ | [FloRes][flores] | 29.5 | 39.2 | 46.0 | 48.8 |
261
+ | [XQuAD][xquad] (all) | 43.9 | 68.0 | 74.5 | 76.8 |
262
+ | [ECLeKTic][eclektic] | 4.69 | 11.0 | 17.2 | 24.4 |
263
+ | [IndicGenBench][indicgenbench] | 41.4 | 57.2 | 61.7 | 63.4 |
264
+
265
+ [mgsm]: https://arxiv.org/abs/2210.03057
266
+ [flores]: https://arxiv.org/abs/2106.03193
267
+ [xquad]: https://arxiv.org/abs/1910.11856v3
268
+ [global-mmlu-lite]: https://huggingface.co/datasets/CohereForAI/Global-MMLU-Lite
269
+ [wmt24pp]: https://arxiv.org/abs/2502.12404v1
270
+ [eclektic]: https://arxiv.org/abs/2502.21228
271
+ [indicgenbench]: https://arxiv.org/abs/2404.16816
272
+
273
+ #### Multimodal
274
+
275
+ | Benchmark | Gemma 3 PT 4B | Gemma 3 PT 12B | Gemma 3 PT 27B |
276
+ | ------------------------------ |:-------------:|:--------------:|:--------------:|
277
+ | [COCOcap][coco-cap] | 102 | 111 | 116 |
278
+ | [DocVQA][docvqa] (val) | 72.8 | 82.3 | 85.6 |
279
+ | [InfoVQA][info-vqa] (val) | 44.1 | 54.8 | 59.4 |
280
+ | [MMMU][mmmu] (pt) | 39.2 | 50.3 | 56.1 |
281
+ | [TextVQA][textvqa] (val) | 58.9 | 66.5 | 68.6 |
282
+ | [RealWorldQA][realworldqa] | 45.5 | 52.2 | 53.9 |
283
+ | [ReMI][remi] | 27.3 | 38.5 | 44.8 |
284
+ | [AI2D][ai2d] | 63.2 | 75.2 | 79.0 |
285
+ | [ChartQA][chartqa] | 63.6 | 74.7 | 76.3 |
286
+ | [VQAv2][vqav2] | 63.9 | 71.2 | 72.9 |
287
+ | [BLINK][blinkvqa] | 38.0 | 35.9 | 39.6 |
288
+ | [OKVQA][okvqa] | 51.0 | 58.7 | 60.2 |
289
+ | [TallyQA][tallyqa] | 42.5 | 51.8 | 54.3 |
290
+ | [SpatialSense VQA][ss-vqa] | 50.9 | 60.0 | 59.4 |
291
+ | [CountBenchQA][countbenchqa] | 26.1 | 17.8 | 68.0 |
292
+
293
+ [coco-cap]: https://cocodataset.org/#home
294
+ [docvqa]: https://www.docvqa.org/
295
+ [info-vqa]: https://arxiv.org/abs/2104.12756
296
+ [mmmu]: https://arxiv.org/abs/2311.16502
297
+ [textvqa]: https://textvqa.org/
298
+ [realworldqa]: https://paperswithcode.com/dataset/realworldqa
299
+ [remi]: https://arxiv.org/html/2406.09175v1
300
+ [ai2d]: https://allenai.org/data/diagrams
301
+ [chartqa]: https://arxiv.org/abs/2203.10244
302
+ [vqav2]: https://visualqa.org/index.html
303
+ [blinkvqa]: https://arxiv.org/abs/2404.12390
304
+ [okvqa]: https://okvqa.allenai.org/
305
+ [tallyqa]: https://arxiv.org/abs/1810.12440
306
+ [ss-vqa]: https://arxiv.org/abs/1908.02660
307
+ [countbenchqa]: https://github.com/google-research/big_vision/blob/main/big_vision/datasets/countbenchqa/
308
+
309
+ ## Ethics and Safety
310
+
311
+ Ethics and safety evaluation approach and results.
312
+
313
+ ### Evaluation Approach
314
+
315
+ Our evaluation methods include structured evaluations and internal red-teaming
316
+ testing of relevant content policies. Red-teaming was conducted by a number of
317
+ different teams, each with different goals and human evaluation metrics. These
318
+ models were evaluated against a number of different categories relevant to
319
+ ethics and safety, including:
320
+
321
+ - **Child Safety**: Evaluation of text-to-text and image to text prompts
322
+ covering child safety policies, including child sexual abuse and
323
+ exploitation.
324
+ - **Content Safety:** Evaluation of text-to-text and image to text prompts
325
+ covering safety policies including, harassment, violence and gore, and hate
326
+ speech.
327
+ - **Representational Harms**: Evaluation of text-to-text and image to text
328
+ prompts covering safety policies including bias, stereotyping, and harmful
329
+ associations or inaccuracies.
330
+
331
+ In addition to development level evaluations, we conduct "assurance
332
+ evaluations" which are our 'arms-length' internal evaluations for responsibility
333
+ governance decision making. They are conducted separately from the model
334
+ development team, to inform decision making about release. High level findings
335
+ are fed back to the model team, but prompt sets are held-out to prevent
336
+ overfitting and preserve the results' ability to inform decision making.
337
+ Assurance evaluation results are reported to our Responsibility & Safety Council
338
+ as part of release review.
339
+
340
+ ### Evaluation Results
341
+
342
+ For all areas of safety testing, we saw major improvements in the categories of
343
+ child safety, content safety, and representational harms relative to previous
344
+ Gemma models. All testing was conducted without safety filters to evaluate the
345
+ model capabilities and behaviors. For both text-to-text and image-to-text, and
346
+ across all model sizes, the model produced minimal policy violations, and showed
347
+ significant improvements over previous Gemma models' performance with respect
348
+ to ungrounded inferences. A limitation of our evaluations was they included only
349
+ English language prompts.
350
+
351
+ ## Usage and Limitations
352
+
353
+ These models have certain limitations that users should be aware of.
354
+
355
+ ### Intended Usage
356
+
357
+ Open vision-language models (VLMs) models have a wide range of applications
358
+ across various industries and domains. The following list of potential uses is
359
+ not comprehensive. The purpose of this list is to provide contextual information
360
+ about the possible use-cases that the model creators considered as part of model
361
+ training and development.
362
+
363
+ - Content Creation and Communication
364
+ - Text Generation: These models can be used to generate creative text
365
+ formats such as poems, scripts, code, marketing copy, and email drafts.
366
+ - Chatbots and Conversational AI: Power conversational interfaces
367
+ for customer service, virtual assistants, or interactive applications.
368
+ - Text Summarization: Generate concise summaries of a text corpus,
369
+ research papers, or reports.
370
+ - Image Data Extraction: These models can be used to extract,
371
+ interpret, and summarize visual data for text communications.
372
+ - Research and Education
373
+ - Natural Language Processing (NLP) and VLM Research: These
374
+ models can serve as a foundation for researchers to experiment with VLM
375
+ and NLP techniques, develop algorithms, and contribute to the
376
+ advancement of the field.
377
+ - Language Learning Tools: Support interactive language learning
378
+ experiences, aiding in grammar correction or providing writing practice.
379
+ - Knowledge Exploration: Assist researchers in exploring large
380
+ bodies of text by generating summaries or answering questions about
381
+ specific topics.
382
+
383
+ ### Limitations
384
+
385
+ - Training Data
386
+ - The quality and diversity of the training data significantly
387
+ influence the model's capabilities. Biases or gaps in the training data
388
+ can lead to limitations in the model's responses.
389
+ - The scope of the training dataset determines the subject areas
390
+ the model can handle effectively.
391
+ - Context and Task Complexity
392
+ - Models are better at tasks that can be framed with clear
393
+ prompts and instructions. Open-ended or highly complex tasks might be
394
+ challenging.
395
+ - A model's performance can be influenced by the amount of context
396
+ provided (longer context generally leads to better outputs, up to a
397
+ certain point).
398
+ - Language Ambiguity and Nuance
399
+ - Natural language is inherently complex. Models might struggle
400
+ to grasp subtle nuances, sarcasm, or figurative language.
401
+ - Factual Accuracy
402
+ - Models generate responses based on information they learned
403
+ from their training datasets, but they are not knowledge bases. They
404
+ may generate incorrect or outdated factual statements.
405
+ - Common Sense
406
+ - Models rely on statistical patterns in language. They might
407
+ lack the ability to apply common sense reasoning in certain situations.
408
+
409
+ ### Ethical Considerations and Risks
410
+
411
+ The development of vision-language models (VLMs) raises several ethical
412
+ concerns. In creating an open model, we have carefully considered the following:
413
+
414
+ - Bias and Fairness
415
+ - VLMs trained on large-scale, real-world text and image data can
416
+ reflect socio-cultural biases embedded in the training material. These
417
+ models underwent careful scrutiny, input data pre-processing described
418
+ and posterior evaluations reported in this card.
419
+ - Misinformation and Misuse
420
+ - VLMs can be misused to generate text that is false, misleading,
421
+ or harmful.
422
+ - Guidelines are provided for responsible use with the model, see the
423
+ [Responsible Generative AI Toolkit][rai-toolkit].
424
+ - Transparency and Accountability:
425
+ - This model card summarizes details on the models' architecture,
426
+ capabilities, limitations, and evaluation processes.
427
+ - A responsibly developed open model offers the opportunity to
428
+ share innovation by making VLM technology accessible to developers and
429
+ researchers across the AI ecosystem.
430
+
431
+ Risks identified and mitigations:
432
+
433
+ - **Perpetuation of biases**: It's encouraged to perform continuous
434
+ monitoring (using evaluation metrics, human review) and the exploration of
435
+ de-biasing techniques during model training, fine-tuning, and other use
436
+ cases.
437
+ - **Generation of harmful content**: Mechanisms and guidelines for content
438
+ safety are essential. Developers are encouraged to exercise caution and
439
+ implement appropriate content safety safeguards based on their specific
440
+ product policies and application use cases.
441
+ - **Misuse for malicious purposes**: Technical limitations and developer
442
+ and end-user education can help mitigate against malicious applications of
443
+ VLMs. Educational resources and reporting mechanisms for users to flag
444
+ misuse are provided. Prohibited uses of Gemma models are outlined in the
445
+ [Gemma Prohibited Use Policy][prohibited-use].
446
+ - **Privacy violations**: Models were trained on data filtered for removal
447
+ of certain personal information and other sensitive data. Developers are
448
+ encouraged to adhere to privacy regulations with privacy-preserving
449
+ techniques.
450
+
451
+ ### Benefits
452
+
453
+ At the time of release, this family of models provides high-performance open
454
+ vision-language model implementations designed from the ground up for
455
+ responsible AI development compared to similarly sized models.
456
+
457
+ Using the benchmark evaluation metrics described in this document, these models
458
+ have shown to provide superior performance to other, comparably-sized open model
459
+ alternatives.
460
+
461
+ [g3-tech-report]: https://goo.gle/Gemma3Report
462
+ [rai-toolkit]: https://ai.google.dev/responsible
463
+ [kaggle-gemma]: https://www.kaggle.com/models/google/gemma-3
464
+ [vertex-mg-gemma3]: https://console.cloud.google.com/vertex-ai/publishers/google/model-garden/gemma3
465
+ [terms]: https://ai.google.dev/gemma/terms
466
+ [safety-policies]: https://ai.google/static/documents/ai-responsibility-update-published-february-2025.pdf
467
+ [prohibited-use]: https://ai.google.dev/gemma/prohibited_use_policy
468
+ [tpu]: https://cloud.google.com/tpu/docs/intro-to-tpu
469
+ [sustainability]: https://sustainability.google/operating-sustainably/
470
+ [jax]: https://github.com/jax-ml/jax
471
+ [ml-pathways]: https://blog.google/technology/ai/introducing-pathways-next-generation-ai-architecture/
472
+ [sustainability]: https://sustainability.google/operating-sustainably/
473
+ [gemini-2-paper]: https://arxiv.org/abs/2312.11805
gemma-3-27b-it-q4_0.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:45e586879bc5f5d7a5b6527e812952057ce916d9fc7ba16f7262ec9972c9e2a2
3
+ size 17229630496
gitattributes ADDED
@@ -0,0 +1,80 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ *.7z filter=lfs diff=lfs merge=lfs -text
2
+ *.arrow filter=lfs diff=lfs merge=lfs -text
3
+ *.bin filter=lfs diff=lfs merge=lfs -text
4
+ *.bz2 filter=lfs diff=lfs merge=lfs -text
5
+ *.ckpt filter=lfs diff=lfs merge=lfs -text
6
+ *.ftz filter=lfs diff=lfs merge=lfs -text
7
+ *.gz filter=lfs diff=lfs merge=lfs -text
8
+ *.h5 filter=lfs diff=lfs merge=lfs -text
9
+ *.joblib filter=lfs diff=lfs merge=lfs -text
10
+ *.lfs.* filter=lfs diff=lfs merge=lfs -text
11
+ *.mlmodel filter=lfs diff=lfs merge=lfs -text
12
+ *.model filter=lfs diff=lfs merge=lfs -text
13
+ *.msgpack filter=lfs diff=lfs merge=lfs -text
14
+ *.npy filter=lfs diff=lfs merge=lfs -text
15
+ *.npz filter=lfs diff=lfs merge=lfs -text
16
+ *.onnx filter=lfs diff=lfs merge=lfs -text
17
+ *.ot filter=lfs diff=lfs merge=lfs -text
18
+ *.parquet filter=lfs diff=lfs merge=lfs -text
19
+ *.pb filter=lfs diff=lfs merge=lfs -text
20
+ *.pickle filter=lfs diff=lfs merge=lfs -text
21
+ *.pkl filter=lfs diff=lfs merge=lfs -text
22
+ *.pt filter=lfs diff=lfs merge=lfs -text
23
+ *.pth filter=lfs diff=lfs merge=lfs -text
24
+ *.rar filter=lfs diff=lfs merge=lfs -text
25
+ *.safetensors filter=lfs diff=lfs merge=lfs -text
26
+ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
27
+ *.tar.* filter=lfs diff=lfs merge=lfs -text
28
+ *.tar filter=lfs diff=lfs merge=lfs -text
29
+ *.tflite filter=lfs diff=lfs merge=lfs -text
30
+ *.tgz filter=lfs diff=lfs merge=lfs -text
31
+ *.wasm filter=lfs diff=lfs merge=lfs -text
32
+ *.xz filter=lfs diff=lfs merge=lfs -text
33
+ *.zip filter=lfs diff=lfs merge=lfs -text
34
+ *.zst filter=lfs diff=lfs merge=lfs -text
35
+ *tfevents* filter=lfs diff=lfs merge=lfs -text
36
+ ocdbt.process_0/d/90daf0fffcae3ddcb3313f372f6223e0 filter=lfs diff=lfs merge=lfs -text
37
+ ocdbt.process_0/d/74d50bb048ca8776e7ba676f20da59ad filter=lfs diff=lfs merge=lfs -text
38
+ ocdbt.process_0/d/34a84e7f7777575734700e412e471610 filter=lfs diff=lfs merge=lfs -text
39
+ ocdbt.process_0/d/ec523e8767aa5f35e4a68dc1e2aef9ef filter=lfs diff=lfs merge=lfs -text
40
+ ocdbt.process_0/d/822f85a7cffcb73ddbaa5ce339f0d839 filter=lfs diff=lfs merge=lfs -text
41
+ ocdbt.process_0/d/18a420ca529cb405790482e5a51019af filter=lfs diff=lfs merge=lfs -text
42
+ ocdbt.process_0/d/a4029942343f366a9ab4923f16c846d6 filter=lfs diff=lfs merge=lfs -text
43
+ ocdbt.process_0/d/1408193d9ba25eb7439a252fa57e9a64 filter=lfs diff=lfs merge=lfs -text
44
+ ocdbt.process_0/d/e1b92796a3fe59667a542a4e9e993f7c filter=lfs diff=lfs merge=lfs -text
45
+ ocdbt.process_0/d/63f1b4399a48be3e55018e7c91a9efce filter=lfs diff=lfs merge=lfs -text
46
+ ocdbt.process_0/d/63aa91a9e174d917e998d388e8d0fd89 filter=lfs diff=lfs merge=lfs -text
47
+ ocdbt.process_0/d/e8c509c703132b84b296b222421c007d filter=lfs diff=lfs merge=lfs -text
48
+ ocdbt.process_0/d/8069bd3517cb2190ea0a2ee5149fd20f filter=lfs diff=lfs merge=lfs -text
49
+ ocdbt.process_0/d/be90ab6973d0b800d22e81fba6a117ab filter=lfs diff=lfs merge=lfs -text
50
+ ocdbt.process_0/d/9602809d565cd24cad2e7e6e189edac2 filter=lfs diff=lfs merge=lfs -text
51
+ ocdbt.process_0/d/bbdaf78062da1439a5054804cb88bb16 filter=lfs diff=lfs merge=lfs -text
52
+ ocdbt.process_0/d/e0000b0d3126ff8ab570710c35badb63 filter=lfs diff=lfs merge=lfs -text
53
+ ocdbt.process_0/d/767eece64718db7f60d198d549a3f2bb filter=lfs diff=lfs merge=lfs -text
54
+ ocdbt.process_0/d/4dcb4ab90d5f2afef52cb9eff89f3057 filter=lfs diff=lfs merge=lfs -text
55
+ ocdbt.process_0/d/9fb887fbb580e8bd00c72b239e66744f filter=lfs diff=lfs merge=lfs -text
56
+ ocdbt.process_0/d/c5f8004cf1827b2d8aa42748b1689540 filter=lfs diff=lfs merge=lfs -text
57
+ ocdbt.process_0/d/6903cc5cc61d7c3bc694c33f3ee95e00 filter=lfs diff=lfs merge=lfs -text
58
+ ocdbt.process_0/d/d2939ddd178583addfa051337734d5ff filter=lfs diff=lfs merge=lfs -text
59
+ ocdbt.process_0/d/0f2956a0c285b57be640ebbeb9dd58ab filter=lfs diff=lfs merge=lfs -text
60
+ ocdbt.process_0/d/cdb9e7e3a66c5b0a128e2a0925977952 filter=lfs diff=lfs merge=lfs -text
61
+ ocdbt.process_0/d/31bb4d7cc87ca3e610e5e372ae5efc8a filter=lfs diff=lfs merge=lfs -text
62
+ ocdbt.process_0/d/213ccc9feb3ee8c7f59683daf514cb3c filter=lfs diff=lfs merge=lfs -text
63
+ ocdbt.process_0/d/5975d12def211def6250e4f9f89ab885 filter=lfs diff=lfs merge=lfs -text
64
+ ocdbt.process_0/d/34f894e1b8892e0577cf4c5b82f20905 filter=lfs diff=lfs merge=lfs -text
65
+ ocdbt.process_0/d/1a6697e22ea3ca044efd27419376d904 filter=lfs diff=lfs merge=lfs -text
66
+ ocdbt.process_0/d/034c402fa36ff3367aeb8f592f1de5c7 filter=lfs diff=lfs merge=lfs -text
67
+ ocdbt.process_0/d/7a6d391c0ef722b695da99a4b0f25b6e filter=lfs diff=lfs merge=lfs -text
68
+ ocdbt.process_0/d/d5a8f204604624f91d44b0dd73ca233e filter=lfs diff=lfs merge=lfs -text
69
+ ocdbt.process_0/d/92c318839411dc55154bdba30a8e7d99 filter=lfs diff=lfs merge=lfs -text
70
+ ocdbt.process_0/d/079caa88c9159e355493f28201d93f06 filter=lfs diff=lfs merge=lfs -text
71
+ ocdbt.process_0/d/9692bb3bf9a63cd15bf43b48ec50d91f filter=lfs diff=lfs merge=lfs -text
72
+ ocdbt.process_0/d/f64c7bf9862b9c12588a6660945fa579 filter=lfs diff=lfs merge=lfs -text
73
+ ocdbt.process_0/d/601d073cf592d17066b07e0cf29d1a73 filter=lfs diff=lfs merge=lfs -text
74
+ ocdbt.process_0/d/14dfebdff55320dcbed40203f68133f9 filter=lfs diff=lfs merge=lfs -text
75
+ ocdbt.process_0/d/c16e7ad7f68d798cd805fc71f1f4c82d filter=lfs diff=lfs merge=lfs -text
76
+ ocdbt.process_0/d/6ab84140dd76a5ef5ddd7a336c74974e filter=lfs diff=lfs merge=lfs -text
77
+ IT_27B_Q4_0_final_q4_0.gguf filter=lfs diff=lfs merge=lfs -text
78
+ mmproj-model-f16.gguf filter=lfs diff=lfs merge=lfs -text
79
+ mmproj-model-f16-27B.gguf filter=lfs diff=lfs merge=lfs -text
80
+ gemma-3-27b-it-q4_0.gguf filter=lfs diff=lfs merge=lfs -text
mmproj-model-f16-27B.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:54cb61c842fe49ac3c89bc1a614a2778163eb49f3dec2b90ff688b4c0392cb48
3
+ size 857739168