Multi-Source Experimentals
Collection
Domain Specific Classification Models : SigLIP2
•
10 items
•
Updated
•
1
WikiArt-Style
WikiArt-Style is a vision model fine-tuned from google/siglip2-base-patch16-224 using the SiglipForImageClassification architecture. It classifies art images into one of 137 painting style categories.
Classification Report:
precision recall f1-score support
Abstract Art 0.2784 0.3228 0.2990 979
Abstract Expressionism 0.3615 0.5757 0.4441 2074
Academicism 0.4410 0.0730 0.1253 972
Action painting 0.0000 0.0000 0.0000 98
American Realism 0.9592 0.1697 0.2883 277
Analytical Cubism 0.2000 0.0115 0.0217 87
Analytical Realism 0.6667 0.0225 0.0435 89
Art Brut 0.0000 0.0000 0.0000 198
Art Deco 0.6178 0.6801 0.6475 644
Art Informel 0.3295 0.2486 0.2834 1267
Art Nouveau (Modern) 0.5183 0.6289 0.5682 4899
Automatic Painting 0.0000 0.0000 0.0000 37
Baroque 0.5312 0.6495 0.5845 4400
Biedermeier 0.0000 0.0000 0.0000 132
Byzantine 0.0000 0.0000 0.0000 77
Cartographic Art 0.0000 0.0000 0.0000 10
Classicism 0.0000 0.0000 0.0000 223
Cloisonnism 0.0000 0.0000 0.0000 172
Color Field Painting 0.6947 0.5352 0.6046 910
Conceptual Art 0.6667 0.0161 0.0315 124
Concretism 0.3973 0.4596 0.4262 581
Constructivism 0.3462 0.3022 0.3227 268
Contemporary Realism 1.0000 0.0518 0.0985 309
Costumbrismo 0.0000 0.0000 0.0000 19
Cubism 0.3426 0.6926 0.4584 1747
Cubo-Expressionism 0.0000 0.0000 0.0000 22
Cubo-Futurism 0.0000 0.0000 0.0000 137
Dada 0.5000 0.0098 0.0191 205
Divisionism 0.6810 0.2337 0.3480 338
Early Renaissance 0.5411 0.6329 0.5834 1351
Environmental (Land) Art 0.0000 0.0000 0.0000 1
Existential Art 0.0000 0.0000 0.0000 17
Expressionism 0.4540 0.5701 0.5055 7013
Fantastic Realism 0.0000 0.0000 0.0000 31
Fauvism 0.4480 0.1710 0.2475 731
Feminist Art 0.0000 0.0000 0.0000 18
Figurative Expressionism 0.0000 0.0000 0.0000 19
Futurism 0.4717 0.0859 0.1453 291
Gongbi 0.0000 0.0000 0.0000 38
Gothic 0.0000 0.0000 0.0000 12
Hard Edge Painting 0.4458 0.3978 0.4205 372
High Renaissance 0.5016 0.3653 0.4227 1314
Hyper-Realism 0.0000 0.0000 0.0000 49
Ilkhanid 0.0000 0.0000 0.0000 2
Impressionism 0.6057 0.7266 0.6607 10643
Indian Space painting 0.0000 0.0000 0.0000 25
Ink and wash painting 0.7739 0.4459 0.5658 545
International Gothic 0.8099 0.5349 0.6443 215
Intimism 0.0000 0.0000 0.0000 109
Japonism 0.0000 0.0000 0.0000 118
Joseon Dynasty 0.0000 0.0000 0.0000 10
Kinetic Art 0.0000 0.0000 0.0000 3
Kitsch 0.0000 0.0000 0.0000 47
Lettrism 0.0000 0.0000 0.0000 33
Light and Space 0.0000 0.0000 0.0000 11
Luminism 0.8333 0.0519 0.0978 385
Lyrical Abstraction 0.4631 0.2060 0.2851 670
Magic Realism 0.5883 0.5020 0.5417 1002
Mail Art 0.0000 0.0000 0.0000 10
Mannerism (Late Renaissance) 0.4875 0.3934 0.4355 1342
Mechanistic Cubism 0.0000 0.0000 0.0000 69
Metaphysical art 0.5385 0.0729 0.1284 192
Minimalism 0.5352 0.5957 0.5638 460
Miserablism 0.0000 0.0000 0.0000 8
Modernismo 0.0000 0.0000 0.0000 43
Mosan art 0.0000 0.0000 0.0000 39
Muralism 0.3636 0.0268 0.0500 149
Nanga (Bunjinga) 0.0000 0.0000 0.0000 58
Nas-Taliq 0.0000 0.0000 0.0000 9
Native Art 0.0000 0.0000 0.0000 21
Naturalism 0.8459 0.6437 0.7311 435
Naïve Art (Primitivism) 0.4897 0.5412 0.5142 2295
Neo-Byzantine 0.0000 0.0000 0.0000 18
Neo-Concretism 0.0000 0.0000 0.0000 44
Neo-Dada 0.0000 0.0000 0.0000 131
Neo-Expressionism 0.6763 0.2238 0.3363 420
Neo-Figurative Art 0.0000 0.0000 0.0000 27
Neo-Rococo 0.0000 0.0000 0.0000 97
Neo-Romanticism 0.6762 0.1254 0.2116 566
Neo-baroque 0.0000 0.0000 0.0000 105
Neoclassicism 0.5868 0.3317 0.4238 2038
Neoplasticism 0.8889 0.2775 0.4229 173
New Casualism 0.0000 0.0000 0.0000 22
New European Painting 0.0000 0.0000 0.0000 25
New Realism 0.0000 0.0000 0.0000 329
Nihonga 0.0000 0.0000 0.0000 29
None 0.3056 0.0112 0.0215 986
Northern Renaissance 0.6198 0.6448 0.6321 2379
Nouveau Réalisme 0.0000 0.0000 0.0000 142
Op Art 0.5120 0.7292 0.6016 528
Orientalism 0.0000 0.0000 0.0000 392
Orphism 0.6471 0.0444 0.0830 248
Ottoman Period 0.8571 0.0833 0.1519 72
Outsider art 0.0000 0.0000 0.0000 68
Perceptism 0.0000 0.0000 0.0000 6
Photorealism 0.0000 0.0000 0.0000 61
Pointillism 0.6450 0.6347 0.6398 501
Pop Art 0.5580 0.4501 0.4983 791
Post-Impressionism 0.4611 0.4200 0.4396 5778
Post-Minimalism 0.0000 0.0000 0.0000 31
Post-Painterly Abstraction 0.6250 0.0296 0.0565 169
Poster Art Realism 0.0000 0.0000 0.0000 43
Precisionism 0.7258 0.3169 0.4412 284
Primitivism 0.0000 0.0000 0.0000 36
Proto Renaissance 0.4342 0.3626 0.3952 273
Purism 0.5000 0.1635 0.2464 159
Rayonism 0.0000 0.0000 0.0000 6
Realism 0.4909 0.6939 0.5750 10523
Regionalism 0.7500 0.1776 0.2872 321
Renaissance 0.0000 0.0000 0.0000 1
Rococo 0.4975 0.5913 0.5404 2733
Romanesque 0.0000 0.0000 0.0000 55
Romanticism 0.5182 0.5380 0.5279 9285
Safavid Period 0.0000 0.0000 0.0000 39
Shin-hanga 0.6894 0.7184 0.7036 380
Social Realism 0.0000 0.0000 0.0000 305
Socialist Realism 0.0000 0.0000 0.0000 95
Spatialism 0.0000 0.0000 0.0000 83
Spectralism 0.0000 0.0000 0.0000 5
Street art 0.0000 0.0000 0.0000 23
Suprematism 0.0000 0.0000 0.0000 80
Surrealism 0.5011 0.6151 0.5523 4167
Symbolism 0.4398 0.3087 0.3627 3476
Synchromism 0.0000 0.0000 0.0000 10
Synthetic Cubism 0.6914 0.2995 0.4179 187
Synthetism 0.0000 0.0000 0.0000 49
Sōsaku hanga 0.5753 0.2900 0.3856 369
Tachisme 0.4366 0.1422 0.2145 436
Tenebrism 0.0000 0.0000 0.0000 221
Timurid Period 0.0000 0.0000 0.0000 17
Tonalism 0.0000 0.0000 0.0000 202
Transautomatism 0.0000 0.0000 0.0000 74
Tubism 0.0000 0.0000 0.0000 21
Ukiyo-e 0.7822 0.8612 0.8198 1426
Verism 0.0000 0.0000 0.0000 84
Yamato-e 0.0000 0.0000 0.0000 12
Zen 0.6702 0.6702 0.6702 94
accuracy 0.5108 103250
macro avg 0.2664 0.1708 0.1811 103250
weighted avg 0.4956 0.5108 0.4822 103250
from datasets import load_dataset
# Load the dataset
dataset = load_dataset("Artificio/WikiArt")
# Extract unique masterCategory values (assuming it's a string field)
labels = sorted(set(example["style"] for example in dataset["train"]))
# Create id2label mapping
id2label = {str(i): label for i, label in enumerate(labels)}
# Print the mapping
print(id2label)
{'0': 'Abstract Art', '1': 'Abstract Expressionism', '2': 'Academicism', '3': 'Action painting', '4': 'American Realism', '5': 'Analytical Cubism', '6': 'Analytical\xa0Realism', '7': 'Art Brut', '8': 'Art Deco', '9': 'Art Informel', '10': 'Art Nouveau (Modern)', '11': 'Automatic Painting', '12': 'Baroque', '13': 'Biedermeier', '14': 'Byzantine', '15': 'Cartographic Art', '16': 'Classicism', '17': 'Cloisonnism', '18': 'Color Field Painting', '19': 'Conceptual Art', '20': 'Concretism', '21': 'Constructivism', '22': 'Contemporary Realism', '23': 'Costumbrismo', '24': 'Cubism', '25': 'Cubo-Expressionism', '26': 'Cubo-Futurism', '27': 'Dada', '28': 'Divisionism', '29': 'Early Renaissance', '30': 'Environmental (Land) Art', '31': 'Existential Art', '32': 'Expressionism', '33': 'Fantastic Realism', '34': 'Fauvism', '35': 'Feminist Art', '36': 'Figurative Expressionism', '37': 'Futurism', '38': 'Gongbi', '39': 'Gothic', '40': 'Hard Edge Painting', '41': 'High Renaissance', '42': 'Hyper-Realism', '43': 'Ilkhanid', '44': 'Impressionism', '45': 'Indian Space painting', '46': 'Ink and wash painting', '47': 'International Gothic', '48': 'Intimism', '49': 'Japonism', '50': 'Joseon Dynasty', '51': 'Kinetic Art', '52': 'Kitsch', '53': 'Lettrism', '54': 'Light and Space', '55': 'Luminism', '56': 'Lyrical Abstraction', '57': 'Magic Realism', '58': 'Mail Art', '59': 'Mannerism (Late Renaissance)', '60': 'Mechanistic Cubism', '61': 'Metaphysical art', '62': 'Minimalism', '63': 'Miserablism', '64': 'Modernismo', '65': 'Mosan art', '66': 'Muralism', '67': 'Nanga (Bunjinga)', '68': 'Nas-Taliq', '69': 'Native Art', '70': 'Naturalism', '71': 'Naïve Art (Primitivism)', '72': 'Neo-Byzantine', '73': 'Neo-Concretism', '74': 'Neo-Dada', '75': 'Neo-Expressionism', '76': 'Neo-Figurative Art', '77': 'Neo-Rococo', '78': 'Neo-Romanticism', '79': 'Neo-baroque', '80': 'Neoclassicism', '81': 'Neoplasticism', '82': 'New Casualism', '83': 'New European Painting', '84': 'New Realism', '85': 'Nihonga', '86': 'None', '87': 'Northern Renaissance', '88': 'Nouveau Réalisme', '89': 'Op Art', '90': 'Orientalism', '91': 'Orphism', '92': 'Ottoman Period', '93': 'Outsider art', '94': 'Perceptism ', '95': 'Photorealism', '96': 'Pointillism', '97': 'Pop Art', '98': 'Post-Impressionism', '99': 'Post-Minimalism', '100': 'Post-Painterly Abstraction', '101': 'Poster Art Realism', '102': 'Precisionism', '103': 'Primitivism', '104': 'Proto Renaissance', '105': 'Purism', '106': 'Rayonism', '107': 'Realism', '108': 'Regionalism', '109': 'Renaissance', '110': 'Rococo', '111': 'Romanesque', '112': 'Romanticism', '113': 'Safavid Period', '114': 'Shin-hanga', '115': 'Social Realism', '116': 'Socialist Realism', '117': 'Spatialism', '118': 'Spectralism', '119': 'Street art', '120': 'Suprematism', '121': 'Surrealism', '122': 'Symbolism', '123': 'Synchromism', '124': 'Synthetic Cubism', '125': 'Synthetism', '126': 'Sōsaku hanga', '127': 'Tachisme', '128': 'Tenebrism', '129': 'Timurid Period', '130': 'Tonalism', '131': 'Transautomatism', '132': 'Tubism', '133': 'Ukiyo-e', '134': 'Verism', '135': 'Yamato-e', '136': 'Zen'}
The model predicts one of the following painting style categories:
0: Abstract Art
1: Abstract Expressionism
2: Academicism
3: Action painting
4: American Realism
5: Analytical Cubism
6: Analytical Realism
7: Art Brut
8: Art Deco
9: Art Informel
10: Art Nouveau (Modern)
11: Automatic Painting
12: Baroque
13: Biedermeier
14: Byzantine
15: Cartographic Art
16: Classicism
17: Cloisonnism
18: Color Field Painting
19: Conceptual Art
20: Concretism
21: Constructivism
22: Contemporary Realism
23: Costumbrismo
24: Cubism
25: Cubo-Expressionism
26: Cubo-Futurism
27: Dada
28: Divisionism
29: Early Renaissance
30: Environmental (Land) Art
31: Existential Art
32: Expressionism
33: Fantastic Realism
34: Fauvism
35: Feminist Art
36: Figurative Expressionism
37: Futurism
38: Gongbi
39: Gothic
40: Hard Edge Painting
41: High Renaissance
42: Hyper-Realism
43: Ilkhanid
44: Impressionism
45: Indian Space painting
46: Ink and wash painting
47: International Gothic
48: Intimism
49: Japonism
50: Joseon Dynasty
51: Kinetic Art
52: Kitsch
53: Lettrism
54: Light and Space
55: Luminism
56: Lyrical Abstraction
57: Magic Realism
58: Mail Art
59: Mannerism (Late Renaissance)
60: Mechanistic Cubism
61: Metaphysical art
62: Minimalism
63: Miserablism
64: Modernismo
65: Mosan art
66: Muralism
67: Nanga (Bunjinga)
68: Nas-Taliq
69: Native Art
70: Naturalism
71: Naïve Art (Primitivism)
72: Neo-Byzantine
73: Neo-Concretism
74: Neo-Dada
75: Neo-Expressionism
76: Neo-Figurative Art
77: Neo-Rococo
78: Neo-Romanticism
79: Neo-baroque
80: Neoclassicism
81: Neoplasticism
82: New Casualism
83: New European Painting
84: New Realism
85: Nihonga
86: None
87: Northern Renaissance
88: Nouveau Réalisme
89: Op Art
90: Orientalism
91: Orphism
92: Ottoman Period
93: Outsider art
94: Perceptism
95: Photorealism
96: Pointillism
97: Pop Art
98: Post-Impressionism
99: Post-Minimalism
100: Post-Painterly Abstraction
101: Poster Art Realism
102: Precisionism
103: Primitivism
104: Proto Renaissance
105: Purism
106: Rayonism
107: Realism
108: Regionalism
109: Renaissance
110: Rococo
111: Romanesque
112: Romanticism
113: Safavid Period
114: Shin-hanga
115: Social Realism
116: Socialist Realism
117: Spatialism
118: Spectralism
119: Street art
120: Suprematism
121: Surrealism
122: Symbolism
123: Synchromism
124: Synthetic Cubism
125: Synthetism
126: Sōsaku hanga
127: Tachisme
128: Tenebrism
129: Timurid Period
130: Tonalism
131: Transautomatism
132: Tubism
133: Ukiyo-e
134: Verism
135: Yamato-e
136: Zen
Run with Transformers 🤗
pip install -q transformers torch pillow gradio
import gradio as gr
from transformers import AutoImageProcessor, SiglipForImageClassification
from PIL import Image
import torch
# Load model and processor
model_name = "prithivMLmods/WikiArt-Style" # Replace with your model path
model = SiglipForImageClassification.from_pretrained(model_name)
processor = AutoImageProcessor.from_pretrained(model_name)
# Label mapping
id2label = {
0: "Abstract Art", 1: "Abstract Expressionism", 2: "Academicism", 3: "Action painting",
4: "American Realism", 5: "Analytical Cubism", 6: "Analytical Realism", 7: "Art Brut",
8: "Art Deco", 9: "Art Informel", 10: "Art Nouveau (Modern)", 11: "Automatic Painting",
12: "Baroque", 13: "Biedermeier", 14: "Byzantine", 15: "Cartographic Art", 16: "Classicism",
17: "Cloisonnism", 18: "Color Field Painting", 19: "Conceptual Art", 20: "Concretism",
21: "Constructivism", 22: "Contemporary Realism", 23: "Costumbrismo", 24: "Cubism",
25: "Cubo-Expressionism", 26: "Cubo-Futurism", 27: "Dada", 28: "Divisionism",
29: "Early Renaissance", 30: "Environmental (Land) Art", 31: "Existential Art",
32: "Expressionism", 33: "Fantastic Realism", 34: "Fauvism", 35: "Feminist Art",
36: "Figurative Expressionism", 37: "Futurism", 38: "Gongbi", 39: "Gothic",
40: "Hard Edge Painting", 41: "High Renaissance", 42: "Hyper-Realism", 43: "Ilkhanid",
44: "Impressionism", 45: "Indian Space painting", 46: "Ink and wash painting",
47: "International Gothic", 48: "Intimism", 49: "Japonism", 50: "Joseon Dynasty",
51: "Kinetic Art", 52: "Kitsch", 53: "Lettrism", 54: "Light and Space", 55: "Luminism",
56: "Lyrical Abstraction", 57: "Magic Realism", 58: "Mail Art", 59: "Mannerism (Late Renaissance)",
60: "Mechanistic Cubism", 61: "Metaphysical art", 62: "Minimalism", 63: "Miserablism",
64: "Modernismo", 65: "Mosan art", 66: "Muralism", 67: "Nanga (Bunjinga)", 68: "Nas-Taliq",
69: "Native Art", 70: "Naturalism", 71: "Naïve Art (Primitivism)", 72: "Neo-Byzantine",
73: "Neo-Concretism", 74: "Neo-Dada", 75: "Neo-Expressionism", 76: "Neo-Figurative Art",
77: "Neo-Rococo", 78: "Neo-Romanticism", 79: "Neo-baroque", 80: "Neoclassicism",
81: "Neoplasticism", 82: "New Casualism", 83: "New European Painting", 84: "New Realism",
85: "Nihonga", 86: "None", 87: "Northern Renaissance", 88: "Nouveau Réalisme", 89: "Op Art",
90: "Orientalism", 91: "Orphism", 92: "Ottoman Period", 93: "Outsider art", 94: "Perceptism ",
95: "Photorealism", 96: "Pointillism", 97: "Pop Art", 98: "Post-Impressionism",
99: "Post-Minimalism", 100: "Post-Painterly Abstraction", 101: "Poster Art Realism",
102: "Precisionism", 103: "Primitivism", 104: "Proto Renaissance", 105: "Purism",
106: "Rayonism", 107: "Realism", 108: "Regionalism", 109: "Renaissance", 110: "Rococo",
111: "Romanesque", 112: "Romanticism", 113: "Safavid Period", 114: "Shin-hanga",
115: "Social Realism", 116: "Socialist Realism", 117: "Spatialism", 118: "Spectralism",
119: "Street art", 120: "Suprematism", 121: "Surrealism", 122: "Symbolism",
123: "Synchromism", 124: "Synthetic Cubism", 125: "Synthetism", 126: "Sōsaku hanga",
127: "Tachisme", 128: "Tenebrism", 129: "Timurid Period", 130: "Tonalism",
131: "Transautomatism", 132: "Tubism", 133: "Ukiyo-e", 134: "Verism", 135: "Yamato-e",
136: "Zen"
}
def classify_style(image):
"""Predicts the artistic style of the input artwork."""
image = Image.fromarray(image).convert("RGB")
inputs = processor(images=image, return_tensors="pt")
with torch.no_grad():
outputs = model(**inputs)
probs = torch.nn.functional.softmax(outputs.logits, dim=1).squeeze().tolist()
return {id2label[i]: round(probs[i], 3) for i in range(len(probs))}
# Gradio interface
iface = gr.Interface(
fn=classify_style,
inputs=gr.Image(type="numpy"),
outputs=gr.Label(label="Style Prediction Scores"),
title="WikiArt-Style",
description="Upload an art image to predict its painting style category (e.g., Impressionism, Cubism, Baroque, etc.)."
)
if __name__ == "__main__":
iface.launch()
Intended Use of WikiArt-Style
1. Style Classification in Machine Learning Models
- Used as labels for training and evaluating models that classify artworks based on their artistic styles.
- Ideal for deep learning applications involving convolutional neural networks (CNNs) or transformer-based vision models.
2. Style Transfer Applications
- Acts as a style reference for neural style transfer algorithms (e.g., applying "Baroque" or "Cubism" to photos).
- Can guide users to select a target style from a curated list.
3. Dataset Annotation
- Used to annotate images in large datasets of paintings with consistent style names.
- Ensures compatibility with datasets like WikiArt, Kaggle’s Painter by Numbers, or custom curation.
4. Educational and Exploratory Interfaces
- Powers interfaces or apps for exploring art history, with filterable and searchable styles.
- Great for building art recommender systems or virtual museums.
5. Generative Art Prompting
- Assists in text-to-image prompting for generative models (e.g., Stable Diffusion, DALL·E) to specify desired styles.
- Example: "Generate a portrait in the style of Neo-Expressionism."
6. Metadata Categorization in Art Databases
- Useful for tagging and organizing artworks by style in digital archives or NFT marketplaces.
- Downloads last month
- 129
Inference Providers
NEW
This model isn't deployed by any Inference Provider.
🙋
Ask for provider support
Model tree for prithivMLmods/WikiArt-Style
Base model
google/siglip2-base-patch16-224