Hugging Face's logo

gabrielilharco
/
test

Model card Files Community
gabrielilharco commited on
Commit
bd60a40
·
1 Parent(s): 78c44bf

Upload track_0_results.jsonl with huggingface_hub

Browse files
Files changed (1) hide show
  1. track_0_results.jsonl +400 -0
track_0_results.jsonl ADDED
@@ -0,0 +1,400 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {"key": "vtab/caltech101", "dataset": "Caltech-101", "metrics": {"acc1": 0.0031224322103533277, "acc5": 0.024322103533278554, "mean_per_class_recall": 0.013409653173832503}}
2
+ {"key": "cifar10", "dataset": "CIFAR-10", "metrics": {"acc1": 0.0967, "acc5": 0.4707, "mean_per_class_recall": 0.0967}}
3
+ {"key": "vtab/cifar100", "dataset": "CIFAR-100", "metrics": {"acc1": 0.0131, "acc5": 0.0561, "mean_per_class_recall": 0.0131}}
4
+ {"key": "vtab/clevr_count_all", "dataset": "CLEVR Counts", "metrics": {"acc1": 0.0976, "acc5": 0.641, "mean_per_class_recall": 0.09815130928989746}}
5
+ {"key": "vtab/caltech101", "dataset": "Caltech-101", "metrics": {"acc1": 0.0031224322103533277, "acc5": 0.024322103533278554, "mean_per_class_recall": 0.013409653173832503}}
6
+ {"key": "cifar10", "dataset": "CIFAR-10", "metrics": {"acc1": 0.0967, "acc5": 0.4707, "mean_per_class_recall": 0.0967}}
7
+ {"key": "vtab/cifar100", "dataset": "CIFAR-100", "metrics": {"acc1": 0.0131, "acc5": 0.0561, "mean_per_class_recall": 0.0131}}
8
+ {"key": "vtab/clevr_count_all", "dataset": "CLEVR Counts", "metrics": {"acc1": 0.0976, "acc5": 0.641, "mean_per_class_recall": 0.09815130928989746}}
9
+ {"key": "vtab/clevr_closest_object_distance", "dataset": "CLEVR Distance", "metrics": {"acc1": 0.2398, "acc5": 0.9186666666666666, "mean_per_class_recall": 0.180646428963025}}
10
+ {"key": "country211", "dataset": "Country211", "metrics": {"acc1": 0.0051184834123222745, "acc5": 0.022606635071090047, "mean_per_class_recall": 0.005118483412322275}}
11
+ {"key": "vtab/dtd", "dataset": "Describable Textures", "metrics": {"acc1": 0.01276595744680851, "acc5": 0.11170212765957446, "mean_per_class_recall": 0.012765957446808512}}
12
+ {"key": "vtab/dmlab", "dataset": "DMlab Frames", "metrics": {"acc1": 0.16155707059599736, "acc5": 0.8585880800527821, "mean_per_class_recall": 0.171404743692575}}
13
+ {"key": "vtab/dsprites_label_orientation", "dataset": "dSprites Orientation", "metrics": {"acc1": 0.025566948784722224, "acc5": 0.12626139322916666, "mean_per_class_recall": 0.025}}
14
+ {"key": "vtab/dsprites_label_x_position", "dataset": "dSprites X Position", "metrics": {"acc1": 0.031087239583333332, "acc5": 0.15489366319444445, "mean_per_class_recall": 0.03125}}
15
+ {"key": "vtab/dsprites_label_y_position", "dataset": "dSprites Y Position", "metrics": {"acc1": 0.033379448784722224, "acc5": 0.1563178168402778, "mean_per_class_recall": 0.03300332636437787}}
16
+ {"key": "vtab/eurosat", "dataset": "EuroSAT", "metrics": {"acc1": 0.1087037037037037, "acc5": 0.5618518518518518, "mean_per_class_recall": 0.11457839022216158}}
17
+ {"key": "fgvc_aircraft", "dataset": "FGVC Aircraft", "metrics": {"acc1": 0.005700570057005701, "acc5": 0.0462046204620462, "mean_per_class_recall": 0.0057219251336898405}}
18
+ {"key": "food101", "dataset": "Food-101", "metrics": {"acc1": 0.009425742574257425, "acc5": 0.053267326732673266, "mean_per_class_recall": 0.009425742574257427}}
19
+ {"key": "gtsrb", "dataset": "GTSRB", "metrics": {"acc1": 0.005067300079176564, "acc5": 0.034045922406967535, "mean_per_class_recall": 0.016537467700258397}}
20
+ {"key": "imagenet1k", "dataset": "ImageNet 1k", "metrics": {"acc1": 0.00092, "acc5": 0.00498, "mean_per_class_recall": 0.00092}}
21
+ {"key": "imagenet_sketch", "dataset": "ImageNet Sketch", "metrics": {"acc1": 0.0012969403996934505, "acc5": 0.004558942011043644, "mean_per_class_recall": 0.0012941176470588236}}
22
+ {"key": "imagenetv2", "dataset": "ImageNet v2", "metrics": {"acc1": 0.0013, "acc5": 0.0049, "mean_per_class_recall": 0.0013}}
23
+ {"key": "imagenet-a", "dataset": "ImageNet-A", "metrics": {"acc1": 0.0041333333333333335, "acc5": 0.025733333333333334, "mean_per_class_recall": 0.0038437592031399137}}
24
+ {"key": "imagenet-o", "dataset": "ImageNet-O", "metrics": {"acc1": 0.0045, "acc5": 0.026, "mean_per_class_recall": 0.004208333333333333}}
25
+ {"key": "imagenet-r", "dataset": "ImageNet-R", "metrics": {"acc1": 0.0051333333333333335, "acc5": 0.025333333333333333, "mean_per_class_recall": 0.0056758194288415486}}
26
+ {"key": "vtab/kitti_closest_vehicle_distance", "dataset": "KITTI Vehicle Distance", "metrics": {"acc1": 0.3066104078762307, "acc5": NaN, "mean_per_class_recall": 0.21102473625251086}}
27
+ {"key": "mnist", "dataset": "MNIST", "metrics": {"acc1": 0.1017, "acc5": 0.4561, "mean_per_class_recall": 0.1007920792079208}}
28
+ {"key": "objectnet", "dataset": "ObjectNet", "metrics": {"acc1": 0.008668030580381177, "acc5": 0.039409927856142994, "mean_per_class_recall": 0.00838518153398381}}
29
+ {"key": "vtab/flowers", "dataset": "Oxford Flowers-102", "metrics": {"acc1": 0.005854610505773296, "acc5": 0.03447715075622052, "mean_per_class_recall": 0.007435673203202382}}
30
+ {"key": "vtab/pets", "dataset": "Oxford-IIIT Pet", "metrics": {"acc1": 0.0291632597437994, "acc5": 0.13109839193240666, "mean_per_class_recall": 0.029410741575690028}}
31
+ {"key": "voc2007", "dataset": "Pascal VOC 2007", "metrics": {"acc1": 0.032518696581196584, "acc5": 0.24005074786324787, "mean_per_class_recall": 0.04480189115615936}}
32
+ {"key": "vtab/pcam", "dataset": "PatchCamelyon", "metrics": {"acc1": 0.4686279296875, "acc5": NaN, "mean_per_class_recall": 0.4684331154570827}}
33
+ {"key": "renderedsst2", "dataset": "Rendered SST2", "metrics": {"acc1": 0.49917627677100496, "acc5": NaN, "mean_per_class_recall": 0.5}}
34
+ {"key": "vtab/resisc45", "dataset": "RESISC45", "metrics": {"acc1": 0.011111111111111112, "acc5": 0.09507936507936508, "mean_per_class_recall": 0.010554943308601954}}
35
+ {"key": "vtab/smallnorb_label_azimuth", "dataset": "Small NORB Azimuth", "metrics": {"acc1": 0.055308641975308645, "acc5": 0.2783539094650206, "mean_per_class_recall": 0.05562991896379334}}
36
+ {"key": "vtab/smallnorb_label_elevation", "dataset": "Small NORB Elevation", "metrics": {"acc1": 0.11209876543209876, "acc5": 0.548724279835391, "mean_per_class_recall": 0.11265998206570475}}
37
+ {"key": "cars", "dataset": "Stanford Cars", "metrics": {"acc1": 0.003979604526800149, "acc5": 0.023007088670563364, "mean_per_class_recall": 0.00457510176897932}}
38
+ {"key": "stl10", "dataset": "STL-10", "metrics": {"acc1": 0.10725, "acc5": 0.514375, "mean_per_class_recall": 0.10725}}
39
+ {"key": "sun397", "dataset": "SUN397", "metrics": {"acc1": 0.0018757930742777278, "acc5": 0.009452525884105412, "mean_per_class_recall": 0.0026033992727889817}}
40
+ {"key": "vtab/svhn", "dataset": "SVHN", "metrics": {"acc1": 0.09250153657037492, "acc5": 0.5820528580208973, "mean_per_class_recall": 0.10032880844117324}}
41
+ {"key": "vtab/caltech101", "dataset": "Caltech-101", "metrics": {"acc1": 0.0031224322103533277, "acc5": 0.024322103533278554, "mean_per_class_recall": 0.013409653173832503}}
42
+ {"key": "cifar10", "dataset": "CIFAR-10", "metrics": {"acc1": 0.0967, "acc5": 0.4707, "mean_per_class_recall": 0.0967}}
43
+ {"key": "vtab/cifar100", "dataset": "CIFAR-100", "metrics": {"acc1": 0.0131, "acc5": 0.0561, "mean_per_class_recall": 0.0131}}
44
+ {"key": "vtab/clevr_count_all", "dataset": "CLEVR Counts", "metrics": {"acc1": 0.0976, "acc5": 0.641, "mean_per_class_recall": 0.09815130928989746}}
45
+ {"key": "vtab/clevr_closest_object_distance", "dataset": "CLEVR Distance", "metrics": {"acc1": 0.2398, "acc5": 0.9186666666666666, "mean_per_class_recall": 0.180646428963025}}
46
+ {"key": "country211", "dataset": "Country211", "metrics": {"acc1": 0.0051184834123222745, "acc5": 0.022606635071090047, "mean_per_class_recall": 0.005118483412322275}}
47
+ {"key": "vtab/dtd", "dataset": "Describable Textures", "metrics": {"acc1": 0.01276595744680851, "acc5": 0.11170212765957446, "mean_per_class_recall": 0.012765957446808512}}
48
+ {"key": "vtab/dmlab", "dataset": "DMlab Frames", "metrics": {"acc1": 0.16155707059599736, "acc5": 0.8585880800527821, "mean_per_class_recall": 0.171404743692575}}
49
+ {"key": "vtab/dsprites_label_orientation", "dataset": "dSprites Orientation", "metrics": {"acc1": 0.025566948784722224, "acc5": 0.12626139322916666, "mean_per_class_recall": 0.025}}
50
+ {"key": "vtab/dsprites_label_x_position", "dataset": "dSprites X Position", "metrics": {"acc1": 0.031087239583333332, "acc5": 0.15489366319444445, "mean_per_class_recall": 0.03125}}
51
+ {"key": "vtab/dsprites_label_y_position", "dataset": "dSprites Y Position", "metrics": {"acc1": 0.033379448784722224, "acc5": 0.1563178168402778, "mean_per_class_recall": 0.03300332636437787}}
52
+ {"key": "vtab/eurosat", "dataset": "EuroSAT", "metrics": {"acc1": 0.1087037037037037, "acc5": 0.5618518518518518, "mean_per_class_recall": 0.11457839022216158}}
53
+ {"key": "fgvc_aircraft", "dataset": "FGVC Aircraft", "metrics": {"acc1": 0.005700570057005701, "acc5": 0.0462046204620462, "mean_per_class_recall": 0.0057219251336898405}}
54
+ {"key": "food101", "dataset": "Food-101", "metrics": {"acc1": 0.009425742574257425, "acc5": 0.053267326732673266, "mean_per_class_recall": 0.009425742574257427}}
55
+ {"key": "gtsrb", "dataset": "GTSRB", "metrics": {"acc1": 0.005067300079176564, "acc5": 0.034045922406967535, "mean_per_class_recall": 0.016537467700258397}}
56
+ {"key": "imagenet1k", "dataset": "ImageNet 1k", "metrics": {"acc1": 0.00092, "acc5": 0.00498, "mean_per_class_recall": 0.00092}}
57
+ {"key": "imagenet_sketch", "dataset": "ImageNet Sketch", "metrics": {"acc1": 0.0012969403996934505, "acc5": 0.004558942011043644, "mean_per_class_recall": 0.0012941176470588236}}
58
+ {"key": "imagenetv2", "dataset": "ImageNet v2", "metrics": {"acc1": 0.0013, "acc5": 0.0049, "mean_per_class_recall": 0.0013}}
59
+ {"key": "imagenet-a", "dataset": "ImageNet-A", "metrics": {"acc1": 0.0041333333333333335, "acc5": 0.025733333333333334, "mean_per_class_recall": 0.0038437592031399137}}
60
+ {"key": "imagenet-o", "dataset": "ImageNet-O", "metrics": {"acc1": 0.0045, "acc5": 0.026, "mean_per_class_recall": 0.004208333333333333}}
61
+ {"key": "imagenet-r", "dataset": "ImageNet-R", "metrics": {"acc1": 0.0051333333333333335, "acc5": 0.025333333333333333, "mean_per_class_recall": 0.0056758194288415486}}
62
+ {"key": "vtab/kitti_closest_vehicle_distance", "dataset": "KITTI Vehicle Distance", "metrics": {"acc1": 0.3066104078762307, "acc5": NaN, "mean_per_class_recall": 0.21102473625251086}}
63
+ {"key": "mnist", "dataset": "MNIST", "metrics": {"acc1": 0.1017, "acc5": 0.4561, "mean_per_class_recall": 0.1007920792079208}}
64
+ {"key": "objectnet", "dataset": "ObjectNet", "metrics": {"acc1": 0.008668030580381177, "acc5": 0.039409927856142994, "mean_per_class_recall": 0.00838518153398381}}
65
+ {"key": "vtab/flowers", "dataset": "Oxford Flowers-102", "metrics": {"acc1": 0.005854610505773296, "acc5": 0.03447715075622052, "mean_per_class_recall": 0.007435673203202382}}
66
+ {"key": "vtab/pets", "dataset": "Oxford-IIIT Pet", "metrics": {"acc1": 0.0291632597437994, "acc5": 0.13109839193240666, "mean_per_class_recall": 0.029410741575690028}}
67
+ {"key": "voc2007", "dataset": "Pascal VOC 2007", "metrics": {"acc1": 0.032518696581196584, "acc5": 0.24005074786324787, "mean_per_class_recall": 0.04480189115615936}}
68
+ {"key": "vtab/pcam", "dataset": "PatchCamelyon", "metrics": {"acc1": 0.4686279296875, "acc5": NaN, "mean_per_class_recall": 0.4684331154570827}}
69
+ {"key": "renderedsst2", "dataset": "Rendered SST2", "metrics": {"acc1": 0.49917627677100496, "acc5": NaN, "mean_per_class_recall": 0.5}}
70
+ {"key": "vtab/resisc45", "dataset": "RESISC45", "metrics": {"acc1": 0.011111111111111112, "acc5": 0.09507936507936508, "mean_per_class_recall": 0.010554943308601954}}
71
+ {"key": "vtab/smallnorb_label_azimuth", "dataset": "Small NORB Azimuth", "metrics": {"acc1": 0.055308641975308645, "acc5": 0.2783539094650206, "mean_per_class_recall": 0.05562991896379334}}
72
+ {"key": "vtab/smallnorb_label_elevation", "dataset": "Small NORB Elevation", "metrics": {"acc1": 0.11209876543209876, "acc5": 0.548724279835391, "mean_per_class_recall": 0.11265998206570475}}
73
+ {"key": "cars", "dataset": "Stanford Cars", "metrics": {"acc1": 0.003979604526800149, "acc5": 0.023007088670563364, "mean_per_class_recall": 0.00457510176897932}}
74
+ {"key": "stl10", "dataset": "STL-10", "metrics": {"acc1": 0.10725, "acc5": 0.514375, "mean_per_class_recall": 0.10725}}
75
+ {"key": "sun397", "dataset": "SUN397", "metrics": {"acc1": 0.0018757930742777278, "acc5": 0.009452525884105412, "mean_per_class_recall": 0.0026033992727889817}}
76
+ {"key": "vtab/svhn", "dataset": "SVHN", "metrics": {"acc1": 0.09250153657037492, "acc5": 0.5820528580208973, "mean_per_class_recall": 0.10032880844117324}}
77
+ {"key": "vtab/caltech101", "dataset": "Caltech-101", "metrics": {"acc1": 0.0031224322103533277, "acc5": 0.024322103533278554, "mean_per_class_recall": 0.013409653173832503}}
78
+ {"key": "cifar10", "dataset": "CIFAR-10", "metrics": {"acc1": 0.0967, "acc5": 0.4707, "mean_per_class_recall": 0.0967}}
79
+ {"key": "vtab/cifar100", "dataset": "CIFAR-100", "metrics": {"acc1": 0.0131, "acc5": 0.0561, "mean_per_class_recall": 0.0131}}
80
+ {"key": "vtab/clevr_count_all", "dataset": "CLEVR Counts", "metrics": {"acc1": 0.0976, "acc5": 0.641, "mean_per_class_recall": 0.09815130928989746}}
81
+ {"key": "vtab/clevr_closest_object_distance", "dataset": "CLEVR Distance", "metrics": {"acc1": 0.2398, "acc5": 0.9186666666666666, "mean_per_class_recall": 0.180646428963025}}
82
+ {"key": "country211", "dataset": "Country211", "metrics": {"acc1": 0.0051184834123222745, "acc5": 0.022606635071090047, "mean_per_class_recall": 0.005118483412322275}}
83
+ {"key": "vtab/dtd", "dataset": "Describable Textures", "metrics": {"acc1": 0.01276595744680851, "acc5": 0.11170212765957446, "mean_per_class_recall": 0.012765957446808512}}
84
+ {"key": "vtab/dmlab", "dataset": "DMlab Frames", "metrics": {"acc1": 0.16155707059599736, "acc5": 0.8585880800527821, "mean_per_class_recall": 0.171404743692575}}
85
+ {"key": "vtab/dsprites_label_orientation", "dataset": "dSprites Orientation", "metrics": {"acc1": 0.025566948784722224, "acc5": 0.12626139322916666, "mean_per_class_recall": 0.025}}
86
+ {"key": "vtab/dsprites_label_x_position", "dataset": "dSprites X Position", "metrics": {"acc1": 0.031087239583333332, "acc5": 0.15489366319444445, "mean_per_class_recall": 0.03125}}
87
+ {"key": "vtab/dsprites_label_y_position", "dataset": "dSprites Y Position", "metrics": {"acc1": 0.033379448784722224, "acc5": 0.1563178168402778, "mean_per_class_recall": 0.03300332636437787}}
88
+ {"key": "vtab/eurosat", "dataset": "EuroSAT", "metrics": {"acc1": 0.1087037037037037, "acc5": 0.5618518518518518, "mean_per_class_recall": 0.11457839022216158}}
89
+ {"key": "fgvc_aircraft", "dataset": "FGVC Aircraft", "metrics": {"acc1": 0.005700570057005701, "acc5": 0.0462046204620462, "mean_per_class_recall": 0.0057219251336898405}}
90
+ {"key": "food101", "dataset": "Food-101", "metrics": {"acc1": 0.009425742574257425, "acc5": 0.053267326732673266, "mean_per_class_recall": 0.009425742574257427}}
91
+ {"key": "gtsrb", "dataset": "GTSRB", "metrics": {"acc1": 0.005067300079176564, "acc5": 0.034045922406967535, "mean_per_class_recall": 0.016537467700258397}}
92
+ {"key": "imagenet1k", "dataset": "ImageNet 1k", "metrics": {"acc1": 0.00092, "acc5": 0.00498, "mean_per_class_recall": 0.00092}}
93
+ {"key": "imagenet_sketch", "dataset": "ImageNet Sketch", "metrics": {"acc1": 0.0012969403996934505, "acc5": 0.004558942011043644, "mean_per_class_recall": 0.0012941176470588236}}
94
+ {"key": "imagenetv2", "dataset": "ImageNet v2", "metrics": {"acc1": 0.0013, "acc5": 0.0049, "mean_per_class_recall": 0.0013}}
95
+ {"key": "imagenet-a", "dataset": "ImageNet-A", "metrics": {"acc1": 0.0041333333333333335, "acc5": 0.025733333333333334, "mean_per_class_recall": 0.0038437592031399137}}
96
+ {"key": "imagenet-o", "dataset": "ImageNet-O", "metrics": {"acc1": 0.0045, "acc5": 0.026, "mean_per_class_recall": 0.004208333333333333}}
97
+ {"key": "imagenet-r", "dataset": "ImageNet-R", "metrics": {"acc1": 0.0051333333333333335, "acc5": 0.025333333333333333, "mean_per_class_recall": 0.0056758194288415486}}
98
+ {"key": "vtab/kitti_closest_vehicle_distance", "dataset": "KITTI Vehicle Distance", "metrics": {"acc1": 0.3066104078762307, "acc5": NaN, "mean_per_class_recall": 0.21102473625251086}}
99
+ {"key": "mnist", "dataset": "MNIST", "metrics": {"acc1": 0.1017, "acc5": 0.4561, "mean_per_class_recall": 0.1007920792079208}}
100
+ {"key": "objectnet", "dataset": "ObjectNet", "metrics": {"acc1": 0.008668030580381177, "acc5": 0.039409927856142994, "mean_per_class_recall": 0.00838518153398381}}
101
+ {"key": "vtab/flowers", "dataset": "Oxford Flowers-102", "metrics": {"acc1": 0.005854610505773296, "acc5": 0.03447715075622052, "mean_per_class_recall": 0.007435673203202382}}
102
+ {"key": "vtab/pets", "dataset": "Oxford-IIIT Pet", "metrics": {"acc1": 0.0291632597437994, "acc5": 0.13109839193240666, "mean_per_class_recall": 0.029410741575690028}}
103
+ {"key": "voc2007", "dataset": "Pascal VOC 2007", "metrics": {"acc1": 0.032518696581196584, "acc5": 0.24005074786324787, "mean_per_class_recall": 0.04480189115615936}}
104
+ {"key": "vtab/pcam", "dataset": "PatchCamelyon", "metrics": {"acc1": 0.4686279296875, "acc5": NaN, "mean_per_class_recall": 0.4684331154570827}}
105
+ {"key": "renderedsst2", "dataset": "Rendered SST2", "metrics": {"acc1": 0.49917627677100496, "acc5": NaN, "mean_per_class_recall": 0.5}}
106
+ {"key": "vtab/resisc45", "dataset": "RESISC45", "metrics": {"acc1": 0.011111111111111112, "acc5": 0.09507936507936508, "mean_per_class_recall": 0.010554943308601954}}
107
+ {"key": "vtab/smallnorb_label_azimuth", "dataset": "Small NORB Azimuth", "metrics": {"acc1": 0.055308641975308645, "acc5": 0.2783539094650206, "mean_per_class_recall": 0.05562991896379334}}
108
+ {"key": "vtab/smallnorb_label_elevation", "dataset": "Small NORB Elevation", "metrics": {"acc1": 0.11209876543209876, "acc5": 0.548724279835391, "mean_per_class_recall": 0.11265998206570475}}
109
+ {"key": "cars", "dataset": "Stanford Cars", "metrics": {"acc1": 0.003979604526800149, "acc5": 0.023007088670563364, "mean_per_class_recall": 0.00457510176897932}}
110
+ {"key": "stl10", "dataset": "STL-10", "metrics": {"acc1": 0.10725, "acc5": 0.514375, "mean_per_class_recall": 0.10725}}
111
+ {"key": "sun397", "dataset": "SUN397", "metrics": {"acc1": 0.0018757930742777278, "acc5": 0.009452525884105412, "mean_per_class_recall": 0.0026033992727889817}}
112
+ {"key": "vtab/svhn", "dataset": "SVHN", "metrics": {"acc1": 0.09250153657037492, "acc5": 0.5820528580208973, "mean_per_class_recall": 0.10032880844117324}}
113
+ {"key": "vtab/caltech101", "dataset": "Caltech-101", "metrics": {"acc1": 0.0031224322103533277, "acc5": 0.024322103533278554, "mean_per_class_recall": 0.013409653173832503}}
114
+ {"key": "cifar10", "dataset": "CIFAR-10", "metrics": {"acc1": 0.0967, "acc5": 0.4707, "mean_per_class_recall": 0.0967}}
115
+ {"key": "vtab/cifar100", "dataset": "CIFAR-100", "metrics": {"acc1": 0.0131, "acc5": 0.0561, "mean_per_class_recall": 0.0131}}
116
+ {"key": "vtab/clevr_count_all", "dataset": "CLEVR Counts", "metrics": {"acc1": 0.0976, "acc5": 0.641, "mean_per_class_recall": 0.09815130928989746}}
117
+ {"key": "vtab/clevr_closest_object_distance", "dataset": "CLEVR Distance", "metrics": {"acc1": 0.2398, "acc5": 0.9186666666666666, "mean_per_class_recall": 0.180646428963025}}
118
+ {"key": "country211", "dataset": "Country211", "metrics": {"acc1": 0.0051184834123222745, "acc5": 0.022606635071090047, "mean_per_class_recall": 0.005118483412322275}}
119
+ {"key": "vtab/dtd", "dataset": "Describable Textures", "metrics": {"acc1": 0.01276595744680851, "acc5": 0.11170212765957446, "mean_per_class_recall": 0.012765957446808512}}
120
+ {"key": "vtab/dmlab", "dataset": "DMlab Frames", "metrics": {"acc1": 0.16155707059599736, "acc5": 0.8585880800527821, "mean_per_class_recall": 0.171404743692575}}
121
+ {"key": "vtab/dsprites_label_orientation", "dataset": "dSprites Orientation", "metrics": {"acc1": 0.025566948784722224, "acc5": 0.12626139322916666, "mean_per_class_recall": 0.025}}
122
+ {"key": "vtab/dsprites_label_x_position", "dataset": "dSprites X Position", "metrics": {"acc1": 0.031087239583333332, "acc5": 0.15489366319444445, "mean_per_class_recall": 0.03125}}
123
+ {"key": "vtab/dsprites_label_y_position", "dataset": "dSprites Y Position", "metrics": {"acc1": 0.033379448784722224, "acc5": 0.1563178168402778, "mean_per_class_recall": 0.03300332636437787}}
124
+ {"key": "vtab/eurosat", "dataset": "EuroSAT", "metrics": {"acc1": 0.1087037037037037, "acc5": 0.5618518518518518, "mean_per_class_recall": 0.11457839022216158}}
125
+ {"key": "fgvc_aircraft", "dataset": "FGVC Aircraft", "metrics": {"acc1": 0.005700570057005701, "acc5": 0.0462046204620462, "mean_per_class_recall": 0.0057219251336898405}}
126
+ {"key": "food101", "dataset": "Food-101", "metrics": {"acc1": 0.009425742574257425, "acc5": 0.053267326732673266, "mean_per_class_recall": 0.009425742574257427}}
127
+ {"key": "gtsrb", "dataset": "GTSRB", "metrics": {"acc1": 0.005067300079176564, "acc5": 0.034045922406967535, "mean_per_class_recall": 0.016537467700258397}}
128
+ {"key": "imagenet1k", "dataset": "ImageNet 1k", "metrics": {"acc1": 0.00092, "acc5": 0.00498, "mean_per_class_recall": 0.00092}}
129
+ {"key": "imagenet_sketch", "dataset": "ImageNet Sketch", "metrics": {"acc1": 0.0012969403996934505, "acc5": 0.004558942011043644, "mean_per_class_recall": 0.0012941176470588236}}
130
+ {"key": "imagenetv2", "dataset": "ImageNet v2", "metrics": {"acc1": 0.0013, "acc5": 0.0049, "mean_per_class_recall": 0.0013}}
131
+ {"key": "imagenet-a", "dataset": "ImageNet-A", "metrics": {"acc1": 0.0041333333333333335, "acc5": 0.025733333333333334, "mean_per_class_recall": 0.0038437592031399137}}
132
+ {"key": "imagenet-o", "dataset": "ImageNet-O", "metrics": {"acc1": 0.0045, "acc5": 0.026, "mean_per_class_recall": 0.004208333333333333}}
133
+ {"key": "imagenet-r", "dataset": "ImageNet-R", "metrics": {"acc1": 0.0051333333333333335, "acc5": 0.025333333333333333, "mean_per_class_recall": 0.0056758194288415486}}
134
+ {"key": "vtab/kitti_closest_vehicle_distance", "dataset": "KITTI Vehicle Distance", "metrics": {"acc1": 0.3066104078762307, "acc5": NaN, "mean_per_class_recall": 0.21102473625251086}}
135
+ {"key": "mnist", "dataset": "MNIST", "metrics": {"acc1": 0.1017, "acc5": 0.4561, "mean_per_class_recall": 0.1007920792079208}}
136
+ {"key": "objectnet", "dataset": "ObjectNet", "metrics": {"acc1": 0.008668030580381177, "acc5": 0.039409927856142994, "mean_per_class_recall": 0.00838518153398381}}
137
+ {"key": "vtab/flowers", "dataset": "Oxford Flowers-102", "metrics": {"acc1": 0.005854610505773296, "acc5": 0.03447715075622052, "mean_per_class_recall": 0.007435673203202382}}
138
+ {"key": "vtab/pets", "dataset": "Oxford-IIIT Pet", "metrics": {"acc1": 0.0291632597437994, "acc5": 0.13109839193240666, "mean_per_class_recall": 0.029410741575690028}}
139
+ {"key": "voc2007", "dataset": "Pascal VOC 2007", "metrics": {"acc1": 0.032518696581196584, "acc5": 0.24005074786324787, "mean_per_class_recall": 0.04480189115615936}}
140
+ {"key": "vtab/pcam", "dataset": "PatchCamelyon", "metrics": {"acc1": 0.4686279296875, "acc5": NaN, "mean_per_class_recall": 0.4684331154570827}}
141
+ {"key": "renderedsst2", "dataset": "Rendered SST2", "metrics": {"acc1": 0.49917627677100496, "acc5": NaN, "mean_per_class_recall": 0.5}}
142
+ {"key": "vtab/resisc45", "dataset": "RESISC45", "metrics": {"acc1": 0.011111111111111112, "acc5": 0.09507936507936508, "mean_per_class_recall": 0.010554943308601954}}
143
+ {"key": "vtab/smallnorb_label_azimuth", "dataset": "Small NORB Azimuth", "metrics": {"acc1": 0.055308641975308645, "acc5": 0.2783539094650206, "mean_per_class_recall": 0.05562991896379334}}
144
+ {"key": "vtab/smallnorb_label_elevation", "dataset": "Small NORB Elevation", "metrics": {"acc1": 0.11209876543209876, "acc5": 0.548724279835391, "mean_per_class_recall": 0.11265998206570475}}
145
+ {"key": "cars", "dataset": "Stanford Cars", "metrics": {"acc1": 0.003979604526800149, "acc5": 0.023007088670563364, "mean_per_class_recall": 0.00457510176897932}}
146
+ {"key": "stl10", "dataset": "STL-10", "metrics": {"acc1": 0.10725, "acc5": 0.514375, "mean_per_class_recall": 0.10725}}
147
+ {"key": "sun397", "dataset": "SUN397", "metrics": {"acc1": 0.0018757930742777278, "acc5": 0.009452525884105412, "mean_per_class_recall": 0.0026033992727889817}}
148
+ {"key": "vtab/svhn", "dataset": "SVHN", "metrics": {"acc1": 0.09250153657037492, "acc5": 0.5820528580208973, "mean_per_class_recall": 0.10032880844117324}}
149
+ {"key": "vtab/caltech101", "dataset": "Caltech-101", "metrics": {"acc1": 0.0031224322103533277, "acc5": 0.024322103533278554, "mean_per_class_recall": 0.013409653173832503}}
150
+ {"key": "cifar10", "dataset": "CIFAR-10", "metrics": {"acc1": 0.0967, "acc5": 0.4707, "mean_per_class_recall": 0.0967}}
151
+ {"key": "vtab/cifar100", "dataset": "CIFAR-100", "metrics": {"acc1": 0.0131, "acc5": 0.0561, "mean_per_class_recall": 0.0131}}
152
+ {"key": "vtab/clevr_count_all", "dataset": "CLEVR Counts", "metrics": {"acc1": 0.0976, "acc5": 0.641, "mean_per_class_recall": 0.09815130928989746}}
153
+ {"key": "vtab/clevr_closest_object_distance", "dataset": "CLEVR Distance", "metrics": {"acc1": 0.2398, "acc5": 0.9186666666666666, "mean_per_class_recall": 0.180646428963025}}
154
+ {"key": "country211", "dataset": "Country211", "metrics": {"acc1": 0.0051184834123222745, "acc5": 0.022606635071090047, "mean_per_class_recall": 0.005118483412322275}}
155
+ {"key": "vtab/dtd", "dataset": "Describable Textures", "metrics": {"acc1": 0.01276595744680851, "acc5": 0.11170212765957446, "mean_per_class_recall": 0.012765957446808512}}
156
+ {"key": "vtab/dmlab", "dataset": "DMlab Frames", "metrics": {"acc1": 0.16155707059599736, "acc5": 0.8585880800527821, "mean_per_class_recall": 0.171404743692575}}
157
+ {"key": "vtab/dsprites_label_orientation", "dataset": "dSprites Orientation", "metrics": {"acc1": 0.025566948784722224, "acc5": 0.12626139322916666, "mean_per_class_recall": 0.025}}
158
+ {"key": "vtab/dsprites_label_x_position", "dataset": "dSprites X Position", "metrics": {"acc1": 0.031087239583333332, "acc5": 0.15489366319444445, "mean_per_class_recall": 0.03125}}
159
+ {"key": "vtab/dsprites_label_y_position", "dataset": "dSprites Y Position", "metrics": {"acc1": 0.033379448784722224, "acc5": 0.1563178168402778, "mean_per_class_recall": 0.03300332636437787}}
160
+ {"key": "vtab/eurosat", "dataset": "EuroSAT", "metrics": {"acc1": 0.1087037037037037, "acc5": 0.5618518518518518, "mean_per_class_recall": 0.11457839022216158}}
161
+ {"key": "fgvc_aircraft", "dataset": "FGVC Aircraft", "metrics": {"acc1": 0.005700570057005701, "acc5": 0.0462046204620462, "mean_per_class_recall": 0.0057219251336898405}}
162
+ {"key": "food101", "dataset": "Food-101", "metrics": {"acc1": 0.009425742574257425, "acc5": 0.053267326732673266, "mean_per_class_recall": 0.009425742574257427}}
163
+ {"key": "gtsrb", "dataset": "GTSRB", "metrics": {"acc1": 0.005067300079176564, "acc5": 0.034045922406967535, "mean_per_class_recall": 0.016537467700258397}}
164
+ {"key": "imagenet1k", "dataset": "ImageNet 1k", "metrics": {"acc1": 0.00092, "acc5": 0.00498, "mean_per_class_recall": 0.00092}}
165
+ {"key": "imagenet_sketch", "dataset": "ImageNet Sketch", "metrics": {"acc1": 0.0012969403996934505, "acc5": 0.004558942011043644, "mean_per_class_recall": 0.0012941176470588236}}
166
+ {"key": "imagenetv2", "dataset": "ImageNet v2", "metrics": {"acc1": 0.0013, "acc5": 0.0049, "mean_per_class_recall": 0.0013}}
167
+ {"key": "imagenet-a", "dataset": "ImageNet-A", "metrics": {"acc1": 0.0041333333333333335, "acc5": 0.025733333333333334, "mean_per_class_recall": 0.0038437592031399137}}
168
+ {"key": "imagenet-o", "dataset": "ImageNet-O", "metrics": {"acc1": 0.0045, "acc5": 0.026, "mean_per_class_recall": 0.004208333333333333}}
169
+ {"key": "imagenet-r", "dataset": "ImageNet-R", "metrics": {"acc1": 0.0051333333333333335, "acc5": 0.025333333333333333, "mean_per_class_recall": 0.0056758194288415486}}
170
+ {"key": "vtab/kitti_closest_vehicle_distance", "dataset": "KITTI Vehicle Distance", "metrics": {"acc1": 0.3066104078762307, "acc5": NaN, "mean_per_class_recall": 0.21102473625251086}}
171
+ {"key": "mnist", "dataset": "MNIST", "metrics": {"acc1": 0.1017, "acc5": 0.4561, "mean_per_class_recall": 0.1007920792079208}}
172
+ {"key": "objectnet", "dataset": "ObjectNet", "metrics": {"acc1": 0.008668030580381177, "acc5": 0.039409927856142994, "mean_per_class_recall": 0.00838518153398381}}
173
+ {"key": "vtab/flowers", "dataset": "Oxford Flowers-102", "metrics": {"acc1": 0.005854610505773296, "acc5": 0.03447715075622052, "mean_per_class_recall": 0.007435673203202382}}
174
+ {"key": "vtab/pets", "dataset": "Oxford-IIIT Pet", "metrics": {"acc1": 0.0291632597437994, "acc5": 0.13109839193240666, "mean_per_class_recall": 0.029410741575690028}}
175
+ {"key": "voc2007", "dataset": "Pascal VOC 2007", "metrics": {"acc1": 0.032518696581196584, "acc5": 0.24005074786324787, "mean_per_class_recall": 0.04480189115615936}}
176
+ {"key": "vtab/pcam", "dataset": "PatchCamelyon", "metrics": {"acc1": 0.4686279296875, "acc5": NaN, "mean_per_class_recall": 0.4684331154570827}}
177
+ {"key": "renderedsst2", "dataset": "Rendered SST2", "metrics": {"acc1": 0.49917627677100496, "acc5": NaN, "mean_per_class_recall": 0.5}}
178
+ {"key": "vtab/resisc45", "dataset": "RESISC45", "metrics": {"acc1": 0.011111111111111112, "acc5": 0.09507936507936508, "mean_per_class_recall": 0.010554943308601954}}
179
+ {"key": "vtab/smallnorb_label_azimuth", "dataset": "Small NORB Azimuth", "metrics": {"acc1": 0.055308641975308645, "acc5": 0.2783539094650206, "mean_per_class_recall": 0.05562991896379334}}
180
+ {"key": "vtab/smallnorb_label_elevation", "dataset": "Small NORB Elevation", "metrics": {"acc1": 0.11209876543209876, "acc5": 0.548724279835391, "mean_per_class_recall": 0.11265998206570475}}
181
+ {"key": "cars", "dataset": "Stanford Cars", "metrics": {"acc1": 0.003979604526800149, "acc5": 0.023007088670563364, "mean_per_class_recall": 0.00457510176897932}}
182
+ {"key": "stl10", "dataset": "STL-10", "metrics": {"acc1": 0.10725, "acc5": 0.514375, "mean_per_class_recall": 0.10725}}
183
+ {"key": "sun397", "dataset": "SUN397", "metrics": {"acc1": 0.0018757930742777278, "acc5": 0.009452525884105412, "mean_per_class_recall": 0.0026033992727889817}}
184
+ {"key": "vtab/svhn", "dataset": "SVHN", "metrics": {"acc1": 0.09250153657037492, "acc5": 0.5820528580208973, "mean_per_class_recall": 0.10032880844117324}}
185
+ {"key": "vtab/caltech101", "dataset": "Caltech-101", "metrics": {"acc1": 0.0031224322103533277, "acc5": 0.024322103533278554, "mean_per_class_recall": 0.013409653173832503}}
186
+ {"key": "cifar10", "dataset": "CIFAR-10", "metrics": {"acc1": 0.0967, "acc5": 0.4707, "mean_per_class_recall": 0.0967}}
187
+ {"key": "vtab/cifar100", "dataset": "CIFAR-100", "metrics": {"acc1": 0.0131, "acc5": 0.0561, "mean_per_class_recall": 0.0131}}
188
+ {"key": "vtab/clevr_count_all", "dataset": "CLEVR Counts", "metrics": {"acc1": 0.0976, "acc5": 0.641, "mean_per_class_recall": 0.09815130928989746}}
189
+ {"key": "vtab/clevr_closest_object_distance", "dataset": "CLEVR Distance", "metrics": {"acc1": 0.2398, "acc5": 0.9186666666666666, "mean_per_class_recall": 0.180646428963025}}
190
+ {"key": "country211", "dataset": "Country211", "metrics": {"acc1": 0.0051184834123222745, "acc5": 0.022606635071090047, "mean_per_class_recall": 0.005118483412322275}}
191
+ {"key": "vtab/dtd", "dataset": "Describable Textures", "metrics": {"acc1": 0.01276595744680851, "acc5": 0.11170212765957446, "mean_per_class_recall": 0.012765957446808512}}
192
+ {"key": "vtab/dmlab", "dataset": "DMlab Frames", "metrics": {"acc1": 0.16155707059599736, "acc5": 0.8585880800527821, "mean_per_class_recall": 0.171404743692575}}
193
+ {"key": "vtab/dsprites_label_orientation", "dataset": "dSprites Orientation", "metrics": {"acc1": 0.025566948784722224, "acc5": 0.12626139322916666, "mean_per_class_recall": 0.025}}
194
+ {"key": "vtab/dsprites_label_x_position", "dataset": "dSprites X Position", "metrics": {"acc1": 0.031087239583333332, "acc5": 0.15489366319444445, "mean_per_class_recall": 0.03125}}
195
+ {"key": "vtab/dsprites_label_y_position", "dataset": "dSprites Y Position", "metrics": {"acc1": 0.033379448784722224, "acc5": 0.1563178168402778, "mean_per_class_recall": 0.03300332636437787}}
196
+ {"key": "vtab/eurosat", "dataset": "EuroSAT", "metrics": {"acc1": 0.1087037037037037, "acc5": 0.5618518518518518, "mean_per_class_recall": 0.11457839022216158}}
197
+ {"key": "fgvc_aircraft", "dataset": "FGVC Aircraft", "metrics": {"acc1": 0.005700570057005701, "acc5": 0.0462046204620462, "mean_per_class_recall": 0.0057219251336898405}}
198
+ {"key": "food101", "dataset": "Food-101", "metrics": {"acc1": 0.009425742574257425, "acc5": 0.053267326732673266, "mean_per_class_recall": 0.009425742574257427}}
199
+ {"key": "gtsrb", "dataset": "GTSRB", "metrics": {"acc1": 0.005067300079176564, "acc5": 0.034045922406967535, "mean_per_class_recall": 0.016537467700258397}}
200
+ {"key": "imagenet1k", "dataset": "ImageNet 1k", "metrics": {"acc1": 0.00092, "acc5": 0.00498, "mean_per_class_recall": 0.00092}}
201
+ {"key": "imagenet_sketch", "dataset": "ImageNet Sketch", "metrics": {"acc1": 0.0012969403996934505, "acc5": 0.004558942011043644, "mean_per_class_recall": 0.0012941176470588236}}
202
+ {"key": "imagenetv2", "dataset": "ImageNet v2", "metrics": {"acc1": 0.0013, "acc5": 0.0049, "mean_per_class_recall": 0.0013}}
203
+ {"key": "imagenet-a", "dataset": "ImageNet-A", "metrics": {"acc1": 0.0041333333333333335, "acc5": 0.025733333333333334, "mean_per_class_recall": 0.0038437592031399137}}
204
+ {"key": "imagenet-o", "dataset": "ImageNet-O", "metrics": {"acc1": 0.0045, "acc5": 0.026, "mean_per_class_recall": 0.004208333333333333}}
205
+ {"key": "imagenet-r", "dataset": "ImageNet-R", "metrics": {"acc1": 0.0051333333333333335, "acc5": 0.025333333333333333, "mean_per_class_recall": 0.0056758194288415486}}
206
+ {"key": "vtab/kitti_closest_vehicle_distance", "dataset": "KITTI Vehicle Distance", "metrics": {"acc1": 0.3066104078762307, "acc5": NaN, "mean_per_class_recall": 0.21102473625251086}}
207
+ {"key": "mnist", "dataset": "MNIST", "metrics": {"acc1": 0.1017, "acc5": 0.4561, "mean_per_class_recall": 0.1007920792079208}}
208
+ {"key": "objectnet", "dataset": "ObjectNet", "metrics": {"acc1": 0.008668030580381177, "acc5": 0.039409927856142994, "mean_per_class_recall": 0.00838518153398381}}
209
+ {"key": "vtab/flowers", "dataset": "Oxford Flowers-102", "metrics": {"acc1": 0.005854610505773296, "acc5": 0.03447715075622052, "mean_per_class_recall": 0.007435673203202382}}
210
+ {"key": "vtab/pets", "dataset": "Oxford-IIIT Pet", "metrics": {"acc1": 0.0291632597437994, "acc5": 0.13109839193240666, "mean_per_class_recall": 0.029410741575690028}}
211
+ {"key": "voc2007", "dataset": "Pascal VOC 2007", "metrics": {"acc1": 0.032518696581196584, "acc5": 0.24005074786324787, "mean_per_class_recall": 0.04480189115615936}}
212
+ {"key": "vtab/pcam", "dataset": "PatchCamelyon", "metrics": {"acc1": 0.4686279296875, "acc5": NaN, "mean_per_class_recall": 0.4684331154570827}}
213
+ {"key": "renderedsst2", "dataset": "Rendered SST2", "metrics": {"acc1": 0.49917627677100496, "acc5": NaN, "mean_per_class_recall": 0.5}}
214
+ {"key": "vtab/resisc45", "dataset": "RESISC45", "metrics": {"acc1": 0.011111111111111112, "acc5": 0.09507936507936508, "mean_per_class_recall": 0.010554943308601954}}
215
+ {"key": "vtab/smallnorb_label_azimuth", "dataset": "Small NORB Azimuth", "metrics": {"acc1": 0.055308641975308645, "acc5": 0.2783539094650206, "mean_per_class_recall": 0.05562991896379334}}
216
+ {"key": "vtab/smallnorb_label_elevation", "dataset": "Small NORB Elevation", "metrics": {"acc1": 0.11209876543209876, "acc5": 0.548724279835391, "mean_per_class_recall": 0.11265998206570475}}
217
+ {"key": "cars", "dataset": "Stanford Cars", "metrics": {"acc1": 0.003979604526800149, "acc5": 0.023007088670563364, "mean_per_class_recall": 0.00457510176897932}}
218
+ {"key": "stl10", "dataset": "STL-10", "metrics": {"acc1": 0.10725, "acc5": 0.514375, "mean_per_class_recall": 0.10725}}
219
+ {"key": "sun397", "dataset": "SUN397", "metrics": {"acc1": 0.0018757930742777278, "acc5": 0.009452525884105412, "mean_per_class_recall": 0.0026033992727889817}}
220
+ {"key": "vtab/svhn", "dataset": "SVHN", "metrics": {"acc1": 0.09250153657037492, "acc5": 0.5820528580208973, "mean_per_class_recall": 0.10032880844117324}}
221
+ {"key": "vtab/caltech101", "dataset": "Caltech-101", "metrics": {"acc1": 0.0031224322103533277, "acc5": 0.024322103533278554, "mean_per_class_recall": 0.013409653173832503}}
222
+ {"key": "cifar10", "dataset": "CIFAR-10", "metrics": {"acc1": 0.0967, "acc5": 0.4707, "mean_per_class_recall": 0.0967}}
223
+ {"key": "vtab/cifar100", "dataset": "CIFAR-100", "metrics": {"acc1": 0.0131, "acc5": 0.0561, "mean_per_class_recall": 0.0131}}
224
+ {"key": "vtab/clevr_count_all", "dataset": "CLEVR Counts", "metrics": {"acc1": 0.0976, "acc5": 0.641, "mean_per_class_recall": 0.09815130928989746}}
225
+ {"key": "vtab/clevr_closest_object_distance", "dataset": "CLEVR Distance", "metrics": {"acc1": 0.2398, "acc5": 0.9186666666666666, "mean_per_class_recall": 0.180646428963025}}
226
+ {"key": "country211", "dataset": "Country211", "metrics": {"acc1": 0.0051184834123222745, "acc5": 0.022606635071090047, "mean_per_class_recall": 0.005118483412322275}}
227
+ {"key": "vtab/dtd", "dataset": "Describable Textures", "metrics": {"acc1": 0.01276595744680851, "acc5": 0.11170212765957446, "mean_per_class_recall": 0.012765957446808512}}
228
+ {"key": "vtab/dmlab", "dataset": "DMlab Frames", "metrics": {"acc1": 0.16155707059599736, "acc5": 0.8585880800527821, "mean_per_class_recall": 0.171404743692575}}
229
+ {"key": "vtab/dsprites_label_orientation", "dataset": "dSprites Orientation", "metrics": {"acc1": 0.025566948784722224, "acc5": 0.12626139322916666, "mean_per_class_recall": 0.025}}
230
+ {"key": "vtab/dsprites_label_x_position", "dataset": "dSprites X Position", "metrics": {"acc1": 0.031087239583333332, "acc5": 0.15489366319444445, "mean_per_class_recall": 0.03125}}
231
+ {"key": "vtab/dsprites_label_y_position", "dataset": "dSprites Y Position", "metrics": {"acc1": 0.033379448784722224, "acc5": 0.1563178168402778, "mean_per_class_recall": 0.03300332636437787}}
232
+ {"key": "vtab/eurosat", "dataset": "EuroSAT", "metrics": {"acc1": 0.1087037037037037, "acc5": 0.5618518518518518, "mean_per_class_recall": 0.11457839022216158}}
233
+ {"key": "fgvc_aircraft", "dataset": "FGVC Aircraft", "metrics": {"acc1": 0.005700570057005701, "acc5": 0.0462046204620462, "mean_per_class_recall": 0.0057219251336898405}}
234
+ {"key": "food101", "dataset": "Food-101", "metrics": {"acc1": 0.009425742574257425, "acc5": 0.053267326732673266, "mean_per_class_recall": 0.009425742574257427}}
235
+ {"key": "gtsrb", "dataset": "GTSRB", "metrics": {"acc1": 0.005067300079176564, "acc5": 0.034045922406967535, "mean_per_class_recall": 0.016537467700258397}}
236
+ {"key": "imagenet1k", "dataset": "ImageNet 1k", "metrics": {"acc1": 0.00092, "acc5": 0.00498, "mean_per_class_recall": 0.00092}}
237
+ {"key": "imagenet_sketch", "dataset": "ImageNet Sketch", "metrics": {"acc1": 0.0012969403996934505, "acc5": 0.004558942011043644, "mean_per_class_recall": 0.0012941176470588236}}
238
+ {"key": "imagenetv2", "dataset": "ImageNet v2", "metrics": {"acc1": 0.0013, "acc5": 0.0049, "mean_per_class_recall": 0.0013}}
239
+ {"key": "imagenet-a", "dataset": "ImageNet-A", "metrics": {"acc1": 0.0041333333333333335, "acc5": 0.025733333333333334, "mean_per_class_recall": 0.0038437592031399137}}
240
+ {"key": "imagenet-o", "dataset": "ImageNet-O", "metrics": {"acc1": 0.0045, "acc5": 0.026, "mean_per_class_recall": 0.004208333333333333}}
241
+ {"key": "imagenet-r", "dataset": "ImageNet-R", "metrics": {"acc1": 0.0051333333333333335, "acc5": 0.025333333333333333, "mean_per_class_recall": 0.0056758194288415486}}
242
+ {"key": "vtab/kitti_closest_vehicle_distance", "dataset": "KITTI Vehicle Distance", "metrics": {"acc1": 0.3066104078762307, "acc5": NaN, "mean_per_class_recall": 0.21102473625251086}}
243
+ {"key": "mnist", "dataset": "MNIST", "metrics": {"acc1": 0.1017, "acc5": 0.4561, "mean_per_class_recall": 0.1007920792079208}}
244
+ {"key": "objectnet", "dataset": "ObjectNet", "metrics": {"acc1": 0.008668030580381177, "acc5": 0.039409927856142994, "mean_per_class_recall": 0.00838518153398381}}
245
+ {"key": "vtab/flowers", "dataset": "Oxford Flowers-102", "metrics": {"acc1": 0.005854610505773296, "acc5": 0.03447715075622052, "mean_per_class_recall": 0.007435673203202382}}
246
+ {"key": "vtab/pets", "dataset": "Oxford-IIIT Pet", "metrics": {"acc1": 0.0291632597437994, "acc5": 0.13109839193240666, "mean_per_class_recall": 0.029410741575690028}}
247
+ {"key": "voc2007", "dataset": "Pascal VOC 2007", "metrics": {"acc1": 0.032518696581196584, "acc5": 0.24005074786324787, "mean_per_class_recall": 0.04480189115615936}}
248
+ {"key": "vtab/pcam", "dataset": "PatchCamelyon", "metrics": {"acc1": 0.4686279296875, "acc5": NaN, "mean_per_class_recall": 0.4684331154570827}}
249
+ {"key": "renderedsst2", "dataset": "Rendered SST2", "metrics": {"acc1": 0.49917627677100496, "acc5": NaN, "mean_per_class_recall": 0.5}}
250
+ {"key": "vtab/resisc45", "dataset": "RESISC45", "metrics": {"acc1": 0.011111111111111112, "acc5": 0.09507936507936508, "mean_per_class_recall": 0.010554943308601954}}
251
+ {"key": "vtab/smallnorb_label_azimuth", "dataset": "Small NORB Azimuth", "metrics": {"acc1": 0.055308641975308645, "acc5": 0.2783539094650206, "mean_per_class_recall": 0.05562991896379334}}
252
+ {"key": "vtab/smallnorb_label_elevation", "dataset": "Small NORB Elevation", "metrics": {"acc1": 0.11209876543209876, "acc5": 0.548724279835391, "mean_per_class_recall": 0.11265998206570475}}
253
+ {"key": "cars", "dataset": "Stanford Cars", "metrics": {"acc1": 0.003979604526800149, "acc5": 0.023007088670563364, "mean_per_class_recall": 0.00457510176897932}}
254
+ {"key": "stl10", "dataset": "STL-10", "metrics": {"acc1": 0.10725, "acc5": 0.514375, "mean_per_class_recall": 0.10725}}
255
+ {"key": "sun397", "dataset": "SUN397", "metrics": {"acc1": 0.0018757930742777278, "acc5": 0.009452525884105412, "mean_per_class_recall": 0.0026033992727889817}}
256
+ {"key": "vtab/svhn", "dataset": "SVHN", "metrics": {"acc1": 0.09250153657037492, "acc5": 0.5820528580208973, "mean_per_class_recall": 0.10032880844117324}}
257
+ {"key": "vtab/caltech101", "dataset": "Caltech-101", "metrics": {"acc1": 0.0031224322103533277, "acc5": 0.024322103533278554, "mean_per_class_recall": 0.013409653173832503}}
258
+ {"key": "cifar10", "dataset": "CIFAR-10", "metrics": {"acc1": 0.0967, "acc5": 0.4707, "mean_per_class_recall": 0.0967}}
259
+ {"key": "vtab/cifar100", "dataset": "CIFAR-100", "metrics": {"acc1": 0.0131, "acc5": 0.0561, "mean_per_class_recall": 0.0131}}
260
+ {"key": "vtab/clevr_count_all", "dataset": "CLEVR Counts", "metrics": {"acc1": 0.0976, "acc5": 0.641, "mean_per_class_recall": 0.09815130928989746}}
261
+ {"key": "vtab/clevr_closest_object_distance", "dataset": "CLEVR Distance", "metrics": {"acc1": 0.2398, "acc5": 0.9186666666666666, "mean_per_class_recall": 0.180646428963025}}
262
+ {"key": "country211", "dataset": "Country211", "metrics": {"acc1": 0.0051184834123222745, "acc5": 0.022606635071090047, "mean_per_class_recall": 0.005118483412322275}}
263
+ {"key": "vtab/dtd", "dataset": "Describable Textures", "metrics": {"acc1": 0.01276595744680851, "acc5": 0.11170212765957446, "mean_per_class_recall": 0.012765957446808512}}
264
+ {"key": "vtab/dmlab", "dataset": "DMlab Frames", "metrics": {"acc1": 0.16155707059599736, "acc5": 0.8585880800527821, "mean_per_class_recall": 0.171404743692575}}
265
+ {"key": "vtab/dsprites_label_orientation", "dataset": "dSprites Orientation", "metrics": {"acc1": 0.025566948784722224, "acc5": 0.12626139322916666, "mean_per_class_recall": 0.025}}
266
+ {"key": "vtab/dsprites_label_x_position", "dataset": "dSprites X Position", "metrics": {"acc1": 0.031087239583333332, "acc5": 0.15489366319444445, "mean_per_class_recall": 0.03125}}
267
+ {"key": "vtab/dsprites_label_y_position", "dataset": "dSprites Y Position", "metrics": {"acc1": 0.033379448784722224, "acc5": 0.1563178168402778, "mean_per_class_recall": 0.03300332636437787}}
268
+ {"key": "vtab/eurosat", "dataset": "EuroSAT", "metrics": {"acc1": 0.1087037037037037, "acc5": 0.5618518518518518, "mean_per_class_recall": 0.11457839022216158}}
269
+ {"key": "fgvc_aircraft", "dataset": "FGVC Aircraft", "metrics": {"acc1": 0.005700570057005701, "acc5": 0.0462046204620462, "mean_per_class_recall": 0.0057219251336898405}}
270
+ {"key": "food101", "dataset": "Food-101", "metrics": {"acc1": 0.009425742574257425, "acc5": 0.053267326732673266, "mean_per_class_recall": 0.009425742574257427}}
271
+ {"key": "gtsrb", "dataset": "GTSRB", "metrics": {"acc1": 0.005067300079176564, "acc5": 0.034045922406967535, "mean_per_class_recall": 0.016537467700258397}}
272
+ {"key": "imagenet1k", "dataset": "ImageNet 1k", "metrics": {"acc1": 0.00092, "acc5": 0.00498, "mean_per_class_recall": 0.00092}}
273
+ {"key": "imagenet_sketch", "dataset": "ImageNet Sketch", "metrics": {"acc1": 0.0012969403996934505, "acc5": 0.004558942011043644, "mean_per_class_recall": 0.0012941176470588236}}
274
+ {"key": "imagenetv2", "dataset": "ImageNet v2", "metrics": {"acc1": 0.0013, "acc5": 0.0049, "mean_per_class_recall": 0.0013}}
275
+ {"key": "imagenet-a", "dataset": "ImageNet-A", "metrics": {"acc1": 0.0041333333333333335, "acc5": 0.025733333333333334, "mean_per_class_recall": 0.0038437592031399137}}
276
+ {"key": "imagenet-o", "dataset": "ImageNet-O", "metrics": {"acc1": 0.0045, "acc5": 0.026, "mean_per_class_recall": 0.004208333333333333}}
277
+ {"key": "imagenet-r", "dataset": "ImageNet-R", "metrics": {"acc1": 0.0051333333333333335, "acc5": 0.025333333333333333, "mean_per_class_recall": 0.0056758194288415486}}
278
+ {"key": "vtab/kitti_closest_vehicle_distance", "dataset": "KITTI Vehicle Distance", "metrics": {"acc1": 0.3066104078762307, "acc5": NaN, "mean_per_class_recall": 0.21102473625251086}}
279
+ {"key": "mnist", "dataset": "MNIST", "metrics": {"acc1": 0.1017, "acc5": 0.4561, "mean_per_class_recall": 0.1007920792079208}}
280
+ {"key": "objectnet", "dataset": "ObjectNet", "metrics": {"acc1": 0.008668030580381177, "acc5": 0.039409927856142994, "mean_per_class_recall": 0.00838518153398381}}
281
+ {"key": "vtab/flowers", "dataset": "Oxford Flowers-102", "metrics": {"acc1": 0.005854610505773296, "acc5": 0.03447715075622052, "mean_per_class_recall": 0.007435673203202382}}
282
+ {"key": "vtab/pets", "dataset": "Oxford-IIIT Pet", "metrics": {"acc1": 0.0291632597437994, "acc5": 0.13109839193240666, "mean_per_class_recall": 0.029410741575690028}}
283
+ {"key": "voc2007", "dataset": "Pascal VOC 2007", "metrics": {"acc1": 0.032518696581196584, "acc5": 0.24005074786324787, "mean_per_class_recall": 0.04480189115615936}}
284
+ {"key": "vtab/pcam", "dataset": "PatchCamelyon", "metrics": {"acc1": 0.4686279296875, "acc5": NaN, "mean_per_class_recall": 0.4684331154570827}}
285
+ {"key": "renderedsst2", "dataset": "Rendered SST2", "metrics": {"acc1": 0.49917627677100496, "acc5": NaN, "mean_per_class_recall": 0.5}}
286
+ {"key": "vtab/resisc45", "dataset": "RESISC45", "metrics": {"acc1": 0.011111111111111112, "acc5": 0.09507936507936508, "mean_per_class_recall": 0.010554943308601954}}
287
+ {"key": "vtab/smallnorb_label_azimuth", "dataset": "Small NORB Azimuth", "metrics": {"acc1": 0.055308641975308645, "acc5": 0.2783539094650206, "mean_per_class_recall": 0.05562991896379334}}
288
+ {"key": "vtab/smallnorb_label_elevation", "dataset": "Small NORB Elevation", "metrics": {"acc1": 0.11209876543209876, "acc5": 0.548724279835391, "mean_per_class_recall": 0.11265998206570475}}
289
+ {"key": "cars", "dataset": "Stanford Cars", "metrics": {"acc1": 0.003979604526800149, "acc5": 0.023007088670563364, "mean_per_class_recall": 0.00457510176897932}}
290
+ {"key": "stl10", "dataset": "STL-10", "metrics": {"acc1": 0.10725, "acc5": 0.514375, "mean_per_class_recall": 0.10725}}
291
+ {"key": "sun397", "dataset": "SUN397", "metrics": {"acc1": 0.0018757930742777278, "acc5": 0.009452525884105412, "mean_per_class_recall": 0.0026033992727889817}}
292
+ {"key": "vtab/svhn", "dataset": "SVHN", "metrics": {"acc1": 0.09250153657037492, "acc5": 0.5820528580208973, "mean_per_class_recall": 0.10032880844117324}}
293
+ {"key": "vtab/caltech101", "dataset": "Caltech-101", "metrics": {"acc1": 0.0031224322103533277, "acc5": 0.024322103533278554, "mean_per_class_recall": 0.013409653173832503}}
294
+ {"key": "cifar10", "dataset": "CIFAR-10", "metrics": {"acc1": 0.0967, "acc5": 0.4707, "mean_per_class_recall": 0.0967}}
295
+ {"key": "vtab/cifar100", "dataset": "CIFAR-100", "metrics": {"acc1": 0.0131, "acc5": 0.0561, "mean_per_class_recall": 0.0131}}
296
+ {"key": "vtab/clevr_count_all", "dataset": "CLEVR Counts", "metrics": {"acc1": 0.0976, "acc5": 0.641, "mean_per_class_recall": 0.09815130928989746}}
297
+ {"key": "vtab/clevr_closest_object_distance", "dataset": "CLEVR Distance", "metrics": {"acc1": 0.2398, "acc5": 0.9186666666666666, "mean_per_class_recall": 0.180646428963025}}
298
+ {"key": "country211", "dataset": "Country211", "metrics": {"acc1": 0.0051184834123222745, "acc5": 0.022606635071090047, "mean_per_class_recall": 0.005118483412322275}}
299
+ {"key": "vtab/dtd", "dataset": "Describable Textures", "metrics": {"acc1": 0.01276595744680851, "acc5": 0.11170212765957446, "mean_per_class_recall": 0.012765957446808512}}
300
+ {"key": "vtab/dmlab", "dataset": "DMlab Frames", "metrics": {"acc1": 0.16155707059599736, "acc5": 0.8585880800527821, "mean_per_class_recall": 0.171404743692575}}
301
+ {"key": "vtab/dsprites_label_orientation", "dataset": "dSprites Orientation", "metrics": {"acc1": 0.025566948784722224, "acc5": 0.12626139322916666, "mean_per_class_recall": 0.025}}
302
+ {"key": "vtab/dsprites_label_x_position", "dataset": "dSprites X Position", "metrics": {"acc1": 0.031087239583333332, "acc5": 0.15489366319444445, "mean_per_class_recall": 0.03125}}
303
+ {"key": "vtab/dsprites_label_y_position", "dataset": "dSprites Y Position", "metrics": {"acc1": 0.033379448784722224, "acc5": 0.1563178168402778, "mean_per_class_recall": 0.03300332636437787}}
304
+ {"key": "vtab/eurosat", "dataset": "EuroSAT", "metrics": {"acc1": 0.1087037037037037, "acc5": 0.5618518518518518, "mean_per_class_recall": 0.11457839022216158}}
305
+ {"key": "fgvc_aircraft", "dataset": "FGVC Aircraft", "metrics": {"acc1": 0.005700570057005701, "acc5": 0.0462046204620462, "mean_per_class_recall": 0.0057219251336898405}}
306
+ {"key": "food101", "dataset": "Food-101", "metrics": {"acc1": 0.009425742574257425, "acc5": 0.053267326732673266, "mean_per_class_recall": 0.009425742574257427}}
307
+ {"key": "gtsrb", "dataset": "GTSRB", "metrics": {"acc1": 0.005067300079176564, "acc5": 0.034045922406967535, "mean_per_class_recall": 0.016537467700258397}}
308
+ {"key": "imagenet1k", "dataset": "ImageNet 1k", "metrics": {"acc1": 0.00092, "acc5": 0.00498, "mean_per_class_recall": 0.00092}}
309
+ {"key": "imagenet_sketch", "dataset": "ImageNet Sketch", "metrics": {"acc1": 0.0012969403996934505, "acc5": 0.004558942011043644, "mean_per_class_recall": 0.0012941176470588236}}
310
+ {"key": "imagenetv2", "dataset": "ImageNet v2", "metrics": {"acc1": 0.0013, "acc5": 0.0049, "mean_per_class_recall": 0.0013}}
311
+ {"key": "imagenet-a", "dataset": "ImageNet-A", "metrics": {"acc1": 0.0041333333333333335, "acc5": 0.025733333333333334, "mean_per_class_recall": 0.0038437592031399137}}
312
+ {"key": "imagenet-o", "dataset": "ImageNet-O", "metrics": {"acc1": 0.0045, "acc5": 0.026, "mean_per_class_recall": 0.004208333333333333}}
313
+ {"key": "imagenet-r", "dataset": "ImageNet-R", "metrics": {"acc1": 0.0051333333333333335, "acc5": 0.025333333333333333, "mean_per_class_recall": 0.0056758194288415486}}
314
+ {"key": "vtab/kitti_closest_vehicle_distance", "dataset": "KITTI Vehicle Distance", "metrics": {"acc1": 0.3066104078762307, "acc5": NaN, "mean_per_class_recall": 0.21102473625251086}}
315
+ {"key": "mnist", "dataset": "MNIST", "metrics": {"acc1": 0.1017, "acc5": 0.4561, "mean_per_class_recall": 0.1007920792079208}}
316
+ {"key": "objectnet", "dataset": "ObjectNet", "metrics": {"acc1": 0.008668030580381177, "acc5": 0.039409927856142994, "mean_per_class_recall": 0.00838518153398381}}
317
+ {"key": "vtab/flowers", "dataset": "Oxford Flowers-102", "metrics": {"acc1": 0.005854610505773296, "acc5": 0.03447715075622052, "mean_per_class_recall": 0.007435673203202382}}
318
+ {"key": "vtab/pets", "dataset": "Oxford-IIIT Pet", "metrics": {"acc1": 0.0291632597437994, "acc5": 0.13109839193240666, "mean_per_class_recall": 0.029410741575690028}}
319
+ {"key": "voc2007", "dataset": "Pascal VOC 2007", "metrics": {"acc1": 0.032518696581196584, "acc5": 0.24005074786324787, "mean_per_class_recall": 0.04480189115615936}}
320
+ {"key": "vtab/pcam", "dataset": "PatchCamelyon", "metrics": {"acc1": 0.4686279296875, "acc5": NaN, "mean_per_class_recall": 0.4684331154570827}}
321
+ {"key": "renderedsst2", "dataset": "Rendered SST2", "metrics": {"acc1": 0.49917627677100496, "acc5": NaN, "mean_per_class_recall": 0.5}}
322
+ {"key": "vtab/resisc45", "dataset": "RESISC45", "metrics": {"acc1": 0.011111111111111112, "acc5": 0.09507936507936508, "mean_per_class_recall": 0.010554943308601954}}
323
+ {"key": "vtab/smallnorb_label_azimuth", "dataset": "Small NORB Azimuth", "metrics": {"acc1": 0.055308641975308645, "acc5": 0.2783539094650206, "mean_per_class_recall": 0.05562991896379334}}
324
+ {"key": "vtab/smallnorb_label_elevation", "dataset": "Small NORB Elevation", "metrics": {"acc1": 0.11209876543209876, "acc5": 0.548724279835391, "mean_per_class_recall": 0.11265998206570475}}
325
+ {"key": "cars", "dataset": "Stanford Cars", "metrics": {"acc1": 0.003979604526800149, "acc5": 0.023007088670563364, "mean_per_class_recall": 0.00457510176897932}}
326
+ {"key": "stl10", "dataset": "STL-10", "metrics": {"acc1": 0.10725, "acc5": 0.514375, "mean_per_class_recall": 0.10725}}
327
+ {"key": "sun397", "dataset": "SUN397", "metrics": {"acc1": 0.0018757930742777278, "acc5": 0.009452525884105412, "mean_per_class_recall": 0.0026033992727889817}}
328
+ {"key": "vtab/svhn", "dataset": "SVHN", "metrics": {"acc1": 0.09250153657037492, "acc5": 0.5820528580208973, "mean_per_class_recall": 0.10032880844117324}}
329
+ {"key": "vtab/caltech101", "dataset": "Caltech-101", "metrics": {"acc1": 0.0031224322103533277, "acc5": 0.024322103533278554, "mean_per_class_recall": 0.013409653173832503}}
330
+ {"key": "cifar10", "dataset": "CIFAR-10", "metrics": {"acc1": 0.0967, "acc5": 0.4707, "mean_per_class_recall": 0.0967}}
331
+ {"key": "vtab/cifar100", "dataset": "CIFAR-100", "metrics": {"acc1": 0.0131, "acc5": 0.0561, "mean_per_class_recall": 0.0131}}
332
+ {"key": "vtab/clevr_count_all", "dataset": "CLEVR Counts", "metrics": {"acc1": 0.0976, "acc5": 0.641, "mean_per_class_recall": 0.09815130928989746}}
333
+ {"key": "vtab/clevr_closest_object_distance", "dataset": "CLEVR Distance", "metrics": {"acc1": 0.2398, "acc5": 0.9186666666666666, "mean_per_class_recall": 0.180646428963025}}
334
+ {"key": "country211", "dataset": "Country211", "metrics": {"acc1": 0.0051184834123222745, "acc5": 0.022606635071090047, "mean_per_class_recall": 0.005118483412322275}}
335
+ {"key": "vtab/dtd", "dataset": "Describable Textures", "metrics": {"acc1": 0.01276595744680851, "acc5": 0.11170212765957446, "mean_per_class_recall": 0.012765957446808512}}
336
+ {"key": "vtab/dmlab", "dataset": "DMlab Frames", "metrics": {"acc1": 0.16155707059599736, "acc5": 0.8585880800527821, "mean_per_class_recall": 0.171404743692575}}
337
+ {"key": "vtab/dsprites_label_orientation", "dataset": "dSprites Orientation", "metrics": {"acc1": 0.025566948784722224, "acc5": 0.12626139322916666, "mean_per_class_recall": 0.025}}
338
+ {"key": "vtab/dsprites_label_x_position", "dataset": "dSprites X Position", "metrics": {"acc1": 0.031087239583333332, "acc5": 0.15489366319444445, "mean_per_class_recall": 0.03125}}
339
+ {"key": "vtab/dsprites_label_y_position", "dataset": "dSprites Y Position", "metrics": {"acc1": 0.033379448784722224, "acc5": 0.1563178168402778, "mean_per_class_recall": 0.03300332636437787}}
340
+ {"key": "vtab/eurosat", "dataset": "EuroSAT", "metrics": {"acc1": 0.1087037037037037, "acc5": 0.5618518518518518, "mean_per_class_recall": 0.11457839022216158}}
341
+ {"key": "fgvc_aircraft", "dataset": "FGVC Aircraft", "metrics": {"acc1": 0.005700570057005701, "acc5": 0.0462046204620462, "mean_per_class_recall": 0.0057219251336898405}}
342
+ {"key": "food101", "dataset": "Food-101", "metrics": {"acc1": 0.009425742574257425, "acc5": 0.053267326732673266, "mean_per_class_recall": 0.009425742574257427}}
343
+ {"key": "gtsrb", "dataset": "GTSRB", "metrics": {"acc1": 0.005067300079176564, "acc5": 0.034045922406967535, "mean_per_class_recall": 0.016537467700258397}}
344
+ {"key": "imagenet1k", "dataset": "ImageNet 1k", "metrics": {"acc1": 0.00092, "acc5": 0.00498, "mean_per_class_recall": 0.00092}}
345
+ {"key": "imagenet_sketch", "dataset": "ImageNet Sketch", "metrics": {"acc1": 0.0012969403996934505, "acc5": 0.004558942011043644, "mean_per_class_recall": 0.0012941176470588236}}
346
+ {"key": "imagenetv2", "dataset": "ImageNet v2", "metrics": {"acc1": 0.0013, "acc5": 0.0049, "mean_per_class_recall": 0.0013}}
347
+ {"key": "imagenet-a", "dataset": "ImageNet-A", "metrics": {"acc1": 0.0041333333333333335, "acc5": 0.025733333333333334, "mean_per_class_recall": 0.0038437592031399137}}
348
+ {"key": "imagenet-o", "dataset": "ImageNet-O", "metrics": {"acc1": 0.0045, "acc5": 0.026, "mean_per_class_recall": 0.004208333333333333}}
349
+ {"key": "imagenet-r", "dataset": "ImageNet-R", "metrics": {"acc1": 0.0051333333333333335, "acc5": 0.025333333333333333, "mean_per_class_recall": 0.0056758194288415486}}
350
+ {"key": "vtab/kitti_closest_vehicle_distance", "dataset": "KITTI Vehicle Distance", "metrics": {"acc1": 0.3066104078762307, "acc5": NaN, "mean_per_class_recall": 0.21102473625251086}}
351
+ {"key": "mnist", "dataset": "MNIST", "metrics": {"acc1": 0.1017, "acc5": 0.4561, "mean_per_class_recall": 0.1007920792079208}}
352
+ {"key": "objectnet", "dataset": "ObjectNet", "metrics": {"acc1": 0.008668030580381177, "acc5": 0.039409927856142994, "mean_per_class_recall": 0.00838518153398381}}
353
+ {"key": "vtab/flowers", "dataset": "Oxford Flowers-102", "metrics": {"acc1": 0.005854610505773296, "acc5": 0.03447715075622052, "mean_per_class_recall": 0.007435673203202382}}
354
+ {"key": "vtab/pets", "dataset": "Oxford-IIIT Pet", "metrics": {"acc1": 0.0291632597437994, "acc5": 0.13109839193240666, "mean_per_class_recall": 0.029410741575690028}}
355
+ {"key": "voc2007", "dataset": "Pascal VOC 2007", "metrics": {"acc1": 0.032518696581196584, "acc5": 0.24005074786324787, "mean_per_class_recall": 0.04480189115615936}}
356
+ {"key": "vtab/pcam", "dataset": "PatchCamelyon", "metrics": {"acc1": 0.4686279296875, "acc5": NaN, "mean_per_class_recall": 0.4684331154570827}}
357
+ {"key": "renderedsst2", "dataset": "Rendered SST2", "metrics": {"acc1": 0.49917627677100496, "acc5": NaN, "mean_per_class_recall": 0.5}}
358
+ {"key": "vtab/resisc45", "dataset": "RESISC45", "metrics": {"acc1": 0.011111111111111112, "acc5": 0.09507936507936508, "mean_per_class_recall": 0.010554943308601954}}
359
+ {"key": "vtab/smallnorb_label_azimuth", "dataset": "Small NORB Azimuth", "metrics": {"acc1": 0.055308641975308645, "acc5": 0.2783539094650206, "mean_per_class_recall": 0.05562991896379334}}
360
+ {"key": "vtab/smallnorb_label_elevation", "dataset": "Small NORB Elevation", "metrics": {"acc1": 0.11209876543209876, "acc5": 0.548724279835391, "mean_per_class_recall": 0.11265998206570475}}
361
+ {"key": "cars", "dataset": "Stanford Cars", "metrics": {"acc1": 0.003979604526800149, "acc5": 0.023007088670563364, "mean_per_class_recall": 0.00457510176897932}}
362
+ {"key": "stl10", "dataset": "STL-10", "metrics": {"acc1": 0.10725, "acc5": 0.514375, "mean_per_class_recall": 0.10725}}
363
+ {"key": "sun397", "dataset": "SUN397", "metrics": {"acc1": 0.0018757930742777278, "acc5": 0.009452525884105412, "mean_per_class_recall": 0.0026033992727889817}}
364
+ {"key": "vtab/svhn", "dataset": "SVHN", "metrics": {"acc1": 0.09250153657037492, "acc5": 0.5820528580208973, "mean_per_class_recall": 0.10032880844117324}}
365
+ {"key": "vtab/caltech101", "dataset": "Caltech-101", "metrics": {"acc1": 0.0031224322103533277, "acc5": 0.024322103533278554, "mean_per_class_recall": 0.013409653173832503}}
366
+ {"key": "cifar10", "dataset": "CIFAR-10", "metrics": {"acc1": 0.0967, "acc5": 0.4707, "mean_per_class_recall": 0.0967}}
367
+ {"key": "vtab/cifar100", "dataset": "CIFAR-100", "metrics": {"acc1": 0.0131, "acc5": 0.0561, "mean_per_class_recall": 0.0131}}
368
+ {"key": "vtab/clevr_count_all", "dataset": "CLEVR Counts", "metrics": {"acc1": 0.0976, "acc5": 0.641, "mean_per_class_recall": 0.09815130928989746}}
369
+ {"key": "vtab/clevr_closest_object_distance", "dataset": "CLEVR Distance", "metrics": {"acc1": 0.2398, "acc5": 0.9186666666666666, "mean_per_class_recall": 0.180646428963025}}
370
+ {"key": "country211", "dataset": "Country211", "metrics": {"acc1": 0.0051184834123222745, "acc5": 0.022606635071090047, "mean_per_class_recall": 0.005118483412322275}}
371
+ {"key": "vtab/dtd", "dataset": "Describable Textures", "metrics": {"acc1": 0.01276595744680851, "acc5": 0.11170212765957446, "mean_per_class_recall": 0.012765957446808512}}
372
+ {"key": "vtab/dmlab", "dataset": "DMlab Frames", "metrics": {"acc1": 0.16155707059599736, "acc5": 0.8585880800527821, "mean_per_class_recall": 0.171404743692575}}
373
+ {"key": "vtab/dsprites_label_orientation", "dataset": "dSprites Orientation", "metrics": {"acc1": 0.025566948784722224, "acc5": 0.12626139322916666, "mean_per_class_recall": 0.025}}
374
+ {"key": "vtab/dsprites_label_x_position", "dataset": "dSprites X Position", "metrics": {"acc1": 0.031087239583333332, "acc5": 0.15489366319444445, "mean_per_class_recall": 0.03125}}
375
+ {"key": "vtab/dsprites_label_y_position", "dataset": "dSprites Y Position", "metrics": {"acc1": 0.033379448784722224, "acc5": 0.1563178168402778, "mean_per_class_recall": 0.03300332636437787}}
376
+ {"key": "vtab/eurosat", "dataset": "EuroSAT", "metrics": {"acc1": 0.1087037037037037, "acc5": 0.5618518518518518, "mean_per_class_recall": 0.11457839022216158}}
377
+ {"key": "fgvc_aircraft", "dataset": "FGVC Aircraft", "metrics": {"acc1": 0.005700570057005701, "acc5": 0.0462046204620462, "mean_per_class_recall": 0.0057219251336898405}}
378
+ {"key": "food101", "dataset": "Food-101", "metrics": {"acc1": 0.009425742574257425, "acc5": 0.053267326732673266, "mean_per_class_recall": 0.009425742574257427}}
379
+ {"key": "gtsrb", "dataset": "GTSRB", "metrics": {"acc1": 0.005067300079176564, "acc5": 0.034045922406967535, "mean_per_class_recall": 0.016537467700258397}}
380
+ {"key": "imagenet1k", "dataset": "ImageNet 1k", "metrics": {"acc1": 0.00092, "acc5": 0.00498, "mean_per_class_recall": 0.00092}}
381
+ {"key": "imagenet_sketch", "dataset": "ImageNet Sketch", "metrics": {"acc1": 0.0012969403996934505, "acc5": 0.004558942011043644, "mean_per_class_recall": 0.0012941176470588236}}
382
+ {"key": "imagenetv2", "dataset": "ImageNet v2", "metrics": {"acc1": 0.0013, "acc5": 0.0049, "mean_per_class_recall": 0.0013}}
383
+ {"key": "imagenet-a", "dataset": "ImageNet-A", "metrics": {"acc1": 0.0041333333333333335, "acc5": 0.025733333333333334, "mean_per_class_recall": 0.0038437592031399137}}
384
+ {"key": "imagenet-o", "dataset": "ImageNet-O", "metrics": {"acc1": 0.0045, "acc5": 0.026, "mean_per_class_recall": 0.004208333333333333}}
385
+ {"key": "imagenet-r", "dataset": "ImageNet-R", "metrics": {"acc1": 0.0051333333333333335, "acc5": 0.025333333333333333, "mean_per_class_recall": 0.0056758194288415486}}
386
+ {"key": "vtab/kitti_closest_vehicle_distance", "dataset": "KITTI Vehicle Distance", "metrics": {"acc1": 0.3066104078762307, "acc5": NaN, "mean_per_class_recall": 0.21102473625251086}}
387
+ {"key": "mnist", "dataset": "MNIST", "metrics": {"acc1": 0.1017, "acc5": 0.4561, "mean_per_class_recall": 0.1007920792079208}}
388
+ {"key": "objectnet", "dataset": "ObjectNet", "metrics": {"acc1": 0.008668030580381177, "acc5": 0.039409927856142994, "mean_per_class_recall": 0.00838518153398381}}
389
+ {"key": "vtab/flowers", "dataset": "Oxford Flowers-102", "metrics": {"acc1": 0.005854610505773296, "acc5": 0.03447715075622052, "mean_per_class_recall": 0.007435673203202382}}
390
+ {"key": "vtab/pets", "dataset": "Oxford-IIIT Pet", "metrics": {"acc1": 0.0291632597437994, "acc5": 0.13109839193240666, "mean_per_class_recall": 0.029410741575690028}}
391
+ {"key": "voc2007", "dataset": "Pascal VOC 2007", "metrics": {"acc1": 0.032518696581196584, "acc5": 0.24005074786324787, "mean_per_class_recall": 0.04480189115615936}}
392
+ {"key": "vtab/pcam", "dataset": "PatchCamelyon", "metrics": {"acc1": 0.4686279296875, "acc5": NaN, "mean_per_class_recall": 0.4684331154570827}}
393
+ {"key": "renderedsst2", "dataset": "Rendered SST2", "metrics": {"acc1": 0.49917627677100496, "acc5": NaN, "mean_per_class_recall": 0.5}}
394
+ {"key": "vtab/resisc45", "dataset": "RESISC45", "metrics": {"acc1": 0.011111111111111112, "acc5": 0.09507936507936508, "mean_per_class_recall": 0.010554943308601954}}
395
+ {"key": "vtab/smallnorb_label_azimuth", "dataset": "Small NORB Azimuth", "metrics": {"acc1": 0.055308641975308645, "acc5": 0.2783539094650206, "mean_per_class_recall": 0.05562991896379334}}
396
+ {"key": "vtab/smallnorb_label_elevation", "dataset": "Small NORB Elevation", "metrics": {"acc1": 0.11209876543209876, "acc5": 0.548724279835391, "mean_per_class_recall": 0.11265998206570475}}
397
+ {"key": "cars", "dataset": "Stanford Cars", "metrics": {"acc1": 0.003979604526800149, "acc5": 0.023007088670563364, "mean_per_class_recall": 0.00457510176897932}}
398
+ {"key": "stl10", "dataset": "STL-10", "metrics": {"acc1": 0.10725, "acc5": 0.514375, "mean_per_class_recall": 0.10725}}
399
+ {"key": "sun397", "dataset": "SUN397", "metrics": {"acc1": 0.0018757930742777278, "acc5": 0.009452525884105412, "mean_per_class_recall": 0.0026033992727889817}}
400
+ {"key": "vtab/svhn", "dataset": "SVHN", "metrics": {"acc1": 0.09250153657037492, "acc5": 0.5820528580208973, "mean_per_class_recall": 0.10032880844117324}}