[EDA] A lot of labels have few images.

From: https://www.kaggle.com/go5kuramubon/eda-a-lot-of-labels-have-few-images

Author: pao

Numbers of train images per label

This competition is multi-label task.

So we should understand the number of train images per label.

Let's check!!

In [1]:
import numpy as np
import pandas as pd
from tqdm import tqdm
import matplotlib.pyplot as plt
pd.set_option("max_columns",300)
pd.set_option("max_rows",1020)
In [2]:
train_df = pd.read_csv("../input/train.csv")
labels_df = pd.read_csv("../input/labels.csv")
In [3]:
train_df["attribute_ids"]=train_df["attribute_ids"].apply(lambda x:[int(x) for x in x.split(" ")])
train_df["id"]=train_df["id"].apply(lambda x:x+".png")
train_df.head()
Out[3]:
id attribute_ids
0 1000483014d91860.png [147, 616, 813]
1 1000fe2e667721fe.png [51, 616, 734, 813]
2 1001614cb89646ee.png [776]
3 10041eb49b297c08.png [51, 671, 698, 813, 1092]
4 100501c227f8beea.png [13, 404, 492, 903, 1093]
In [4]:
for ix in tqdm(range(1103)):
    train_df["label_"+str(ix)] = train_df["attribute_ids"].map(lambda x: 1 if ix in x else 0)
100%|██████████| 1103/1103 [01:12<00:00, 15.24it/s]
In [5]:
train_df.head()
Out[5]:
id attribute_ids label_0 label_1 label_2 label_3 label_4 label_5 label_6 label_7 label_8 label_9 label_10 label_11 label_12 label_13 label_14 label_15 label_16 label_17 label_18 label_19 label_20 label_21 label_22 label_23 label_24 label_25 label_26 label_27 label_28 label_29 label_30 label_31 label_32 label_33 label_34 label_35 label_36 label_37 label_38 label_39 label_40 label_41 label_42 label_43 label_44 label_45 label_46 label_47 label_48 label_49 label_50 label_51 label_52 label_53 label_54 label_55 label_56 label_57 label_58 label_59 label_60 label_61 label_62 label_63 label_64 label_65 label_66 label_67 label_68 label_69 label_70 label_71 label_72 label_73 label_74 label_75 label_76 label_77 label_78 label_79 label_80 label_81 label_82 label_83 label_84 label_85 label_86 label_87 label_88 label_89 label_90 label_91 label_92 label_93 label_94 label_95 label_96 label_97 label_98 label_99 label_100 label_101 label_102 label_103 label_104 label_105 label_106 label_107 label_108 label_109 label_110 label_111 label_112 label_113 label_114 label_115 label_116 label_117 label_118 label_119 label_120 label_121 label_122 label_123 label_124 label_125 label_126 label_127 label_128 label_129 label_130 label_131 label_132 label_133 label_134 label_135 label_136 label_137 label_138 label_139 label_140 label_141 label_142 label_143 label_144 label_145 label_146 label_147 ... label_953 label_954 label_955 label_956 label_957 label_958 label_959 label_960 label_961 label_962 label_963 label_964 label_965 label_966 label_967 label_968 label_969 label_970 label_971 label_972 label_973 label_974 label_975 label_976 label_977 label_978 label_979 label_980 label_981 label_982 label_983 label_984 label_985 label_986 label_987 label_988 label_989 label_990 label_991 label_992 label_993 label_994 label_995 label_996 label_997 label_998 label_999 label_1000 label_1001 label_1002 label_1003 label_1004 label_1005 label_1006 label_1007 label_1008 label_1009 label_1010 label_1011 label_1012 label_1013 label_1014 label_1015 label_1016 label_1017 label_1018 label_1019 label_1020 label_1021 label_1022 label_1023 label_1024 label_1025 label_1026 label_1027 label_1028 label_1029 label_1030 label_1031 label_1032 label_1033 label_1034 label_1035 label_1036 label_1037 label_1038 label_1039 label_1040 label_1041 label_1042 label_1043 label_1044 label_1045 label_1046 label_1047 label_1048 label_1049 label_1050 label_1051 label_1052 label_1053 label_1054 label_1055 label_1056 label_1057 label_1058 label_1059 label_1060 label_1061 label_1062 label_1063 label_1064 label_1065 label_1066 label_1067 label_1068 label_1069 label_1070 label_1071 label_1072 label_1073 label_1074 label_1075 label_1076 label_1077 label_1078 label_1079 label_1080 label_1081 label_1082 label_1083 label_1084 label_1085 label_1086 label_1087 label_1088 label_1089 label_1090 label_1091 label_1092 label_1093 label_1094 label_1095 label_1096 label_1097 label_1098 label_1099 label_1100 label_1101 label_1102
0 1000483014d91860.png [147, 616, 813] 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 1 ... 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
1 1000fe2e667721fe.png [51, 616, 734, 813] 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 1 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 ... 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
2 1001614cb89646ee.png [776] 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 ... 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
3 10041eb49b297c08.png [51, 671, 698, 813, 1092] 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 1 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 ... 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 1 0 0 0 0 0 0 0 0 0 0
4 100501c227f8beea.png [13, 404, 492, 903, 1093] 0 0 0 0 0 0 0 0 0 0 0 0 0 1 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 ... 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 1 0 0 0 0 0 0 0 0 0

5 rows × 1105 columns

In [6]:
labels = ["label_{}".format(i) for i in range(1103)]
summary = train_df[labels].sum()
In [7]:
labels_df["count"] = summary.values
In [8]:
labels_df.sort_values("count")
Out[8]:
attribute_id attribute_name count
199 199 culture::kholmogory 1
81 81 culture::chinese with european decoration 1
221 221 culture::macedonian 1
230 230 culture::mennecy or sceaux 1
366 366 culture::tsimshian 1
11 11 culture::algerian 1
104 104 culture::dehua 1
396 396 culture::zoroastrian 1
262 262 culture::nimes 1
805 805 tag::mark antony 1
112 112 culture::dyak 1
146 146 culture::freiburg im breisgau 1
281 281 culture::palermo 1
293 293 culture::populonia 1
328 328 culture::skyros 1
987 987 tag::slavery 2
71 71 culture::central highlands 2
271 271 culture::northwest china/eastern central asia 2
201 201 culture::konigsberg 2
240 240 culture::moche-wari 2
108 108 culture::devonshire 2
142 142 culture::for russian market 2
389 389 culture::vulci 2
904 904 tag::prostitutes 2
312 312 culture::san sabastian 2
187 187 culture::isin-larsaold babylonian 2
100 100 culture::cypriot or phoenician 3
250 250 culture::nailsea 3
39 39 culture::beautiran 3
198 198 culture::kazakhstan 3
160 160 culture::gonia 3
123 123 culture::england 3
53 53 culture::british or scottish 3
203 203 culture::la rochelle 3
140 140 culture::for iberian market 3
1017 1017 tag::sunflowers 3
94 94 culture::costa rica or panama 3
727 727 tag::hindu religious figures 3
190 190 culture::italian or sicilian 3
36 36 culture::balinese 3
7 7 culture::after italian 3
372 372 culture::united states 3
329 329 culture::smyrna 3
376 376 culture::urbino with gubbio luster 3
3 3 culture::afghan 3
132 132 culture::flemish or italian 4
233 233 culture::michoacan 4
214 214 culture::longton hall 4
20 20 culture::aragon 4
88 88 culture::colonial 4
92 92 culture::coromandel coast 4
787 787 tag::living rooms 4
260 260 culture::neuwied am rhein 4
103 103 culture::deccan 4
367 367 culture::turin 4
166 166 culture::gurkha 4
129 129 culture::faliscan 4
6 6 culture::after german original 4
177 177 culture::huron 4
176 176 culture::hungary 4
855 855 tag::olive trees 4
278 278 culture::ottonian 4
284 284 culture::parita 4
290 290 culture::phrygian 4
291 291 culture::piedmont 4
34 34 culture::babylonian or kassite 4
327 327 culture::sinceny 4
365 365 culture::topara 5
115 115 culture::eastern european 5
21 21 culture::arica 5
80 80 culture::chinese with dutch decoration 5
211 211 culture::liverpool 5
31 31 culture::avon 5
297 297 culture::proto-elamite 5
873 873 tag::pentecost 5
207 207 culture::langobardic 5
1060 1060 tag::vajrapani 5
431 431 tag::architects 5
268 268 culture::northern india 5
30 30 culture::avignon 5
298 298 culture::provincial 5
219 219 culture::macao 6
137 137 culture::for danish market 6
391 391 culture::west slavic 6
130 130 culture::ferrara 6
311 311 culture::salzburg 6
527 527 tag::celestial bodies 6
264 264 culture::north indian 6
181 181 culture::indian or nepalese 6
363 363 culture::tlingit 6
186 186 culture::isin-larsa 6
883 883 tag::pinecones 6
314 314 culture::savoy 6
118 118 culture::edinburgh 6
286 286 culture::parthian or sasanian 6
82 82 culture::chinese with french mounts 6
843 843 tag::nero 6
126 126 culture::euboean 6
388 388 culture::visigothic 6
167 167 culture::haida 6
370 370 culture::ubaid 7
128 128 culture::european bronze age 7
159 159 culture::gnathian 7
119 119 culture::edomite 7
845 845 tag::new testament 7
892 892 tag::polka-dot pattern 7
19 19 culture::arabian 7
346 346 culture::surrey 7
340 340 culture::stockholm 7
333 333 culture::southall 7
235 235 culture::mimbres 7
37 37 culture::bavaria 7
635 635 tag::easter 7
241 241 culture::montelupo 7
224 224 culture::mali 7
355 355 culture::thanjavur 7
242 242 culture::moro 7
544 544 tag::christmas 7
917 917 tag::rectangles 7
364 364 culture::tolita-tumaco 7
101 101 culture::czech 7
197 197 culture::kathmandu valley 7
73 73 culture::chalcidian 7
254 254 culture::naxos 8
652 652 tag::fairies 8
174 174 culture::huastec 8
168 168 culture::hanau 8
561 561 tag::concerts 8
812 812 tag::medea 8
395 395 culture::zenu 8
394 394 culture::wurzburg 8
460 460 tag::bathsheba 8
215 215 culture::lowestoft 8
599 599 tag::deities 8
381 381 culture::verona 8
84 84 culture::chorrera 8
68 68 culture::caughley 8
798 798 tag::magicians 9
288 288 culture::pesaro 9
296 296 culture::praenestine 9
200 200 culture::kievan rus' 9
452 452 tag::bakers 9
523 523 tag::cathedrals 9
303 303 culture::rhenish 9
47 47 culture::bordeaux 9
305 305 culture::roman egyptian 9
193 193 culture::italic-native 9
854 854 tag::old testament 9
183 183 culture::inuit 9
476 476 tag::billiards 9
643 643 tag::esther 9
302 302 culture::remojadas 10
87 87 culture::colombian 10
919 919 tag::religious texts 10
719 719 tag::hell 10
38 38 culture::bayreuth 10
209 209 culture::lille 10
164 164 culture::guanacaste-nicoya 10
310 310 culture::salinar 10
752 752 tag::jason 10
343 343 culture::sulawesi 10
143 143 culture::for swedish market 10
220 220 culture::macaracas 10
56 56 culture::burma 10
54 54 culture::brunswick 10
243 243 culture::moroccan 10
225 225 culture::manteno 10
277 277 culture::orleans 10
10 10 culture::alexandria-hadra 10
66 66 culture::catalonia 11
46 46 culture::bologna 11
1031 1031 tag::telescopes 11
897 897 tag::poseidon 11
295 295 culture::potsdam 11
62 62 culture::canaanite 11
474 474 tag::bible 11
386 386 culture::villeroy 11
206 206 culture::lambeth 11
244 244 culture::moustiers 12
918 918 tag::religious events 12
779 779 tag::law 12
72 72 culture::central italian 12
148 148 culture::french or german 12
28 28 culture::augsburg original 12
16 16 culture::ansbach 12
49 49 culture::brescia 12
697 697 tag::gingham pattern 12
356 356 culture::the hague 12
1094 1094 tag::world war i 12
246 246 culture::muisca 12
64 64 culture::castel durante 13
213 213 culture::london original 13
63 63 culture::canosan 13
97 97 culture::cyclades 13
352 352 culture::teano 13
1052 1052 tag::tulips 13
4 4 culture::after british 13
27 27 culture::augsburg decoration 13
1048 1048 tag::tricorns 13
330 330 culture::south german 13
157 157 culture::german or swiss 14
152 152 culture::furstenberg 14
267 267 culture::northern european 14
8 8 culture::after russian original 14
1076 1076 tag::wagons 14
238 238 culture::mixtec 14
594 594 tag::dawn 14
139 139 culture::for french market 14
2 2 culture::aegean 14
12 12 culture::alsace 14
77 77 culture::chelsea-derby 14
853 853 tag::octopus 14
443 443 tag::astronomy 14
319 319 culture::scythian 15
208 208 culture::leuven 15
300 300 culture::qajar 15
930 930 tag::rowing 15
361 361 culture::tiwanaku 15
856 856 tag::opera 16
301 301 culture::quechua 16
799 799 tag::maitreya 16
85 85 culture::chupicuaro 16
172 172 culture::hittite 16
575 575 tag::cradles 16
1087 1087 tag::wind 16
353 353 culture::teotihuacan 16
392 392 culture::western european 16
357 357 culture::thessaly 16
491 491 tag::boxing 16
317 317 culture::sceaux 16
344 344 culture::sumatran 17
790 790 tag::lockets 17
5 5 culture::after german 17
336 336 culture::spitalfields 17
261 261 culture::nevers 17
52 52 culture::british or french 17
1021 1021 tag::tabernacles 17
644 644 tag::europa 17
982 982 tag::singing 17
266 266 culture::north netherlandish 17
1090 1090 tag::wine 17
525 525 tag::cauldrons 17
228 228 culture::meissen with german 17
117 117 culture::eastern mediterranean or italian 17
337 337 culture::sri lankan 18
371 371 culture::umbria 18
481 481 tag::bobbins 18
407 407 tag::admirals 18
970 970 tag::shakyamuni 18
0 0 culture::abruzzi 18
223 223 culture::malayan 18
687 687 tag::galatea 18
944 944 tag::saint mark 18
153 153 culture::gaul 18
98 98 culture::cycladic 19
435 435 tag::ariadne 19
416 416 tag::amun 19
414 414 tag::amazons 19
89 89 culture::colonial american 19
589 589 tag::daisies 19
362 362 culture::tlatilco 19
403 403 tag::acrobats 19
136 136 culture::for continental market 19
377 377 culture::valencia 19
255 255 culture::nayarit 19
852 852 tag::octagons 19
928 928 tag::rosaries 20
781 781 tag::leda 20
943 943 tag::saint lawrence 20
379 379 culture::veracruz 20
765 765 tag::kitchens 20
1028 1028 tag::tea drinking 20
17 17 culture::antwerp 20
736 736 tag::hospitals 20
851 851 tag::occupations 20
1011 1011 tag::students 21
632 632 tag::durga 21
380 380 culture::veraguas 21
456 456 tag::barns 21
247 247 culture::munich 21
1029 1029 tag::teachers 21
216 216 culture::ludwigsburg 21
417 417 tag::ancient greek 21
350 350 culture::tairona 21
857 857 tag::organs 21
601 601 tag::descent from the cross 21
229 229 culture::mennecy 21
170 170 culture::helladic 21
743 743 tag::inns 22
880 880 tag::pigeons 22
22 22 culture::asia minor 22
150 150 culture::french or swiss 22
402 402 tag::acorns 22
341 341 culture::stoke-on-trent 22
1067 1067 tag::victory 22
785 785 tag::literature 22
374 374 culture::urartian 22
909 909 tag::pyramids 22
398 398 tag::abbies 22
841 841 tag::necktie 22
93 93 culture::costa rica 22
245 245 culture::mughal 22
694 694 tag::genre scene 22
67 67 culture::caucasian 22
59 59 culture::calima 22
222 222 culture::madrid 22
981 981 tag::singers 22
1008 1008 tag::street scene 23
325 325 culture::siena 23
689 689 tag::gardeners 23
171 171 culture::hilt 23
120 120 culture::egypt 23
814 814 tag::merchants 23
602 602 tag::deserts 24
810 810 tag::massacres 24
75 75 culture::chaumont-sur-loire 24
802 802 tag::manjushri 24
869 869 tag::peaches 24
550 550 tag::cleopatra 24
801 801 tag::mandolins 24
625 625 tag::drawing 24
455 455 tag::baptism of christ 24
504 504 tag::burial grounds 25
387 387 culture::vincennes 25
469 469 tag::bees 25
106 106 culture::derby 25
762 762 tag::kettles 25
859 859 tag::orpheus 25
1079 1079 tag::washing 25
640 640 tag::emperor augustus 26
1016 1016 tag::sundials 26
109 109 culture::dresden 26
472 472 tag::benjamin franklin 26
151 151 culture::fulda 26
471 471 tag::benches 26
933 933 tag::sailors 26
326 326 culture::silesia 26
658 658 tag::fathers 26
440 440 tag::artemis 26
751 751 tag::jars 26
165 165 culture::gubbio 26
547 547 tag::circus 27
839 839 tag::navy 27
169 169 culture::hattian 27
837 837 tag::napoleon i 27
320 320 culture::seleucid 27
609 609 tag::dice 27
717 717 tag::hawks 27
877 877 tag::perseus 27
9 9 culture::akkadian 28
419 419 tag::anger 28
1042 1042 tag::toys 28
270 270 culture::northwest china 28
499 499 tag::buddhist religious figures 28
83 83 culture::chiriqui 28
957 957 tag::schools 28
617 617 tag::dolls 28
630 630 tag::drunkenness 28
141 141 culture::for portuguese market 29
74 74 culture::chantilly 29
397 397 culture::zurich 29
1014 1014 tag::summer 29
500 500 tag::buffalos 29
900 900 tag::prisms 29
997 997 tag::sports 29
358 358 culture::thuringia 29
50 50 culture::bristol 29
265 265 culture::north italian 30
90 90 culture::copenhagen 30
730 730 tag::holofernes 30
1100 1100 tag::zeus 30
509 509 tag::calendars 30
531 531 tag::ceres 30
299 299 culture::ptolemaic 30
894 894 tag::ponds 30
990 990 tag::snails 30
958 958 tag::scorpions 30
205 205 culture::lambayeque 30
408 408 tag::adonis 31
539 539 tag::chinese 31
893 893 tag::pomegranates 31
651 651 tag::factories 31
1102 1102 tag::zodiac 31
342 342 culture::strasbourg 32
385 385 culture::villanovan 32
789 789 tag::lobsters 32
788 788 tag::lizards 32
122 122 culture::elamite 32
847 847 tag::nike 32
134 134 culture::for american market 32
257 257 culture::neolithic 32
1082 1082 tag::watermills 33
249 249 culture::nabataean 33
292 292 culture::polish 33
57 57 culture::burslem 33
715 715 tag::hathor 34
1075 1075 tag::vulcan 34
442 442 tag::assumption of the virgin 34
777 777 tag::last judgement 34
48 48 culture::bow 34
659 659 tag::fauns 34
759 759 tag::julius caesar 34
15 15 culture::amsterdam 34
1070 1070 tag::violas 34
475 475 tag::bicycles 34
530 530 tag::ceremony 35
441 441 tag::artists 35
382 382 culture::versailles 35
429 429 tag::archangel gabriel 35
722 722 tag::hermes 35
656 656 tag::farmers 35
251 251 culture::nantes 35
44 44 culture::boeotian 35
980 980 tag::silenus 36
935 935 tag::saint anthony 36
792 792 tag::louis xiv 36
195 195 culture::javanese 36
158 158 culture::ghassulian 36
614 614 tag::doctors 36
984 984 tag::skirts 36
411 411 tag::air transports 36
979 979 tag::sibyl 36
729 729 tag::historical figures 36
421 421 tag::anklet 36
315 315 culture::saxony 37
740 740 tag::illness 37
149 149 culture::french or italian 37
926 926 tag::roman deities 37
848 848 tag::nonrepresentational art 37
526 526 tag::caves 37
775 775 tag::landforms 38
1000 1000 tag::squirrels 38
237 237 culture::mitanni 38
686 686 tag::gadrooning 38
178 178 culture::ica 38
946 946 tag::saint michael 38
279 279 culture::padua 38
144 144 culture::frankenthal 38
324 324 culture::sicily 39
572 572 tag::coverlets and quilts 39
560 560 tag::commodes 39
945 945 tag::saint matthew 39
272 272 culture::norwegian 39
636 636 tag::egg and dart 39
773 773 tag::lamentation 40
818 818 tag::military clothing 40
484 484 tag::body parts 40
1074 1074 tag::volcanoes 40
309 309 culture::saint-cloud 40
360 360 culture::tibetan 40
124 124 culture::etruria 40
451 451 tag::bagpipes 41
969 969 tag::shakespeare 41
107 107 culture::deruta 41
938 938 tag::saint george 41
470 470 tag::belts 41
427 427 tag::apples 41
401 401 tag::acanthus 41
24 24 culture::atlantic watershed 41
902 902 tag::prisons 42
1026 1026 tag::taweret 42
473 473 tag::bes 43
770 770 tag::ladles 43
274 274 culture::nymphenburg 43
263 263 culture::north china 43
69 69 culture::central asia 43
95 95 culture::cretan 43
757 757 tag::judith 44
196 196 culture::jouy-en-josas 44
375 375 culture::urbino 44
683 683 tag::funerals 44
86 86 culture::colima 44
562 562 tag::contemplation 45
998 998 tag::spring 45
865 865 tag::pants 45
1049 1049 tag::triton 45
321 321 culture::seville 45
831 831 tag::muses 45
110 110 culture::dublin 45
876 876 tag::performance 46
782 782 tag::leopards 46
778 778 tag::last supper 46
571 571 tag::courtyards 46
318 318 culture::scottish 46
820 820 tag::minerva 47
446 446 tag::autumn 47
711 711 tag::hair 47
760 760 tag::juno 47
574 574 tag::crabs 47
467 467 tag::bedrooms 47
1043 1043 tag::trains 48
399 399 tag::abraham 48
1086 1086 tag::wells 48
797 797 tag::maenads 48
673 673 tag::fluting 48
951 951 tag::sarcophagus 48
424 424 tag::apocalypse 48
256 256 culture::neo-sumerian 48
40 40 culture::beauvais 48
1063 1063 tag::vegetables 48
533 533 tag::chalices 48
772 772 tag::lambs 49
1057 1057 tag::uniforms 49
712 712 tag::hammers 49
868 868 tag::party 49
748 748 tag::isis 50
569 569 tag::couches 50
641 641 tag::entombment 50
1006 1006 tag::storms 50
349 349 culture::syrian 50
... ... ... ...
345 345 culture::sumerian 64
964 964 tag::seascapes 65
968 968 tag::servants 65
881 881 tag::pigs 66
906 906 tag::punishment 66
905 905 tag::psyche 66
1053 1053 tag::tunics 66
710 710 tag::guitars 66
1041 1041 tag::towns 66
437 437 tag::army 66
444 444 tag::athena 66
373 373 culture::unknown 66
1003 1003 tag::still life 67
648 648 tag::eyes 67
965 965 tag::seating furniture 67
879 879 tag::pianos 67
795 795 tag::lutes 67
565 565 tag::corpses 67
1007 1007 tag::strapwork 68
1013 1013 tag::suits 68
390 390 culture::wari 68
700 700 tag::gloves 68
463 463 tag::beaches 68
618 618 tag::dolphins 69
191 191 culture::italian or spanish 69
842 842 tag::neptune 69
735 735 tag::horus 69
155 155 culture::genoa 69
528 528 tag::censers 70
816 816 tag::mice 70
521 521 tag::caryatids 70
232 232 culture::mezcala 71
613 613 tag::docks 71
275 275 culture::old assyrian trading colony 71
410 410 tag::adoration of the sheperds 71
61 61 culture::campanian 71
1091 1091 tag::winter 72
32 32 culture::aztec 72
486 486 tag::boots 72
102 102 culture::danish 72
65 65 culture::catalan 72
702 702 tag::goblets 73
60 60 culture::cambodia 74
824 824 tag::monsters 74
458 458 tag::basins 75
588 588 tag::daily life 75
226 226 culture::maya 76
815 815 tag::mercury 76
461 461 tag::bats 76
920 920 tag::reliquaries 77
368 368 culture::turkish 77
875 875 tag::percussion instruments 77
453 453 tag::balconies 77
846 846 tag::night 78
596 596 tag::decorative designs 78
1077 1077 tag::walking 78
1036 1036 tag::theatre 79
836 836 tag::mythology 79
478 478 tag::bishops 79
942 942 tag::saint joseph 79
466 466 tag::bears 79
804 804 tag::maps 79
867 867 tag::parrots 79
885 885 tag::pitchers 80
105 105 culture::delft 80
874 874 tag::peonies 80
512 512 tag::canals 80
457 457 tag::baseball 81
334 334 culture::southern german 81
513 513 tag::candelabra 81
936 936 tag::saint catherine 81
307 307 culture::rouen 81
1010 1010 tag::stripes 81
258 258 culture::nepal 82
43 43 culture::birmingham 82
1015 1015 tag::sun 83
556 556 tag::coffeepots 84
1101 1101 tag::zigzag pattern 85
567 567 tag::corsets 85
714 714 tag::harps 85
1055 1055 tag::turtles 85
838 838 tag::nativity 86
537 537 tag::chickens 86
449 449 tag::bacchus 86
661 661 tag::feathers 87
653 653 tag::falcons 87
941 941 tag::saint john the evangelist 87
850 850 tag::obelisks 88
761 761 tag::jupiter 88
175 175 culture::hungarian 88
679 679 tag::foxes 88
406 406 tag::adam 89
316 316 culture::scandinavian 90
608 608 tag::diana 90
664 664 tag::fire 90
409 409 tag::adoration of the magi 91
763 763 tag::keys 91
536 536 tag::chests 92
1080 1080 tag::watches 92
898 898 tag::princes 92
585 585 tag::curtains 92
253 253 culture::nasca 93
693 693 tag::generals 93
285 285 culture::parthian 93
645 645 tag::eve 93
138 138 culture::for european market 93
860 860 tag::owls 94
866 866 tag::parks 94
921 921 tag::riding 94
135 135 culture::for british market 94
1025 1025 tag::tapestries 95
400 400 tag::abstraction 95
185 185 culture::irish 95
1051 1051 tag::trumpets 95
505 505 tag::burials 95
287 287 culture::peruvian 96
939 939 tag::saint jerome 96
995 995 tag::spectators 96
959 959 tag::screens 96
529 529 tag::centaurs 97
234 234 culture::milan 97
960 960 tag::scrolls 97
966 966 tag::self-portraits 97
823 823 tag::monks 97
967 967 tag::serpents 97
540 540 tag::chinoiserie 98
1024 1024 tag::taoism 98
546 546 tag::circles 99
674 674 tag::food 99
1 1 culture::achaemenid 100
1066 1066 tag::vests 100
502 502 tag::buildings and structures 102
755 755 tag::jockeys 103
662 662 tag::feet 103
771 771 tag::lakes 103
459 459 tag::bathing 104
685 685 tag::furniture 104
1018 1018 tag::swans 104
422 422 tag::annunciation 106
55 55 culture::brussels 106
861 861 tag::painting 106
479 479 tag::boars 106
882 882 tag::pilasters 107
649 649 tag::facades 108
192 192 culture::italic 108
907 907 tag::purses 110
1065 1065 tag::vestments 110
516 516 tag::cannons 110
808 808 tag::mary magdalene 111
273 273 culture::nuremberg 111
681 681 tag::frogs 111
468 468 tag::beds 111
347 347 culture::swedish 112
750 750 tag::jainism 112
642 642 tag::eros 112
947 947 tag::saint paul 113
1071 1071 tag::violins 113
794 794 tag::lovers 113
217 217 culture::lydian 114
709 709 tag::grotesques 114
566 566 tag::correspondence 114
454 454 tag::bamboo 114
1083 1083 tag::waves 114
413 413 tag::altars 115
654 654 tag::family 115
204 204 culture::laconian 116
510 510 tag::camels 117
359 359 culture::tibet 118
619 619 tag::domes 118
179 179 culture::inca 118
393 393 culture::worcester 118
622 622 tag::doorways 119
948 948 tag::saint peter 119
35 35 culture::bactria-margiana archaeological complex 119
749 749 tag::jackets 119
708 708 tag::griffins 120
669 669 tag::fishing 120
1068 1068 tag::villages 120
999 999 tag::squares 120
18 18 culture::apulian 121
535 535 tag::chess 121
666 666 tag::fireplaces 123
507 507 tag::buttons 123
629 629 tag::drums 124
732 732 tag::horns 124
1037 1037 tag::tigers 124
600 600 tag::demons 124
1058 1058 tag::urns 126
511 511 tag::cameos 127
116 116 culture::eastern mediterranean 127
741 741 tag::incense burners 128
915 915 tag::rams 129
829 829 tag::mothers 130
825 825 tag::monuments 130
496 496 tag::buckles 131
680 680 tag::friezes 133
76 76 culture::chelsea 133
576 576 tag::cranes 135
1096 1096 tag::wreaths 137
1033 1033 tag::tents 137
508 508 tag::cabinets 137
985 985 tag::skulls 137
887 887 tag::playing 139
448 448 tag::axes 140
41 41 culture::belgian 141
888 888 tag::playing cards 141
425 425 tag::apollo 142
1081 1081 tag::waterfalls 143
1069 1069 tag::vines 143
863 863 tag::palaces 144
78 78 culture::chimu 146
591 591 tag::dancers 146
791 791 tag::lotuses 147
932 932 tag::sadness 147
912 912 tag::rabbits 147
996 996 tag::sphinx 148
972 972 tag::shells 148
383 383 culture::vienna 148
551 551 tag::clocks 150
676 676 tag::forests 150
627 627 tag::drinking 150
280 280 culture::pakistan 152
826 826 tag::moon 153
522 522 tag::castles 153
849 849 tag::nymphs 155
692 692 tag::gates 156
989 989 tag::smoking 156
306 306 culture::rome 157
1097 1097 tag::writing 158
973 973 tag::shepherds 159
638 638 tag::emblems 160
1001 1001 tag::stairs 160
731 731 tag::holy family 160
1040 1040 tag::towers 162
621 621 tag::doors 165
871 871 tag::pediments 167
688 688 tag::games 167
426 426 tag::apostles 169
620 620 tag::donkeys 170
924 924 tag::roads 170
992 992 tag::snow 173
988 988 tag::sleep 174
675 675 tag::footwear 176
631 631 tag::ducks 177
26 26 culture::augsburg 177
910 910 tag::queens 179
870 870 tag::peacocks 179
1038 1038 tag::tombs 180
555 555 tag::coats 181
963 963 tag::seas 181
811 811 tag::medallions 182
927 927 tag::roosters 184
548 548 tag::cities 185
495 495 tag::brooches 186
628 628 tag::drinking glasses 186
983 983 tag::skeletons 188
1009 1009 tag::streets 193
832 832 tag::music 194
1056 1056 tag::undergarment 195
678 678 tag::fountains 196
929 929 tag::roses 200
705 705 tag::grapes 202
672 672 tag::flutes 203
889 889 tag::pocket watches 204
701 701 tag::goats 204
518 518 tag::carpets and rugs 205
570 570 tag::couples 205
739 739 tag::hunting 205
890 890 tag::poetry 206
1012 1012 tag::suffering 207
252 252 culture::naples 207
721 721 tag::hercules 208
354 354 culture::thailand 210
864 864 tag::palmettes 215
971 971 tag::sheep 216
563 563 tag::coptic 216
756 756 tag::journals 218
695 695 tag::geometric patterns 219
445 445 tag::athletes 219
332 332 culture::south netherlandish 219
1045 1045 tag::trays 220
482 482 tag::bodhisattva 221
713 713 tag::hands 221
908 908 tag::putti 223
822 822 tag::monkeys 224
834 834 tag::musicians 225
450 450 tag::badges 226
884 884 tag::pins 227
1085 1085 tag::weights and measures 228
728 728 tag::hinduism 229
690 690 tag::gardens 230
282 282 culture::paracas 233
819 819 tag::military equipment 233
786 786 tag::liturgical objects 234
1064 1064 tag::venus 236
637 637 tag::elephants 236
840 840 tag::necklaces 239
58 58 culture::byzantine 240
607 607 tag::diamonds 240
524 524 tag::cats 243
23 23 culture::assyrian 244
534 534 tag::chariots 244
1089 1089 tag::windows 251
1030 1030 tag::teapots 251
488 488 tag::bow and arrow 253
994 994 tag::spears 253
432 432 tag::architectural elements 254
133 133 culture::florence 254
490 490 tag::boxes 254
553 553 tag::clouds 256
726 726 tag::hilts 256
691 691 tag::garlands 257
707 707 tag::greek figures 257
978 978 tag::shoes 258
783 783 tag::lighting 262
991 991 tag::snakes 262
517 517 tag::capitals 263
766 766 tag::knives 265
647 647 tag::ewers 266
803 803 tag::manuscripts 269
202 202 culture::korea 269
568 568 tag::costumes 270
1032 1032 tag::temples 273
515 515 tag::candlesticks 273
236 236 culture::minoan 281
503 503 tag::bulls 284
745 745 tag::insects 286
587 587 tag::daggers 289
916 916 tag::reading 290
33 33 culture::babylonian 292
331 331 culture::south italian 293
506 506 tag::butterflies 295
595 595 tag::death 296
665 665 tag::firearms 297
493 493 tag::bracelets 298
497 497 tag::buddha 302
1019 1019 tag::sword guards 303
633 633 tag::eagles 303
925 925 tag::robes 312
322 322 culture::sevres 317
725 725 tag::hills 322
438 438 tag::arrowheads 323
592 592 tag::dancing 327
545 545 tag::churches 327
348 348 culture::swiss 328
558 558 tag::coins 329
940 940 tag::saint john the baptist 329
573 573 tag::cows 332
581 581 tag::crucifixion 332
462 462 tag::battles 338
520 520 tag::cartouches 354
809 809 tag::masks 355
465 465 tag::beakers 357
684 684 tag::funerary objects 358
239 239 culture::moche 362
308 308 culture::russian 368
954 954 tag::saucers 369
703 703 tag::goddess 369
1022 1022 tag::tables 371
428 428 tag::arabic 373
974 974 tag::shields 382
582 582 tag::cuneiform 387
339 339 culture::staffordshire 388
821 821 tag::mirrors 393
682 682 tag::fruit 399
227 227 culture::meissen 403
14 14 culture::american or european 408
953 953 tag::satyrs 413
952 952 tag::satire 422
774 774 tag::lamps 422
583 583 tag::cupid 427
720 720 tag::helmets 433
603 603 tag::design elements 440
586 586 tag::cutlery 446
747 747 tag::interiors 453
1023 1023 tag::tablets 454
753 753 tag::jesus 461
704 704 tag::gods 462
313 313 culture::sasanian 467
931 931 tag::ruins 477
598 598 tag::deer 480
543 543 tag::christianity 481
1098 1098 tag::writing implements 487
922 922 tag::rings 493
125 125 culture::etruscan 494
127 127 culture::european 499
844 844 tag::netsuke 504
45 45 culture::bohemian 515
742 742 tag::infants 515
923 923 tag::rivers 518
378 378 culture::venice 523
29 29 culture::austrian 530
532 532 tag::chairs 540
886 886 tag::plants 543
184 184 culture::iran 545
634 634 tag::earrings 551
580 580 tag::crowd 555
746 746 tag::insignia 560
494 494 tag::bridges 564
415 415 tag::amulets 565
764 764 tag::kings 566
950 950 tag::samples 568
668 668 tag::fish 570
182 182 culture::indonesia 580
758 758 tag::jugs 582
436 436 tag::armors 582
716 716 tag::hats 583
180 180 culture::india 593
858 858 tag::ornament 593
231 231 culture::mexican 595
670 670 tag::flags 600
624 624 tag::dragons 613
1093 1093 tag::working 622
519 519 tag::carriages 622
975 975 tag::ships 627
655 655 tag::fans 630
430 430 tag::arches 636
796 796 tag::madonna and child 637
559 559 tag::columns 672
25 25 culture::attic 676
404 404 tag::actors 676
955 955 tag::scarabs 682
1061 1061 tag::vase fragments 744
579 579 tag::cross 745
639 639 tag::embroidery 750
498 498 tag::buddhism 766
650 650 tag::faces 773
1035 1035 tag::textiles 775
131 131 culture::flemish 787
615 615 tag::documents 810
283 283 culture::paris 810
1072 1072 tag::virgin mary 816
70 70 culture::central european 831
212 212 culture::london 838
464 464 tag::beads 859
542 542 tag::christian imagery 866
433 433 tag::architectural fragments 888
538 538 tag::children 901
800 800 tag::male nudes 902
754 754 tag::jewelry 921
872 872 tag::pendants 956
830 830 tag::mountains 957
492 492 tag::boys 959
1084 1084 tag::weapons 961
698 698 tag::girls 965
1020 1020 tag::swords 977
784 784 tag::lions 1016
626 626 tag::dresses 1050
949 949 tag::saints 1053
993 993 tag::soldiers 1073
724 724 tag::hieroglyphs 1083
833 833 tag::musical instruments 1138
768 768 tag::lace 1200
434 434 tag::architecture 1213
418 418 tag::angels 1260
616 616 tag::dogs 1278
584 584 tag::cups 1283
663 663 tag::female nudes 1286
259 259 culture::netherlandish 1302
99 99 culture::cypriot 1327
554 554 tag::coat of arms 1390
718 718 tag::heads 1397
335 335 culture::spanish 1403
480 480 tag::boats 1414
597 597 tag::decorative elements 1428
737 737 tag::houses 1446
405 405 tag::actresses 1457
483 483 tag::bodies of water 1472
734 734 tag::horses 1480
541 541 tag::christ 1492
961 961 tag::sculpture 1526
1062 1062 tag::vases 1540
501 501 tag::buildings 1667
487 487 tag::bottles 1685
962 962 tag::seals 1744
111 111 culture::dutch 1762
612 612 tag::dishes 1789
304 304 culture::roman 1881
733 733 tag::horse riding 1895
1039 1039 tag::tools and equipment 2001
489 489 tag::bowls 2045
161 161 culture::greek 2050
776 776 tag::landscapes 2075
485 485 tag::books 2097
552 552 tag::clothing and accessories 2180
1099 1099 tag::writing systems 2327
420 420 tag::animals 2548
903 903 tag::profiles 2552
835 835 tag::mythical creatures 3005
188 188 culture::islamic 3500
1034 1034 tag::textile fragments 3570
738 738 tag::human figures 3665
477 477 tag::birds 3692
744 744 tag::inscriptions 3890
369 369 culture::turkish or venice 4416
156 156 culture::german 5163
780 780 tag::leaves 5259
79 79 culture::china 5382
1046 1046 tag::trees 5591
896 896 tag::portraits 5955
121 121 culture::egyptian 6542
1059 1059 tag::utilitarian objects 6564
194 194 culture::japan 7394
51 51 culture::british 7615
671 671 tag::flowers 8419
13 13 culture::american 9151
189 189 culture::italian 10375
147 147 culture::french 13522
1092 1092 tag::women 14281
813 813 tag::men 19970

1103 rows × 3 columns

In [9]:
fig = plt.figure(figsize=(20,5))
ax = fig.add_subplot(1, 1, 1)
ax.set_xticks([x for x in range(0,1000,20)]) 
plt.xlabel('train num per label')
plt.hist(summary, range=(0, 1000), bins=50);
In [10]:
for num in [5, 10, 50, 100]: 
    print("under {0}: {1}".format(num, (summary<=num).sum()))
under 5: 81
under 10: 169
under 50: 511
under 100: 724

How do we learn the labels which have less than 10 images?

Summary

There are a lot of labels, and many labels have few images.

I think this competition's key is to treat these labels.