Rank	Submission Title	Model	URL	SPARROW Score	Details	Created On	Show Results
1	Finetuned LMs	XLM-RoBERTa-Large		71.6628		2023-11-01 11:37:10
Submission (Finetuned LMs) Model (XLM-RoBERTa-Large) Results Task Score Task Score Task Score Task Score Aggressive-hin-Kumar 75.7885 Dangerous-ara-Alshehri 64.4772 Emotion-ara-Abdul 64.9454 Emotion-ara-Mohammad 85.0011 Emotion-ben-Iqbal 65.7731 Emotion-deu-Bianchi 84.8025 Emotion-eng-Demszky 55.9996 Emotion-eng-Mohammad 79.9946 Emotion-eng-Plaza 51.0465 Emotion-eng-Wallbott 74.4317 Emotion-fas-Sabri 23.8307 Emotion-fin-Kajava 63.2954 Emotion-fin-Ohman 59.3721 Emotion-fre-Bianchi 82.8451 Emotion-fre-Kajava 63.1902 Emotion-hin-Debaditya 53.3858 Emotion-ind-Saputri 81.4263 Emotion-ind-Wilie 77.8397 Emotion-ita-Bianchi 72.1882 Emotion-ita-Kajava 64.2511 Emotion-por-Cortiz 76.1283 Emotion-ron-Ciobotaru 92.9088 Emotion-rus-Sboev 86.1962 Emotion-spa-Mohammad 84.0452 Emotion-spa-Plaza 54.5311 Emotion-tur-Guven 99.25 Emotion-vie-Ho 65.9179 Emotion-zho-Lee 74.0032 Hate-ara-Alakrot 84.2543 Hate-ara-Mubarak 83.7121 Hate-ara-Mulki 72.9697 Hate-eng-Basile 53.8721 Hate-eng-Davidson 92.056 Hate-eng-Waseem 89.7468 Hate-fil-Cabasag 78.8949 Hate-Group-ara-Ousidhoum 58.3654 Hate-Group-fre-Ousidhoum 40.5495 Hate-ita-Bosco 81.1843 Hate-kor-Jeong 81.6544 Hate-kor-Moon 65.4247 Hate-pol-Ptaszynski 73.608 Hate-por-Fortuna 72.8991 Hate-spa-Basile 74.6381 Hate-Target-ara-Ousidhoum 56.8406 Hate-Target-ben-Karim 86.093 Hate-Target-fre-Ousidhoum 45.3326 Hate-Target-kor-Jeong 68.4805 Hate-tel-Marreddy 49.7316 Hate-zho-Deng 83.9642 Humor-eng-Meaney 91.7939 Humor-hin-Aggarwal 79.5333 Humor-rus-Blinov 89.7956 Humor-spa-Chiruzzo 85.9996 Irony-ara-Ghanem 82.2229 Irony-eng-Hee 65.631 Irony-fas-Golazizian 73.356 Irony-hin-Vijay 72.6831 Irony-ita-Basile 67.3033 Irony-ita-Cignarella 79.2685 Irony-spa-Barbieri 60.1007 Irony-spa-Ortega 71.2015 Irony-Type-eng-Hee 50.7748 Irony-zho-Xiang 33.0427 Offense-Target-kan-Chakravarthi 43.6611 Offense-Target-kan-Chakravarthi 75.1737 Offense-Target-kan-Chakravarthi 38.1975 Offense-Target-mal-Chakravarthi 43.6611 Offense-Target-mal-Chakravarthi 75.1737 Offense-Target-mal-Chakravarthi 38.1975 Offense-Target-tam-Chakravarthi 43.6611 Offense-Target-tam-Chakravarthi 75.1737 Offense-Target-tam-Chakravarthi 38.1975 Offensive-ara-Mubarak 88.9528 Offensive-ara-Zampieri 89.484 Offensive-dan-Zampieri 68.9371 Offensive-ell-Zampieri 77.1809 Offensive-eng-Zampieri 76.4355 Offensive-Group-eng-Zampieri 57.9821 Offensive-slv-Novak 50.0689 Offensive-Target-eng-Zampieri 67.1167 Offensive-tur-Zampieri 78.8602 Sarcasm-ara-Abufarha 75.575 Sarcasm-ara-Farha 70.8533 Sarcasm-ces-Ptacek 70.4269 Sarcasm-eng-Bamman 80.9333 Sarcasm-eng-Oraby 77.0769 Sarcasm-eng-Ptacek 95.7629 Sarcasm-eng-Rajadesingan 95 Sarcasm-eng-Riloff 57.0864 Sarcasm-eng-Walker 66.8894 Sarcasm-zho-Gong 74.7643 Sentiment-5-eng-Socher 54.8 Sentiment-ace-Winata 76.7225 Sentiment-amh-Muhammad 60.5234 Sentiment-ara-Abdul 76.9289 Sentiment-ara-Muhammad 59.8667 Sentiment-arq-Muhammad 69.1729 Sentiment-ary-Muhammad 50.721 Sentiment-bam-Diallo 63.7752 Sentiment-ban-Winata 79.268 Sentiment-bbc-Winata 70.2845 Sentiment-ben-Islam 69.4916 Sentiment-ben-Patra 62.5481 Sentiment-bjn-Winata 84.4164 Sentiment-bos-Mozetic 71.9626 Sentiment-bug-Winata 67.4844 Sentiment-bul-Mozetic 67.973 Sentiment-deu-Mozetic 64.2712 Sentiment-deu-Rei 54.8054 Sentiment-eng-Mozetic 69.7215 Sentiment-eng-Pang 89.6 Sentiment-eng-Rosenthal 70.3717 Sentiment-eng-Socher 91.6667 Sentiment-fas-Ashrafi 84.3953 Sentiment-fin-Kajava 86.949 Sentiment-fre-Kajava 88.701 Sentiment-hau-Muhammad 75.0646 Sentiment-heb-Amram 95.6 Sentiment-hin-Patra 62.3897 Sentiment-hrv-Mozetic 71.0063 Sentiment-hun-Mozetic 70.3209 Sentiment-ibo-Muhammad 77.4337 Sentiment-ind-Wilie 92.5802 Sentiment-ita-Basile 87.8288 Sentiment-ita-Basile 82.942 Sentiment-ita-Kajava 70.2148 Sentiment-ita-Rei 47.3196 Sentiment-jav-Winata 86.9069 Sentiment-jpn-Suzuki 62.3333 Sentiment-kan-Chakravarthi 81.1632 Sentiment-kin-Muhammad 58.1027 Sentiment-kor-Jang 45.4451 Sentiment-mad-Winata 76.4894 Sentiment-mal-Chakravarthi 86.4498 Sentiment-mar-Kulkarni 86.0667 Sentiment-min-Winata 84.2426 Sentiment-mlt-Dingli 51.6506 Sentiment-nij-Winata 78.3135 Sentiment-nor-Velldal 45.3716 Sentiment-pcm-Muhammad 65.018 Sentiment-pcm-Oyewusi 69.5089 Sentiment-pol-Kocon 82.6395 Sentiment-pol-Mozetic 70.0465 Sentiment-pol-Rybak 55.6706 Sentiment-por-Brum 58.9215 Sentiment-por-Mozetic 57.2246 Sentiment-ron-Dumitrescu 91.374 Sentiment-rus-Mozetic 79.8727 Sentiment-slk-Mozetic 75.9312 Sentiment-slv-Mozetic 63.8495 Sentiment-spa-Mozetic 57.02 Sentiment-spa-Rei 45.033 Sentiment-sqi-Mozetic 49.537 Sentiment-srp-Mozetic 58.35 Sentiment-sun-Winata 84.4773 Sentiment-swe-Mozetic 73.1889 Sentiment-swh-Muhammad 62.687 Sentiment-tam-Chakravarthi 77.4016 Sentiment-tel-Marreddy 71.5399 Sentiment-tha-Suriyawongkul 71.8186 Sentiment-tso-Muhammad 47.0228 Sentiment-Tw-eng-Thelwall 90.2 Sentiment-twi-Muhammad 66.7873 Sentiment-yor-Muhammad 66.1496 Sentiment-yor-Shode 83.2199 Sentiment-Yt-eng-Thelwall 83.8667 Sentiment-zho-Tan 96.4531 Sentiment-zho-Wan 98.9997 Sexism-fre-Chiril 84.0856 Subject-ita-Basile 78.9071 Subject-ita-Basile 75.9493 Subjective-ces-Priban 93.6 Subjective-kor-Jang 38.447 Subjective-spa-Barbieri 77.7599 Subjevtive-eng-Pang 96.5333
2	Finetuned LMs	InfoDCL		71.6026		2023-11-09 16:14:53
Submission (Finetuned LMs) Model (InfoDCL) Results Task Score Task Score Task Score Task Score Aggressive-hin-Kumar 73.9577 Dangerous-ara-Alshehri 65.2254 Emotion-ara-Abdul 65.6857 Emotion-ara-Mohammad 83.289 Emotion-ben-Iqbal 63.6876 Emotion-deu-Bianchi 79.1841 Emotion-eng-Demszky 58.8281 Emotion-eng-Mohammad 81.3743 Emotion-eng-Plaza 47.4521 Emotion-eng-Wallbott 70.1035 Emotion-fas-Sabri 26.2104 Emotion-fin-Kajava 58.869 Emotion-fin-Ohman 50.3645 Emotion-fre-Bianchi 83.565 Emotion-fre-Kajava 60.0389 Emotion-hin-Debaditya 52.4637 Emotion-ind-Saputri 81.2731 Emotion-ind-Wilie 75.185 Emotion-ita-Bianchi 75.5755 Emotion-ita-Kajava 60.8446 Emotion-por-Cortiz 75.1639 Emotion-ron-Ciobotaru 91.4267 Emotion-rus-Sboev 83.7505 Emotion-spa-Mohammad 85.4896 Emotion-spa-Plaza 54.2489 Emotion-tur-Guven 99.3333 Emotion-vie-Ho 64.5813 Emotion-zho-Lee 72.9665 Hate-ara-Alakrot 85.9529 Hate-ara-Mubarak 82.0002 Hate-ara-Mulki 71.7407 Hate-eng-Basile 53.2514 Hate-eng-Davidson 91.116 Hate-eng-Waseem 88.9332 Hate-fil-Cabasag 79.0063 Hate-Group-ara-Ousidhoum 51.0836 Hate-Group-fre-Ousidhoum 38.1928 Hate-ita-Bosco 81.1656 Hate-kor-Jeong 79.316 Hate-kor-Moon 63.0883 Hate-pol-Ptaszynski 71.2282 Hate-por-Fortuna 73.2221 Hate-spa-Basile 76.9596 Hate-Target-ara-Ousidhoum 53.8379 Hate-Target-ben-Karim 86.3043 Hate-Target-fre-Ousidhoum 48.1783 Hate-Target-kor-Jeong 63.2545 Hate-tel-Marreddy 49.7487 Hate-zho-Deng 84.8631 Humor-eng-Meaney 91.3404 Humor-hin-Aggarwal 80.4 Humor-rus-Blinov 88.7976 Humor-spa-Chiruzzo 87.664 Irony-ara-Ghanem 83.0786 Irony-eng-Hee 68.2543 Irony-fas-Golazizian 76.5306 Irony-hin-Vijay 71.1626 Irony-ita-Basile 65.6678 Irony-ita-Cignarella 75.9227 Irony-spa-Barbieri 67.5232 Irony-spa-Ortega 73.8797 Irony-Type-eng-Hee 57.5832 Irony-zho-Xiang 33.3641 Offense-Target-kan-Chakravarthi 40.6527 Offense-Target-kan-Chakravarthi 81.5283 Offense-Target-kan-Chakravarthi 39.755 Offense-Target-mal-Chakravarthi 40.6527 Offense-Target-mal-Chakravarthi 81.5283 Offense-Target-mal-Chakravarthi 39.755 Offense-Target-tam-Chakravarthi 40.6527 Offense-Target-tam-Chakravarthi 81.5283 Offense-Target-tam-Chakravarthi 39.755 Offensive-ara-Mubarak 91.397 Offensive-ara-Zampieri 89.5315 Offensive-dan-Zampieri 82.0941 Offensive-ell-Zampieri 79.1307 Offensive-eng-Zampieri 78.6678 Offensive-Group-eng-Zampieri 61.445 Offensive-slv-Novak 55.2859 Offensive-Target-eng-Zampieri 72.801 Offensive-tur-Zampieri 76.082 Sarcasm-ara-Abufarha 71.8744 Sarcasm-ara-Farha 68.8114 Sarcasm-ces-Ptacek 67.8944 Sarcasm-eng-Bamman 82.2667 Sarcasm-eng-Oraby 75.6374 Sarcasm-eng-Ptacek 95.5601 Sarcasm-eng-Rajadesingan 95.6667 Sarcasm-eng-Riloff 57.4589 Sarcasm-eng-Walker 63.6537 Sarcasm-zho-Gong 70.5315 Sentiment-5-eng-Socher 53.6667 Sentiment-ace-Winata 77.3559 Sentiment-amh-Muhammad 65.6758 Sentiment-ara-Abdul 77.298 Sentiment-ara-Muhammad 62.2 Sentiment-arq-Muhammad 71.2518 Sentiment-ary-Muhammad 53.4436 Sentiment-bam-Diallo 65.5674 Sentiment-ban-Winata 79.4897 Sentiment-bbc-Winata 73.5828 Sentiment-ben-Islam 68.5362 Sentiment-ben-Patra 59.4459 Sentiment-bjn-Winata 84.4963 Sentiment-bos-Mozetic 68.305 Sentiment-bug-Winata 71.5453 Sentiment-bul-Mozetic 65.0855 Sentiment-deu-Mozetic 62.531 Sentiment-deu-Rei 60.9438 Sentiment-eng-Mozetic 68.7767 Sentiment-eng-Pang 86.9333 Sentiment-eng-Rosenthal 70.3883 Sentiment-eng-Socher 88.7333 Sentiment-fas-Ashrafi 84.537 Sentiment-fin-Kajava 82.3154 Sentiment-fre-Kajava 87.4959 Sentiment-hau-Muhammad 72.1838 Sentiment-heb-Amram 95.8 Sentiment-hin-Patra 59.757 Sentiment-hrv-Mozetic 67.8304 Sentiment-hun-Mozetic 68.3654 Sentiment-ibo-Muhammad 76.7507 Sentiment-ind-Wilie 92.6987 Sentiment-ita-Basile 88.7675 Sentiment-ita-Basile 84.7343 Sentiment-ita-Kajava 86.1687 Sentiment-ita-Rei 51.1953 Sentiment-jav-Winata 84.7913 Sentiment-jpn-Suzuki 61.4667 Sentiment-kan-Chakravarthi 82.9212 Sentiment-kin-Muhammad 56.6949 Sentiment-kor-Jang 44.6982 Sentiment-mad-Winata 78.3642 Sentiment-mal-Chakravarthi 83.8796 Sentiment-mar-Kulkarni 86.4667 Sentiment-min-Winata 84.07 Sentiment-mlt-Dingli 68.0062 Sentiment-nij-Winata 77.2233 Sentiment-nor-Velldal 42.3631 Sentiment-pcm-Muhammad 64.4494 Sentiment-pcm-Oyewusi 68.8447 Sentiment-pol-Kocon 77.626 Sentiment-pol-Mozetic 68.2171 Sentiment-pol-Rybak 55.107 Sentiment-por-Brum 59.2868 Sentiment-por-Mozetic 56.709 Sentiment-ron-Dumitrescu 88.234 Sentiment-rus-Mozetic 80.3694 Sentiment-slk-Mozetic 75.7059 Sentiment-slv-Mozetic 61.9574 Sentiment-spa-Mozetic 55.8656 Sentiment-spa-Rei 52.827 Sentiment-sqi-Mozetic 47.0395 Sentiment-srp-Mozetic 56.8505 Sentiment-sun-Winata 81.7143 Sentiment-swe-Mozetic 70.9769 Sentiment-swh-Muhammad 61.2874 Sentiment-tam-Chakravarthi 75.8677 Sentiment-tel-Marreddy 69.4688 Sentiment-tha-Suriyawongkul 75.1656 Sentiment-tso-Muhammad 52.5494 Sentiment-Tw-eng-Thelwall 89.6 Sentiment-twi-Muhammad 64.5123 Sentiment-yor-Muhammad 64.8407 Sentiment-yor-Shode 84.9286 Sentiment-Yt-eng-Thelwall 93.3333 Sentiment-zho-Tan 95.9162 Sentiment-zho-Wan 98.933 Sexism-fre-Chiril 81.988 Subject-ita-Basile 80.1589 Subject-ita-Basile 72.3612 Subjective-ces-Priban 92.4 Subjective-kor-Jang 36.9519 Subjective-spa-Barbieri 77.326 Subjevtive-eng-Pang 95.2
3	Finetuned LMs	Bernice		70.8522		2023-11-01 11:37:10
Submission (Finetuned LMs) Model (Bernice) Results Task Score Task Score Task Score Task Score Aggressive-hin-Kumar 75.4472 Dangerous-ara-Alshehri 67.1278 Emotion-ara-Abdul 66.2361 Emotion-ara-Mohammad 84.0981 Emotion-ben-Iqbal 63.8645 Emotion-deu-Bianchi 81.7485 Emotion-eng-Demszky 57.5022 Emotion-eng-Mohammad 80.8555 Emotion-eng-Plaza 48.5099 Emotion-eng-Wallbott 69.5074 Emotion-fas-Sabri 21.1493 Emotion-fin-Kajava 49.5437 Emotion-fin-Ohman 45.0668 Emotion-fre-Bianchi 84.1453 Emotion-fre-Kajava 60.0952 Emotion-hin-Debaditya 48.5158 Emotion-ind-Saputri 78.3657 Emotion-ind-Wilie 76.1214 Emotion-ita-Bianchi 76.7783 Emotion-ita-Kajava 60.682 Emotion-por-Cortiz 76.6956 Emotion-ron-Ciobotaru 89.2589 Emotion-rus-Sboev 81.9594 Emotion-spa-Mohammad 83.3286 Emotion-spa-Plaza 57.9461 Emotion-tur-Guven 98.9167 Emotion-vie-Ho 63.1226 Emotion-zho-Lee 67.3046 Hate-ara-Alakrot 83.9935 Hate-ara-Mubarak 81.1622 Hate-ara-Mulki 76.5326 Hate-eng-Basile 54.1739 Hate-eng-Davidson 91.986 Hate-eng-Waseem 88.7944 Hate-fil-Cabasag 79.4984 Hate-Group-ara-Ousidhoum 52.3789 Hate-Group-fre-Ousidhoum 39.13 Hate-ita-Bosco 80.1944 Hate-kor-Jeong 80.1928 Hate-kor-Moon 64.8019 Hate-pol-Ptaszynski 71.6807 Hate-por-Fortuna 74.4002 Hate-spa-Basile 78.2002 Hate-Target-ara-Ousidhoum 52.9631 Hate-Target-ben-Karim 85.8414 Hate-Target-fre-Ousidhoum 43.2981 Hate-Target-kor-Jeong 64.4667 Hate-tel-Marreddy 58.2163 Hate-zho-Deng 84.3929 Humor-eng-Meaney 93.4065 Humor-hin-Aggarwal 78.2667 Humor-rus-Blinov 88.1326 Humor-spa-Chiruzzo 87.1976 Irony-ara-Ghanem 82.4519 Irony-eng-Hee 67.4306 Irony-fas-Golazizian 73.5828 Irony-hin-Vijay 72.9047 Irony-ita-Basile 63.1598 Irony-ita-Cignarella 77.4445 Irony-spa-Barbieri 61.6575 Irony-spa-Ortega 72.7872 Irony-Type-eng-Hee 56.0365 Irony-zho-Xiang 30.5227 Offense-Target-kan-Chakravarthi 46.4663 Offense-Target-kan-Chakravarthi 76.5093 Offense-Target-kan-Chakravarthi 39.9773 Offense-Target-mal-Chakravarthi 46.4663 Offense-Target-mal-Chakravarthi 76.5093 Offense-Target-mal-Chakravarthi 39.9773 Offense-Target-tam-Chakravarthi 46.4663 Offense-Target-tam-Chakravarthi 76.5093 Offense-Target-tam-Chakravarthi 39.9773 Offensive-ara-Mubarak 93.1568 Offensive-ara-Zampieri 91.5521 Offensive-dan-Zampieri 78.0297 Offensive-ell-Zampieri 79.6251 Offensive-eng-Zampieri 77.7537 Offensive-Group-eng-Zampieri 61.9324 Offensive-slv-Novak 51.9774 Offensive-Target-eng-Zampieri 78.1616 Offensive-tur-Zampieri 77.0654 Sarcasm-ara-Abufarha 69.5748 Sarcasm-ara-Farha 68.7975 Sarcasm-ces-Ptacek 65.9749 Sarcasm-eng-Bamman 82.4 Sarcasm-eng-Oraby 74.6933 Sarcasm-eng-Ptacek 94.9925 Sarcasm-eng-Rajadesingan 96.2667 Sarcasm-eng-Riloff 54.8948 Sarcasm-eng-Walker 67.4526 Sarcasm-zho-Gong 72.7502 Sentiment-5-eng-Socher 51.7333 Sentiment-ace-Winata 75.7397 Sentiment-amh-Muhammad 57.2102 Sentiment-ara-Abdul 77.3622 Sentiment-ara-Muhammad 61.2 Sentiment-arq-Muhammad 70.2063 Sentiment-ary-Muhammad 52.6125 Sentiment-bam-Diallo 65.4632 Sentiment-ban-Winata 76.8574 Sentiment-bbc-Winata 75.1651 Sentiment-ben-Islam 66.7399 Sentiment-ben-Patra 57.557 Sentiment-bjn-Winata 82.5826 Sentiment-bos-Mozetic 65.8299 Sentiment-bug-Winata 73.8462 Sentiment-bul-Mozetic 63.0882 Sentiment-deu-Mozetic 62.7956 Sentiment-deu-Rei 55.9253 Sentiment-eng-Mozetic 68.5938 Sentiment-eng-Pang 85.2 Sentiment-eng-Rosenthal 70.8997 Sentiment-eng-Socher 86.8667 Sentiment-fas-Ashrafi 84.5643 Sentiment-fin-Kajava 79.8644 Sentiment-fre-Kajava 86.1183 Sentiment-hau-Muhammad 73.1099 Sentiment-heb-Amram 95.4 Sentiment-hin-Patra 62.2998 Sentiment-hrv-Mozetic 66.6796 Sentiment-hun-Mozetic 70.162 Sentiment-ibo-Muhammad 78.3577 Sentiment-ind-Wilie 92.5179 Sentiment-ita-Basile 85.3323 Sentiment-ita-Basile 79.9305 Sentiment-ita-Kajava 84.5864 Sentiment-ita-Rei 47.1428 Sentiment-jav-Winata 84.3839 Sentiment-jpn-Suzuki 61.1333 Sentiment-kan-Chakravarthi 82.3478 Sentiment-kin-Muhammad 58.7816 Sentiment-kor-Jang 41.0485 Sentiment-mad-Winata 77.3558 Sentiment-mal-Chakravarthi 84.0318 Sentiment-mar-Kulkarni 84.4 Sentiment-min-Winata 80.1919 Sentiment-mlt-Dingli 65.9556 Sentiment-nij-Winata 78.1949 Sentiment-nor-Velldal 39.7276 Sentiment-pcm-Muhammad 63.6062 Sentiment-pcm-Oyewusi 68.8666 Sentiment-pol-Kocon 77.0485 Sentiment-pol-Mozetic 67.907 Sentiment-pol-Rybak 51.1239 Sentiment-por-Brum 57.8542 Sentiment-por-Mozetic 56.3676 Sentiment-ron-Dumitrescu 84.1168 Sentiment-rus-Mozetic 78.8352 Sentiment-slk-Mozetic 71.8181 Sentiment-slv-Mozetic 61.266 Sentiment-spa-Mozetic 55.786 Sentiment-spa-Rei 51.5332 Sentiment-sqi-Mozetic 45.693 Sentiment-srp-Mozetic 52.513 Sentiment-sun-Winata 77.704 Sentiment-swe-Mozetic 69.9278 Sentiment-swh-Muhammad 56.1932 Sentiment-tam-Chakravarthi 75.9004 Sentiment-tel-Marreddy 67.136 Sentiment-tha-Suriyawongkul 71.9949 Sentiment-tso-Muhammad 52.4687 Sentiment-Tw-eng-Thelwall 91.4 Sentiment-twi-Muhammad 65.4313 Sentiment-yor-Muhammad 66.7096 Sentiment-yor-Shode 85.3931 Sentiment-Yt-eng-Thelwall 92.8667 Sentiment-zho-Tan 96.8541 Sentiment-zho-Wan 98.6664 Sexism-fre-Chiril 79.9642 Subject-ita-Basile 77.7071 Subject-ita-Basile 71.6492 Subjective-ces-Priban 91.6 Subjective-kor-Jang 37.7843 Subjective-spa-Barbieri 75.5373 Subjevtive-eng-Pang 94.5333
4	Finetuned LMs	XLM-Twitter		70.2662		2023-11-01 11:37:10
Submission (Finetuned LMs) Model (XLM-Twitter) Results Task Score Task Score Task Score Task Score Aggressive-hin-Kumar 74.4742 Dangerous-ara-Alshehri 67.1497 Emotion-ara-Abdul 65.2368 Emotion-ara-Mohammad 84.6881 Emotion-ben-Iqbal 60.9798 Emotion-deu-Bianchi 79.3861 Emotion-eng-Demszky 53.8012 Emotion-eng-Mohammad 79.41 Emotion-eng-Plaza 49.9044 Emotion-eng-Wallbott 69.3946 Emotion-fas-Sabri 24.7268 Emotion-fin-Kajava 57.1841 Emotion-fin-Ohman 49.028 Emotion-fre-Bianchi 83.1417 Emotion-fre-Kajava 60.0442 Emotion-hin-Debaditya 51.1326 Emotion-ind-Saputri 78.3198 Emotion-ind-Wilie 72.1336 Emotion-ita-Bianchi 68.9658 Emotion-ita-Kajava 59.3219 Emotion-por-Cortiz 77.2545 Emotion-ron-Ciobotaru 89.8729 Emotion-rus-Sboev 81.8983 Emotion-spa-Mohammad 83.4984 Emotion-spa-Plaza 54.966 Emotion-tur-Guven 98.75 Emotion-vie-Ho 62.5013 Emotion-zho-Lee 68.8198 Hate-ara-Alakrot 84.2685 Hate-ara-Mubarak 78.1985 Hate-ara-Mulki 72.3187 Hate-eng-Basile 54.8284 Hate-eng-Davidson 91.5751 Hate-eng-Waseem 89.1202 Hate-fil-Cabasag 78.9106 Hate-Group-ara-Ousidhoum 49.2936 Hate-Group-fre-Ousidhoum 38.7428 Hate-ita-Bosco 79.8863 Hate-kor-Jeong 79.396 Hate-kor-Moon 63.9905 Hate-pol-Ptaszynski 71.7334 Hate-por-Fortuna 72.5391 Hate-spa-Basile 77.3651 Hate-Target-ara-Ousidhoum 49.2942 Hate-Target-ben-Karim 85.2778 Hate-Target-fre-Ousidhoum 44.2451 Hate-Target-kor-Jeong 51.3522 Hate-tel-Marreddy 49.8159 Hate-zho-Deng 83.3818 Humor-eng-Meaney 91.4821 Humor-hin-Aggarwal 79.8 Humor-rus-Blinov 86.7984 Humor-spa-Chiruzzo 86.732 Irony-ara-Ghanem 81.3179 Irony-eng-Hee 67.8378 Irony-fas-Golazizian 73.0159 Irony-hin-Vijay 71.1992 Irony-ita-Basile 63.5828 Irony-ita-Cignarella 73.3818 Irony-spa-Barbieri 56.5513 Irony-spa-Ortega 71.2292 Irony-Type-eng-Hee 51.3864 Irony-zho-Xiang 30.9597 Offense-Target-kan-Chakravarthi 42.9539 Offense-Target-kan-Chakravarthi 78.1695 Offense-Target-kan-Chakravarthi 39.2197 Offense-Target-mal-Chakravarthi 42.9539 Offense-Target-mal-Chakravarthi 78.1695 Offense-Target-mal-Chakravarthi 39.2197 Offense-Target-tam-Chakravarthi 42.9539 Offense-Target-tam-Chakravarthi 78.1695 Offense-Target-tam-Chakravarthi 39.2197 Offensive-ara-Mubarak 89.534 Offensive-ara-Zampieri 87.8035 Offensive-dan-Zampieri 78.6303 Offensive-ell-Zampieri 78.8908 Offensive-eng-Zampieri 77.0701 Offensive-Group-eng-Zampieri 57.4907 Offensive-slv-Novak 55.0319 Offensive-Target-eng-Zampieri 74.647 Offensive-tur-Zampieri 76.2298 Sarcasm-ara-Abufarha 73.3587 Sarcasm-ara-Farha 67.2958 Sarcasm-ces-Ptacek 64.0092 Sarcasm-eng-Bamman 80.8667 Sarcasm-eng-Oraby 74.8853 Sarcasm-eng-Ptacek 94.4875 Sarcasm-eng-Rajadesingan 95 Sarcasm-eng-Riloff 56.605 Sarcasm-eng-Walker 63.1402 Sarcasm-zho-Gong 70.7273 Sentiment-5-eng-Socher 53.6 Sentiment-ace-Winata 74.7908 Sentiment-amh-Muhammad 57.4537 Sentiment-ara-Abdul 74.6354 Sentiment-ara-Muhammad 59.6667 Sentiment-arq-Muhammad 70.9273 Sentiment-ary-Muhammad 49.7239 Sentiment-bam-Diallo 65.0999 Sentiment-ban-Winata 79.7713 Sentiment-bbc-Winata 73.5552 Sentiment-ben-Islam 67.8919 Sentiment-ben-Patra 56.1281 Sentiment-bjn-Winata 79.4302 Sentiment-bos-Mozetic 67.2158 Sentiment-bug-Winata 71.6028 Sentiment-bul-Mozetic 64.9674 Sentiment-deu-Mozetic 61.735 Sentiment-deu-Rei 54.6099 Sentiment-eng-Mozetic 68.7347 Sentiment-eng-Pang 87.2 Sentiment-eng-Rosenthal 68.799 Sentiment-eng-Socher 88.2 Sentiment-fas-Ashrafi 84.6543 Sentiment-fin-Kajava 82.3831 Sentiment-fre-Kajava 85.3434 Sentiment-hau-Muhammad 72.8134 Sentiment-heb-Amram 94.8 Sentiment-hin-Patra 60.9462 Sentiment-hrv-Mozetic 67.414 Sentiment-hun-Mozetic 68.7487 Sentiment-ibo-Muhammad 76.8566 Sentiment-ind-Wilie 91.8859 Sentiment-ita-Basile 85.2386 Sentiment-ita-Basile 74.09 Sentiment-ita-Kajava 84.747 Sentiment-ita-Rei 50.8769 Sentiment-jav-Winata 84.0502 Sentiment-jpn-Suzuki 59.1333 Sentiment-kan-Chakravarthi 80.6776 Sentiment-kin-Muhammad 57.317 Sentiment-kor-Jang 39.8843 Sentiment-mad-Winata 74.0291 Sentiment-mal-Chakravarthi 84.2285 Sentiment-mar-Kulkarni 84.9333 Sentiment-min-Winata 81.5811 Sentiment-mlt-Dingli 61.4941 Sentiment-nij-Winata 76.1783 Sentiment-nor-Velldal 42.9481 Sentiment-pcm-Muhammad 63.2135 Sentiment-pcm-Oyewusi 67.1534 Sentiment-pol-Kocon 78.1366 Sentiment-pol-Mozetic 69.1856 Sentiment-pol-Rybak 54.2189 Sentiment-por-Brum 59.1729 Sentiment-por-Mozetic 56.4476 Sentiment-ron-Dumitrescu 85.997 Sentiment-rus-Mozetic 77.655 Sentiment-slk-Mozetic 73.2703 Sentiment-slv-Mozetic 61.8699 Sentiment-spa-Mozetic 57.1888 Sentiment-spa-Rei 49.0494 Sentiment-sqi-Mozetic 45.5487 Sentiment-srp-Mozetic 56.4793 Sentiment-sun-Winata 78.3198 Sentiment-swe-Mozetic 70.4815 Sentiment-swh-Muhammad 58.5453 Sentiment-tam-Chakravarthi 76.9404 Sentiment-tel-Marreddy 66.0929 Sentiment-tha-Suriyawongkul 71.887 Sentiment-tso-Muhammad 53.7627 Sentiment-Tw-eng-Thelwall 89.6 Sentiment-twi-Muhammad 65.9731 Sentiment-yor-Muhammad 65.2847 Sentiment-yor-Shode 85.7783 Sentiment-Yt-eng-Thelwall 93.2 Sentiment-zho-Tan 96.6511 Sentiment-zho-Wan 98.9997 Sexism-fre-Chiril 81.8831 Subject-ita-Basile 79.306 Subject-ita-Basile 71.6795 Subjective-ces-Priban 92.5333 Subjective-kor-Jang 36.1484 Subjective-spa-Barbieri 76.5084 Subjevtive-eng-Pang 95
5	Finetuned LMs	TwHIN-BERT		69.6956		2023-11-01 11:37:10
Submission (Finetuned LMs) Model (TwHIN-BERT) Results Task Score Task Score Task Score Task Score Aggressive-hin-Kumar 74.3525 Dangerous-ara-Alshehri 65.4244 Emotion-ara-Abdul 63.9976 Emotion-ara-Mohammad 83.1294 Emotion-ben-Iqbal 62.7142 Emotion-deu-Bianchi 78.9548 Emotion-eng-Demszky 55.5378 Emotion-eng-Mohammad 81.4713 Emotion-eng-Plaza 46.4572 Emotion-eng-Wallbott 68.6578 Emotion-fas-Sabri 23.9558 Emotion-fin-Kajava 51.4703 Emotion-fin-Ohman 45.4068 Emotion-fre-Bianchi 82.8076 Emotion-fre-Kajava 55.9573 Emotion-hin-Debaditya 49.2375 Emotion-ind-Saputri 75.7056 Emotion-ind-Wilie 71.7395 Emotion-ita-Bianchi 73.0527 Emotion-ita-Kajava 56.8459 Emotion-por-Cortiz 75.6339 Emotion-ron-Ciobotaru 87.8034 Emotion-rus-Sboev 81.4119 Emotion-spa-Mohammad 83.7343 Emotion-spa-Plaza 53.9282 Emotion-tur-Guven 98.9167 Emotion-vie-Ho 63.2227 Emotion-zho-Lee 69.1388 Hate-ara-Alakrot 83.654 Hate-ara-Mubarak 79.4788 Hate-ara-Mulki 70.538 Hate-eng-Basile 52.0491 Hate-eng-Davidson 91.8036 Hate-eng-Waseem 89.3121 Hate-fil-Cabasag 80.2842 Hate-Group-ara-Ousidhoum 47.8725 Hate-Group-fre-Ousidhoum 37.6562 Hate-ita-Bosco 77.6412 Hate-kor-Jeong 80.8502 Hate-kor-Moon 62.0576 Hate-pol-Ptaszynski 72.1996 Hate-por-Fortuna 72.3896 Hate-spa-Basile 77.5853 Hate-Target-ara-Ousidhoum 50.8849 Hate-Target-ben-Karim 84.5314 Hate-Target-fre-Ousidhoum 44.6802 Hate-Target-kor-Jeong 64.162 Hate-tel-Marreddy 49.7824 Hate-zho-Deng 83.3988 Humor-eng-Meaney 92.4238 Humor-hin-Aggarwal 79.6 Humor-rus-Blinov 87.131 Humor-spa-Chiruzzo 86.1322 Irony-ara-Ghanem 81.6553 Irony-eng-Hee 65.7501 Irony-fas-Golazizian 71.2018 Irony-hin-Vijay 72.428 Irony-ita-Basile 66.1162 Irony-ita-Cignarella 71.2862 Irony-spa-Barbieri 62.3556 Irony-spa-Ortega 70.5407 Irony-Type-eng-Hee 52.1609 Irony-zho-Xiang 31.5096 Offense-Target-kan-Chakravarthi 43.7351 Offense-Target-kan-Chakravarthi 77.177 Offense-Target-kan-Chakravarthi 38.4098 Offense-Target-mal-Chakravarthi 43.7351 Offense-Target-mal-Chakravarthi 77.177 Offense-Target-mal-Chakravarthi 38.4098 Offense-Target-tam-Chakravarthi 43.7351 Offense-Target-tam-Chakravarthi 77.177 Offense-Target-tam-Chakravarthi 38.4098 Offensive-ara-Mubarak 89.5483 Offensive-ara-Zampieri 89.8729 Offensive-dan-Zampieri 76.5849 Offensive-ell-Zampieri 76.998 Offensive-eng-Zampieri 76.0742 Offensive-Group-eng-Zampieri 56.4842 Offensive-slv-Novak 62.6408 Offensive-Target-eng-Zampieri 74.8689 Offensive-tur-Zampieri 79.5932 Sarcasm-ara-Abufarha 71.6758 Sarcasm-ara-Farha 70.6109 Sarcasm-ces-Ptacek 64.9002 Sarcasm-eng-Bamman 82.3333 Sarcasm-eng-Oraby 74.4968 Sarcasm-eng-Ptacek 94.7614 Sarcasm-eng-Rajadesingan 95.2667 Sarcasm-eng-Riloff 53.5636 Sarcasm-eng-Walker 63.8246 Sarcasm-zho-Gong 69.4805 Sentiment-5-eng-Socher 51.5333 Sentiment-ace-Winata 71.5461 Sentiment-amh-Muhammad 66.6 Sentiment-ara-Abdul 77.6051 Sentiment-ara-Muhammad 56.8667 Sentiment-arq-Muhammad 63.1467 Sentiment-ary-Muhammad 49.9876 Sentiment-bam-Diallo 63.6916 Sentiment-ban-Winata 74.3692 Sentiment-bbc-Winata 70.9465 Sentiment-ben-Islam 66.8593 Sentiment-ben-Patra 55.6542 Sentiment-bjn-Winata 77.1296 Sentiment-bos-Mozetic 66.2823 Sentiment-bug-Winata 70.7888 Sentiment-bul-Mozetic 64.7161 Sentiment-deu-Mozetic 61.0751 Sentiment-deu-Rei 55.4824 Sentiment-eng-Mozetic 67.9389 Sentiment-eng-Pang 85.5333 Sentiment-eng-Rosenthal 69.1174 Sentiment-eng-Socher 87.4667 Sentiment-fas-Ashrafi 84.7255 Sentiment-fin-Kajava 78.1968 Sentiment-fre-Kajava 82.6529 Sentiment-hau-Muhammad 72.8568 Sentiment-heb-Amram 94.6667 Sentiment-hin-Patra 60.8642 Sentiment-hrv-Mozetic 66.1016 Sentiment-hun-Mozetic 69.5043 Sentiment-ibo-Muhammad 75.5226 Sentiment-ind-Wilie 90.9727 Sentiment-ita-Basile 83.1511 Sentiment-ita-Basile 79.8508 Sentiment-ita-Kajava 86.0511 Sentiment-ita-Rei 48.0776 Sentiment-jav-Winata 77.7413 Sentiment-jpn-Suzuki 61.8667 Sentiment-kan-Chakravarthi 81.5862 Sentiment-kin-Muhammad 59.8569 Sentiment-kor-Jang 36.2895 Sentiment-mad-Winata 69.887 Sentiment-mal-Chakravarthi 83.9996 Sentiment-mar-Kulkarni 86 Sentiment-min-Winata 77.3888 Sentiment-mlt-Dingli 60.8917 Sentiment-nij-Winata 73.1243 Sentiment-nor-Velldal 38.7853 Sentiment-pcm-Muhammad 63.974 Sentiment-pcm-Oyewusi 68.0159 Sentiment-pol-Kocon 71.3254 Sentiment-pol-Mozetic 67.9101 Sentiment-pol-Rybak 49.7645 Sentiment-por-Brum 59.0795 Sentiment-por-Mozetic 57.0385 Sentiment-ron-Dumitrescu 85.0503 Sentiment-rus-Mozetic 77.7503 Sentiment-slk-Mozetic 72.3407 Sentiment-slv-Mozetic 61.5322 Sentiment-spa-Mozetic 56.2579 Sentiment-spa-Rei 51.6208 Sentiment-sqi-Mozetic 44.4185 Sentiment-srp-Mozetic 57.1329 Sentiment-sun-Winata 74.6026 Sentiment-swe-Mozetic 70.2541 Sentiment-swh-Muhammad 57.2039 Sentiment-tam-Chakravarthi 73.7786 Sentiment-tel-Marreddy 68.6057 Sentiment-tha-Suriyawongkul 71.9034 Sentiment-tso-Muhammad 50.5103 Sentiment-Tw-eng-Thelwall 85.1333 Sentiment-twi-Muhammad 64.5698 Sentiment-yor-Muhammad 64.9308 Sentiment-yor-Shode 82.1305 Sentiment-Yt-eng-Thelwall 90.4 Sentiment-zho-Tan 96.7898 Sentiment-zho-Wan 98.9997 Sexism-fre-Chiril 82.2731 Subject-ita-Basile 78.5487 Subject-ita-Basile 71.4277 Subjective-ces-Priban 90.1333 Subjective-kor-Jang 33.1785 Subjective-spa-Barbieri 74.4173 Subjevtive-eng-Pang 93.9333
6	Finetuned LMs	XLM-RoBERTa-Base		69.3828		2023-11-01 11:37:10
Submission (Finetuned LMs) Model (XLM-RoBERTa-Base) Results Task Score Task Score Task Score Task Score Aggressive-hin-Kumar 74.6396 Dangerous-ara-Alshehri 63.5674 Emotion-ara-Abdul 59.6951 Emotion-ara-Mohammad 83.1892 Emotion-ben-Iqbal 59.5745 Emotion-deu-Bianchi 78.2141 Emotion-eng-Demszky 52.5811 Emotion-eng-Mohammad 78.3015 Emotion-eng-Plaza 46.4915 Emotion-eng-Wallbott 69.2389 Emotion-fas-Sabri 21.3169 Emotion-fin-Kajava 58.6095 Emotion-fin-Ohman 49.8239 Emotion-fre-Bianchi 79.9829 Emotion-fre-Kajava 58.2311 Emotion-hin-Debaditya 50.1728 Emotion-ind-Saputri 76.9255 Emotion-ind-Wilie 73.3872 Emotion-ita-Bianchi 67.764 Emotion-ita-Kajava 59.3467 Emotion-por-Cortiz 73.9275 Emotion-ron-Ciobotaru 91.24 Emotion-rus-Sboev 83.1669 Emotion-spa-Mohammad 82.2748 Emotion-spa-Plaza 52.2811 Emotion-tur-Guven 98.5 Emotion-vie-Ho 63.5016 Emotion-zho-Lee 70.8134 Hate-ara-Alakrot 81.2298 Hate-ara-Mubarak 79.6664 Hate-ara-Mulki 67.1166 Hate-eng-Basile 51.8742 Hate-eng-Davidson 92.9558 Hate-eng-Waseem 89.3298 Hate-fil-Cabasag 78.4046 Hate-Group-ara-Ousidhoum 37.1136 Hate-Group-fre-Ousidhoum 34.6091 Hate-ita-Bosco 76.958 Hate-kor-Jeong 78.5037 Hate-kor-Moon 63.1707 Hate-pol-Ptaszynski 70.2553 Hate-por-Fortuna 70.0163 Hate-spa-Basile 76.26 Hate-Target-ara-Ousidhoum 52.9404 Hate-Target-ben-Karim 85.3051 Hate-Target-fre-Ousidhoum 43.3855 Hate-Target-kor-Jeong 66.4336 Hate-tel-Marreddy 49.7824 Hate-zho-Deng 83.3586 Humor-eng-Meaney 89.8613 Humor-hin-Aggarwal 78.8667 Humor-rus-Blinov 87.5988 Humor-spa-Chiruzzo 84.4496 Irony-ara-Ghanem 83.9505 Irony-eng-Hee 63.4302 Irony-fas-Golazizian 74.6032 Irony-hin-Vijay 73.2472 Irony-ita-Basile 61.5351 Irony-ita-Cignarella 72.6571 Irony-spa-Barbieri 58.0072 Irony-spa-Ortega 71.1768 Irony-Type-eng-Hee 46.4279 Irony-zho-Xiang 31.1896 Offense-Target-kan-Chakravarthi 38.7761 Offense-Target-kan-Chakravarthi 74.2218 Offense-Target-kan-Chakravarthi 36.2456 Offense-Target-mal-Chakravarthi 38.7761 Offense-Target-mal-Chakravarthi 74.2218 Offense-Target-mal-Chakravarthi 36.2456 Offense-Target-tam-Chakravarthi 38.7761 Offense-Target-tam-Chakravarthi 74.2218 Offense-Target-tam-Chakravarthi 36.2456 Offensive-ara-Mubarak 86.4385 Offensive-ara-Zampieri 86.8783 Offensive-dan-Zampieri 76.1091 Offensive-ell-Zampieri 76.9078 Offensive-eng-Zampieri 75.1021 Offensive-Group-eng-Zampieri 55.4434 Offensive-slv-Novak 52.8339 Offensive-Target-eng-Zampieri 64.0401 Offensive-tur-Zampieri 76.8993 Sarcasm-ara-Abufarha 69.5681 Sarcasm-ara-Farha 68.4483 Sarcasm-ces-Ptacek 60.1656 Sarcasm-eng-Bamman 80.4 Sarcasm-eng-Oraby 75.8721 Sarcasm-eng-Ptacek 95.7637 Sarcasm-eng-Rajadesingan 95.3333 Sarcasm-eng-Riloff 52.4981 Sarcasm-eng-Walker 65.3593 Sarcasm-zho-Gong 70.6346 Sentiment-5-eng-Socher 53.9333 Sentiment-ace-Winata 74.1911 Sentiment-amh-Muhammad 60.3246 Sentiment-ara-Abdul 75.7481 Sentiment-ara-Muhammad 56.4 Sentiment-arq-Muhammad 65.0878 Sentiment-ary-Muhammad 50.2095 Sentiment-bam-Diallo 58.4554 Sentiment-ban-Winata 74.7922 Sentiment-bbc-Winata 65.565 Sentiment-ben-Islam 67.9863 Sentiment-ben-Patra 58.2847 Sentiment-bjn-Winata 79.8187 Sentiment-bos-Mozetic 68.1226 Sentiment-bug-Winata 67.7155 Sentiment-bul-Mozetic 64.2168 Sentiment-deu-Mozetic 61.542 Sentiment-deu-Rei 52.9869 Sentiment-eng-Mozetic 68.5281 Sentiment-eng-Pang 86.0667 Sentiment-eng-Rosenthal 67.4972 Sentiment-eng-Socher 88.4 Sentiment-fas-Ashrafi 84.7965 Sentiment-fin-Kajava 83.4757 Sentiment-fre-Kajava 84.21 Sentiment-hau-Muhammad 73.4381 Sentiment-heb-Amram 95.2667 Sentiment-hin-Patra 58.3081 Sentiment-hrv-Mozetic 69.4386 Sentiment-hun-Mozetic 71.6167 Sentiment-ibo-Muhammad 76.5249 Sentiment-ind-Wilie 92.0597 Sentiment-ita-Basile 85.2166 Sentiment-ita-Basile 78.5121 Sentiment-ita-Kajava 85.6969 Sentiment-ita-Rei 49.5704 Sentiment-jav-Winata 83.4425 Sentiment-jpn-Suzuki 59.6667 Sentiment-kan-Chakravarthi 80.5461 Sentiment-kin-Muhammad 57.4392 Sentiment-kor-Jang 42.5607 Sentiment-mad-Winata 73.358 Sentiment-mal-Chakravarthi 83.4994 Sentiment-mar-Kulkarni 86.4 Sentiment-min-Winata 80.8866 Sentiment-mlt-Dingli 39.7929 Sentiment-nij-Winata 73.4731 Sentiment-nor-Velldal 51.1497 Sentiment-pcm-Muhammad 62.4425 Sentiment-pcm-Oyewusi 66.8626 Sentiment-pol-Kocon 76.0311 Sentiment-pol-Mozetic 66.9628 Sentiment-pol-Rybak 53.9807 Sentiment-por-Brum 60.0005 Sentiment-por-Mozetic 56.2061 Sentiment-ron-Dumitrescu 88.6014 Sentiment-rus-Mozetic 78.3478 Sentiment-slk-Mozetic 74.7792 Sentiment-slv-Mozetic 61.5664 Sentiment-spa-Mozetic 55.7955 Sentiment-spa-Rei 51.2643 Sentiment-sqi-Mozetic 46.4164 Sentiment-srp-Mozetic 56.6208 Sentiment-sun-Winata 76.6122 Sentiment-swe-Mozetic 68.8442 Sentiment-swh-Muhammad 61.1546 Sentiment-tam-Chakravarthi 75.9774 Sentiment-tel-Marreddy 69.4442 Sentiment-tha-Suriyawongkul 72.1788 Sentiment-tso-Muhammad 48.5585 Sentiment-Tw-eng-Thelwall 88.7333 Sentiment-twi-Muhammad 64.2939 Sentiment-yor-Muhammad 64.3761 Sentiment-yor-Shode 83.6945 Sentiment-Yt-eng-Thelwall 90.8 Sentiment-zho-Tan 95.8476 Sentiment-zho-Wan 98.9997 Sexism-fre-Chiril 81.0072 Subject-ita-Basile 77.1843 Subject-ita-Basile 71.3414 Subjective-ces-Priban 92.1333 Subjective-kor-Jang 36.9916 Subjective-spa-Barbieri 73.9234 Subjevtive-eng-Pang 95.1333
7	Finetuned LMs	mBERT		66.5981		2023-11-01 11:37:10
Submission (Finetuned LMs) Model (mBERT) Results Task Score Task Score Task Score Task Score Aggressive-hin-Kumar 72.7094 Dangerous-ara-Alshehri 62.356 Emotion-ara-Abdul 57.7729 Emotion-ara-Mohammad 72.9299 Emotion-ben-Iqbal 53.7939 Emotion-deu-Bianchi 71.3462 Emotion-eng-Demszky 53.7512 Emotion-eng-Mohammad 70.8967 Emotion-eng-Plaza 39.0881 Emotion-eng-Wallbott 65.3538 Emotion-fas-Sabri 21.4871 Emotion-fin-Kajava 46.1543 Emotion-fin-Ohman 41.7402 Emotion-fre-Bianchi 75.0666 Emotion-fre-Kajava 49.9898 Emotion-hin-Debaditya 45.4229 Emotion-ind-Saputri 63.5815 Emotion-ind-Wilie 63.0964 Emotion-ita-Bianchi 66.4701 Emotion-ita-Kajava 54.6137 Emotion-por-Cortiz 72.0922 Emotion-ron-Ciobotaru 87.6288 Emotion-rus-Sboev 76.4928 Emotion-spa-Mohammad 78.5339 Emotion-spa-Plaza 50.8861 Emotion-tur-Guven 98.25 Emotion-vie-Ho 54.6289 Emotion-zho-Lee 65.8692 Hate-ara-Alakrot 82.0694 Hate-ara-Mubarak 73.925 Hate-ara-Mulki 69.3754 Hate-eng-Basile 50.2434 Hate-eng-Davidson 91.2792 Hate-eng-Waseem 87.7364 Hate-fil-Cabasag 74.3758 Hate-Group-ara-Ousidhoum 46.7127 Hate-Group-fre-Ousidhoum 37.3461 Hate-ita-Bosco 75.6674 Hate-kor-Jeong 79.0314 Hate-kor-Moon 57.1017 Hate-pol-Ptaszynski 69.6865 Hate-por-Fortuna 70.0804 Hate-spa-Basile 74.181 Hate-Target-ara-Ousidhoum 48.3192 Hate-Target-ben-Karim 83.564 Hate-Target-fre-Ousidhoum 45.8759 Hate-Target-kor-Jeong 60.9766 Hate-tel-Marreddy 49.8998 Hate-zho-Deng 83.29 Humor-eng-Meaney 87.1879 Humor-hin-Aggarwal 78.2667 Humor-rus-Blinov 86.4663 Humor-spa-Chiruzzo 85.4633 Irony-ara-Ghanem 82.1913 Irony-eng-Hee 59.9867 Irony-fas-Golazizian 74.0363 Irony-hin-Vijay 70.8993 Irony-ita-Basile 63.375 Irony-ita-Cignarella 70.3667 Irony-spa-Barbieri 57.9026 Irony-spa-Ortega 67.4244 Irony-Type-eng-Hee 47.3488 Irony-zho-Xiang 31.9621 Offense-Target-kan-Chakravarthi 42.1349 Offense-Target-kan-Chakravarthi 42.1217 Offense-Target-kan-Chakravarthi 38.6998 Offense-Target-mal-Chakravarthi 42.1349 Offense-Target-mal-Chakravarthi 42.1217 Offense-Target-mal-Chakravarthi 38.6998 Offense-Target-tam-Chakravarthi 42.1349 Offense-Target-tam-Chakravarthi 42.1217 Offense-Target-tam-Chakravarthi 38.6998 Offensive-ara-Mubarak 86.845 Offensive-ara-Zampieri 86.2732 Offensive-dan-Zampieri 77.5317 Offensive-ell-Zampieri 80.6361 Offensive-eng-Zampieri 75.074 Offensive-Group-eng-Zampieri 54.4866 Offensive-slv-Novak 63.2293 Offensive-Target-eng-Zampieri 63.6084 Offensive-tur-Zampieri 73.1086 Sarcasm-ara-Abufarha 69.0587 Sarcasm-ara-Farha 66.8688 Sarcasm-ces-Ptacek 66.1225 Sarcasm-eng-Bamman 79.7333 Sarcasm-eng-Oraby 72.7302 Sarcasm-eng-Ptacek 94.2818 Sarcasm-eng-Rajadesingan 94.2 Sarcasm-eng-Riloff 46.7595 Sarcasm-eng-Walker 63.3154 Sarcasm-zho-Gong 71.0134 Sentiment-5-eng-Socher 49.7333 Sentiment-ace-Winata 76.586 Sentiment-amh-Muhammad 24.9334 Sentiment-ara-Abdul 71.9639 Sentiment-ara-Muhammad 48.7333 Sentiment-arq-Muhammad 57.1563 Sentiment-ary-Muhammad 46.5579 Sentiment-bam-Diallo 64.2756 Sentiment-ban-Winata 75.9647 Sentiment-bbc-Winata 72.6557 Sentiment-ben-Islam 62.9515 Sentiment-ben-Patra 54.2049 Sentiment-bjn-Winata 75.8064 Sentiment-bos-Mozetic 64.7524 Sentiment-bug-Winata 74.5701 Sentiment-bul-Mozetic 62.0068 Sentiment-deu-Mozetic 61.6299 Sentiment-deu-Rei 47.0511 Sentiment-eng-Mozetic 62.8123 Sentiment-eng-Pang 81.6 Sentiment-eng-Rosenthal 64.5188 Sentiment-eng-Socher 84.4667 Sentiment-fas-Ashrafi 82.7048 Sentiment-fin-Kajava 78.8779 Sentiment-fre-Kajava 78.4387 Sentiment-hau-Muhammad 69.9436 Sentiment-heb-Amram 93.2667 Sentiment-hin-Patra 55.4579 Sentiment-hrv-Mozetic 64.7864 Sentiment-hun-Mozetic 67.2712 Sentiment-ibo-Muhammad 76.3685 Sentiment-ind-Wilie 88.2784 Sentiment-ita-Basile 78.0601 Sentiment-ita-Basile 66.6781 Sentiment-ita-Kajava 79.2138 Sentiment-ita-Rei 47.2907 Sentiment-jav-Winata 76.083 Sentiment-jpn-Suzuki 54.3333 Sentiment-kan-Chakravarthi 78.9198 Sentiment-kin-Muhammad 55.3203 Sentiment-kor-Jang 38.6434 Sentiment-mad-Winata 70.5641 Sentiment-mal-Chakravarthi 83.9988 Sentiment-mar-Kulkarni 84 Sentiment-min-Winata 77.2464 Sentiment-mlt-Dingli 63.1418 Sentiment-nij-Winata 73.8217 Sentiment-nor-Velldal 41.0497 Sentiment-pcm-Muhammad 60.8215 Sentiment-pcm-Oyewusi 65.1132 Sentiment-pol-Kocon 70.9898 Sentiment-pol-Mozetic 67.0874 Sentiment-pol-Rybak 45.4505 Sentiment-por-Brum 59.0465 Sentiment-por-Mozetic 57.1444 Sentiment-ron-Dumitrescu 84.066 Sentiment-rus-Mozetic 75.2438 Sentiment-slk-Mozetic 71.7802 Sentiment-slv-Mozetic 59.5333 Sentiment-spa-Mozetic 51.3943 Sentiment-spa-Rei 39.5899 Sentiment-sqi-Mozetic 43.0725 Sentiment-srp-Mozetic 53.1615 Sentiment-sun-Winata 75.3198 Sentiment-swe-Mozetic 64.6137 Sentiment-swh-Muhammad 53.043 Sentiment-tam-Chakravarthi 70.9054 Sentiment-tel-Marreddy 65.1999 Sentiment-tha-Suriyawongkul 65.0719 Sentiment-tso-Muhammad 42.6424 Sentiment-Tw-eng-Thelwall 79.2 Sentiment-twi-Muhammad 63.3157 Sentiment-yor-Muhammad 67.8732 Sentiment-yor-Shode 86.8636 Sentiment-Yt-eng-Thelwall 86 Sentiment-zho-Tan 95.7234 Sentiment-zho-Wan 98.7998 Sexism-fre-Chiril 79.6031 Subject-ita-Basile 74.0228 Subject-ita-Basile 68.0972 Subjective-ces-Priban 90.6667 Subjective-kor-Jang 36.5324 Subjective-spa-Barbieri 70.9503 Subjevtive-eng-Pang 95
8	Zero-shot	Chatgpt		60.0443		2023-11-01 11:37:10
Submission (Zero-shot) Model (Chatgpt) Results Task Score Task Score Task Score Task Score Aggressive-hin-Kumar 63.5344 Dangerous-ara-Alshehri 37.9306 Emotion-ara-Abdul 32.0946 Emotion-ara-Mohammad 80.5659 Emotion-ben-Iqbal 53.2346 Emotion-deu-Bianchi 76.0748 Emotion-eng-Demszky 32.6078 Emotion-eng-Mohammad 74.4423 Emotion-eng-Plaza 40.7283 Emotion-eng-Wallbott 68.0573 Emotion-fas-Sabri 28.5941 Emotion-fin-Kajava 52.7861 Emotion-fin-Ohman 52.9447 Emotion-fre-Bianchi 79.0198 Emotion-fre-Kajava 58.2923 Emotion-hin-Debaditya 31.3122 Emotion-ind-Saputri 77.515 Emotion-ind-Wilie 74.8654 Emotion-ita-Bianchi 73.6608 Emotion-ita-Kajava 60.5345 Emotion-por-Cortiz 8.72307 Emotion-ron-Ciobotaru 84.7383 Emotion-rus-Sboev 79.617 Emotion-spa-Mohammad 75.8855 Emotion-spa-Plaza 40.5107 Emotion-tur-Guven 89.5 Emotion-vie-Ho 54.6937 Emotion-zho-Lee 68.1818 Hate-ara-Alakrot 63.9587 Hate-ara-Mubarak 60.7248 Hate-ara-Mulki 61.1258 Hate-eng-Basile 63.6883 Hate-eng-Davidson 69.5765 Hate-eng-Waseem 79.9793 Hate-fil-Cabasag 69.132 Hate-Group-ara-Ousidhoum 35.0456 Hate-Group-fre-Ousidhoum 32.4088 Hate-ita-Bosco 77.9793 Hate-kor-Jeong 63.6064 Hate-kor-Moon 39.7927 Hate-pol-Ptaszynski 77.0219 Hate-por-Fortuna 68.4466 Hate-spa-Basile 64.9284 Hate-Target-ara-Ousidhoum 44.533 Hate-Target-ben-Karim 49.0256 Hate-Target-fre-Ousidhoum 39.9799 Hate-Target-kor-Jeong 41.3548 Hate-tel-Marreddy 49.8998 Hate-zho-Deng 72.3421 Humor-eng-Meaney 89.5578 Humor-hin-Aggarwal 56 Humor-rus-Blinov 72.7472 Humor-spa-Chiruzzo 68.2799 Irony-ara-Ghanem 68.7755 Irony-eng-Hee 59 Irony-fas-Golazizian 62.585 Irony-hin-Vijay 52.8912 Irony-ita-Basile 59.9097 Irony-ita-Cignarella 73.3222 Irony-spa-Barbieri 66.1047 Irony-spa-Ortega 62.9206 Irony-Type-eng-Hee 30.8136 Irony-zho-Xiang 18.5828 Offense-Target-kan-Chakravarthi 21.187 Offense-Target-kan-Chakravarthi 19.3181 Offense-Target-kan-Chakravarthi 25.724 Offense-Target-mal-Chakravarthi 21.187 Offense-Target-mal-Chakravarthi 19.3181 Offense-Target-mal-Chakravarthi 25.724 Offense-Target-tam-Chakravarthi 21.187 Offense-Target-tam-Chakravarthi 19.3181 Offense-Target-tam-Chakravarthi 25.724 Offensive-ara-Mubarak 84.4846 Offensive-ara-Zampieri 82.0111 Offensive-dan-Zampieri 66.9148 Offensive-ell-Zampieri 60.9375 Offensive-eng-Zampieri 67.9048 Offensive-Group-eng-Zampieri 51.5162 Offensive-slv-Novak 33.8629 Offensive-Target-eng-Zampieri 45.974 Offensive-tur-Zampieri 75.0302 Sarcasm-ara-Abufarha 74.378 Sarcasm-ara-Farha 66.2387 Sarcasm-ces-Ptacek 51.1953 Sarcasm-eng-Bamman 64.6 Sarcasm-eng-Oraby 73.7823 Sarcasm-eng-Ptacek 74.2981 Sarcasm-eng-Rajadesingan 74.6 Sarcasm-eng-Riloff 50 Sarcasm-eng-Walker 70.7925 Sarcasm-zho-Gong 53.4969 Sentiment-5-eng-Socher 49.6 Sentiment-ace-Winata 52.6269 Sentiment-amh-Muhammad 20.617 Sentiment-ara-Abdul 61.9022 Sentiment-ara-Muhammad 58.4 Sentiment-arq-Muhammad 63.8888 Sentiment-ary-Muhammad 52.1855 Sentiment-bam-Diallo 40.2677 Sentiment-ban-Winata 60.9115 Sentiment-bbc-Winata 38.4331 Sentiment-ben-Islam 55.759 Sentiment-ben-Patra 54.9967 Sentiment-bjn-Winata 69.3433 Sentiment-bos-Mozetic 63.2217 Sentiment-bug-Winata 34.634 Sentiment-bul-Mozetic 59.3213 Sentiment-deu-Mozetic 49.6973 Sentiment-deu-Rei 30.9495 Sentiment-eng-Mozetic 60.6052 Sentiment-eng-Pang 88.4 Sentiment-eng-Rosenthal 69.9356 Sentiment-eng-Socher 91.8 Sentiment-fas-Ashrafi 73.8723 Sentiment-fin-Kajava 83.7714 Sentiment-fre-Kajava 87.9566 Sentiment-hau-Muhammad 55.5164 Sentiment-heb-Amram 84.2 Sentiment-hin-Patra 59.4035 Sentiment-hrv-Mozetic 62.0223 Sentiment-hun-Mozetic 53.2232 Sentiment-ibo-Muhammad 57.5544 Sentiment-ind-Wilie 73.494 Sentiment-ita-Basile 87.2593 Sentiment-ita-Basile 83.0898 Sentiment-ita-Kajava 86.031 Sentiment-ita-Rei 25.3878 Sentiment-jav-Winata 73.0307 Sentiment-jpn-Suzuki 55.8 Sentiment-kan-Chakravarthi 68.4389 Sentiment-kin-Muhammad 53.7814 Sentiment-kor-Jang 42.3242 Sentiment-mad-Winata 61.0674 Sentiment-mal-Chakravarthi 68.7498 Sentiment-mar-Kulkarni 68.6 Sentiment-min-Winata 69.801 Sentiment-mlt-Dingli 78.4689 Sentiment-nij-Winata 57.6394 Sentiment-nor-Velldal 42.1091 Sentiment-pcm-Muhammad 70.0789 Sentiment-pcm-Oyewusi 52.191 Sentiment-pol-Kocon 50.8636 Sentiment-pol-Mozetic 61.8365 Sentiment-pol-Rybak 43.2974 Sentiment-por-Brum 42.6383 Sentiment-por-Mozetic 44.5956 Sentiment-ron-Dumitrescu 93.4865 Sentiment-rus-Mozetic 61.6673 Sentiment-slk-Mozetic 57.4612 Sentiment-slv-Mozetic 58.6353 Sentiment-spa-Mozetic 39.3909 Sentiment-spa-Rei 25.007 Sentiment-sqi-Mozetic 46.8222 Sentiment-srp-Mozetic 55.842 Sentiment-sun-Winata 64.9677 Sentiment-swe-Mozetic 60.103 Sentiment-swh-Muhammad 54.395 Sentiment-tam-Chakravarthi 65.9776 Sentiment-tel-Marreddy 56.7686 Sentiment-tha-Suriyawongkul 52.8142 Sentiment-tso-Muhammad 42.5827 Sentiment-Tw-eng-Thelwall 90 Sentiment-twi-Muhammad 51.1202 Sentiment-yor-Muhammad 57.5721 Sentiment-yor-Shode 71.973 Sentiment-Yt-eng-Thelwall 90 Sentiment-zho-Tan 90.1622 Sentiment-zho-Wan 77.8252 Sexism-fre-Chiril 74.8104 Subject-ita-Basile 72.4775 Subject-ita-Basile 73.5103 Subjective-ces-Priban 79.4 Subjective-kor-Jang 27.4114 Subjective-spa-Barbieri 71.3788 Subjevtive-eng-Pang 73.4
9	Zero-shot	Chatgpt with translated prompts		53.7915		2023-11-01 11:37:10
Submission (Zero-shot) Model (Chatgpt with translated prompts) Results Task Score Task Score Task Score Task Score Aggressive-hin-Kumar 54.3618 Dangerous-ara-Alshehri 33.6765 Emotion-ara-Abdul 26.9625 Emotion-ara-Mohammad 71.637 Emotion-ben-Iqbal 42.9928 Emotion-deu-Bianchi 24.0496 Emotion-eng-Demszky 32.6078 Emotion-eng-Mohammad 74.4423 Emotion-eng-Plaza 40.7283 Emotion-eng-Wallbott 68.0573 Emotion-fas-Sabri 27.9352 Emotion-fin-Kajava 46.3617 Emotion-fin-Ohman 43.8738 Emotion-fre-Bianchi 77.8775 Emotion-fre-Kajava 45.1468 Emotion-hin-Debaditya 20.3978 Emotion-ind-Saputri 58.5748 Emotion-ind-Wilie 58.7777 Emotion-ita-Bianchi 64.1515 Emotion-ita-Kajava 38.7904 Emotion-por-Cortiz 9.42624 Emotion-ron-Ciobotaru 58.3966 Emotion-rus-Sboev 76.2304 Emotion-spa-Mohammad 75.338 Emotion-spa-Plaza 43.855 Emotion-tur-Guven 83.75 Emotion-vie-Ho 33.584 Emotion-zho-Lee 66.0287 Hate-ara-Alakrot 52.8526 Hate-ara-Mubarak 52.0445 Hate-ara-Mulki 32.7206 Hate-eng-Basile 63.6883 Hate-eng-Davidson 69.5765 Hate-eng-Waseem 79.9793 Hate-fil-Cabasag 66.6667 Hate-Group-ara-Ousidhoum 12.7189 Hate-Group-fre-Ousidhoum 13.5131 Hate-ita-Bosco 57.6154 Hate-kor-Jeong 58.3648 Hate-kor-Moon 43.8576 Hate-pol-Ptaszynski 64.9565 Hate-por-Fortuna 63.3353 Hate-spa-Basile 54.4345 Hate-Target-ara-Ousidhoum 40.9264 Hate-Target-ben-Karim 46.7291 Hate-Target-fre-Ousidhoum 39.3704 Hate-Target-kor-Jeong 29.6741 Hate-tel-Marreddy 33.6593 Hate-zho-Deng 72.3421 Humor-eng-Meaney 89.5578 Humor-hin-Aggarwal 60.8 Humor-rus-Blinov 71.435 Humor-spa-Chiruzzo 68.8015 Irony-ara-Ghanem 67.3967 Irony-eng-Hee 59 Irony-fas-Golazizian 56.8027 Irony-hin-Vijay 57.9222 Irony-ita-Basile 55.0107 Irony-ita-Cignarella 74.1999 Irony-spa-Barbieri 63.9713 Irony-spa-Ortega 61.6914 Irony-Type-eng-Hee 30.8136 Irony-zho-Xiang 10.0563 Offense-Target-kan-Chakravarthi 8.64345 Offense-Target-kan-Chakravarthi 3.62496 Offense-Target-kan-Chakravarthi 12.784 Offense-Target-mal-Chakravarthi 8.64345 Offense-Target-mal-Chakravarthi 3.62496 Offense-Target-mal-Chakravarthi 12.784 Offense-Target-tam-Chakravarthi 8.64345 Offense-Target-tam-Chakravarthi 3.62496 Offense-Target-tam-Chakravarthi 12.784 Offensive-ara-Mubarak 69.3637 Offensive-ara-Zampieri 67.5222 Offensive-dan-Zampieri 66.7941 Offensive-ell-Zampieri 34.9789 Offensive-eng-Zampieri 67.9048 Offensive-Group-eng-Zampieri 51.5162 Offensive-slv-Novak 16.6735 Offensive-Target-eng-Zampieri 45.974 Offensive-tur-Zampieri 46.8738 Sarcasm-ara-Abufarha 75.4719 Sarcasm-ara-Farha 68.4314 Sarcasm-ces-Ptacek 52.4798 Sarcasm-eng-Bamman 64.6 Sarcasm-eng-Oraby 73.7823 Sarcasm-eng-Ptacek 74.2981 Sarcasm-eng-Rajadesingan 74.6 Sarcasm-eng-Riloff 50 Sarcasm-eng-Walker 70.7925 Sarcasm-zho-Gong 51.0482 Sentiment-5-eng-Socher 49.6 Sentiment-ace-Winata 58.0497 Sentiment-amh-Muhammad 48.1139 Sentiment-ara-Abdul 61.0304 Sentiment-ara-Muhammad 58 Sentiment-arq-Muhammad 67.5892 Sentiment-ary-Muhammad 51.1152 Sentiment-bam-Diallo 35.8273 Sentiment-ban-Winata 41.9833 Sentiment-bbc-Winata 40.646 Sentiment-ben-Islam 28.0735 Sentiment-ben-Patra 29.2028 Sentiment-bjn-Winata 75.4307 Sentiment-bos-Mozetic 51.424 Sentiment-bug-Winata 31.1874 Sentiment-bul-Mozetic 54.3893 Sentiment-deu-Mozetic 45.0622 Sentiment-deu-Rei 32.5295 Sentiment-eng-Mozetic 60.6052 Sentiment-eng-Pang 88.4 Sentiment-eng-Rosenthal 69.9356 Sentiment-eng-Socher 91.8 Sentiment-fas-Ashrafi 68.9162 Sentiment-fin-Kajava 83.7108 Sentiment-fre-Kajava 88.3814 Sentiment-hau-Muhammad 32.9432 Sentiment-heb-Amram 58 Sentiment-hin-Patra 48.3042 Sentiment-hrv-Mozetic 55.6551 Sentiment-hun-Mozetic 43.8908 Sentiment-ibo-Muhammad 36.008 Sentiment-ind-Wilie 73.9803 Sentiment-ita-Basile 86.7874 Sentiment-ita-Basile 85.4423 Sentiment-ita-Kajava 85.0995 Sentiment-ita-Rei 30.6057 Sentiment-jav-Winata 78.5633 Sentiment-jpn-Suzuki 46.6 Sentiment-kan-Chakravarthi 51.8358 Sentiment-kin-Muhammad 29.2235 Sentiment-kor-Jang 37.2682 Sentiment-mad-Winata 61.135 Sentiment-mal-Chakravarthi 57.9584 Sentiment-mar-Kulkarni 50.2 Sentiment-min-Winata 63.1293 Sentiment-mlt-Dingli 78.0039 Sentiment-nij-Winata 57.0681 Sentiment-nor-Velldal 41.2998 Sentiment-pcm-Muhammad 50.9509 Sentiment-pcm-Oyewusi 31.5017 Sentiment-pol-Kocon 41.4509 Sentiment-pol-Mozetic 60.194 Sentiment-pol-Rybak 31.4818 Sentiment-por-Brum 42.6139 Sentiment-por-Mozetic 42.761 Sentiment-ron-Dumitrescu 93.9182 Sentiment-rus-Mozetic 59.2695 Sentiment-slk-Mozetic 55.3437 Sentiment-slv-Mozetic 57.2638 Sentiment-spa-Mozetic 42.4762 Sentiment-spa-Rei 28.5426 Sentiment-sqi-Mozetic 33.8441 Sentiment-srp-Mozetic 51.7341 Sentiment-sun-Winata 68.7619 Sentiment-swe-Mozetic 62.3977 Sentiment-swh-Muhammad 53.839 Sentiment-tam-Chakravarthi 55.926 Sentiment-tel-Marreddy 42.9955 Sentiment-tha-Suriyawongkul 35.6874 Sentiment-tso-Muhammad 33.0021 Sentiment-Tw-eng-Thelwall 90 Sentiment-twi-Muhammad 30.152 Sentiment-yor-Muhammad 33.4316 Sentiment-yor-Shode 49.8512 Sentiment-Yt-eng-Thelwall 90 Sentiment-zho-Tan 88.5897 Sentiment-zho-Wan 79.0792 Sexism-fre-Chiril 70.2904 Subject-ita-Basile 65.7738 Subject-ita-Basile 60.5326 Subjective-ces-Priban 74 Subjective-kor-Jang 15.8319 Subjective-spa-Barbieri 71.2122 Subjevtive-eng-Pang 73.4
10	five-shot in-context learning	Vicuna-7B		41.974		2023-11-01 20:15:13
Submission (five-shot in-context learning) Model (Vicuna-7B) Results Task Score Task Score Task Score Task Score Aggressive-hin-Kumar 55.2733 Dangerous-ara-Alshehri 46.865 Emotion-ara-Abdul 18.7701 Emotion-ara-Mohammad 57.6884 Emotion-ben-Iqbal 19.9417 Emotion-deu-Bianchi 74.2012 Emotion-eng-Demszky 15.0502 Emotion-eng-Mohammad 67.6229 Emotion-eng-Plaza 32.6388 Emotion-eng-Wallbott 67.349 Emotion-fas-Sabri 12.4934 Emotion-fin-Kajava 22.1336 Emotion-fin-Ohman 19.2684 Emotion-fre-Bianchi 69.453 Emotion-fre-Kajava 44.0211 Emotion-hin-Debaditya 12.3626 Emotion-ind-Saputri 50.1269 Emotion-ind-Wilie 46.5879 Emotion-ita-Bianchi 65.4409 Emotion-ita-Kajava 35.5785 Emotion-por-Cortiz 7.43665 Emotion-ron-Ciobotaru 69.6565 Emotion-rus-Sboev 67.1461 Emotion-spa-Mohammad 67.5744 Emotion-spa-Plaza 28.0156 Emotion-tur-Guven 39.5 Emotion-vie-Ho 27.6729 Emotion-zho-Lee 48.8038 Hate-ara-Alakrot 47.7332 Hate-ara-Mubarak 55.1712 Hate-ara-Mulki 31.3903 Hate-eng-Basile 60.0103 Hate-eng-Davidson 25.4305 Hate-eng-Waseem 70.3454 Hate-fil-Cabasag 36.573 Hate-Group-ara-Ousidhoum 9.18067 Hate-Group-fre-Ousidhoum 4.20722 Hate-ita-Bosco 58.2701 Hate-kor-Jeong 47.4354 Hate-kor-Moon 18.5156 Hate-pol-Ptaszynski 54.1131 Hate-por-Fortuna 48.2708 Hate-spa-Basile 60.9002 Hate-Target-ara-Ousidhoum 19.1708 Hate-Target-ben-Karim 17.5199 Hate-Target-fre-Ousidhoum 12.6195 Hate-Target-kor-Jeong 18.3552 Hate-tel-Marreddy 48.2937 Hate-zho-Deng 50.5546 Humor-eng-Meaney 68.0053 Humor-hin-Aggarwal 48.8 Humor-rus-Blinov 49.7161 Humor-spa-Chiruzzo 68.4788 Irony-ara-Ghanem 34.0439 Irony-eng-Hee 21.8341 Irony-fas-Golazizian 56.4626 Irony-hin-Vijay 59.0009 Irony-ita-Basile 55.5211 Irony-ita-Cignarella 39.4515 Irony-spa-Barbieri 47.3281 Irony-spa-Ortega 47.072 Irony-Type-eng-Hee 18.8279 Irony-zho-Xiang 13.7863 Offense-Target-kan-Chakravarthi 16.6002 Offense-Target-kan-Chakravarthi 24.0395 Offense-Target-kan-Chakravarthi 17.3499 Offense-Target-mal-Chakravarthi 16.6002 Offense-Target-mal-Chakravarthi 24.0395 Offense-Target-mal-Chakravarthi 17.3499 Offense-Target-tam-Chakravarthi 16.6002 Offense-Target-tam-Chakravarthi 24.0395 Offense-Target-tam-Chakravarthi 17.3499 Offensive-ara-Mubarak 55.6012 Offensive-ara-Zampieri 59.916 Offensive-dan-Zampieri 60.034 Offensive-ell-Zampieri 57.488 Offensive-eng-Zampieri 54.3244 Offensive-Group-eng-Zampieri 35.4284 Offensive-slv-Novak 23.195 Offensive-Target-eng-Zampieri 63.1703 Offensive-tur-Zampieri 51.4776 Sarcasm-ara-Abufarha 54.7127 Sarcasm-ara-Farha 50.7341 Sarcasm-ces-Ptacek 50.1913 Sarcasm-eng-Bamman 58 Sarcasm-eng-Oraby 55.84 Sarcasm-eng-Ptacek 54.2168 Sarcasm-eng-Rajadesingan 78.2 Sarcasm-eng-Riloff 24.6914 Sarcasm-eng-Walker 53.1694 Sarcasm-zho-Gong 45.2971 Sentiment-5-eng-Socher 37.8 Sentiment-ace-Winata 23.7247 Sentiment-amh-Muhammad 44.3484 Sentiment-ara-Abdul 33.406 Sentiment-ara-Muhammad 35.6 Sentiment-arq-Muhammad 38.7331 Sentiment-ary-Muhammad 31.5994 Sentiment-bam-Diallo 19.6358 Sentiment-ban-Winata 29.3339 Sentiment-bbc-Winata 20.9795 Sentiment-ben-Islam 27.0991 Sentiment-ben-Patra 33.2407 Sentiment-bjn-Winata 40.3448 Sentiment-bos-Mozetic 30.6389 Sentiment-bug-Winata 17.7115 Sentiment-bul-Mozetic 42.1123 Sentiment-deu-Mozetic 39.666 Sentiment-deu-Rei 49.707 Sentiment-eng-Mozetic 44.1326 Sentiment-eng-Pang 86.8 Sentiment-eng-Rosenthal 51.7641 Sentiment-eng-Socher 91.2 Sentiment-fas-Ashrafi 35.9025 Sentiment-fin-Kajava 59.4953 Sentiment-fre-Kajava 77.5371 Sentiment-hau-Muhammad 27.0755 Sentiment-heb-Amram 54.4 Sentiment-hin-Patra 34.7177 Sentiment-hrv-Mozetic 26.366 Sentiment-hun-Mozetic 26.407 Sentiment-ibo-Muhammad 36.3115 Sentiment-ind-Wilie 52.3668 Sentiment-ita-Basile 71.4612 Sentiment-ita-Basile 75.5717 Sentiment-ita-Kajava 69.066 Sentiment-ita-Rei 40.6753 Sentiment-jav-Winata 30.8417 Sentiment-jpn-Suzuki 28 Sentiment-kan-Chakravarthi 42.4955 Sentiment-kin-Muhammad 28.546 Sentiment-kor-Jang 9.78833 Sentiment-mad-Winata 21.6333 Sentiment-mal-Chakravarthi 36.3683 Sentiment-mar-Kulkarni 43.2 Sentiment-min-Winata 33.4785 Sentiment-mlt-Dingli 48.9815 Sentiment-nij-Winata 28.7149 Sentiment-nor-Velldal 4.77029 Sentiment-pcm-Muhammad 30.6014 Sentiment-pcm-Oyewusi 27.1799 Sentiment-pol-Kocon 36.5643 Sentiment-pol-Mozetic 30.8668 Sentiment-pol-Rybak 13.7629 Sentiment-por-Brum 26.5428 Sentiment-por-Mozetic 33.9366 Sentiment-ron-Dumitrescu 79.173 Sentiment-rus-Mozetic 41.2242 Sentiment-slk-Mozetic 23.3087 Sentiment-slv-Mozetic 34.3487 Sentiment-spa-Mozetic 31.4117 Sentiment-spa-Rei 44.7917 Sentiment-sqi-Mozetic 19.2217 Sentiment-srp-Mozetic 34.9605 Sentiment-sun-Winata 23.1668 Sentiment-swe-Mozetic 34.0785 Sentiment-swh-Muhammad 45.2048 Sentiment-tam-Chakravarthi 35.9744 Sentiment-tel-Marreddy 31.884 Sentiment-tha-Suriyawongkul 32.0696 Sentiment-tso-Muhammad 22.5267 Sentiment-Tw-eng-Thelwall 78 Sentiment-twi-Muhammad 17.2824 Sentiment-yor-Muhammad 24.7122 Sentiment-yor-Shode 43.4456 Sentiment-Yt-eng-Thelwall 80.2 Sentiment-zho-Tan 82.3997 Sentiment-zho-Wan 68.4037 Sexism-fre-Chiril 60.968 Subject-ita-Basile 64.9685 Subject-ita-Basile 57.7947 Subjective-ces-Priban 70.8 Subjective-kor-Jang 11.3001 Subjective-spa-Barbieri 64.4451 Subjevtive-eng-Pang 67.6
11	five-shot in-context learning	LLaMA-7B		39.4777		2023-11-01 11:37:10
Submission (five-shot in-context learning) Model (LLaMA-7B) Results Task Score Task Score Task Score Task Score Aggressive-hin-Kumar 50.6552 Dangerous-ara-Alshehri 46.865 Emotion-ara-Abdul 12.9082 Emotion-ara-Mohammad 48.51 Emotion-ben-Iqbal 18.2042 Emotion-deu-Bianchi 66.1598 Emotion-eng-Demszky 7.53576 Emotion-eng-Mohammad 63.1473 Emotion-eng-Plaza 21.2972 Emotion-eng-Wallbott 53.8086 Emotion-fas-Sabri 11.6201 Emotion-fin-Kajava 16.4754 Emotion-fin-Ohman 14.4671 Emotion-fre-Bianchi 66.549 Emotion-fre-Kajava 31.5299 Emotion-hin-Debaditya 7.31474 Emotion-ind-Saputri 40.7845 Emotion-ind-Wilie 36.4446 Emotion-ita-Bianchi 53.0924 Emotion-ita-Kajava 27.1524 Emotion-por-Cortiz 1.83366 Emotion-ron-Ciobotaru 61.5774 Emotion-rus-Sboev 60.5698 Emotion-spa-Mohammad 61.6808 Emotion-spa-Plaza 21.9238 Emotion-tur-Guven 31.25 Emotion-vie-Ho 17.9429 Emotion-zho-Lee 35.4067 Hate-ara-Alakrot 46.2443 Hate-ara-Mubarak 54.8307 Hate-ara-Mulki 25.9741 Hate-eng-Basile 46.5982 Hate-eng-Davidson 8.4145 Hate-eng-Waseem 64.1404 Hate-fil-Cabasag 36.573 Hate-Group-ara-Ousidhoum 8.80113 Hate-Group-fre-Ousidhoum 3.54515 Hate-ita-Bosco 46.5837 Hate-kor-Jeong 38.6058 Hate-kor-Moon 18.0017 Hate-pol-Ptaszynski 51.7117 Hate-por-Fortuna 42.8136 Hate-spa-Basile 45.6763 Hate-Target-ara-Ousidhoum 17.6923 Hate-Target-ben-Karim 14.8696 Hate-Target-fre-Ousidhoum 10.6227 Hate-Target-kor-Jeong 12.6945 Hate-tel-Marreddy 48.089 Hate-zho-Deng 39.189 Humor-eng-Meaney 59.1465 Humor-hin-Aggarwal 52 Humor-rus-Blinov 52.3881 Humor-spa-Chiruzzo 51.9088 Irony-ara-Ghanem 35.5159 Irony-eng-Hee 9.7561 Irony-fas-Golazizian 55.7823 Irony-hin-Vijay 47.7753 Irony-ita-Basile 52.4457 Irony-ita-Cignarella 35.8077 Irony-spa-Barbieri 52.381 Irony-spa-Ortega 41.7805 Irony-Type-eng-Hee 18.8279 Irony-zho-Xiang 14.34 Offense-Target-kan-Chakravarthi 16.6628 Offense-Target-kan-Chakravarthi 24.0395 Offense-Target-kan-Chakravarthi 17.3499 Offense-Target-mal-Chakravarthi 16.6628 Offense-Target-mal-Chakravarthi 24.0395 Offense-Target-mal-Chakravarthi 17.3499 Offense-Target-tam-Chakravarthi 16.6628 Offense-Target-tam-Chakravarthi 24.0395 Offense-Target-tam-Chakravarthi 17.3499 Offensive-ara-Mubarak 45.8531 Offensive-ara-Zampieri 44.6279 Offensive-dan-Zampieri 51.2881 Offensive-ell-Zampieri 48.788 Offensive-eng-Zampieri 45.6926 Offensive-Group-eng-Zampieri 25.3833 Offensive-slv-Novak 24.3518 Offensive-Target-eng-Zampieri 46.7849 Offensive-tur-Zampieri 46.1932 Sarcasm-ara-Abufarha 47.6873 Sarcasm-ara-Farha 50.5481 Sarcasm-ces-Ptacek 41.3124 Sarcasm-eng-Bamman 54.6 Sarcasm-eng-Oraby 52.1404 Sarcasm-eng-Ptacek 56.2667 Sarcasm-eng-Rajadesingan 61.8 Sarcasm-eng-Riloff 24.2991 Sarcasm-eng-Walker 51.2523 Sarcasm-zho-Gong 50.383 Sentiment-5-eng-Socher 44 Sentiment-ace-Winata 36.3882 Sentiment-amh-Muhammad 54.4341 Sentiment-ara-Abdul 35.2425 Sentiment-ara-Muhammad 47.6 Sentiment-arq-Muhammad 45.6852 Sentiment-ary-Muhammad 37.2205 Sentiment-bam-Diallo 26.0078 Sentiment-ban-Winata 40.8412 Sentiment-bbc-Winata 33.5576 Sentiment-ben-Islam 38.474 Sentiment-ben-Patra 32.9956 Sentiment-bjn-Winata 43.5734 Sentiment-bos-Mozetic 31.2758 Sentiment-bug-Winata 33.6372 Sentiment-bul-Mozetic 28.3803 Sentiment-deu-Mozetic 22.9135 Sentiment-deu-Rei 12.0187 Sentiment-eng-Mozetic 33.4619 Sentiment-eng-Pang 84.4 Sentiment-eng-Rosenthal 50.2098 Sentiment-eng-Socher 81.8 Sentiment-fas-Ashrafi 32.5796 Sentiment-fin-Kajava 52.0932 Sentiment-fre-Kajava 66.0954 Sentiment-hau-Muhammad 39.3473 Sentiment-heb-Amram 60 Sentiment-hin-Patra 27.1462 Sentiment-hrv-Mozetic 35.5556 Sentiment-hun-Mozetic 31.0817 Sentiment-ibo-Muhammad 36.4377 Sentiment-ind-Wilie 44.9923 Sentiment-ita-Basile 68.5724 Sentiment-ita-Basile 65.2406 Sentiment-ita-Kajava 66.6635 Sentiment-ita-Rei 10.4546 Sentiment-jav-Winata 42.665 Sentiment-jpn-Suzuki 36.2 Sentiment-kan-Chakravarthi 59.1679 Sentiment-kin-Muhammad 38.4486 Sentiment-kor-Jang 27.9291 Sentiment-mad-Winata 38.8154 Sentiment-mal-Chakravarthi 54.6326 Sentiment-mar-Kulkarni 47.6 Sentiment-min-Winata 41.4137 Sentiment-mlt-Dingli 57.5468 Sentiment-nij-Winata 42.2285 Sentiment-nor-Velldal 1.30719 Sentiment-pcm-Muhammad 49.8102 Sentiment-pcm-Oyewusi 28.7351 Sentiment-pol-Kocon 34.3486 Sentiment-pol-Mozetic 36.2239 Sentiment-pol-Rybak 15.0897 Sentiment-por-Brum 32.2885 Sentiment-por-Mozetic 28.6031 Sentiment-ron-Dumitrescu 70.9971 Sentiment-rus-Mozetic 28.4605 Sentiment-slk-Mozetic 32.9092 Sentiment-slv-Mozetic 28.7389 Sentiment-spa-Mozetic 30.0992 Sentiment-spa-Rei 7.36862 Sentiment-sqi-Mozetic 27.484 Sentiment-srp-Mozetic 30.7921 Sentiment-sun-Winata 41.3157 Sentiment-swe-Mozetic 34.2454 Sentiment-swh-Muhammad 35.9114 Sentiment-tam-Chakravarthi 55.6607 Sentiment-tel-Marreddy 26.6464 Sentiment-tha-Suriyawongkul 22.0319 Sentiment-tso-Muhammad 38.1136 Sentiment-Tw-eng-Thelwall 69.4 Sentiment-twi-Muhammad 40.7409 Sentiment-yor-Muhammad 32.2068 Sentiment-yor-Shode 52.6959 Sentiment-Yt-eng-Thelwall 79.6 Sentiment-zho-Tan 70.5999 Sentiment-zho-Wan 61.0404 Sexism-fre-Chiril 56.5185 Subject-ita-Basile 56.1763 Subject-ita-Basile 55.0741 Subjective-ces-Priban 54.2 Subjective-kor-Jang 5.12634 Subjective-spa-Barbieri 54.6057 Subjevtive-eng-Pang 54
12	three-shot in-context learning	Vicuna-7B		39.4367		2023-11-01 11:37:10
Submission (three-shot in-context learning) Model (Vicuna-7B) Results Task Score Task Score Task Score Task Score Aggressive-hin-Kumar 44.5343 Dangerous-ara-Alshehri 46.865 Emotion-ara-Abdul 16.0299 Emotion-ara-Mohammad 56.4951 Emotion-ben-Iqbal 15.7618 Emotion-deu-Bianchi 71.0183 Emotion-eng-Demszky 15.5615 Emotion-eng-Mohammad 68.8001 Emotion-eng-Plaza 29.0005 Emotion-eng-Wallbott 67.5368 Emotion-fas-Sabri 11.4631 Emotion-fin-Kajava 21.0503 Emotion-fin-Ohman 18.4528 Emotion-fre-Bianchi 69.7212 Emotion-fre-Kajava 42.2812 Emotion-hin-Debaditya 10.7275 Emotion-ind-Saputri 47.2478 Emotion-ind-Wilie 45.0946 Emotion-ita-Bianchi 55.4774 Emotion-ita-Kajava 38.1193 Emotion-por-Cortiz 7.03604 Emotion-ron-Ciobotaru 70.5317 Emotion-rus-Sboev 66.2152 Emotion-spa-Mohammad 67.04 Emotion-spa-Plaza 28.1452 Emotion-tur-Guven 35.75 Emotion-vie-Ho 27.9135 Emotion-zho-Lee 44.7368 Hate-ara-Alakrot 50.4863 Hate-ara-Mubarak 59.156 Hate-ara-Mulki 30.2836 Hate-eng-Basile 57.7147 Hate-eng-Davidson 35.8219 Hate-eng-Waseem 65.9756 Hate-fil-Cabasag 38.5635 Hate-Group-ara-Ousidhoum 9.63183 Hate-Group-fre-Ousidhoum 4.70663 Hate-ita-Bosco 55.565 Hate-kor-Jeong 46.9277 Hate-kor-Moon 21.8567 Hate-pol-Ptaszynski 54.6715 Hate-por-Fortuna 51.3813 Hate-spa-Basile 58.9851 Hate-Target-ara-Ousidhoum 20.4817 Hate-Target-ben-Karim 17.3644 Hate-Target-fre-Ousidhoum 14.3021 Hate-Target-kor-Jeong 16.8902 Hate-tel-Marreddy 48.7705 Hate-zho-Deng 49.8335 Humor-eng-Meaney 66.0336 Humor-hin-Aggarwal 49.4 Humor-rus-Blinov 52.6633 Humor-spa-Chiruzzo 60.5013 Irony-ara-Ghanem 33.9288 Irony-eng-Hee 11.9816 Irony-fas-Golazizian 56.1224 Irony-hin-Vijay 57.5479 Irony-ita-Basile 53.602 Irony-ita-Cignarella 38.7763 Irony-spa-Barbieri 48.0141 Irony-spa-Ortega 45.4259 Irony-Type-eng-Hee 18.8279 Irony-zho-Xiang 12.6526 Offense-Target-kan-Chakravarthi 18.9895 Offense-Target-kan-Chakravarthi 24.0395 Offense-Target-kan-Chakravarthi 17.3499 Offense-Target-mal-Chakravarthi 18.9895 Offense-Target-mal-Chakravarthi 24.0395 Offense-Target-mal-Chakravarthi 17.3499 Offense-Target-tam-Chakravarthi 18.9895 Offense-Target-tam-Chakravarthi 24.0395 Offense-Target-tam-Chakravarthi 17.3499 Offensive-ara-Mubarak 59.6718 Offensive-ara-Zampieri 67.0867 Offensive-dan-Zampieri 66.2054 Offensive-ell-Zampieri 52.9762 Offensive-eng-Zampieri 60.7168 Offensive-Group-eng-Zampieri 28.2271 Offensive-slv-Novak 21.5246 Offensive-Target-eng-Zampieri 69.3167 Offensive-tur-Zampieri 53.2164 Sarcasm-ara-Abufarha 55.2114 Sarcasm-ara-Farha 51.8096 Sarcasm-ces-Ptacek 50.6944 Sarcasm-eng-Bamman 53.4 Sarcasm-eng-Oraby 53.0918 Sarcasm-eng-Ptacek 55.4193 Sarcasm-eng-Rajadesingan 70.4 Sarcasm-eng-Riloff 37.037 Sarcasm-eng-Walker 47.8773 Sarcasm-zho-Gong 50.5104 Sentiment-5-eng-Socher 29.4 Sentiment-ace-Winata 15.305 Sentiment-amh-Muhammad 24.2115 Sentiment-ara-Abdul 21.8464 Sentiment-ara-Muhammad 29 Sentiment-arq-Muhammad 25.7833 Sentiment-ary-Muhammad 18.7222 Sentiment-bam-Diallo 14.433 Sentiment-ban-Winata 19.3502 Sentiment-bbc-Winata 15.0851 Sentiment-ben-Islam 18.4535 Sentiment-ben-Patra 26.1645 Sentiment-bjn-Winata 25.2591 Sentiment-bos-Mozetic 22.7463 Sentiment-bug-Winata 13.7427 Sentiment-bul-Mozetic 34.4064 Sentiment-deu-Mozetic 30.6401 Sentiment-deu-Rei 42.8048 Sentiment-eng-Mozetic 45.0255 Sentiment-eng-Pang 87 Sentiment-eng-Rosenthal 48.2197 Sentiment-eng-Socher 89.4 Sentiment-fas-Ashrafi 30.2168 Sentiment-fin-Kajava 58.2278 Sentiment-fre-Kajava 70.0458 Sentiment-hau-Muhammad 20.5262 Sentiment-heb-Amram 56 Sentiment-hin-Patra 28.4892 Sentiment-hrv-Mozetic 18.2897 Sentiment-hun-Mozetic 21.2346 Sentiment-ibo-Muhammad 29.406 Sentiment-ind-Wilie 40.2562 Sentiment-ita-Basile 71.9048 Sentiment-ita-Basile 73.0439 Sentiment-ita-Kajava 67.9364 Sentiment-ita-Rei 45.4043 Sentiment-jav-Winata 20.0284 Sentiment-jpn-Suzuki 27.6 Sentiment-kan-Chakravarthi 47.5912 Sentiment-kin-Muhammad 24.8674 Sentiment-kor-Jang 6.31368 Sentiment-mad-Winata 17.803 Sentiment-mal-Chakravarthi 39.9765 Sentiment-mar-Kulkarni 38.6 Sentiment-min-Winata 24.033 Sentiment-mlt-Dingli 48.2654 Sentiment-nij-Winata 18.9314 Sentiment-nor-Velldal 7.99118 Sentiment-pcm-Muhammad 19.6777 Sentiment-pcm-Oyewusi 24.4268 Sentiment-pol-Kocon 32.8168 Sentiment-pol-Mozetic 25.09 Sentiment-pol-Rybak 12.9542 Sentiment-por-Brum 20.576 Sentiment-por-Mozetic 24.4609 Sentiment-ron-Dumitrescu 82.5983 Sentiment-rus-Mozetic 33.0226 Sentiment-slk-Mozetic 14.2485 Sentiment-slv-Mozetic 27.5341 Sentiment-spa-Mozetic 30.8931 Sentiment-spa-Rei 48.1364 Sentiment-sqi-Mozetic 16.1307 Sentiment-srp-Mozetic 28.1019 Sentiment-sun-Winata 17.7695 Sentiment-swe-Mozetic 23.6081 Sentiment-swh-Muhammad 45.6403 Sentiment-tam-Chakravarthi 36.7244 Sentiment-tel-Marreddy 26.5365 Sentiment-tha-Suriyawongkul 29.3833 Sentiment-tso-Muhammad 8.22587 Sentiment-Tw-eng-Thelwall 75.8 Sentiment-twi-Muhammad 8.00776 Sentiment-yor-Muhammad 19.8263 Sentiment-yor-Shode 48.5741 Sentiment-Yt-eng-Thelwall 79.2 Sentiment-zho-Tan 81.5926 Sentiment-zho-Wan 65.7098 Sexism-fre-Chiril 60.713 Subject-ita-Basile 61.7173 Subject-ita-Basile 61.4881 Subjective-ces-Priban 68.4 Subjective-kor-Jang 10.8871 Subjective-spa-Barbieri 61.5173 Subjevtive-eng-Pang 64.6
13	three-shot in-context learning	LLaMA-7B		37.8192		2023-11-01 11:37:10
Submission (three-shot in-context learning) Model (LLaMA-7B) Results Task Score Task Score Task Score Task Score Aggressive-hin-Kumar 43.697 Dangerous-ara-Alshehri 46.865 Emotion-ara-Abdul 13.85 Emotion-ara-Mohammad 47.0997 Emotion-ben-Iqbal 15.8584 Emotion-deu-Bianchi 58.9879 Emotion-eng-Demszky 6.9106 Emotion-eng-Mohammad 64.5026 Emotion-eng-Plaza 20.0078 Emotion-eng-Wallbott 51.947 Emotion-fas-Sabri 12.0895 Emotion-fin-Kajava 16.3861 Emotion-fin-Ohman 14.0826 Emotion-fre-Bianchi 63.9368 Emotion-fre-Kajava 26.5052 Emotion-hin-Debaditya 7.36608 Emotion-ind-Saputri 37.7941 Emotion-ind-Wilie 32.9343 Emotion-ita-Bianchi 47.0811 Emotion-ita-Kajava 25.9432 Emotion-por-Cortiz 1.39947 Emotion-ron-Ciobotaru 59.4972 Emotion-rus-Sboev 54.646 Emotion-spa-Mohammad 57.6337 Emotion-spa-Plaza 19.7048 Emotion-tur-Guven 28 Emotion-vie-Ho 18.5713 Emotion-zho-Lee 32.2966 Hate-ara-Alakrot 51.3664 Hate-ara-Mubarak 54.0698 Hate-ara-Mulki 27.9482 Hate-eng-Basile 48.4496 Hate-eng-Davidson 8.54335 Hate-eng-Waseem 62.7483 Hate-fil-Cabasag 41.9239 Hate-Group-ara-Ousidhoum 7.4037 Hate-Group-fre-Ousidhoum 4.03076 Hate-ita-Bosco 53.7993 Hate-kor-Jeong 42.699 Hate-kor-Moon 20.9928 Hate-pol-Ptaszynski 49.4039 Hate-por-Fortuna 44.4917 Hate-spa-Basile 47.6342 Hate-Target-ara-Ousidhoum 18.4691 Hate-Target-ben-Karim 14.6124 Hate-Target-fre-Ousidhoum 12.5921 Hate-Target-kor-Jeong 9.02062 Hate-tel-Marreddy 44.629 Hate-zho-Deng 41.4435 Humor-eng-Meaney 57.8338 Humor-hin-Aggarwal 49 Humor-rus-Blinov 58.0929 Humor-spa-Chiruzzo 55.8854 Irony-ara-Ghanem 35.8638 Irony-eng-Hee 3 Irony-fas-Golazizian 57.8231 Irony-hin-Vijay 45.2554 Irony-ita-Basile 49.2109 Irony-ita-Cignarella 34.583 Irony-spa-Barbieri 48.7355 Irony-spa-Ortega 43.3727 Irony-Type-eng-Hee 18.8279 Irony-zho-Xiang 12.9529 Offense-Target-kan-Chakravarthi 17.7315 Offense-Target-kan-Chakravarthi 24.0395 Offense-Target-kan-Chakravarthi 17.3499 Offense-Target-mal-Chakravarthi 17.7315 Offense-Target-mal-Chakravarthi 24.0395 Offense-Target-mal-Chakravarthi 17.3499 Offense-Target-tam-Chakravarthi 17.7315 Offense-Target-tam-Chakravarthi 24.0395 Offense-Target-tam-Chakravarthi 17.3499 Offensive-ara-Mubarak 50.1349 Offensive-ara-Zampieri 51.2078 Offensive-dan-Zampieri 54.0619 Offensive-ell-Zampieri 48.2926 Offensive-eng-Zampieri 49.5623 Offensive-Group-eng-Zampieri 24.0039 Offensive-slv-Novak 22.0244 Offensive-Target-eng-Zampieri 50.6953 Offensive-tur-Zampieri 49.2676 Sarcasm-ara-Abufarha 50.347 Sarcasm-ara-Farha 49.8387 Sarcasm-ces-Ptacek 45.8618 Sarcasm-eng-Bamman 52.4 Sarcasm-eng-Oraby 52.0932 Sarcasm-eng-Ptacek 49.6532 Sarcasm-eng-Rajadesingan 71.2 Sarcasm-eng-Riloff 32.4324 Sarcasm-eng-Walker 45.432 Sarcasm-zho-Gong 48.29 Sentiment-5-eng-Socher 37.2 Sentiment-ace-Winata 34.7302 Sentiment-amh-Muhammad 53.8522 Sentiment-ara-Abdul 35.7143 Sentiment-ara-Muhammad 43.6 Sentiment-arq-Muhammad 45.0512 Sentiment-ary-Muhammad 30.7558 Sentiment-bam-Diallo 24.5672 Sentiment-ban-Winata 36.4018 Sentiment-bbc-Winata 33.4536 Sentiment-ben-Islam 33.3104 Sentiment-ben-Patra 29.8472 Sentiment-bjn-Winata 37.5109 Sentiment-bos-Mozetic 31.2335 Sentiment-bug-Winata 34.2855 Sentiment-bul-Mozetic 29.8197 Sentiment-deu-Mozetic 23.5806 Sentiment-deu-Rei 13.1873 Sentiment-eng-Mozetic 31.8445 Sentiment-eng-Pang 73 Sentiment-eng-Rosenthal 48.1226 Sentiment-eng-Socher 73.4 Sentiment-fas-Ashrafi 31.5636 Sentiment-fin-Kajava 50.6733 Sentiment-fre-Kajava 62.2191 Sentiment-hau-Muhammad 27.8808 Sentiment-heb-Amram 56.4 Sentiment-hin-Patra 30.3984 Sentiment-hrv-Mozetic 31.7217 Sentiment-hun-Mozetic 28.0288 Sentiment-ibo-Muhammad 22.2219 Sentiment-ind-Wilie 44.1852 Sentiment-ita-Basile 63.7457 Sentiment-ita-Basile 57.2993 Sentiment-ita-Kajava 62.7994 Sentiment-ita-Rei 11.077 Sentiment-jav-Winata 35.6358 Sentiment-jpn-Suzuki 38.4 Sentiment-kan-Chakravarthi 58.387 Sentiment-kin-Muhammad 24.418 Sentiment-kor-Jang 24.5883 Sentiment-mad-Winata 35.3999 Sentiment-mal-Chakravarthi 50.9854 Sentiment-mar-Kulkarni 37.2 Sentiment-min-Winata 35.6301 Sentiment-mlt-Dingli 47.7571 Sentiment-nij-Winata 33.9373 Sentiment-nor-Velldal 2.38095 Sentiment-pcm-Muhammad 55.4795 Sentiment-pcm-Oyewusi 29.4373 Sentiment-pol-Kocon 31.6168 Sentiment-pol-Mozetic 31.8369 Sentiment-pol-Rybak 15.5462 Sentiment-por-Brum 30.966 Sentiment-por-Mozetic 29.8441 Sentiment-ron-Dumitrescu 71.761 Sentiment-rus-Mozetic 27.9644 Sentiment-slk-Mozetic 33.147 Sentiment-slv-Mozetic 25.0929 Sentiment-spa-Mozetic 27.8275 Sentiment-spa-Rei 8.92746 Sentiment-sqi-Mozetic 27.0687 Sentiment-srp-Mozetic 27.0663 Sentiment-sun-Winata 35.846 Sentiment-swe-Mozetic 33.889 Sentiment-swh-Muhammad 13.703 Sentiment-tam-Chakravarthi 45.591 Sentiment-tel-Marreddy 22.1104 Sentiment-tha-Suriyawongkul 21.2046 Sentiment-tso-Muhammad 40.8135 Sentiment-Tw-eng-Thelwall 68.6 Sentiment-twi-Muhammad 37.9768 Sentiment-yor-Muhammad 28.4782 Sentiment-yor-Shode 54.147 Sentiment-Yt-eng-Thelwall 72.8 Sentiment-zho-Tan 64.7436 Sentiment-zho-Wan 59.1974 Sexism-fre-Chiril 55.9566 Subject-ita-Basile 51.4825 Subject-ita-Basile 55.1325 Subjective-ces-Priban 51.8 Subjective-kor-Jang 4.37011 Subjective-spa-Barbieri 54.5982 Subjevtive-eng-Pang 47.8
14	Zero-shot	BLOOMZ-P3-7B		35.7031		2023-11-01 11:37:10
Submission (Zero-shot) Model (BLOOMZ-P3-7B) Results Task Score Task Score Task Score Task Score Aggressive-hin-Kumar 18.7192 Dangerous-ara-Alshehri 46.865 Emotion-ara-Abdul 6.64943 Emotion-ara-Mohammad 21.0674 Emotion-ben-Iqbal 11.3893 Emotion-deu-Bianchi 20.2584 Emotion-eng-Demszky 1.90418 Emotion-eng-Mohammad 29.7048 Emotion-eng-Plaza 7.80305 Emotion-eng-Wallbott 11.0454 Emotion-fas-Sabri 11.9996 Emotion-fin-Kajava 3.44828 Emotion-fin-Ohman 2.83688 Emotion-fre-Bianchi 20.0007 Emotion-fre-Kajava 4.38641 Emotion-hin-Debaditya 4.51069 Emotion-ind-Saputri 35.5322 Emotion-ind-Wilie 33.9277 Emotion-ita-Bianchi 21.4357 Emotion-ita-Kajava 5.86835 Emotion-por-Cortiz 1.12063 Emotion-ron-Ciobotaru 14.7523 Emotion-rus-Sboev 11.0209 Emotion-spa-Mohammad 19.4953 Emotion-spa-Plaza 7.77049 Emotion-tur-Guven 20.25 Emotion-vie-Ho 12.224 Emotion-zho-Lee 51.4354 Hate-ara-Alakrot 43.6302 Hate-ara-Mubarak 48.6653 Hate-ara-Mulki 37.9033 Hate-eng-Basile 36.2245 Hate-eng-Davidson 25.4274 Hate-eng-Waseem 60.0731 Hate-fil-Cabasag 34.4692 Hate-Group-ara-Ousidhoum 8.40972 Hate-Group-fre-Ousidhoum 11.2796 Hate-ita-Bosco 40.2628 Hate-kor-Jeong 33.687 Hate-kor-Moon 20.9549 Hate-pol-Ptaszynski 46.4668 Hate-por-Fortuna 39.6864 Hate-spa-Basile 37.5 Hate-Target-ara-Ousidhoum 15.5784 Hate-Target-ben-Karim 7.52888 Hate-Target-fre-Ousidhoum 7.91565 Hate-Target-kor-Jeong 3.87454 Hate-tel-Marreddy 49.8998 Hate-zho-Deng 36.2245 Humor-eng-Meaney 26.4706 Humor-hin-Aggarwal 39.6 Humor-rus-Blinov 34.1238 Humor-spa-Chiruzzo 31.9728 Irony-ara-Ghanem 51.4289 Irony-eng-Hee 25.4072 Irony-fas-Golazizian 51.7007 Irony-hin-Vijay 51.3046 Irony-ita-Basile 50.9731 Irony-ita-Cignarella 48.2056 Irony-spa-Barbieri 56.7682 Irony-spa-Ortega 54.4583 Irony-Type-eng-Hee 18.8279 Irony-zho-Xiang 9.89144 Offense-Target-kan-Chakravarthi 16.6082 Offense-Target-kan-Chakravarthi 20.8143 Offense-Target-kan-Chakravarthi 15.7603 Offense-Target-mal-Chakravarthi 16.6082 Offense-Target-mal-Chakravarthi 20.8143 Offense-Target-mal-Chakravarthi 15.7603 Offense-Target-tam-Chakravarthi 16.6082 Offense-Target-tam-Chakravarthi 20.8143 Offense-Target-tam-Chakravarthi 15.7603 Offensive-ara-Mubarak 43.6937 Offensive-ara-Zampieri 44.0716 Offensive-dan-Zampieri 46.6775 Offensive-ell-Zampieri 46.7145 Offensive-eng-Zampieri 42.6184 Offensive-Group-eng-Zampieri 44.0014 Offensive-slv-Novak 1.97862 Offensive-Target-eng-Zampieri 47.0199 Offensive-tur-Zampieri 44.3826 Sarcasm-ara-Abufarha 44.5676 Sarcasm-ara-Farha 41.928 Sarcasm-ces-Ptacek 49.0256 Sarcasm-eng-Bamman 51.8 Sarcasm-eng-Oraby 32.7957 Sarcasm-eng-Ptacek 39.4896 Sarcasm-eng-Rajadesingan 90.8 Sarcasm-eng-Riloff 0 Sarcasm-eng-Walker 33.2289 Sarcasm-zho-Gong 33.1989 Sentiment-5-eng-Socher 48.4 Sentiment-ace-Winata 37.8883 Sentiment-amh-Muhammad 16.0477 Sentiment-ara-Abdul 44.4764 Sentiment-ara-Muhammad 52.8 Sentiment-arq-Muhammad 52.0161 Sentiment-ary-Muhammad 37.3966 Sentiment-bam-Diallo 36.6997 Sentiment-ban-Winata 41.8955 Sentiment-bbc-Winata 36.4198 Sentiment-ben-Islam 45.1781 Sentiment-ben-Patra 34.7323 Sentiment-bjn-Winata 50.5088 Sentiment-bos-Mozetic 31.8002 Sentiment-bug-Winata 34.6032 Sentiment-bul-Mozetic 27.3512 Sentiment-deu-Mozetic 26.1273 Sentiment-deu-Rei 13.6064 Sentiment-eng-Mozetic 36.5248 Sentiment-eng-Pang 96.8 Sentiment-eng-Rosenthal 57.5971 Sentiment-eng-Socher 93 Sentiment-fas-Ashrafi 41.3397 Sentiment-fin-Kajava 41.2409 Sentiment-fre-Kajava 70.8773 Sentiment-hau-Muhammad 30.143 Sentiment-heb-Amram 71.2 Sentiment-hin-Patra 30.4467 Sentiment-hrv-Mozetic 35.1811 Sentiment-hun-Mozetic 30.3112 Sentiment-ibo-Muhammad 23.212 Sentiment-ind-Wilie 59.109 Sentiment-ita-Basile 74.3195 Sentiment-ita-Basile 63.7093 Sentiment-ita-Kajava 65.2386 Sentiment-ita-Rei 12.4471 Sentiment-jav-Winata 48.0639 Sentiment-jpn-Suzuki 44.2 Sentiment-kan-Chakravarthi 61.8594 Sentiment-kin-Muhammad 28.0634 Sentiment-kor-Jang 28.0777 Sentiment-mad-Winata 45.4443 Sentiment-mal-Chakravarthi 66.8665 Sentiment-mar-Kulkarni 43.8 Sentiment-min-Winata 49.9294 Sentiment-mlt-Dingli 47.6956 Sentiment-nij-Winata 42.8628 Sentiment-nor-Velldal 19.8405 Sentiment-pcm-Muhammad 55.3278 Sentiment-pcm-Oyewusi 38.9906 Sentiment-pol-Kocon 32.2046 Sentiment-pol-Mozetic 34.7819 Sentiment-pol-Rybak 13.8177 Sentiment-por-Brum 29.3347 Sentiment-por-Mozetic 27.6465 Sentiment-ron-Dumitrescu 83.1814 Sentiment-rus-Mozetic 31.3326 Sentiment-slk-Mozetic 31.8943 Sentiment-slv-Mozetic 26.7601 Sentiment-spa-Mozetic 33.3051 Sentiment-spa-Rei 8.12385 Sentiment-sqi-Mozetic 31.7758 Sentiment-srp-Mozetic 27.4481 Sentiment-sun-Winata 44.8266 Sentiment-swe-Mozetic 29.3059 Sentiment-swh-Muhammad 17.5982 Sentiment-tam-Chakravarthi 61.2905 Sentiment-tel-Marreddy 32.0767 Sentiment-tha-Suriyawongkul 20.1592 Sentiment-tso-Muhammad 45.5379 Sentiment-Tw-eng-Thelwall 78.4 Sentiment-twi-Muhammad 46.5611 Sentiment-yor-Muhammad 31.702 Sentiment-yor-Shode 54.5037 Sentiment-Yt-eng-Thelwall 85.2 Sentiment-zho-Tan 87.7313 Sentiment-zho-Wan 70.6472 Sexism-fre-Chiril 25.2609 Subject-ita-Basile 17.7632 Subject-ita-Basile 26.1448 Subjective-ces-Priban 52.8 Subjective-kor-Jang 10.7999 Subjective-spa-Barbieri 27.8499 Subjevtive-eng-Pang 49
15	Zero-shot	Bactrian-LLaMA-7B		34.5603		2023-11-01 11:37:10
Submission (Zero-shot) Model (Bactrian-LLaMA-7B) Results Task Score Task Score Task Score Task Score Aggressive-hin-Kumar 16.6171 Dangerous-ara-Alshehri 46.865 Emotion-ara-Abdul 11.8539 Emotion-ara-Mohammad 32.9106 Emotion-ben-Iqbal 2.91971 Emotion-deu-Bianchi 41.0067 Emotion-eng-Demszky 15.3523 Emotion-eng-Mohammad 24.3817 Emotion-eng-Plaza 20.449 Emotion-eng-Wallbott 52.3918 Emotion-fas-Sabri 4.70824 Emotion-fin-Kajava 7.74046 Emotion-fin-Ohman 8.66504 Emotion-fre-Bianchi 42.715 Emotion-fre-Kajava 21.7598 Emotion-hin-Debaditya 5.92406 Emotion-ind-Saputri 28.9503 Emotion-ind-Wilie 30.6965 Emotion-ita-Bianchi 32.4979 Emotion-ita-Kajava 17.9047 Emotion-por-Cortiz 6.10945 Emotion-ron-Ciobotaru 45.8499 Emotion-rus-Sboev 11.3046 Emotion-spa-Mohammad 33.9522 Emotion-spa-Plaza 19.5828 Emotion-tur-Guven 21.25 Emotion-vie-Ho 10.22 Emotion-zho-Lee 16.9856 Hate-ara-Alakrot 48.1038 Hate-ara-Mubarak 43.4847 Hate-ara-Mulki 25.3102 Hate-eng-Basile 57.5758 Hate-eng-Davidson 9.48838 Hate-eng-Waseem 57.6606 Hate-fil-Cabasag 40.2997 Hate-Group-ara-Ousidhoum 7.38435 Hate-Group-fre-Ousidhoum 15.9288 Hate-ita-Bosco 44.2424 Hate-kor-Jeong 51.3022 Hate-kor-Moon 21.955 Hate-pol-Ptaszynski 45.964 Hate-por-Fortuna 52.9121 Hate-spa-Basile 52.209 Hate-Target-ara-Ousidhoum 6.47668 Hate-Target-ben-Karim 19.8526 Hate-Target-fre-Ousidhoum 15.4113 Hate-Target-kor-Jeong 8.98773 Hate-tel-Marreddy 49.2859 Hate-zho-Deng 43.5307 Humor-eng-Meaney 54.4586 Humor-hin-Aggarwal 51.4 Humor-rus-Blinov 49.735 Humor-spa-Chiruzzo 46.1309 Irony-ara-Ghanem 49.7364 Irony-eng-Hee 54.389 Irony-fas-Golazizian 42.517 Irony-hin-Vijay 22.8497 Irony-ita-Basile 40.2341 Irony-ita-Cignarella 45.7364 Irony-spa-Barbieri 38.3853 Irony-spa-Ortega 44.5473 Irony-Type-eng-Hee 18.8279 Irony-zho-Xiang 14.1447 Offense-Target-kan-Chakravarthi 14.1274 Offense-Target-kan-Chakravarthi 24.0395 Offense-Target-kan-Chakravarthi 17.3499 Offense-Target-mal-Chakravarthi 14.1274 Offense-Target-mal-Chakravarthi 24.0395 Offense-Target-mal-Chakravarthi 17.3499 Offense-Target-tam-Chakravarthi 14.1274 Offense-Target-tam-Chakravarthi 24.0395 Offense-Target-tam-Chakravarthi 17.3499 Offensive-ara-Mubarak 43.6937 Offensive-ara-Zampieri 44.0716 Offensive-dan-Zampieri 46.6775 Offensive-ell-Zampieri 45.4744 Offensive-eng-Zampieri 42.0626 Offensive-Group-eng-Zampieri 22.1999 Offensive-slv-Novak 26.5171 Offensive-Target-eng-Zampieri 35.7143 Offensive-tur-Zampieri 44.3826 Sarcasm-ara-Abufarha 60.6962 Sarcasm-ara-Farha 49.7891 Sarcasm-ces-Ptacek 52.0595 Sarcasm-eng-Bamman 55.2 Sarcasm-eng-Oraby 54.7709 Sarcasm-eng-Ptacek 60.4941 Sarcasm-eng-Rajadesingan 69.6 Sarcasm-eng-Riloff 36.1446 Sarcasm-eng-Walker 51.0557 Sarcasm-zho-Gong 41.7541 Sentiment-5-eng-Socher 28.6 Sentiment-ace-Winata 14.4557 Sentiment-amh-Muhammad 8.2725 Sentiment-ara-Abdul 16.9976 Sentiment-ara-Muhammad 35.8 Sentiment-arq-Muhammad 16.9896 Sentiment-ary-Muhammad 31.7978 Sentiment-bam-Diallo 16.534 Sentiment-ban-Winata 14.005 Sentiment-bbc-Winata 14.4322 Sentiment-ben-Islam 17.947 Sentiment-ben-Patra 28.5655 Sentiment-bjn-Winata 19.488 Sentiment-bos-Mozetic 22.162 Sentiment-bug-Winata 16.016 Sentiment-bul-Mozetic 26.6879 Sentiment-deu-Mozetic 33.2088 Sentiment-deu-Rei 45.7828 Sentiment-eng-Mozetic 40.1909 Sentiment-eng-Pang 80.4 Sentiment-eng-Rosenthal 45.3699 Sentiment-eng-Socher 82.2 Sentiment-fas-Ashrafi 34.9477 Sentiment-fin-Kajava 52.6481 Sentiment-fre-Kajava 54.0401 Sentiment-hau-Muhammad 35.909 Sentiment-heb-Amram 75.8 Sentiment-hin-Patra 32.2802 Sentiment-hrv-Mozetic 21.5419 Sentiment-hun-Mozetic 25.3272 Sentiment-ibo-Muhammad 36.2991 Sentiment-ind-Wilie 32.3742 Sentiment-ita-Basile 56.441 Sentiment-ita-Basile 42.8633 Sentiment-ita-Kajava 53.5283 Sentiment-ita-Rei 38.9494 Sentiment-jav-Winata 15.9033 Sentiment-jpn-Suzuki 32.4 Sentiment-kan-Chakravarthi 52.5134 Sentiment-kin-Muhammad 26.8166 Sentiment-kor-Jang 11.5591 Sentiment-mad-Winata 13.603 Sentiment-mal-Chakravarthi 61.3729 Sentiment-mar-Kulkarni 36.4 Sentiment-min-Winata 17.977 Sentiment-mlt-Dingli 64.0152 Sentiment-nij-Winata 18.2404 Sentiment-nor-Velldal 5.956 Sentiment-pcm-Muhammad 21.2695 Sentiment-pcm-Oyewusi 28.9555 Sentiment-pol-Kocon 39.0658 Sentiment-pol-Mozetic 21.7173 Sentiment-pol-Rybak 15.5005 Sentiment-por-Brum 25.7696 Sentiment-por-Mozetic 24.1745 Sentiment-ron-Dumitrescu 88.2928 Sentiment-rus-Mozetic 29.4374 Sentiment-slk-Mozetic 19.9247 Sentiment-slv-Mozetic 29.6108 Sentiment-spa-Mozetic 32.0308 Sentiment-spa-Rei 38.9806 Sentiment-sqi-Mozetic 24.1507 Sentiment-srp-Mozetic 27.5502 Sentiment-sun-Winata 16.9718 Sentiment-swe-Mozetic 24.1039 Sentiment-swh-Muhammad 55.4687 Sentiment-tam-Chakravarthi 63.6886 Sentiment-tel-Marreddy 32.8792 Sentiment-tha-Suriyawongkul 29.4367 Sentiment-tso-Muhammad 23.3013 Sentiment-Tw-eng-Thelwall 77.6 Sentiment-twi-Muhammad 14.3998 Sentiment-yor-Muhammad 22.7978 Sentiment-yor-Shode 43.8009 Sentiment-Yt-eng-Thelwall 85.2 Sentiment-zho-Tan 79.4191 Sentiment-zho-Wan 62.735 Sexism-fre-Chiril 41.3347 Subject-ita-Basile 43.9462 Subject-ita-Basile 40.2991 Subjective-ces-Priban 47.2 Subjective-kor-Jang 13.4493 Subjective-spa-Barbieri 39.7147 Subjevtive-eng-Pang 51
16	Zero-shot	BLOOMZ-7B		33.7897		2023-11-01 11:37:10
Submission (Zero-shot) Model (BLOOMZ-7B) Results Task Score Task Score Task Score Task Score Aggressive-hin-Kumar 15.8249 Dangerous-ara-Alshehri 46.865 Emotion-ara-Abdul 9.41941 Emotion-ara-Mohammad 23.1543 Emotion-ben-Iqbal 13.3667 Emotion-deu-Bianchi 20.9995 Emotion-eng-Demszky 5.40296 Emotion-eng-Mohammad 9.62767 Emotion-eng-Plaza 9.73636 Emotion-eng-Wallbott 21.1292 Emotion-fas-Sabri 11.1498 Emotion-fin-Kajava 3.45423 Emotion-fin-Ohman 3.77689 Emotion-fre-Bianchi 29.1497 Emotion-fre-Kajava 12.5112 Emotion-hin-Debaditya 4.7024 Emotion-ind-Saputri 36.7823 Emotion-ind-Wilie 33.6174 Emotion-ita-Bianchi 27.0652 Emotion-ita-Kajava 8.77518 Emotion-por-Cortiz 2.61729 Emotion-ron-Ciobotaru 19.5946 Emotion-rus-Sboev 15.049 Emotion-spa-Mohammad 25.1376 Emotion-spa-Plaza 12.6304 Emotion-tur-Guven 20.25 Emotion-vie-Ho 14.9009 Emotion-zho-Lee 52.6316 Hate-ara-Alakrot 43.6302 Hate-ara-Mubarak 48.6653 Hate-ara-Mulki 25.4635 Hate-eng-Basile 36.2245 Hate-eng-Davidson 10.7826 Hate-eng-Waseem 65.9635 Hate-fil-Cabasag 34.4692 Hate-Group-ara-Ousidhoum 7.21206 Hate-Group-fre-Ousidhoum 8.56652 Hate-ita-Bosco 40.2628 Hate-kor-Jeong 33.687 Hate-kor-Moon 16.9044 Hate-pol-Ptaszynski 46.4668 Hate-por-Fortuna 39.6864 Hate-spa-Basile 37.5 Hate-Target-ara-Ousidhoum 19.6404 Hate-Target-ben-Karim 15.5188 Hate-Target-fre-Ousidhoum 8.07318 Hate-Target-kor-Jeong 3.87454 Hate-tel-Marreddy 49.8998 Hate-zho-Deng 36.2245 Humor-eng-Meaney 26.6862 Humor-hin-Aggarwal 39.6 Humor-rus-Blinov 34.1238 Humor-spa-Chiruzzo 32.0652 Irony-ara-Ghanem 34.2427 Irony-eng-Hee 0 Irony-fas-Golazizian 56.4626 Irony-hin-Vijay 43.9894 Irony-ita-Basile 46.9214 Irony-ita-Cignarella 34.2105 Irony-spa-Barbieri 46.4668 Irony-spa-Ortega 39.4673 Irony-Type-eng-Hee 18.8279 Irony-zho-Xiang 14.5644 Offense-Target-kan-Chakravarthi 16.69 Offense-Target-kan-Chakravarthi 24.0395 Offense-Target-kan-Chakravarthi 17.3499 Offense-Target-mal-Chakravarthi 16.69 Offense-Target-mal-Chakravarthi 24.0395 Offense-Target-mal-Chakravarthi 17.3499 Offense-Target-tam-Chakravarthi 16.69 Offense-Target-tam-Chakravarthi 24.0395 Offense-Target-tam-Chakravarthi 17.3499 Offensive-ara-Mubarak 43.6937 Offensive-ara-Zampieri 44.0716 Offensive-dan-Zampieri 46.6775 Offensive-ell-Zampieri 45.4744 Offensive-eng-Zampieri 42.0626 Offensive-Group-eng-Zampieri 35.9955 Offensive-slv-Novak 16.6033 Offensive-Target-eng-Zampieri 47.0199 Offensive-tur-Zampieri 44.3826 Sarcasm-ara-Abufarha 44.5676 Sarcasm-ara-Farha 41.9954 Sarcasm-ces-Ptacek 49.0256 Sarcasm-eng-Bamman 52 Sarcasm-eng-Oraby 32.8859 Sarcasm-eng-Ptacek 38.4236 Sarcasm-eng-Rajadesingan 91.2 Sarcasm-eng-Riloff 0 Sarcasm-eng-Walker 32.7957 Sarcasm-zho-Gong 33.2886 Sentiment-5-eng-Socher 48.6 Sentiment-ace-Winata 28.2247 Sentiment-amh-Muhammad 27.7588 Sentiment-ara-Abdul 42.9638 Sentiment-ara-Muhammad 51.6 Sentiment-arq-Muhammad 49.7895 Sentiment-ary-Muhammad 34.4865 Sentiment-bam-Diallo 31.5404 Sentiment-ban-Winata 34.9994 Sentiment-bbc-Winata 24.6109 Sentiment-ben-Islam 42.8368 Sentiment-ben-Patra 34.2862 Sentiment-bjn-Winata 41.729 Sentiment-bos-Mozetic 26.3945 Sentiment-bug-Winata 20.6918 Sentiment-bul-Mozetic 22.6123 Sentiment-deu-Mozetic 26.9611 Sentiment-deu-Rei 14.4623 Sentiment-eng-Mozetic 36.9443 Sentiment-eng-Pang 97.2 Sentiment-eng-Rosenthal 52.7539 Sentiment-eng-Socher 92.2 Sentiment-fas-Ashrafi 33.7688 Sentiment-fin-Kajava 36.5491 Sentiment-fre-Kajava 71.7116 Sentiment-hau-Muhammad 20.6577 Sentiment-heb-Amram 71 Sentiment-hin-Patra 28.7406 Sentiment-hrv-Mozetic 27.9633 Sentiment-hun-Mozetic 28.8661 Sentiment-ibo-Muhammad 16.2369 Sentiment-ind-Wilie 58.2502 Sentiment-ita-Basile 54.1807 Sentiment-ita-Basile 45.3708 Sentiment-ita-Kajava 56.2818 Sentiment-ita-Rei 10.7527 Sentiment-jav-Winata 35.4842 Sentiment-jpn-Suzuki 45.2 Sentiment-kan-Chakravarthi 55.215 Sentiment-kin-Muhammad 23.0168 Sentiment-kor-Jang 29.0347 Sentiment-mad-Winata 31.2314 Sentiment-mal-Chakravarthi 62.1579 Sentiment-mar-Kulkarni 46.2 Sentiment-min-Winata 41.1963 Sentiment-mlt-Dingli 36.7478 Sentiment-nij-Winata 35.1815 Sentiment-nor-Velldal 18.425 Sentiment-pcm-Muhammad 53.4662 Sentiment-pcm-Oyewusi 33.625 Sentiment-pol-Kocon 32.4498 Sentiment-pol-Mozetic 27.5785 Sentiment-pol-Rybak 11.7963 Sentiment-por-Brum 26.7289 Sentiment-por-Mozetic 26.2196 Sentiment-ron-Dumitrescu 65.4044 Sentiment-rus-Mozetic 30.4191 Sentiment-slk-Mozetic 27.3578 Sentiment-slv-Mozetic 19.7924 Sentiment-spa-Mozetic 31.853 Sentiment-spa-Rei 6.70054 Sentiment-sqi-Mozetic 26.8809 Sentiment-srp-Mozetic 20.6609 Sentiment-sun-Winata 31.979 Sentiment-swe-Mozetic 25.8372 Sentiment-swh-Muhammad 17.8031 Sentiment-tam-Chakravarthi 58.0594 Sentiment-tel-Marreddy 38.8096 Sentiment-tha-Suriyawongkul 20.515 Sentiment-tso-Muhammad 38.426 Sentiment-Tw-eng-Thelwall 75.6 Sentiment-twi-Muhammad 37.2565 Sentiment-yor-Muhammad 33.1365 Sentiment-yor-Shode 56.0392 Sentiment-Yt-eng-Thelwall 84.8 Sentiment-zho-Tan 90.5232 Sentiment-zho-Wan 69.8026 Sexism-fre-Chiril 65.251 Subject-ita-Basile 17.7632 Subject-ita-Basile 26.1448 Subjective-ces-Priban 52.8 Subjective-kor-Jang 3.15103 Subjective-spa-Barbieri 27.8499 Subjevtive-eng-Pang 49
17	Zero-shot	mT0-XL		33.6302		2023-11-01 11:37:10
Submission (Zero-shot) Model (mT0-XL) Results Task Score Task Score Task Score Task Score Aggressive-hin-Kumar 15.8249 Dangerous-ara-Alshehri 46.865 Emotion-ara-Abdul 13.9776 Emotion-ara-Mohammad 35.3169 Emotion-ben-Iqbal 17.8975 Emotion-deu-Bianchi 43.2059 Emotion-eng-Demszky 11.3586 Emotion-eng-Mohammad 47.5664 Emotion-eng-Plaza 19.2926 Emotion-eng-Wallbott 27.0093 Emotion-fas-Sabri 14.0298 Emotion-fin-Kajava 18.7047 Emotion-fin-Ohman 14.4706 Emotion-fre-Bianchi 47.9855 Emotion-fre-Kajava 20.7008 Emotion-hin-Debaditya 9.07106 Emotion-ind-Saputri 29.0316 Emotion-ind-Wilie 30.496 Emotion-ita-Bianchi 38.6925 Emotion-ita-Kajava 20.5776 Emotion-por-Cortiz 2.54518 Emotion-ron-Ciobotaru 41.0673 Emotion-rus-Sboev 30.2684 Emotion-spa-Mohammad 42.7222 Emotion-spa-Plaza 13.5438 Emotion-tur-Guven 51.75 Emotion-vie-Ho 27.8077 Emotion-zho-Lee 55.5024 Hate-ara-Alakrot 43.6302 Hate-ara-Mubarak 48.6653 Hate-ara-Mulki 25.4635 Hate-eng-Basile 36.2245 Hate-eng-Davidson 8.33214 Hate-eng-Waseem 59.7501 Hate-fil-Cabasag 34.4692 Hate-Group-ara-Ousidhoum 14.8301 Hate-Group-fre-Ousidhoum 6.97716 Hate-ita-Bosco 40.2628 Hate-kor-Jeong 33.687 Hate-kor-Moon 16.9044 Hate-pol-Ptaszynski 46.4668 Hate-por-Fortuna 39.6864 Hate-spa-Basile 37.5 Hate-Target-ara-Ousidhoum 30.1857 Hate-Target-ben-Karim 23.147 Hate-Target-fre-Ousidhoum 18.8418 Hate-Target-kor-Jeong 16.9138 Hate-tel-Marreddy 49.8998 Hate-zho-Deng 36.2245 Humor-eng-Meaney 26.6862 Humor-hin-Aggarwal 39.6 Humor-rus-Blinov 34.1238 Humor-spa-Chiruzzo 32.0652 Irony-ara-Ghanem 32.6146 Irony-eng-Hee 0 Irony-fas-Golazizian 56.4626 Irony-hin-Vijay 42.5311 Irony-ita-Basile 46.9214 Irony-ita-Cignarella 34.2105 Irony-spa-Barbieri 46.4668 Irony-spa-Ortega 39.4673 Irony-Type-eng-Hee 18.8279 Irony-zho-Xiang 13.5501 Offense-Target-kan-Chakravarthi 8.09353 Offense-Target-kan-Chakravarthi 26.7972 Offense-Target-kan-Chakravarthi 17.8968 Offense-Target-mal-Chakravarthi 8.09353 Offense-Target-mal-Chakravarthi 26.7972 Offense-Target-mal-Chakravarthi 17.8968 Offense-Target-tam-Chakravarthi 8.09353 Offense-Target-tam-Chakravarthi 26.7972 Offense-Target-tam-Chakravarthi 17.8968 Offensive-ara-Mubarak 43.6937 Offensive-ara-Zampieri 44.0716 Offensive-dan-Zampieri 46.6775 Offensive-ell-Zampieri 45.4744 Offensive-eng-Zampieri 42.0626 Offensive-Group-eng-Zampieri 26.9524 Offensive-slv-Novak 12.9281 Offensive-Target-eng-Zampieri 22.7544 Offensive-tur-Zampieri 44.3826 Sarcasm-ara-Abufarha 44.5676 Sarcasm-ara-Farha 41.9954 Sarcasm-ces-Ptacek 49.0256 Sarcasm-eng-Bamman 52 Sarcasm-eng-Oraby 32.8859 Sarcasm-eng-Ptacek 38.4236 Sarcasm-eng-Rajadesingan 91.2 Sarcasm-eng-Riloff 0 Sarcasm-eng-Walker 32.7957 Sarcasm-zho-Gong 33.2886 Sentiment-5-eng-Socher 45.6 Sentiment-ace-Winata 24.7335 Sentiment-amh-Muhammad 22.4932 Sentiment-ara-Abdul 26.6039 Sentiment-ara-Muhammad 41.6 Sentiment-arq-Muhammad 18.0502 Sentiment-ary-Muhammad 23.4064 Sentiment-bam-Diallo 24.3056 Sentiment-ban-Winata 29.9075 Sentiment-bbc-Winata 19.1966 Sentiment-ben-Islam 30.7485 Sentiment-ben-Patra 28.9082 Sentiment-bjn-Winata 27.7778 Sentiment-bos-Mozetic 21.1563 Sentiment-bug-Winata 18.2698 Sentiment-bul-Mozetic 19.3732 Sentiment-deu-Mozetic 20.5353 Sentiment-deu-Rei 15.7845 Sentiment-eng-Mozetic 22.9246 Sentiment-eng-Pang 76.8 Sentiment-eng-Rosenthal 38.8889 Sentiment-eng-Socher 76.8 Sentiment-fas-Ashrafi 45.6881 Sentiment-fin-Kajava 58.167 Sentiment-fre-Kajava 58.6662 Sentiment-hau-Muhammad 20.935 Sentiment-heb-Amram 76.6 Sentiment-hin-Patra 23.9632 Sentiment-hrv-Mozetic 27.473 Sentiment-hun-Mozetic 27.1871 Sentiment-ibo-Muhammad 11.5166 Sentiment-ind-Wilie 50.7934 Sentiment-ita-Basile 53.07 Sentiment-ita-Basile 44.9918 Sentiment-ita-Kajava 64.7622 Sentiment-ita-Rei 11.3019 Sentiment-jav-Winata 37.6462 Sentiment-jpn-Suzuki 47.6 Sentiment-kan-Chakravarthi 47.5108 Sentiment-kin-Muhammad 14.844 Sentiment-kor-Jang 25.9132 Sentiment-mad-Winata 21.8516 Sentiment-mal-Chakravarthi 56.5095 Sentiment-mar-Kulkarni 35.4 Sentiment-min-Winata 32.4077 Sentiment-mlt-Dingli 39.2529 Sentiment-nij-Winata 22.889 Sentiment-nor-Velldal 35.7305 Sentiment-pcm-Muhammad 23.2137 Sentiment-pcm-Oyewusi 25.2902 Sentiment-pol-Kocon 39.5065 Sentiment-pol-Mozetic 25.5688 Sentiment-pol-Rybak 16.2812 Sentiment-por-Brum 20.314 Sentiment-por-Mozetic 18.0285 Sentiment-ron-Dumitrescu 93.213 Sentiment-rus-Mozetic 20.5971 Sentiment-slk-Mozetic 27.8475 Sentiment-slv-Mozetic 20.746 Sentiment-spa-Mozetic 26.3648 Sentiment-spa-Rei 8.48875 Sentiment-sqi-Mozetic 26.5921 Sentiment-srp-Mozetic 20.5541 Sentiment-sun-Winata 37.6462 Sentiment-swe-Mozetic 20.7673 Sentiment-swh-Muhammad 14.0167 Sentiment-tam-Chakravarthi 50.6353 Sentiment-tel-Marreddy 20.3974 Sentiment-tha-Suriyawongkul 23.9366 Sentiment-tso-Muhammad 30.7423 Sentiment-Tw-eng-Thelwall 73.8 Sentiment-twi-Muhammad 29.3354 Sentiment-yor-Muhammad 28.5847 Sentiment-yor-Shode 43.0721 Sentiment-Yt-eng-Thelwall 81.6 Sentiment-zho-Tan 86.5746 Sentiment-zho-Wan 56.5105 Sexism-fre-Chiril 40.048 Subject-ita-Basile 54.0863 Subject-ita-Basile 47.0432 Subjective-ces-Priban 44.2 Subjective-kor-Jang 12.7964 Subjective-spa-Barbieri 42.9391 Subjevtive-eng-Pang 48.8
18	Baseline	Random		33.4697		2023-11-01 11:37:10
Submission (Baseline) Model (Random) Results Task Score Task Score Task Score Task Score Aggressive-hin-Kumar 43.1424 Dangerous-ara-Alshehri 42.0603 Emotion-ara-Abdul 13.1603 Emotion-ara-Mohammad 22.9795 Emotion-ben-Iqbal 15.9724 Emotion-deu-Bianchi 21.5593 Emotion-eng-Demszky 3.178 Emotion-eng-Mohammad 24.4126 Emotion-eng-Plaza 11.2279 Emotion-eng-Wallbott 11.9961 Emotion-fas-Sabri 20.2662 Emotion-fin-Kajava 13.3213 Emotion-fin-Ohman 13.6046 Emotion-fre-Bianchi 20.0878 Emotion-fre-Kajava 12.8481 Emotion-hin-Debaditya 3.10152 Emotion-ind-Saputri 19.6938 Emotion-ind-Wilie 18.3436 Emotion-ita-Bianchi 22.5398 Emotion-ita-Kajava 13.2844 Emotion-por-Cortiz 3.43543 Emotion-ron-Ciobotaru 23.9897 Emotion-rus-Sboev 15.8427 Emotion-spa-Mohammad 25.579 Emotion-spa-Plaza 11.4735 Emotion-tur-Guven 18 Emotion-vie-Ho 16.1162 Emotion-zho-Lee 16.2679 Hate-ara-Alakrot 43.6954 Hate-ara-Mubarak 37.8382 Hate-ara-Mulki 29.5578 Hate-eng-Basile 52.6055 Hate-eng-Davidson 38.9747 Hate-eng-Waseem 41.5674 Hate-fil-Cabasag 52.3726 Hate-Group-ara-Ousidhoum 6.88547 Hate-Group-fre-Ousidhoum 6.35787 Hate-ita-Bosco 46.9961 Hate-kor-Jeong 51.9623 Hate-kor-Moon 36.7413 Hate-pol-Ptaszynski 44.1548 Hate-por-Fortuna 47.8352 Hate-spa-Basile 44.5902 Hate-Target-ara-Ousidhoum 21.4187 Hate-Target-ben-Karim 22.8931 Hate-Target-fre-Ousidhoum 14.8463 Hate-Target-kor-Jeong 22.5061 Hate-tel-Marreddy 34.3154 Hate-zho-Deng 48.7192 Humor-eng-Meaney 45.2549 Humor-hin-Aggarwal 51.4 Humor-rus-Blinov 47.383 Humor-spa-Chiruzzo 54.578 Irony-ara-Ghanem 48.3926 Irony-eng-Hee 45 Irony-fas-Golazizian 48.2993 Irony-hin-Vijay 46.8825 Irony-ita-Basile 41.8671 Irony-ita-Cignarella 51.7983 Irony-spa-Barbieri 40.6976 Irony-spa-Ortega 46.8355 Irony-Type-eng-Hee 22.3576 Irony-zho-Xiang 11.7073 Offense-Target-kan-Chakravarthi 14.7321 Offense-Target-kan-Chakravarthi 12.7055 Offense-Target-kan-Chakravarthi 14.2824 Offense-Target-mal-Chakravarthi 14.7321 Offense-Target-mal-Chakravarthi 12.7055 Offense-Target-mal-Chakravarthi 14.2824 Offense-Target-tam-Chakravarthi 14.7321 Offense-Target-tam-Chakravarthi 12.7055 Offense-Target-tam-Chakravarthi 14.2824 Offensive-ara-Mubarak 46.2841 Offensive-ara-Zampieri 45.6369 Offensive-dan-Zampieri 41.1362 Offensive-ell-Zampieri 41.2429 Offensive-eng-Zampieri 44.1964 Offensive-Group-eng-Zampieri 31.2204 Offensive-slv-Novak 16.751 Offensive-Target-eng-Zampieri 39.7658 Offensive-tur-Zampieri 41.1143 Sarcasm-ara-Abufarha 44.2556 Sarcasm-ara-Farha 46.2202 Sarcasm-ces-Ptacek 35.9155 Sarcasm-eng-Bamman 52.2 Sarcasm-eng-Oraby 48.9982 Sarcasm-eng-Ptacek 49.8536 Sarcasm-eng-Rajadesingan 48.8 Sarcasm-eng-Riloff 27 Sarcasm-eng-Walker 53.3326 Sarcasm-zho-Gong 48.2487 Sentiment-5-eng-Socher 19.8 Sentiment-ace-Winata 34.7767 Sentiment-amh-Muhammad 37.9528 Sentiment-ara-Abdul 29.1676 Sentiment-ara-Muhammad 33.2 Sentiment-arq-Muhammad 34.235 Sentiment-ary-Muhammad 35.9429 Sentiment-bam-Diallo 27.6127 Sentiment-ban-Winata 30.14 Sentiment-bbc-Winata 30.5985 Sentiment-ben-Islam 31.1812 Sentiment-ben-Patra 28.0641 Sentiment-bjn-Winata 30.7732 Sentiment-bos-Mozetic 34.373 Sentiment-bug-Winata 30.7686 Sentiment-bul-Mozetic 32.4844 Sentiment-deu-Mozetic 32.598 Sentiment-deu-Rei 19.047 Sentiment-eng-Mozetic 30.3286 Sentiment-eng-Pang 51.8 Sentiment-eng-Rosenthal 36.7726 Sentiment-eng-Socher 46.8 Sentiment-fas-Ashrafi 30.5113 Sentiment-fin-Kajava 50.1118 Sentiment-fre-Kajava 47.6979 Sentiment-hau-Muhammad 35.2199 Sentiment-heb-Amram 47.6 Sentiment-hin-Patra 31.6735 Sentiment-hrv-Mozetic 30.2258 Sentiment-hun-Mozetic 27.7966 Sentiment-ibo-Muhammad 32.8981 Sentiment-ind-Wilie 30.523 Sentiment-ita-Basile 46.7866 Sentiment-ita-Basile 49.6115 Sentiment-ita-Kajava 49.6532 Sentiment-ita-Rei 23.7644 Sentiment-jav-Winata 31.6159 Sentiment-jpn-Suzuki 18 Sentiment-kan-Chakravarthi 49.5489 Sentiment-kin-Muhammad 35.8323 Sentiment-kor-Jang 20.7912 Sentiment-mad-Winata 28.6441 Sentiment-mal-Chakravarthi 50.6627 Sentiment-mar-Kulkarni 29.6 Sentiment-min-Winata 34.4147 Sentiment-mlt-Dingli 47.5086 Sentiment-nij-Winata 34.8569 Sentiment-nor-Velldal 16.2441 Sentiment-pcm-Muhammad 35.6168 Sentiment-pcm-Oyewusi 31.0949 Sentiment-pol-Kocon 25.0345 Sentiment-pol-Mozetic 30.953 Sentiment-pol-Rybak 21.5607 Sentiment-por-Brum 35.5937 Sentiment-por-Mozetic 29.8085 Sentiment-ron-Dumitrescu 52.339 Sentiment-rus-Mozetic 32.3322 Sentiment-slk-Mozetic 28.5709 Sentiment-slv-Mozetic 35.8971 Sentiment-spa-Mozetic 29.1886 Sentiment-spa-Rei 19.7765 Sentiment-sqi-Mozetic 29.3899 Sentiment-srp-Mozetic 34.0889 Sentiment-sun-Winata 32.1791 Sentiment-swe-Mozetic 33.3531 Sentiment-swh-Muhammad 33.7199 Sentiment-tam-Chakravarthi 44.6079 Sentiment-tel-Marreddy 30.2689 Sentiment-tha-Suriyawongkul 31.2637 Sentiment-tso-Muhammad 34.0255 Sentiment-Tw-eng-Thelwall 47 Sentiment-twi-Muhammad 34.0418 Sentiment-yor-Muhammad 36.5619 Sentiment-yor-Shode 46.7991 Sentiment-Yt-eng-Thelwall 50.2 Sentiment-zho-Tan 49.0402 Sentiment-zho-Wan 46.6558 Sexism-fre-Chiril 46.0533 Subject-ita-Basile 43.2967 Subject-ita-Basile 48.5147 Subjective-ces-Priban 46.2 Subjective-kor-Jang 10.7421 Subjective-spa-Barbieri 51.1324 Subjevtive-eng-Pang 48.6
19	five-shot in-context learning	BLOOMZ-P3-7B		32.8368		2023-11-01 11:37:10
Submission (five-shot in-context learning) Model (BLOOMZ-P3-7B) Results Task Score Task Score Task Score Task Score Aggressive-hin-Kumar 47.6269 Dangerous-ara-Alshehri 46.865 Emotion-ara-Abdul 3.57143 Emotion-ara-Mohammad 13.4983 Emotion-ben-Iqbal 7.36166 Emotion-deu-Bianchi 14.7557 Emotion-eng-Demszky 0.519675 Emotion-eng-Mohammad 26.4664 Emotion-eng-Plaza 6.49942 Emotion-eng-Wallbott 7.01628 Emotion-fas-Sabri 10.1346 Emotion-fin-Kajava 3.44828 Emotion-fin-Ohman 2.83688 Emotion-fre-Bianchi 15.2655 Emotion-fre-Kajava 4.40711 Emotion-hin-Debaditya 0.461393 Emotion-ind-Saputri 32.9128 Emotion-ind-Wilie 31.9248 Emotion-ita-Bianchi 12.3616 Emotion-ita-Kajava 4.51923 Emotion-por-Cortiz 0.195695 Emotion-ron-Ciobotaru 10.801 Emotion-rus-Sboev 9.68037 Emotion-spa-Mohammad 15.6289 Emotion-spa-Plaza 5.32768 Emotion-tur-Guven 22.5 Emotion-vie-Ho 12.2422 Emotion-zho-Lee 46.89 Hate-ara-Alakrot 43.6302 Hate-ara-Mubarak 48.6653 Hate-ara-Mulki 25.4635 Hate-eng-Basile 36.2245 Hate-eng-Davidson 8.34575 Hate-eng-Waseem 43.8884 Hate-fil-Cabasag 34.4692 Hate-Group-ara-Ousidhoum 9.72789 Hate-Group-fre-Ousidhoum 3.43277 Hate-ita-Bosco 40.2628 Hate-kor-Jeong 33.687 Hate-kor-Moon 16.9044 Hate-pol-Ptaszynski 46.4668 Hate-por-Fortuna 39.6864 Hate-spa-Basile 37.5 Hate-Target-ara-Ousidhoum 8.77122 Hate-Target-ben-Karim 17.7211 Hate-Target-fre-Ousidhoum 3.19232 Hate-Target-kor-Jeong 3.87454 Hate-tel-Marreddy 49.8998 Hate-zho-Deng 36.2245 Humor-eng-Meaney 26.6862 Humor-hin-Aggarwal 39.6 Humor-rus-Blinov 34.1238 Humor-spa-Chiruzzo 32.0652 Irony-ara-Ghanem 50.8248 Irony-eng-Hee 37.3259 Irony-fas-Golazizian 49.6599 Irony-hin-Vijay 50.37 Irony-ita-Basile 46.3795 Irony-ita-Cignarella 48.7669 Irony-spa-Barbieri 49.9932 Irony-spa-Ortega 51.6181 Irony-Type-eng-Hee 18.8279 Irony-zho-Xiang 12.3345 Offense-Target-kan-Chakravarthi 17.9255 Offense-Target-kan-Chakravarthi 24.0125 Offense-Target-kan-Chakravarthi 17.3243 Offense-Target-mal-Chakravarthi 17.9255 Offense-Target-mal-Chakravarthi 24.0125 Offense-Target-mal-Chakravarthi 17.3243 Offense-Target-tam-Chakravarthi 17.9255 Offense-Target-tam-Chakravarthi 24.0125 Offense-Target-tam-Chakravarthi 17.3243 Offensive-ara-Mubarak 44.6279 Offensive-ara-Zampieri 45.0555 Offensive-dan-Zampieri 46.6775 Offensive-ell-Zampieri 45.4744 Offensive-eng-Zampieri 42.0626 Offensive-Group-eng-Zampieri 22.1134 Offensive-slv-Novak 15.8411 Offensive-Target-eng-Zampieri 46.7849 Offensive-tur-Zampieri 44.3826 Sarcasm-ara-Abufarha 44.5061 Sarcasm-ara-Farha 43.3665 Sarcasm-ces-Ptacek 48.657 Sarcasm-eng-Bamman 52.6 Sarcasm-eng-Oraby 34.551 Sarcasm-eng-Ptacek 38.7634 Sarcasm-eng-Rajadesingan 90.2 Sarcasm-eng-Riloff 9.7561 Sarcasm-eng-Walker 34.8529 Sarcasm-zho-Gong 33.1989 Sentiment-5-eng-Socher 38.4 Sentiment-ace-Winata 32.8043 Sentiment-amh-Muhammad 29.2207 Sentiment-ara-Abdul 40.9468 Sentiment-ara-Muhammad 50.4 Sentiment-arq-Muhammad 38.678 Sentiment-ary-Muhammad 32.7953 Sentiment-bam-Diallo 32.4286 Sentiment-ban-Winata 33.0815 Sentiment-bbc-Winata 29.8568 Sentiment-ben-Islam 43.5687 Sentiment-ben-Patra 32.358 Sentiment-bjn-Winata 41.1657 Sentiment-bos-Mozetic 25.8612 Sentiment-bug-Winata 29.3402 Sentiment-bul-Mozetic 24.7367 Sentiment-deu-Mozetic 20.605 Sentiment-deu-Rei 12.169 Sentiment-eng-Mozetic 30.0144 Sentiment-eng-Pang 71.4 Sentiment-eng-Rosenthal 49.46 Sentiment-eng-Socher 67.2 Sentiment-fas-Ashrafi 36.6093 Sentiment-fin-Kajava 49.5346 Sentiment-fre-Kajava 76.1082 Sentiment-hau-Muhammad 27.335 Sentiment-heb-Amram 60.2 Sentiment-hin-Patra 27.8095 Sentiment-hrv-Mozetic 33.4992 Sentiment-hun-Mozetic 29.206 Sentiment-ibo-Muhammad 22.2016 Sentiment-ind-Wilie 55.5188 Sentiment-ita-Basile 57.4357 Sentiment-ita-Basile 51.5018 Sentiment-ita-Kajava 66.6956 Sentiment-ita-Rei 10.3803 Sentiment-jav-Winata 38.9706 Sentiment-jpn-Suzuki 35 Sentiment-kan-Chakravarthi 58.7532 Sentiment-kin-Muhammad 21.7962 Sentiment-kor-Jang 25.2943 Sentiment-mad-Winata 34.3137 Sentiment-mal-Chakravarthi 55.2538 Sentiment-mar-Kulkarni 37.6 Sentiment-min-Winata 40.7703 Sentiment-mlt-Dingli 53.0236 Sentiment-nij-Winata 36.8182 Sentiment-nor-Velldal 16.2893 Sentiment-pcm-Muhammad 46.2225 Sentiment-pcm-Oyewusi 34.0169 Sentiment-pol-Kocon 23.2124 Sentiment-pol-Mozetic 28.8833 Sentiment-pol-Rybak 12.2576 Sentiment-por-Brum 31.4399 Sentiment-por-Mozetic 26.4084 Sentiment-ron-Dumitrescu 70.828 Sentiment-rus-Mozetic 29.0107 Sentiment-slk-Mozetic 30.2873 Sentiment-slv-Mozetic 26.6274 Sentiment-spa-Mozetic 26.791 Sentiment-spa-Rei 7.73772 Sentiment-sqi-Mozetic 26.6127 Sentiment-srp-Mozetic 25.4213 Sentiment-sun-Winata 38.0355 Sentiment-swe-Mozetic 27.4527 Sentiment-swh-Muhammad 16.2683 Sentiment-tam-Chakravarthi 54.0495 Sentiment-tel-Marreddy 30.3491 Sentiment-tha-Suriyawongkul 18.4799 Sentiment-tso-Muhammad 39.3707 Sentiment-Tw-eng-Thelwall 55.2 Sentiment-twi-Muhammad 40.4343 Sentiment-yor-Muhammad 31.5766 Sentiment-yor-Shode 58.816 Sentiment-Yt-eng-Thelwall 61.6 Sentiment-zho-Tan 75.2672 Sentiment-zho-Wan 60.0103 Sexism-fre-Chiril 52.9671 Subject-ita-Basile 17.7632 Subject-ita-Basile 26.1448 Subjective-ces-Priban 52.8 Subjective-kor-Jang 10.7564 Subjective-spa-Barbieri 27.8499 Subjevtive-eng-Pang 49
20	three-shot in-context learning	BLOOM-7B		32.757		2023-11-01 11:37:10
Submission (three-shot in-context learning) Model (BLOOM-7B) Results Task Score Task Score Task Score Task Score Aggressive-hin-Kumar 46.4286 Dangerous-ara-Alshehri 46.865 Emotion-ara-Abdul 8.16544 Emotion-ara-Mohammad 27.4353 Emotion-ben-Iqbal 19.2878 Emotion-deu-Bianchi 25.4574 Emotion-eng-Demszky 6.54272 Emotion-eng-Mohammad 35.3269 Emotion-eng-Plaza 10.6335 Emotion-eng-Wallbott 15.145 Emotion-fas-Sabri 5.67204 Emotion-fin-Kajava 6.00027 Emotion-fin-Ohman 5.72168 Emotion-fre-Bianchi 27.1489 Emotion-fre-Kajava 9.06044 Emotion-hin-Debaditya 7.02466 Emotion-ind-Saputri 24.5613 Emotion-ind-Wilie 27.9982 Emotion-ita-Bianchi 24.8991 Emotion-ita-Kajava 9.40055 Emotion-por-Cortiz 2.79185 Emotion-ron-Ciobotaru 18.6232 Emotion-rus-Sboev 11.6964 Emotion-spa-Mohammad 26.5731 Emotion-spa-Plaza 11.7264 Emotion-tur-Guven 24.75 Emotion-vie-Ho 16.2007 Emotion-zho-Lee 36.1244 Hate-ara-Alakrot 45.9378 Hate-ara-Mubarak 49.9709 Hate-ara-Mulki 30.3751 Hate-eng-Basile 37.3813 Hate-eng-Davidson 8.25197 Hate-eng-Waseem 55.3892 Hate-fil-Cabasag 35.6724 Hate-Group-ara-Ousidhoum 9.97807 Hate-Group-fre-Ousidhoum 3.00806 Hate-ita-Bosco 42.501 Hate-kor-Jeong 33.8667 Hate-kor-Moon 17.8763 Hate-pol-Ptaszynski 49.018 Hate-por-Fortuna 40.1382 Hate-spa-Basile 40.9435 Hate-Target-ara-Ousidhoum 6.49351 Hate-Target-ben-Karim 7.6872 Hate-Target-fre-Ousidhoum 1.94166 Hate-Target-kor-Jeong 15.2924 Hate-tel-Marreddy 49.2901 Hate-zho-Deng 39.2875 Humor-eng-Meaney 27.0389 Humor-hin-Aggarwal 39 Humor-rus-Blinov 34.3154 Humor-spa-Chiruzzo 34.339 Irony-ara-Ghanem 45.5147 Irony-eng-Hee 26.4151 Irony-fas-Golazizian 54.7619 Irony-hin-Vijay 55.226 Irony-ita-Basile 45.1798 Irony-ita-Cignarella 43.3448 Irony-spa-Barbieri 48.8373 Irony-spa-Ortega 48.673 Irony-Type-eng-Hee 18.8279 Irony-zho-Xiang 11.94 Offense-Target-kan-Chakravarthi 18.3812 Offense-Target-kan-Chakravarthi 27.8566 Offense-Target-kan-Chakravarthi 17.2924 Offense-Target-mal-Chakravarthi 18.3812 Offense-Target-mal-Chakravarthi 27.8566 Offense-Target-mal-Chakravarthi 17.2924 Offense-Target-tam-Chakravarthi 18.3812 Offense-Target-tam-Chakravarthi 27.8566 Offense-Target-tam-Chakravarthi 17.2924 Offensive-ara-Mubarak 52.9465 Offensive-ara-Zampieri 51.4948 Offensive-dan-Zampieri 53.3908 Offensive-ell-Zampieri 45.6256 Offensive-eng-Zampieri 45.0074 Offensive-Group-eng-Zampieri 21.2993 Offensive-slv-Novak 10.8051 Offensive-Target-eng-Zampieri 41.7878 Offensive-tur-Zampieri 48.3149 Sarcasm-ara-Abufarha 47.7595 Sarcasm-ara-Farha 46.1537 Sarcasm-ces-Ptacek 37.7434 Sarcasm-eng-Bamman 45.8 Sarcasm-eng-Oraby 52.5679 Sarcasm-eng-Ptacek 52.1562 Sarcasm-eng-Rajadesingan 40.4 Sarcasm-eng-Riloff 37.6812 Sarcasm-eng-Walker 48.941 Sarcasm-zho-Gong 52.2445 Sentiment-5-eng-Socher 30.4 Sentiment-ace-Winata 33.5462 Sentiment-amh-Muhammad 55.1143 Sentiment-ara-Abdul 36.8541 Sentiment-ara-Muhammad 38.4 Sentiment-arq-Muhammad 40.2874 Sentiment-ary-Muhammad 28.9682 Sentiment-bam-Diallo 21.4364 Sentiment-ban-Winata 35.9507 Sentiment-bbc-Winata 33.383 Sentiment-ben-Islam 33.7466 Sentiment-ben-Patra 28.9369 Sentiment-bjn-Winata 35.501 Sentiment-bos-Mozetic 32.0234 Sentiment-bug-Winata 32.4471 Sentiment-bul-Mozetic 27.0903 Sentiment-deu-Mozetic 24.9044 Sentiment-deu-Rei 14.2605 Sentiment-eng-Mozetic 30.5398 Sentiment-eng-Pang 55 Sentiment-eng-Rosenthal 38.0418 Sentiment-eng-Socher 59.4 Sentiment-fas-Ashrafi 26.1785 Sentiment-fin-Kajava 49.8542 Sentiment-fre-Kajava 57.895 Sentiment-hau-Muhammad 28.7038 Sentiment-heb-Amram 47.8 Sentiment-hin-Patra 28.102 Sentiment-hrv-Mozetic 29.9611 Sentiment-hun-Mozetic 21.3598 Sentiment-ibo-Muhammad 25.3129 Sentiment-ind-Wilie 37.0669 Sentiment-ita-Basile 54.9594 Sentiment-ita-Basile 50.3284 Sentiment-ita-Kajava 55.6873 Sentiment-ita-Rei 17.9234 Sentiment-jav-Winata 35.7909 Sentiment-jpn-Suzuki 32.2 Sentiment-kan-Chakravarthi 47.5108 Sentiment-kin-Muhammad 25.3827 Sentiment-kor-Jang 17.9484 Sentiment-mad-Winata 32.5317 Sentiment-mal-Chakravarthi 48.1362 Sentiment-mar-Kulkarni 32 Sentiment-min-Winata 35.7361 Sentiment-mlt-Dingli 49.5906 Sentiment-nij-Winata 35.2748 Sentiment-nor-Velldal 0 Sentiment-pcm-Muhammad 46.431 Sentiment-pcm-Oyewusi 24.1588 Sentiment-pol-Kocon 18.887 Sentiment-pol-Mozetic 32.6349 Sentiment-pol-Rybak 10.231 Sentiment-por-Brum 35.0939 Sentiment-por-Mozetic 41.2892 Sentiment-ron-Dumitrescu 54.9025 Sentiment-rus-Mozetic 32.176 Sentiment-slk-Mozetic 27.5875 Sentiment-slv-Mozetic 28.1807 Sentiment-spa-Mozetic 25.8157 Sentiment-spa-Rei 17.68 Sentiment-sqi-Mozetic 23.3896 Sentiment-srp-Mozetic 32.6459 Sentiment-sun-Winata 35.5133 Sentiment-swe-Mozetic 34.7571 Sentiment-swh-Muhammad 14.0112 Sentiment-tam-Chakravarthi 44.4444 Sentiment-tel-Marreddy 32.5826 Sentiment-tha-Suriyawongkul 20.6553 Sentiment-tso-Muhammad 35.7564 Sentiment-Tw-eng-Thelwall 54.2 Sentiment-twi-Muhammad 35.7899 Sentiment-yor-Muhammad 24.2219 Sentiment-yor-Shode 53.4611 Sentiment-Yt-eng-Thelwall 59.2 Sentiment-zho-Tan 49.7409 Sentiment-zho-Wan 50.0705 Sexism-fre-Chiril 45.3165 Subject-ita-Basile 29.7121 Subject-ita-Basile 38.2163 Subjective-ces-Priban 53 Subjective-kor-Jang 11.9119 Subjective-spa-Barbieri 39.7783 Subjevtive-eng-Pang 46.4
21	five-shot in-context learning	BLOOM-7B		32.0266		2023-11-01 11:37:10
Submission (five-shot in-context learning) Model (BLOOM-7B) Results Task Score Task Score Task Score Task Score Aggressive-hin-Kumar 47.9167 Dangerous-ara-Alshehri 46.865 Emotion-ara-Abdul 7.64338 Emotion-ara-Mohammad 26.7099 Emotion-ben-Iqbal 23.1449 Emotion-deu-Bianchi 26.2228 Emotion-eng-Demszky 6.057 Emotion-eng-Mohammad 36.7695 Emotion-eng-Plaza 14.6569 Emotion-eng-Wallbott 16.1263 Emotion-fas-Sabri 7.69082 Emotion-fin-Kajava 5.84533 Emotion-fin-Ohman 5.20823 Emotion-fre-Bianchi 29.8236 Emotion-fre-Kajava 10.3652 Emotion-hin-Debaditya 6.3101 Emotion-ind-Saputri 29.8451 Emotion-ind-Wilie 29.5695 Emotion-ita-Bianchi 27.3689 Emotion-ita-Kajava 8.22332 Emotion-por-Cortiz 3.26498 Emotion-ron-Ciobotaru 18.7449 Emotion-rus-Sboev 23.2208 Emotion-spa-Mohammad 26.9371 Emotion-spa-Plaza 10.2119 Emotion-tur-Guven 24.75 Emotion-vie-Ho 15.4866 Emotion-zho-Lee 40.1914 Hate-ara-Alakrot 46.0227 Hate-ara-Mubarak 50.7605 Hate-ara-Mulki 31.0056 Hate-eng-Basile 39.0188 Hate-eng-Davidson 9.18244 Hate-eng-Waseem 39.8514 Hate-fil-Cabasag 35.2172 Hate-Group-ara-Ousidhoum 5.4695 Hate-Group-fre-Ousidhoum 2.28022 Hate-ita-Bosco 43.0353 Hate-kor-Jeong 34.1366 Hate-kor-Moon 16.9312 Hate-pol-Ptaszynski 47.6948 Hate-por-Fortuna 41.14 Hate-spa-Basile 38.2572 Hate-Target-ara-Ousidhoum 6.47668 Hate-Target-ben-Karim 9.02099 Hate-Target-fre-Ousidhoum 4.2005 Hate-Target-kor-Jeong 18.7998 Hate-tel-Marreddy 57.1351 Hate-zho-Deng 39.189 Humor-eng-Meaney 26.6862 Humor-hin-Aggarwal 40.2 Humor-rus-Blinov 34.3154 Humor-spa-Chiruzzo 35.047 Irony-ara-Ghanem 46.3051 Irony-eng-Hee 41.6667 Irony-fas-Golazizian 49.6599 Irony-hin-Vijay 55.3012 Irony-ita-Basile 46.9427 Irony-ita-Cignarella 47.5942 Irony-spa-Barbieri 45.6418 Irony-spa-Ortega 53.668 Irony-Type-eng-Hee 18.8279 Irony-zho-Xiang 12.3058 Offense-Target-kan-Chakravarthi 17.4662 Offense-Target-kan-Chakravarthi 23.6258 Offense-Target-kan-Chakravarthi 18.3664 Offense-Target-mal-Chakravarthi 17.4662 Offense-Target-mal-Chakravarthi 23.6258 Offense-Target-mal-Chakravarthi 18.3664 Offense-Target-tam-Chakravarthi 17.4662 Offense-Target-tam-Chakravarthi 23.6258 Offense-Target-tam-Chakravarthi 18.3664 Offensive-ara-Mubarak 49.3666 Offensive-ara-Zampieri 45.6256 Offensive-dan-Zampieri 49.5646 Offensive-ell-Zampieri 46.5676 Offensive-eng-Zampieri 43.9403 Offensive-Group-eng-Zampieri 21.2993 Offensive-slv-Novak 16.8421 Offensive-Target-eng-Zampieri 41.5676 Offensive-tur-Zampieri 45.0555 Sarcasm-ara-Abufarha 43.8897 Sarcasm-ara-Farha 45.7855 Sarcasm-ces-Ptacek 34.3129 Sarcasm-eng-Bamman 48.8 Sarcasm-eng-Oraby 50.4565 Sarcasm-eng-Ptacek 50.9291 Sarcasm-eng-Rajadesingan 36.6 Sarcasm-eng-Riloff 39.4737 Sarcasm-eng-Walker 53.3143 Sarcasm-zho-Gong 50.6971 Sentiment-5-eng-Socher 30.6 Sentiment-ace-Winata 30.6576 Sentiment-amh-Muhammad 56.283 Sentiment-ara-Abdul 35.6872 Sentiment-ara-Muhammad 37.2 Sentiment-arq-Muhammad 43.9481 Sentiment-ary-Muhammad 27.8775 Sentiment-bam-Diallo 22.497 Sentiment-ban-Winata 31.2528 Sentiment-bbc-Winata 29.6838 Sentiment-ben-Islam 30.6405 Sentiment-ben-Patra 24.4373 Sentiment-bjn-Winata 31.693 Sentiment-bos-Mozetic 26.5197 Sentiment-bug-Winata 30.2298 Sentiment-bul-Mozetic 23.0239 Sentiment-deu-Mozetic 17.7942 Sentiment-deu-Rei 10.4774 Sentiment-eng-Mozetic 25.4051 Sentiment-eng-Pang 62 Sentiment-eng-Rosenthal 38.4218 Sentiment-eng-Socher 59.8 Sentiment-fas-Ashrafi 25.1344 Sentiment-fin-Kajava 48.8131 Sentiment-fre-Kajava 60.9191 Sentiment-hau-Muhammad 24.8702 Sentiment-heb-Amram 52.2 Sentiment-hin-Patra 21.6458 Sentiment-hrv-Mozetic 24.5686 Sentiment-hun-Mozetic 18.7802 Sentiment-ibo-Muhammad 19.7608 Sentiment-ind-Wilie 35.7026 Sentiment-ita-Basile 58.0131 Sentiment-ita-Basile 49.8536 Sentiment-ita-Kajava 58.3466 Sentiment-ita-Rei 7.82291 Sentiment-jav-Winata 32.0697 Sentiment-jpn-Suzuki 34.4 Sentiment-kan-Chakravarthi 50.339 Sentiment-kin-Muhammad 25.1728 Sentiment-kor-Jang 18.68 Sentiment-mad-Winata 30.5111 Sentiment-mal-Chakravarthi 53.0447 Sentiment-mar-Kulkarni 36.4 Sentiment-min-Winata 32.1828 Sentiment-mlt-Dingli 54.3351 Sentiment-nij-Winata 31.4342 Sentiment-nor-Velldal 0 Sentiment-pcm-Muhammad 46.9373 Sentiment-pcm-Oyewusi 18.3314 Sentiment-pol-Kocon 20.3036 Sentiment-pol-Mozetic 28.1505 Sentiment-pol-Rybak 9.60395 Sentiment-por-Brum 34.5935 Sentiment-por-Mozetic 32.2413 Sentiment-ron-Dumitrescu 49.4702 Sentiment-rus-Mozetic 25.8786 Sentiment-slk-Mozetic 26.7213 Sentiment-slv-Mozetic 25.4723 Sentiment-spa-Mozetic 22.319 Sentiment-spa-Rei 7.79991 Sentiment-sqi-Mozetic 20.4495 Sentiment-srp-Mozetic 29.2901 Sentiment-sun-Winata 31.8238 Sentiment-swe-Mozetic 28.4993 Sentiment-swh-Muhammad 8.50076 Sentiment-tam-Chakravarthi 48.991 Sentiment-tel-Marreddy 23.0265 Sentiment-tha-Suriyawongkul 18.2063 Sentiment-tso-Muhammad 32.8269 Sentiment-Tw-eng-Thelwall 57.4 Sentiment-twi-Muhammad 30.671 Sentiment-yor-Muhammad 23.009 Sentiment-yor-Shode 53.8988 Sentiment-Yt-eng-Thelwall 64.8 Sentiment-zho-Tan 50.8513 Sentiment-zho-Wan 52.7475 Sexism-fre-Chiril 38.6568 Subject-ita-Basile 23.2861 Subject-ita-Basile 31.8681 Subjective-ces-Priban 51.6 Subjective-kor-Jang 12.071 Subjective-spa-Barbieri 34.5597 Subjevtive-eng-Pang 48.8
22	three-shot in-context learning	BLOOMZ-P3-7B		31.914		2023-11-01 11:37:10
Submission (three-shot in-context learning) Model (BLOOMZ-P3-7B) Results Task Score Task Score Task Score Task Score Aggressive-hin-Kumar 43.9279 Dangerous-ara-Alshehri 46.865 Emotion-ara-Abdul 4.53297 Emotion-ara-Mohammad 13.095 Emotion-ben-Iqbal 6.692 Emotion-deu-Bianchi 15.0857 Emotion-eng-Demszky 0.329885 Emotion-eng-Mohammad 24.4326 Emotion-eng-Plaza 5.95996 Emotion-eng-Wallbott 6.96653 Emotion-fas-Sabri 8.84482 Emotion-fin-Kajava 3.44828 Emotion-fin-Ohman 2.83688 Emotion-fre-Bianchi 15.8885 Emotion-fre-Kajava 4.83403 Emotion-hin-Debaditya 2.22126 Emotion-ind-Saputri 30.424 Emotion-ind-Wilie 30.7222 Emotion-ita-Bianchi 13.5288 Emotion-ita-Kajava 4.50489 Emotion-por-Cortiz 0.194932 Emotion-ron-Ciobotaru 12.0164 Emotion-rus-Sboev 10.4669 Emotion-spa-Mohammad 14.233 Emotion-spa-Plaza 6.91379 Emotion-tur-Guven 21 Emotion-vie-Ho 11.6588 Emotion-zho-Lee 45.6938 Hate-ara-Alakrot 43.6302 Hate-ara-Mubarak 48.6653 Hate-ara-Mulki 25.4951 Hate-eng-Basile 36.2245 Hate-eng-Davidson 8.33214 Hate-eng-Waseem 59.9301 Hate-fil-Cabasag 34.4692 Hate-Group-ara-Ousidhoum 10.3516 Hate-Group-fre-Ousidhoum 3.00375 Hate-ita-Bosco 40.2628 Hate-kor-Jeong 33.687 Hate-kor-Moon 16.9044 Hate-pol-Ptaszynski 46.4668 Hate-por-Fortuna 39.6864 Hate-spa-Basile 37.5 Hate-Target-ara-Ousidhoum 9.24002 Hate-Target-ben-Karim 19.7144 Hate-Target-fre-Ousidhoum 3.24366 Hate-Target-kor-Jeong 3.78928 Hate-tel-Marreddy 49.8998 Hate-zho-Deng 36.2245 Humor-eng-Meaney 26.6862 Humor-hin-Aggarwal 39.6 Humor-rus-Blinov 34.1238 Humor-spa-Chiruzzo 32.0652 Irony-ara-Ghanem 42.1081 Irony-eng-Hee 23.8596 Irony-fas-Golazizian 56.1224 Irony-hin-Vijay 49.6625 Irony-ita-Basile 46.0352 Irony-ita-Cignarella 44.9021 Irony-spa-Barbieri 50.7914 Irony-spa-Ortega 48.6359 Irony-Type-eng-Hee 18.8279 Irony-zho-Xiang 12.1006 Offense-Target-kan-Chakravarthi 19.5758 Offense-Target-kan-Chakravarthi 23.904 Offense-Target-kan-Chakravarthi 17.3243 Offense-Target-mal-Chakravarthi 19.5758 Offense-Target-mal-Chakravarthi 23.904 Offense-Target-mal-Chakravarthi 17.3243 Offense-Target-tam-Chakravarthi 19.5758 Offense-Target-tam-Chakravarthi 23.904 Offense-Target-tam-Chakravarthi 17.3243 Offensive-ara-Mubarak 44.6279 Offensive-ara-Zampieri 44.0716 Offensive-dan-Zampieri 46.6775 Offensive-ell-Zampieri 45.4744 Offensive-eng-Zampieri 42.0626 Offensive-Group-eng-Zampieri 25.7776 Offensive-slv-Novak 14.431 Offensive-Target-eng-Zampieri 50.4549 Offensive-tur-Zampieri 44.3826 Sarcasm-ara-Abufarha 45.484 Sarcasm-ara-Farha 41.7249 Sarcasm-ces-Ptacek 48.3904 Sarcasm-eng-Bamman 52 Sarcasm-eng-Oraby 35.8638 Sarcasm-eng-Ptacek 38.6842 Sarcasm-eng-Rajadesingan 90.2 Sarcasm-eng-Riloff 4.7619 Sarcasm-eng-Walker 37.7704 Sarcasm-zho-Gong 34.175 Sentiment-5-eng-Socher 39.4 Sentiment-ace-Winata 33.4428 Sentiment-amh-Muhammad 36.2145 Sentiment-ara-Abdul 37.8206 Sentiment-ara-Muhammad 48 Sentiment-arq-Muhammad 41.3628 Sentiment-ary-Muhammad 30.8981 Sentiment-bam-Diallo 30.7114 Sentiment-ban-Winata 35.3758 Sentiment-bbc-Winata 30.1714 Sentiment-ben-Islam 38.1356 Sentiment-ben-Patra 28.1663 Sentiment-bjn-Winata 40.4767 Sentiment-bos-Mozetic 26.2243 Sentiment-bug-Winata 29.6181 Sentiment-bul-Mozetic 22.9831 Sentiment-deu-Mozetic 19.9065 Sentiment-deu-Rei 10.8895 Sentiment-eng-Mozetic 25.3039 Sentiment-eng-Pang 70.2 Sentiment-eng-Rosenthal 36.9117 Sentiment-eng-Socher 71.2 Sentiment-fas-Ashrafi 32.561 Sentiment-fin-Kajava 52.8005 Sentiment-fre-Kajava 60.1974 Sentiment-hau-Muhammad 24.1866 Sentiment-heb-Amram 53.4 Sentiment-hin-Patra 23.3289 Sentiment-hrv-Mozetic 29.0891 Sentiment-hun-Mozetic 23.4409 Sentiment-ibo-Muhammad 18.7909 Sentiment-ind-Wilie 50.5547 Sentiment-ita-Basile 55.1918 Sentiment-ita-Basile 50.6337 Sentiment-ita-Kajava 57.4161 Sentiment-ita-Rei 8.35903 Sentiment-jav-Winata 39.5089 Sentiment-jpn-Suzuki 33.6 Sentiment-kan-Chakravarthi 56.0628 Sentiment-kin-Muhammad 23.0261 Sentiment-kor-Jang 22.7109 Sentiment-mad-Winata 33.9713 Sentiment-mal-Chakravarthi 54.3468 Sentiment-mar-Kulkarni 37.6 Sentiment-min-Winata 40.3307 Sentiment-mlt-Dingli 46.2878 Sentiment-nij-Winata 35.3892 Sentiment-nor-Velldal 15.3399 Sentiment-pcm-Muhammad 45.1227 Sentiment-pcm-Oyewusi 33.9726 Sentiment-pol-Kocon 25.4331 Sentiment-pol-Mozetic 28.1668 Sentiment-pol-Rybak 12.5195 Sentiment-por-Brum 29.9656 Sentiment-por-Mozetic 27.9559 Sentiment-ron-Dumitrescu 66.749 Sentiment-rus-Mozetic 26.0703 Sentiment-slk-Mozetic 30.2231 Sentiment-slv-Mozetic 20.9432 Sentiment-spa-Mozetic 26.3293 Sentiment-spa-Rei 6.91798 Sentiment-sqi-Mozetic 25.6402 Sentiment-srp-Mozetic 27.4945 Sentiment-sun-Winata 37.1492 Sentiment-swe-Mozetic 29.6499 Sentiment-swh-Muhammad 15.0726 Sentiment-tam-Chakravarthi 52.9766 Sentiment-tel-Marreddy 27.4474 Sentiment-tha-Suriyawongkul 12.6369 Sentiment-tso-Muhammad 35.1944 Sentiment-Tw-eng-Thelwall 54.6 Sentiment-twi-Muhammad 39.0699 Sentiment-yor-Muhammad 28.3373 Sentiment-yor-Shode 52.6673 Sentiment-Yt-eng-Thelwall 61.6 Sentiment-zho-Tan 71.9077 Sentiment-zho-Wan 53.2719 Sexism-fre-Chiril 55.4862 Subject-ita-Basile 17.7632 Subject-ita-Basile 26.1448 Subjective-ces-Priban 52.8 Subjective-kor-Jang 10.4133 Subjective-spa-Barbieri 27.8499 Subjevtive-eng-Pang 49
23	three-shot in-context learning	mT0-XL		31.7095		2023-11-01 11:37:10
Submission (three-shot in-context learning) Model (mT0-XL) Results Task Score Task Score Task Score Task Score Aggressive-hin-Kumar 41.8803 Dangerous-ara-Alshehri 46.865 Emotion-ara-Abdul 13.9432 Emotion-ara-Mohammad 35.3923 Emotion-ben-Iqbal 21.0888 Emotion-deu-Bianchi 36.4435 Emotion-eng-Demszky 2.71517 Emotion-eng-Mohammad 37.941 Emotion-eng-Plaza 11.1357 Emotion-eng-Wallbott 16.9125 Emotion-fas-Sabri 14.8649 Emotion-fin-Kajava 13.9464 Emotion-fin-Ohman 13.2976 Emotion-fre-Bianchi 36.3787 Emotion-fre-Kajava 16.286 Emotion-hin-Debaditya 2.46135 Emotion-ind-Saputri 40.5455 Emotion-ind-Wilie 39.5243 Emotion-ita-Bianchi 29.7624 Emotion-ita-Kajava 15.4532 Emotion-por-Cortiz 1.08745 Emotion-ron-Ciobotaru 31.2334 Emotion-rus-Sboev 29.5023 Emotion-spa-Mohammad 35.7874 Emotion-spa-Plaza 11.1191 Emotion-tur-Guven 37 Emotion-vie-Ho 16.6963 Emotion-zho-Lee 40.6699 Hate-ara-Alakrot 43.6302 Hate-ara-Mubarak 48.6125 Hate-ara-Mulki 25.4635 Hate-eng-Basile 36.143 Hate-eng-Davidson 8.71154 Hate-eng-Waseem 60.8604 Hate-fil-Cabasag 34.4692 Hate-Group-ara-Ousidhoum 14.6634 Hate-Group-fre-Ousidhoum 5.77397 Hate-ita-Bosco 40.2628 Hate-kor-Jeong 33.687 Hate-kor-Moon 18.2252 Hate-pol-Ptaszynski 46.4094 Hate-por-Fortuna 39.6864 Hate-spa-Basile 37.8828 Hate-Target-ara-Ousidhoum 23.1579 Hate-Target-ben-Karim 15.0865 Hate-Target-fre-Ousidhoum 6.30488 Hate-Target-kor-Jeong 17.7737 Hate-tel-Marreddy 49.8998 Hate-zho-Deng 36.7316 Humor-eng-Meaney 31.4286 Humor-hin-Aggarwal 40 Humor-rus-Blinov 43.8227 Humor-spa-Chiruzzo 37.4926 Irony-ara-Ghanem 32.9522 Irony-eng-Hee 1.0363 Irony-fas-Golazizian 56.8027 Irony-hin-Vijay 45.411 Irony-ita-Basile 46.9214 Irony-ita-Cignarella 34.0369 Irony-spa-Barbieri 46.4094 Irony-spa-Ortega 39.3939 Irony-Type-eng-Hee 18.8279 Irony-zho-Xiang 13.6328 Offense-Target-kan-Chakravarthi 17.8597 Offense-Target-kan-Chakravarthi 23.9289 Offense-Target-kan-Chakravarthi 18.2127 Offense-Target-mal-Chakravarthi 17.8597 Offense-Target-mal-Chakravarthi 23.9289 Offense-Target-mal-Chakravarthi 18.2127 Offense-Target-tam-Chakravarthi 17.8597 Offense-Target-tam-Chakravarthi 23.9289 Offense-Target-tam-Chakravarthi 18.2127 Offensive-ara-Mubarak 43.6937 Offensive-ara-Zampieri 44.0716 Offensive-dan-Zampieri 46.6775 Offensive-ell-Zampieri 45.4744 Offensive-eng-Zampieri 42.0626 Offensive-Group-eng-Zampieri 27.4924 Offensive-slv-Novak 24.3328 Offensive-Target-eng-Zampieri 10.1124 Offensive-tur-Zampieri 44.3826 Sarcasm-ara-Abufarha 46.2663 Sarcasm-ara-Farha 45.2304 Sarcasm-ces-Ptacek 36.2502 Sarcasm-eng-Bamman 51.2 Sarcasm-eng-Oraby 54.7993 Sarcasm-eng-Ptacek 49.3213 Sarcasm-eng-Rajadesingan 57.4 Sarcasm-eng-Riloff 38.9831 Sarcasm-eng-Walker 52.9983 Sarcasm-zho-Gong 51.7101 Sentiment-5-eng-Socher 27 Sentiment-ace-Winata 29.7263 Sentiment-amh-Muhammad 20.5196 Sentiment-ara-Abdul 23.8528 Sentiment-ara-Muhammad 41.8 Sentiment-arq-Muhammad 25.7813 Sentiment-ary-Muhammad 25.7653 Sentiment-bam-Diallo 27.2243 Sentiment-ban-Winata 31.0585 Sentiment-bbc-Winata 27.1312 Sentiment-ben-Islam 24.88 Sentiment-ben-Patra 25.3481 Sentiment-bjn-Winata 30.1786 Sentiment-bos-Mozetic 24.5881 Sentiment-bug-Winata 25.9206 Sentiment-bul-Mozetic 22.5229 Sentiment-deu-Mozetic 17.9787 Sentiment-deu-Rei 12.5416 Sentiment-eng-Mozetic 22.2649 Sentiment-eng-Pang 55.6 Sentiment-eng-Rosenthal 36.5753 Sentiment-eng-Socher 56 Sentiment-fas-Ashrafi 30.5793 Sentiment-fin-Kajava 47.4569 Sentiment-fre-Kajava 50.5636 Sentiment-hau-Muhammad 23.5506 Sentiment-heb-Amram 63.6 Sentiment-hin-Patra 22.0353 Sentiment-hrv-Mozetic 30.8722 Sentiment-hun-Mozetic 27.1265 Sentiment-ibo-Muhammad 17.859 Sentiment-ind-Wilie 33.3 Sentiment-ita-Basile 40.7218 Sentiment-ita-Basile 39.5789 Sentiment-ita-Kajava 47.6709 Sentiment-ita-Rei 8.36681 Sentiment-jav-Winata 31.6468 Sentiment-jpn-Suzuki 31 Sentiment-kan-Chakravarthi 48.3105 Sentiment-kin-Muhammad 20.3453 Sentiment-kor-Jang 21.5371 Sentiment-mad-Winata 28.4438 Sentiment-mal-Chakravarthi 49.6283 Sentiment-mar-Kulkarni 31.8 Sentiment-min-Winata 29.4558 Sentiment-mlt-Dingli 40.5102 Sentiment-nij-Winata 28.8889 Sentiment-nor-Velldal 12.3478 Sentiment-pcm-Muhammad 31.2685 Sentiment-pcm-Oyewusi 28.8508 Sentiment-pol-Kocon 32.4824 Sentiment-pol-Mozetic 25.4112 Sentiment-pol-Rybak 12.6139 Sentiment-por-Brum 23.4619 Sentiment-por-Mozetic 20.1828 Sentiment-ron-Dumitrescu 68.5721 Sentiment-rus-Mozetic 22.1337 Sentiment-slk-Mozetic 27.5526 Sentiment-slv-Mozetic 18.7691 Sentiment-spa-Mozetic 22.8022 Sentiment-spa-Rei 5.20764 Sentiment-sqi-Mozetic 26.0599 Sentiment-srp-Mozetic 22.8717 Sentiment-sun-Winata 31.5427 Sentiment-swe-Mozetic 23.9352 Sentiment-swh-Muhammad 14.1506 Sentiment-tam-Chakravarthi 47.1645 Sentiment-tel-Marreddy 20.1508 Sentiment-tha-Suriyawongkul 18.9733 Sentiment-tso-Muhammad 35.3018 Sentiment-Tw-eng-Thelwall 58.6 Sentiment-twi-Muhammad 36.4377 Sentiment-yor-Muhammad 29.7345 Sentiment-yor-Shode 50.9757 Sentiment-Yt-eng-Thelwall 71 Sentiment-zho-Tan 54.0399 Sentiment-zho-Wan 42.5186 Sexism-fre-Chiril 44.5193 Subject-ita-Basile 25.6566 Subject-ita-Basile 33.3616 Subjective-ces-Priban 53 Subjective-kor-Jang 8.18351 Subjective-spa-Barbieri 37.3684 Subjevtive-eng-Pang 48.6
24	five-shot in-context learning	mT0-XL		30.4419		2023-11-01 11:37:10
Submission (five-shot in-context learning) Model (mT0-XL) Results Task Score Task Score Task Score Task Score Aggressive-hin-Kumar 37.5195 Dangerous-ara-Alshehri 46.865 Emotion-ara-Abdul 12.6291 Emotion-ara-Mohammad 41.6162 Emotion-ben-Iqbal 24.2461 Emotion-deu-Bianchi 36.1925 Emotion-eng-Demszky 2.50183 Emotion-eng-Mohammad 39.8316 Emotion-eng-Plaza 13.9875 Emotion-eng-Wallbott 21.5984 Emotion-fas-Sabri 16.8477 Emotion-fin-Kajava 15.6065 Emotion-fin-Ohman 11.9922 Emotion-fre-Bianchi 41.1973 Emotion-fre-Kajava 18.9981 Emotion-hin-Debaditya 2.15499 Emotion-ind-Saputri 44.1164 Emotion-ind-Wilie 41.4296 Emotion-ita-Bianchi 33.7477 Emotion-ita-Kajava 14.8429 Emotion-por-Cortiz 1.54312 Emotion-ron-Ciobotaru 38.5608 Emotion-rus-Sboev 35.9676 Emotion-spa-Mohammad 40.0439 Emotion-spa-Plaza 11.2255 Emotion-tur-Guven 40.25 Emotion-vie-Ho 20.5183 Emotion-zho-Lee 43.0622 Hate-ara-Alakrot 43.6302 Hate-ara-Mubarak 48.6653 Hate-ara-Mulki 25.4635 Hate-eng-Basile 36.2245 Hate-eng-Davidson 8.33214 Hate-eng-Waseem 61.0119 Hate-fil-Cabasag 34.4692 Hate-Group-ara-Ousidhoum 13.1962 Hate-Group-fre-Ousidhoum 5.90714 Hate-ita-Bosco 40.2628 Hate-kor-Jeong 33.687 Hate-kor-Moon 16.9044 Hate-pol-Ptaszynski 46.4668 Hate-por-Fortuna 39.6864 Hate-spa-Basile 37.5 Hate-Target-ara-Ousidhoum 24.9905 Hate-Target-ben-Karim 10.0513 Hate-Target-fre-Ousidhoum 5.74384 Hate-Target-kor-Jeong 18.0913 Hate-tel-Marreddy 49.8998 Hate-zho-Deng 36.2245 Humor-eng-Meaney 31.3741 Humor-hin-Aggarwal 41.6 Humor-rus-Blinov 36.8968 Humor-spa-Chiruzzo 38.4552 Irony-ara-Ghanem 33.8009 Irony-eng-Hee 0 Irony-fas-Golazizian 55.102 Irony-hin-Vijay 42.4116 Irony-ita-Basile 46.865 Irony-ita-Cignarella 34.5821 Irony-spa-Barbieri 46.4094 Irony-spa-Ortega 39.8562 Irony-Type-eng-Hee 18.8279 Irony-zho-Xiang 14.3593 Offense-Target-kan-Chakravarthi 21.1481 Offense-Target-kan-Chakravarthi 23.9854 Offense-Target-kan-Chakravarthi 18.3615 Offense-Target-mal-Chakravarthi 21.1481 Offense-Target-mal-Chakravarthi 23.9854 Offense-Target-mal-Chakravarthi 18.3615 Offense-Target-tam-Chakravarthi 21.1481 Offense-Target-tam-Chakravarthi 23.9854 Offense-Target-tam-Chakravarthi 18.3615 Offensive-ara-Mubarak 43.6937 Offensive-ara-Zampieri 44.0716 Offensive-dan-Zampieri 46.6775 Offensive-ell-Zampieri 45.4744 Offensive-eng-Zampieri 42.0626 Offensive-Group-eng-Zampieri 24.4107 Offensive-slv-Novak 25.3185 Offensive-Target-eng-Zampieri 10.1124 Offensive-tur-Zampieri 44.3826 Sarcasm-ara-Abufarha 33.5479 Sarcasm-ara-Farha 35.1852 Sarcasm-ces-Ptacek 23.4419 Sarcasm-eng-Bamman 52.4 Sarcasm-eng-Oraby 47.8531 Sarcasm-eng-Ptacek 46.5672 Sarcasm-eng-Rajadesingan 32.6 Sarcasm-eng-Riloff 33.9181 Sarcasm-eng-Walker 47.0486 Sarcasm-zho-Gong 46.2066 Sentiment-5-eng-Socher 24.8 Sentiment-ace-Winata 23.121 Sentiment-amh-Muhammad 11.9478 Sentiment-ara-Abdul 23.1861 Sentiment-ara-Muhammad 42 Sentiment-arq-Muhammad 18.649 Sentiment-ary-Muhammad 23.5331 Sentiment-bam-Diallo 25.1923 Sentiment-ban-Winata 25.7645 Sentiment-bbc-Winata 19.6274 Sentiment-ben-Islam 23.5885 Sentiment-ben-Patra 22.9673 Sentiment-bjn-Winata 22.707 Sentiment-bos-Mozetic 21.813 Sentiment-bug-Winata 18.9973 Sentiment-bul-Mozetic 16.7212 Sentiment-deu-Mozetic 14.614 Sentiment-deu-Rei 9.64857 Sentiment-eng-Mozetic 20.5925 Sentiment-eng-Pang 53.6 Sentiment-eng-Rosenthal 34.4881 Sentiment-eng-Socher 54.8 Sentiment-fas-Ashrafi 36.1412 Sentiment-fin-Kajava 47.1196 Sentiment-fre-Kajava 47.0985 Sentiment-hau-Muhammad 21.9565 Sentiment-heb-Amram 69 Sentiment-hin-Patra 19.9257 Sentiment-hrv-Mozetic 28.9332 Sentiment-hun-Mozetic 28.712 Sentiment-ibo-Muhammad 14.389 Sentiment-ind-Wilie 34.9694 Sentiment-ita-Basile 40.6057 Sentiment-ita-Basile 34.9658 Sentiment-ita-Kajava 45.9378 Sentiment-ita-Rei 7.24317 Sentiment-jav-Winata 30.7274 Sentiment-jpn-Suzuki 31.8 Sentiment-kan-Chakravarthi 51.9703 Sentiment-kin-Muhammad 15.0693 Sentiment-kor-Jang 19.4428 Sentiment-mad-Winata 20.7963 Sentiment-mal-Chakravarthi 53.0409 Sentiment-mar-Kulkarni 31.4 Sentiment-min-Winata 27.1143 Sentiment-mlt-Dingli 40.7792 Sentiment-nij-Winata 23.4547 Sentiment-nor-Velldal 15.4518 Sentiment-pcm-Muhammad 24.9332 Sentiment-pcm-Oyewusi 25.3996 Sentiment-pol-Kocon 39.144 Sentiment-pol-Mozetic 23.722 Sentiment-pol-Rybak 13.0074 Sentiment-por-Brum 15.9229 Sentiment-por-Mozetic 18.8284 Sentiment-ron-Dumitrescu 82.5529 Sentiment-rus-Mozetic 17.9996 Sentiment-slk-Mozetic 23.6172 Sentiment-slv-Mozetic 17.5318 Sentiment-spa-Mozetic 22.7632 Sentiment-spa-Rei 7.6153 Sentiment-sqi-Mozetic 23.5968 Sentiment-srp-Mozetic 17.0193 Sentiment-sun-Winata 31.736 Sentiment-swe-Mozetic 17.1333 Sentiment-swh-Muhammad 14.153 Sentiment-tam-Chakravarthi 51.6164 Sentiment-tel-Marreddy 14.8263 Sentiment-tha-Suriyawongkul 13.4832 Sentiment-tso-Muhammad 30.9125 Sentiment-Tw-eng-Thelwall 58.8 Sentiment-twi-Muhammad 30.7145 Sentiment-yor-Muhammad 27.9228 Sentiment-yor-Shode 43.8261 Sentiment-Yt-eng-Thelwall 68.4 Sentiment-zho-Tan 47.8207 Sentiment-zho-Wan 41.4683 Sexism-fre-Chiril 44.7693 Subject-ita-Basile 20.9462 Subject-ita-Basile 28.4031 Subjective-ces-Priban 51.6 Subjective-kor-Jang 8.61064 Subjective-spa-Barbieri 30.375 Subjevtive-eng-Pang 48.6
25	Zero-shot	Bactrian-BLOOM		29.4487		2023-11-01 11:37:10
Submission (Zero-shot) Model (Bactrian-BLOOM) Results Task Score Task Score Task Score Task Score Aggressive-hin-Kumar 16.3686 Dangerous-ara-Alshehri 46.865 Emotion-ara-Abdul 8.92383 Emotion-ara-Mohammad 22.677 Emotion-ben-Iqbal 9.36149 Emotion-deu-Bianchi 15.9631 Emotion-eng-Demszky 3.13811 Emotion-eng-Mohammad 30.9999 Emotion-eng-Plaza 10.1236 Emotion-eng-Wallbott 24.5841 Emotion-fas-Sabri 5.24217 Emotion-fin-Kajava 8.45513 Emotion-fin-Ohman 7.67172 Emotion-fre-Bianchi 37.9424 Emotion-fre-Kajava 8.44656 Emotion-hin-Debaditya 3.67169 Emotion-ind-Saputri 15.5455 Emotion-ind-Wilie 16.299 Emotion-ita-Bianchi 22.6485 Emotion-ita-Kajava 12.7505 Emotion-por-Cortiz 2.98745 Emotion-ron-Ciobotaru 30.8494 Emotion-rus-Sboev 11.737 Emotion-spa-Mohammad 33.1665 Emotion-spa-Plaza 3.51714 Emotion-tur-Guven 19.5 Emotion-vie-Ho 10.1992 Emotion-zho-Lee 18.4211 Hate-ara-Alakrot 52.0819 Hate-ara-Mubarak 34.0813 Hate-ara-Mulki 19.2243 Hate-eng-Basile 52.8625 Hate-eng-Davidson 9.32313 Hate-eng-Waseem 60.167 Hate-fil-Cabasag 46.7991 Hate-Group-ara-Ousidhoum 7.54789 Hate-Group-fre-Ousidhoum 11.2307 Hate-ita-Bosco 45.6897 Hate-kor-Jeong 34.7466 Hate-kor-Moon 16.9044 Hate-pol-Ptaszynski 48.054 Hate-por-Fortuna 51.5266 Hate-spa-Basile 48.6775 Hate-Target-ara-Ousidhoum 14.254 Hate-Target-ben-Karim 12.9783 Hate-Target-fre-Ousidhoum 2.10526 Hate-Target-kor-Jeong 15.1363 Hate-tel-Marreddy 48.1865 Hate-zho-Deng 60.9632 Humor-eng-Meaney 27.0594 Humor-hin-Aggarwal 40.8 Humor-rus-Blinov 36.3827 Humor-spa-Chiruzzo 39.3923 Irony-ara-Ghanem 32.6146 Irony-eng-Hee 0 Irony-fas-Golazizian 56.4626 Irony-hin-Vijay 55.804 Irony-ita-Basile 46.9214 Irony-ita-Cignarella 34.2105 Irony-spa-Barbieri 46.4668 Irony-spa-Ortega 39.4673 Irony-Type-eng-Hee 18.8279 Irony-zho-Xiang 13.6495 Offense-Target-kan-Chakravarthi 16.69 Offense-Target-kan-Chakravarthi 24.0395 Offense-Target-kan-Chakravarthi 17.3499 Offense-Target-mal-Chakravarthi 16.69 Offense-Target-mal-Chakravarthi 24.0395 Offense-Target-mal-Chakravarthi 17.3499 Offense-Target-tam-Chakravarthi 16.69 Offense-Target-tam-Chakravarthi 24.0395 Offense-Target-tam-Chakravarthi 17.3499 Offensive-ara-Mubarak 43.6302 Offensive-ara-Zampieri 44.0716 Offensive-dan-Zampieri 46.6775 Offensive-ell-Zampieri 45.4744 Offensive-eng-Zampieri 42.0626 Offensive-Group-eng-Zampieri 25.6624 Offensive-slv-Novak 16.6834 Offensive-Target-eng-Zampieri 47.6345 Offensive-tur-Zampieri 44.3826 Sarcasm-ara-Abufarha 45.1477 Sarcasm-ara-Farha 53.3091 Sarcasm-ces-Ptacek 49.7517 Sarcasm-eng-Bamman 50.6 Sarcasm-eng-Oraby 42.1081 Sarcasm-eng-Ptacek 37.0461 Sarcasm-eng-Rajadesingan 87.8 Sarcasm-eng-Riloff 0 Sarcasm-eng-Walker 41.5385 Sarcasm-zho-Gong 56.0968 Sentiment-5-eng-Socher 19.8 Sentiment-ace-Winata 20.3986 Sentiment-amh-Muhammad 49.0364 Sentiment-ara-Abdul 32.3569 Sentiment-ara-Muhammad 37 Sentiment-arq-Muhammad 37.8342 Sentiment-ary-Muhammad 23.9763 Sentiment-bam-Diallo 19.6581 Sentiment-ban-Winata 23.1242 Sentiment-bbc-Winata 23.6813 Sentiment-ben-Islam 29.1127 Sentiment-ben-Patra 22.1221 Sentiment-bjn-Winata 34.8877 Sentiment-bos-Mozetic 24.0453 Sentiment-bug-Winata 20.9184 Sentiment-bul-Mozetic 29.5356 Sentiment-deu-Mozetic 20.0963 Sentiment-deu-Rei 16.7755 Sentiment-eng-Mozetic 27.2485 Sentiment-eng-Pang 56.4 Sentiment-eng-Rosenthal 32.2901 Sentiment-eng-Socher 53.6 Sentiment-fas-Ashrafi 10.2488 Sentiment-fin-Kajava 41.3333 Sentiment-fre-Kajava 42.5362 Sentiment-hau-Muhammad 33.2568 Sentiment-heb-Amram 60.8 Sentiment-hin-Patra 28.2319 Sentiment-hrv-Mozetic 20.6777 Sentiment-hun-Mozetic 19.6216 Sentiment-ibo-Muhammad 37.4751 Sentiment-ind-Wilie 45.2372 Sentiment-ita-Basile 41.2524 Sentiment-ita-Basile 42.6262 Sentiment-ita-Kajava 36.4802 Sentiment-ita-Rei 25.3869 Sentiment-jav-Winata 23.6839 Sentiment-jpn-Suzuki 33.4 Sentiment-kan-Chakravarthi 23.8182 Sentiment-kin-Muhammad 26.009 Sentiment-kor-Jang 1.10664 Sentiment-mad-Winata 23.1238 Sentiment-mal-Chakravarthi 24.7558 Sentiment-mar-Kulkarni 35.8 Sentiment-min-Winata 28.7587 Sentiment-mlt-Dingli 41.1411 Sentiment-nij-Winata 27.6967 Sentiment-nor-Velldal 0 Sentiment-pcm-Muhammad 8.9859 Sentiment-pcm-Oyewusi 23.0086 Sentiment-pol-Kocon 9.2257 Sentiment-pol-Mozetic 26.6487 Sentiment-pol-Rybak 5.9163 Sentiment-por-Brum 34.2308 Sentiment-por-Mozetic 34.7821 Sentiment-ron-Dumitrescu 44.6617 Sentiment-rus-Mozetic 30.6977 Sentiment-slk-Mozetic 18.138 Sentiment-slv-Mozetic 22.9478 Sentiment-spa-Mozetic 24.1797 Sentiment-spa-Rei 12.9065 Sentiment-sqi-Mozetic 23.1485 Sentiment-srp-Mozetic 24.1993 Sentiment-sun-Winata 27.1429 Sentiment-swe-Mozetic 28.1366 Sentiment-swh-Muhammad 8.05093 Sentiment-tam-Chakravarthi 19.3743 Sentiment-tel-Marreddy 13.5169 Sentiment-tha-Suriyawongkul 11.0391 Sentiment-tso-Muhammad 25.4153 Sentiment-Tw-eng-Thelwall 45.2 Sentiment-twi-Muhammad 16.9121 Sentiment-yor-Muhammad 18.8652 Sentiment-yor-Shode 34.0314 Sentiment-Yt-eng-Thelwall 36.8 Sentiment-zho-Tan 58.3173 Sentiment-zho-Wan 61.3138 Sexism-fre-Chiril 46.4 Subject-ita-Basile 47.2358 Subject-ita-Basile 48.176 Subjective-ces-Priban 47.2 Subjective-kor-Jang 3.938 Subjective-spa-Barbieri 40.3255 Subjevtive-eng-Pang 51
26	Zero-shot	Vicuna-7B		29.3553		2023-11-01 11:37:10
Submission (Zero-shot) Model (Vicuna-7B) Results Task Score Task Score Task Score Task Score Aggressive-hin-Kumar 25.0713 Dangerous-ara-Alshehri 46.865 Emotion-ara-Abdul 9.49201 Emotion-ara-Mohammad 25.852 Emotion-ben-Iqbal 2.98054 Emotion-deu-Bianchi 32.1006 Emotion-eng-Demszky 10.6482 Emotion-eng-Mohammad 25.1549 Emotion-eng-Plaza 20.5966 Emotion-eng-Wallbott 44.8766 Emotion-fas-Sabri 4.46972 Emotion-fin-Kajava 5.45365 Emotion-fin-Ohman 6.0365 Emotion-fre-Bianchi 39.3821 Emotion-fre-Kajava 14.23 Emotion-hin-Debaditya 2.87807 Emotion-ind-Saputri 24.0428 Emotion-ind-Wilie 25.262 Emotion-ita-Bianchi 24.0993 Emotion-ita-Kajava 11.8413 Emotion-por-Cortiz 2.53837 Emotion-ron-Ciobotaru 30.8148 Emotion-rus-Sboev 8.59113 Emotion-spa-Mohammad 29.1771 Emotion-spa-Plaza 22.3094 Emotion-tur-Guven 19.75 Emotion-vie-Ho 9.52425 Emotion-zho-Lee 19.1388 Hate-ara-Alakrot 43.6302 Hate-ara-Mubarak 48.6653 Hate-ara-Mulki 30.9854 Hate-eng-Basile 37.9585 Hate-eng-Davidson 55.8948 Hate-eng-Waseem 61.6623 Hate-fil-Cabasag 34.4692 Hate-Group-ara-Ousidhoum 1.42857 Hate-Group-fre-Ousidhoum 5.65736 Hate-ita-Bosco 40.2628 Hate-kor-Jeong 33.687 Hate-kor-Moon 16.9044 Hate-pol-Ptaszynski 46.4668 Hate-por-Fortuna 39.6864 Hate-spa-Basile 37.5 Hate-Target-ara-Ousidhoum 6.47668 Hate-Target-ben-Karim 23.4237 Hate-Target-fre-Ousidhoum 3.14764 Hate-Target-kor-Jeong 9.95864 Hate-tel-Marreddy 49.8998 Hate-zho-Deng 36.2245 Humor-eng-Meaney 42.8571 Humor-hin-Aggarwal 37.2 Humor-rus-Blinov 54.5998 Humor-spa-Chiruzzo 50.0998 Irony-ara-Ghanem 35.9436 Irony-eng-Hee 41.1911 Irony-fas-Golazizian 57.8231 Irony-hin-Vijay 57.7263 Irony-ita-Basile 55.4881 Irony-ita-Cignarella 56.2189 Irony-spa-Barbieri 52.7847 Irony-spa-Ortega 56.7749 Irony-Type-eng-Hee 18.8279 Irony-zho-Xiang 13.4004 Offense-Target-kan-Chakravarthi 14.164 Offense-Target-kan-Chakravarthi 24.0395 Offense-Target-kan-Chakravarthi 17.3499 Offense-Target-mal-Chakravarthi 14.164 Offense-Target-mal-Chakravarthi 24.0395 Offense-Target-mal-Chakravarthi 17.3499 Offense-Target-tam-Chakravarthi 14.164 Offense-Target-tam-Chakravarthi 24.0395 Offense-Target-tam-Chakravarthi 17.3499 Offensive-ara-Mubarak 58.9612 Offensive-ara-Zampieri 58.4671 Offensive-dan-Zampieri 51.8385 Offensive-ell-Zampieri 48.2108 Offensive-eng-Zampieri 59.6742 Offensive-Group-eng-Zampieri 20.6821 Offensive-slv-Novak 12.5937 Offensive-Target-eng-Zampieri 37.4811 Offensive-tur-Zampieri 51.1241 Sarcasm-ara-Abufarha 53.7386 Sarcasm-ara-Farha 50.371 Sarcasm-ces-Ptacek 55.0008 Sarcasm-eng-Bamman 52.2 Sarcasm-eng-Oraby 36.0801 Sarcasm-eng-Ptacek 48.1682 Sarcasm-eng-Rajadesingan 83.6 Sarcasm-eng-Riloff 14.8148 Sarcasm-eng-Walker 33.3779 Sarcasm-zho-Gong 49.3618 Sentiment-5-eng-Socher 19.6 Sentiment-ace-Winata 12.7946 Sentiment-amh-Muhammad 2.98834 Sentiment-ara-Abdul 8.20589 Sentiment-ara-Muhammad 25 Sentiment-arq-Muhammad 5.32639 Sentiment-ary-Muhammad 16.6359 Sentiment-bam-Diallo 14.3959 Sentiment-ban-Winata 13.8157 Sentiment-bbc-Winata 13.8574 Sentiment-ben-Islam 15.0821 Sentiment-ben-Patra 21.0105 Sentiment-bjn-Winata 14.8891 Sentiment-bos-Mozetic 16.7151 Sentiment-bug-Winata 12.9032 Sentiment-bul-Mozetic 23.6903 Sentiment-deu-Mozetic 25.5144 Sentiment-deu-Rei 30.3226 Sentiment-eng-Mozetic 23.8725 Sentiment-eng-Pang 55.4 Sentiment-eng-Rosenthal 39.3141 Sentiment-eng-Socher 49.8 Sentiment-fas-Ashrafi 17.6315 Sentiment-fin-Kajava 57.756 Sentiment-fre-Kajava 68.8087 Sentiment-hau-Muhammad 17.3905 Sentiment-heb-Amram 40.8 Sentiment-hin-Patra 22.4477 Sentiment-hrv-Mozetic 13.6725 Sentiment-hun-Mozetic 16.3901 Sentiment-ibo-Muhammad 28.3668 Sentiment-ind-Wilie 12.778 Sentiment-ita-Basile 60.8505 Sentiment-ita-Basile 67.6166 Sentiment-ita-Kajava 64.5945 Sentiment-ita-Rei 31.1679 Sentiment-jav-Winata 15.2137 Sentiment-jpn-Suzuki 26.8 Sentiment-kan-Chakravarthi 24.066 Sentiment-kin-Muhammad 22.2334 Sentiment-kor-Jang 8.00909 Sentiment-mad-Winata 13.1386 Sentiment-mal-Chakravarthi 25.651 Sentiment-mar-Kulkarni 34.4 Sentiment-min-Winata 14.9535 Sentiment-mlt-Dingli 48.9815 Sentiment-nij-Winata 15.2112 Sentiment-nor-Velldal 9.79741 Sentiment-pcm-Muhammad 11.9051 Sentiment-pcm-Oyewusi 15.9285 Sentiment-pol-Kocon 9.6347 Sentiment-pol-Mozetic 14.9068 Sentiment-pol-Rybak 5.57659 Sentiment-por-Brum 15.4877 Sentiment-por-Mozetic 18.9357 Sentiment-ron-Dumitrescu 30.265 Sentiment-rus-Mozetic 22.3505 Sentiment-slk-Mozetic 10.4553 Sentiment-slv-Mozetic 20.6897 Sentiment-spa-Mozetic 20.6271 Sentiment-spa-Rei 31.5049 Sentiment-sqi-Mozetic 16.1094 Sentiment-srp-Mozetic 19.0504 Sentiment-sun-Winata 12.9293 Sentiment-swe-Mozetic 16.0475 Sentiment-swh-Muhammad 45.5451 Sentiment-tam-Chakravarthi 17.8518 Sentiment-tel-Marreddy 23.3203 Sentiment-tha-Suriyawongkul 24.3964 Sentiment-tso-Muhammad 6.50329 Sentiment-Tw-eng-Thelwall 55.6 Sentiment-twi-Muhammad 5.27562 Sentiment-yor-Muhammad 19.0134 Sentiment-yor-Shode 33.7526 Sentiment-Yt-eng-Thelwall 33.2 Sentiment-zho-Tan 45.3102 Sentiment-zho-Wan 65.6998 Sexism-fre-Chiril 51.5252 Subject-ita-Basile 43.8833 Subject-ita-Basile 39.547 Subjective-ces-Priban 47 Subjective-kor-Jang 12.7555 Subjective-spa-Barbieri 38.6048 Subjevtive-eng-Pang 50.6
27	Zero-shot	Alpaca-7B		28.7947		2023-11-01 11:37:10
Submission (Zero-shot) Model (Alpaca-7B) Results Task Score Task Score Task Score Task Score Aggressive-hin-Kumar 49.2901 Dangerous-ara-Alshehri 46.865 Emotion-ara-Abdul 5.32679 Emotion-ara-Mohammad 41.1603 Emotion-ben-Iqbal 9.51693 Emotion-deu-Bianchi 69.8616 Emotion-eng-Demszky 15.906 Emotion-eng-Mohammad 59.7136 Emotion-eng-Plaza 25.5898 Emotion-eng-Wallbott 60.0835 Emotion-fas-Sabri 12.2575 Emotion-fin-Kajava 3.8619 Emotion-fin-Ohman 3.73265 Emotion-fre-Bianchi 63.4815 Emotion-fre-Kajava 17.4045 Emotion-hin-Debaditya 6.69833 Emotion-ind-Saputri 36.3666 Emotion-ind-Wilie 36.7782 Emotion-ita-Bianchi 50.4165 Emotion-ita-Kajava 14.0759 Emotion-por-Cortiz 6.70089 Emotion-ron-Ciobotaru 52.7641 Emotion-rus-Sboev 51.0609 Emotion-spa-Mohammad 54.0551 Emotion-spa-Plaza 27.484 Emotion-tur-Guven 36.5 Emotion-vie-Ho 16.3396 Emotion-zho-Lee 49.7608 Hate-ara-Alakrot 43.5028 Hate-ara-Mubarak 48.5067 Hate-ara-Mulki 17.1608 Hate-eng-Basile 53.1458 Hate-eng-Davidson 73.1004 Hate-eng-Waseem 37.332 Hate-fil-Cabasag 47.0043 Hate-Group-ara-Ousidhoum 0.273973 Hate-Group-fre-Ousidhoum 11.3943 Hate-ita-Bosco 42.3363 Hate-kor-Jeong 40.0627 Hate-kor-Moon 27.5947 Hate-pol-Ptaszynski 53.1112 Hate-por-Fortuna 55.2745 Hate-spa-Basile 59.1582 Hate-Target-ara-Ousidhoum 7.63682 Hate-Target-ben-Karim 12.759 Hate-Target-fre-Ousidhoum 2.26471 Hate-Target-kor-Jeong 15.2681 Hate-tel-Marreddy 49.8998 Hate-zho-Deng 36.2245 Humor-eng-Meaney 39.3915 Humor-hin-Aggarwal 60.4 Humor-rus-Blinov 32.5236 Humor-spa-Chiruzzo 34.555 Irony-ara-Ghanem 34.4045 Irony-eng-Hee 55.0595 Irony-fas-Golazizian 43.8776 Irony-hin-Vijay 23.6098 Irony-ita-Basile 13.2659 Irony-ita-Cignarella 33.2396 Irony-spa-Barbieri 13.8808 Irony-spa-Ortega 29.4675 Irony-Type-eng-Hee 18.8279 Irony-zho-Xiang 0.629921 Offense-Target-kan-Chakravarthi 15.4416 Offense-Target-kan-Chakravarthi 24.0395 Offense-Target-kan-Chakravarthi 17.3439 Offense-Target-mal-Chakravarthi 15.4416 Offense-Target-mal-Chakravarthi 24.0395 Offense-Target-mal-Chakravarthi 17.3439 Offense-Target-tam-Chakravarthi 15.4416 Offense-Target-tam-Chakravarthi 24.0395 Offense-Target-tam-Chakravarthi 17.3439 Offensive-ara-Mubarak 18.5877 Offensive-ara-Zampieri 17.4917 Offensive-dan-Zampieri 11.4571 Offensive-ell-Zampieri 14.2367 Offensive-eng-Zampieri 25.5687 Offensive-Group-eng-Zampieri 30.7339 Offensive-slv-Novak 13.5652 Offensive-Target-eng-Zampieri 39.8923 Offensive-tur-Zampieri 16.8053 Sarcasm-ara-Abufarha 17.2113 Sarcasm-ara-Farha 23.4659 Sarcasm-ces-Ptacek 6.21882 Sarcasm-eng-Bamman 52 Sarcasm-eng-Oraby 47.0763 Sarcasm-eng-Ptacek 33.009 Sarcasm-eng-Rajadesingan 15 Sarcasm-eng-Riloff 38.9744 Sarcasm-eng-Walker 50.4723 Sarcasm-zho-Gong 41.4093 Sentiment-5-eng-Socher 40.4 Sentiment-ace-Winata 19.3833 Sentiment-amh-Muhammad 54.5317 Sentiment-ara-Abdul 27.5569 Sentiment-ara-Muhammad 37.8 Sentiment-arq-Muhammad 39.7977 Sentiment-ary-Muhammad 18.0159 Sentiment-bam-Diallo 9.93586 Sentiment-ban-Winata 18.4448 Sentiment-bbc-Winata 18.4448 Sentiment-ben-Islam 18.4971 Sentiment-ben-Patra 18.5289 Sentiment-bjn-Winata 22.0699 Sentiment-bos-Mozetic 19.3208 Sentiment-bug-Winata 18.4448 Sentiment-bul-Mozetic 16.8752 Sentiment-deu-Mozetic 15.8757 Sentiment-deu-Rei 8.75876 Sentiment-eng-Mozetic 28.8647 Sentiment-eng-Pang 60.2 Sentiment-eng-Rosenthal 38.7186 Sentiment-eng-Socher 58.2 Sentiment-fas-Ashrafi 10.2488 Sentiment-fin-Kajava 40.4066 Sentiment-fre-Kajava 60.4941 Sentiment-hau-Muhammad 16.9727 Sentiment-heb-Amram 34.8 Sentiment-hin-Patra 20.5779 Sentiment-hrv-Mozetic 14.4471 Sentiment-hun-Mozetic 8.65632 Sentiment-ibo-Muhammad 14.9598 Sentiment-ind-Wilie 23.893 Sentiment-ita-Basile 51.5779 Sentiment-ita-Basile 52.7079 Sentiment-ita-Kajava 56.6716 Sentiment-ita-Rei 10.5862 Sentiment-jav-Winata 18.4448 Sentiment-jpn-Suzuki 19.6 Sentiment-kan-Chakravarthi 23.7496 Sentiment-kin-Muhammad 19.1718 Sentiment-kor-Jang 25.3684 Sentiment-mad-Winata 18.9169 Sentiment-mal-Chakravarthi 23.1771 Sentiment-mar-Kulkarni 38.2 Sentiment-min-Winata 18.4448 Sentiment-mlt-Dingli 39.3617 Sentiment-nij-Winata 18.4448 Sentiment-nor-Velldal 11.7582 Sentiment-pcm-Muhammad 42.3593 Sentiment-pcm-Oyewusi 15.1718 Sentiment-pol-Kocon 30.4211 Sentiment-pol-Mozetic 20.8263 Sentiment-pol-Rybak 15.9148 Sentiment-por-Brum 25.6294 Sentiment-por-Mozetic 26.5869 Sentiment-ron-Dumitrescu 32.2136 Sentiment-rus-Mozetic 21.7255 Sentiment-slk-Mozetic 17.9269 Sentiment-slv-Mozetic 20.2667 Sentiment-spa-Mozetic 14.6892 Sentiment-spa-Rei 14.705 Sentiment-sqi-Mozetic 9.97732 Sentiment-srp-Mozetic 22.7306 Sentiment-sun-Winata 18.4448 Sentiment-swe-Mozetic 22.5556 Sentiment-swh-Muhammad 2.36026 Sentiment-tam-Chakravarthi 16.5894 Sentiment-tel-Marreddy 9.97732 Sentiment-tha-Suriyawongkul 14.208 Sentiment-tso-Muhammad 21.0453 Sentiment-Tw-eng-Thelwall 54 Sentiment-twi-Muhammad 24.4768 Sentiment-yor-Muhammad 8.10629 Sentiment-yor-Shode 33.3333 Sentiment-Yt-eng-Thelwall 47.4 Sentiment-zho-Tan 49.5947 Sentiment-zho-Wan 45.3241 Sexism-fre-Chiril 25.5952 Subject-ita-Basile 18.8909 Subject-ita-Basile 26.1448 Subjective-ces-Priban 53 Subjective-kor-Jang 7.16955 Subjective-spa-Barbieri 27.8499 Subjevtive-eng-Pang 49.6
28	Zero-shot	LLaMA-7B		28.7535		2023-11-01 11:37:10
Submission (Zero-shot) Model (LLaMA-7B) Results Task Score Task Score Task Score Task Score Aggressive-hin-Kumar 18.3087 Dangerous-ara-Alshehri 46.865 Emotion-ara-Abdul 3.18892 Emotion-ara-Mohammad 26.1778 Emotion-ben-Iqbal 2.97511 Emotion-deu-Bianchi 26.9625 Emotion-eng-Demszky 4.03497 Emotion-eng-Mohammad 15.7712 Emotion-eng-Plaza 7.96001 Emotion-eng-Wallbott 47.9381 Emotion-fas-Sabri 5.13013 Emotion-fin-Kajava 3.29541 Emotion-fin-Ohman 3.72679 Emotion-fre-Bianchi 30.4245 Emotion-fre-Kajava 8.81657 Emotion-hin-Debaditya 2.43942 Emotion-ind-Saputri 26.9422 Emotion-ind-Wilie 29.7868 Emotion-ita-Bianchi 27.4723 Emotion-ita-Kajava 8.59873 Emotion-por-Cortiz 1.05005 Emotion-ron-Ciobotaru 26.9513 Emotion-rus-Sboev 8.29795 Emotion-spa-Mohammad 25.3664 Emotion-spa-Plaza 9.40868 Emotion-tur-Guven 22.75 Emotion-vie-Ho 2.03903 Emotion-zho-Lee 16.0287 Hate-ara-Alakrot 43.6302 Hate-ara-Mubarak 48.6653 Hate-ara-Mulki 25.4635 Hate-eng-Basile 36.648 Hate-eng-Davidson 8.33214 Hate-eng-Waseem 60.4234 Hate-fil-Cabasag 34.4692 Hate-Group-ara-Ousidhoum 0 Hate-Group-fre-Ousidhoum 5.60622 Hate-ita-Bosco 40.2628 Hate-kor-Jeong 33.8667 Hate-kor-Moon 16.9044 Hate-pol-Ptaszynski 47.4637 Hate-por-Fortuna 40.0866 Hate-spa-Basile 38.9477 Hate-Target-ara-Ousidhoum 6.47668 Hate-Target-ben-Karim 18.4759 Hate-Target-fre-Ousidhoum 2.07547 Hate-Target-kor-Jeong 7.55581 Hate-tel-Marreddy 49.8998 Hate-zho-Deng 36.7316 Humor-eng-Meaney 28.3897 Humor-hin-Aggarwal 56.8 Humor-rus-Blinov 35.3639 Humor-spa-Chiruzzo 38.5635 Irony-ara-Ghanem 39.1719 Irony-eng-Hee 5.2863 Irony-fas-Golazizian 49.6599 Irony-hin-Vijay 52.0233 Irony-ita-Basile 49.018 Irony-ita-Cignarella 48.2239 Irony-spa-Barbieri 49.3355 Irony-spa-Ortega 60.6424 Irony-Type-eng-Hee 18.8279 Irony-zho-Xiang 13.6148 Offense-Target-kan-Chakravarthi 20.0091 Offense-Target-kan-Chakravarthi 24.0395 Offense-Target-kan-Chakravarthi 17.221 Offense-Target-mal-Chakravarthi 20.0091 Offense-Target-mal-Chakravarthi 24.0395 Offense-Target-mal-Chakravarthi 17.221 Offense-Target-tam-Chakravarthi 20.0091 Offense-Target-tam-Chakravarthi 24.0395 Offense-Target-tam-Chakravarthi 17.221 Offensive-ara-Mubarak 43.6937 Offensive-ara-Zampieri 44.0716 Offensive-dan-Zampieri 46.6775 Offensive-ell-Zampieri 45.4744 Offensive-eng-Zampieri 42.0626 Offensive-Group-eng-Zampieri 31.4571 Offensive-slv-Novak 12.5749 Offensive-Target-eng-Zampieri 58.6682 Offensive-tur-Zampieri 44.3826 Sarcasm-ara-Abufarha 53.385 Sarcasm-ara-Farha 42.6547 Sarcasm-ces-Ptacek 34.4617 Sarcasm-eng-Bamman 49.2 Sarcasm-eng-Oraby 33.7051 Sarcasm-eng-Ptacek 40.4486 Sarcasm-eng-Rajadesingan 87 Sarcasm-eng-Riloff 0 Sarcasm-eng-Walker 34.551 Sarcasm-zho-Gong 36.248 Sentiment-5-eng-Socher 20 Sentiment-ace-Winata 19.386 Sentiment-amh-Muhammad 54.5317 Sentiment-ara-Abdul 28.4304 Sentiment-ara-Muhammad 36.6 Sentiment-arq-Muhammad 34.9061 Sentiment-ary-Muhammad 20.1098 Sentiment-bam-Diallo 15.4695 Sentiment-ban-Winata 19.7992 Sentiment-bbc-Winata 18.7665 Sentiment-ben-Islam 18.4971 Sentiment-ben-Patra 19.5273 Sentiment-bjn-Winata 18.4448 Sentiment-bos-Mozetic 27.9174 Sentiment-bug-Winata 19.5948 Sentiment-bul-Mozetic 13.239 Sentiment-deu-Mozetic 22.504 Sentiment-deu-Rei 13.8213 Sentiment-eng-Mozetic 15.7704 Sentiment-eng-Pang 61.8 Sentiment-eng-Rosenthal 33.9726 Sentiment-eng-Socher 53.4 Sentiment-fas-Ashrafi 12.7634 Sentiment-fin-Kajava 38.381 Sentiment-fre-Kajava 49.5785 Sentiment-hau-Muhammad 19.8314 Sentiment-heb-Amram 67 Sentiment-hin-Patra 13.7976 Sentiment-hrv-Mozetic 24.3183 Sentiment-hun-Mozetic 12.1807 Sentiment-ibo-Muhammad 14.2512 Sentiment-ind-Wilie 16.1616 Sentiment-ita-Basile 54.1998 Sentiment-ita-Basile 57.9655 Sentiment-ita-Kajava 57.6496 Sentiment-ita-Rei 14.7975 Sentiment-jav-Winata 18.9475 Sentiment-jpn-Suzuki 32 Sentiment-kan-Chakravarthi 29.2774 Sentiment-kin-Muhammad 24.3232 Sentiment-kor-Jang 12.7803 Sentiment-mad-Winata 18.3575 Sentiment-mal-Chakravarthi 35.537 Sentiment-mar-Kulkarni 36.8 Sentiment-min-Winata 18.4448 Sentiment-mlt-Dingli 53.9886 Sentiment-nij-Winata 18.4448 Sentiment-nor-Velldal 0 Sentiment-pcm-Muhammad 40.1834 Sentiment-pcm-Oyewusi 8.99758 Sentiment-pol-Kocon 21.7539 Sentiment-pol-Mozetic 24.983 Sentiment-pol-Rybak 10.5849 Sentiment-por-Brum 28.1882 Sentiment-por-Mozetic 31.484 Sentiment-ron-Dumitrescu 62.0895 Sentiment-rus-Mozetic 18.1944 Sentiment-slk-Mozetic 25.0084 Sentiment-slv-Mozetic 27.0861 Sentiment-spa-Mozetic 19.945 Sentiment-spa-Rei 15.7174 Sentiment-sqi-Mozetic 27.5088 Sentiment-srp-Mozetic 31.9517 Sentiment-sun-Winata 18.8571 Sentiment-swe-Mozetic 24.5735 Sentiment-swh-Muhammad 9.45303 Sentiment-tam-Chakravarthi 22.5211 Sentiment-tel-Marreddy 9.97732 Sentiment-tha-Suriyawongkul 13.2905 Sentiment-tso-Muhammad 24.5765 Sentiment-Tw-eng-Thelwall 43.2 Sentiment-twi-Muhammad 23.1842 Sentiment-yor-Muhammad 9.27091 Sentiment-yor-Shode 40.8348 Sentiment-Yt-eng-Thelwall 32.6 Sentiment-zho-Tan 56.8323 Sentiment-zho-Wan 53.8907 Sexism-fre-Chiril 42.9462 Subject-ita-Basile 46.666 Subject-ita-Basile 47.2432 Subjective-ces-Priban 47.2 Subjective-kor-Jang 6.54775 Subjective-spa-Barbieri 53.3279 Subjevtive-eng-Pang 52.8
29	Baseline	Majority		28.4782		2023-11-01 11:37:10
Submission (Baseline) Model (Majority) Results Task Score Task Score Task Score Task Score Aggressive-hin-Kumar 44.7293 Dangerous-ara-Alshehri 46.747 Emotion-ara-Abdul 3.4633 Emotion-ara-Mohammad 11.9475 Emotion-ben-Iqbal 6.13831 Emotion-deu-Bianchi 14.3393 Emotion-eng-Demszky 0.773643 Emotion-eng-Mohammad 14.098 Emotion-eng-Plaza 9.10664 Emotion-eng-Wallbott 3.7253 Emotion-fas-Sabri 6.79858 Emotion-fin-Kajava 3.29122 Emotion-fin-Ohman 3.52057 Emotion-fre-Bianchi 14.9188 Emotion-fre-Kajava 2.93919 Emotion-hin-Debaditya 0.773643 Emotion-ind-Saputri 7.69231 Emotion-ind-Wilie 8 Emotion-ita-Bianchi 15.4237 Emotion-ita-Kajava 3.08725 Emotion-por-Cortiz 0.752139 Emotion-ron-Ciobotaru 10.7748 Emotion-rus-Sboev 9.83957 Emotion-spa-Mohammad 10.4293 Emotion-spa-Plaza 9.19355 Emotion-tur-Guven 22 Emotion-vie-Ho 12.1333 Emotion-zho-Lee 41.866 Hate-ara-Alakrot 43.0233 Hate-ara-Mubarak 48.7048 Hate-ara-Mulki 25.4622 Hate-eng-Basile 36.7089 Hate-eng-Davidson 66.0716 Hate-eng-Waseem 62.2153 Hate-fil-Cabasag 34.4587 Hate-Group-ara-Ousidhoum 7.69628 Hate-Group-fre-Ousidhoum 2.59185 Hate-ita-Bosco 40.3341 Hate-kor-Jeong 33.3278 Hate-kor-Moon 19.0909 Hate-pol-Ptaszynski 46.4094 Hate-por-Fortuna 39.8727 Hate-spa-Basile 37.0224 Hate-Target-ara-Ousidhoum 17.8161 Hate-Target-ben-Karim 14.375 Hate-Target-fre-Ousidhoum 13.9806 Hate-Target-kor-Jeong 19.0162 Hate-tel-Marreddy 49.7284 Hate-zho-Deng 37.6625 Humor-eng-Meaney 38.0805 Humor-hin-Aggarwal 59.6558 Humor-rus-Blinov 34.2447 Humor-spa-Chiruzzo 33.3333 Irony-ara-Ghanem 34.2054 Irony-eng-Hee 0 Irony-fas-Golazizian 56.4626 Irony-hin-Vijay 42.5311 Irony-ita-Basile 46.7236 Irony-ita-Cignarella 33.3843 Irony-spa-Barbieri 46.8758 Irony-spa-Ortega 40 Irony-Type-eng-Hee 18.8146 Irony-zho-Xiang 13.211 Offense-Target-kan-Chakravarthi 16.7451 Offense-Target-kan-Chakravarthi 24.4528 Offense-Target-kan-Chakravarthi 17.1921 Offense-Target-mal-Chakravarthi 16.7451 Offense-Target-mal-Chakravarthi 24.4528 Offense-Target-mal-Chakravarthi 17.1921 Offense-Target-tam-Chakravarthi 16.7451 Offense-Target-tam-Chakravarthi 24.4528 Offense-Target-tam-Chakravarthi 17.1921 Offensive-ara-Mubarak 44.4136 Offensive-ara-Zampieri 44.3836 Offensive-dan-Zampieri 46.6775 Offensive-ell-Zampieri 45.7484 Offensive-eng-Zampieri 41.8919 Offensive-Group-eng-Zampieri 21.2993 Offensive-slv-Novak 19.416 Offensive-Target-eng-Zampieri 47.0199 Offensive-tur-Zampieri 44.3741 Sarcasm-ara-Abufarha 45.5484 Sarcasm-ara-Farha 42.0738 Sarcasm-ces-Ptacek 49.0256 Sarcasm-eng-Bamman 49.3261 Sarcasm-eng-Oraby 33.666 Sarcasm-eng-Ptacek 39.7314 Sarcasm-eng-Rajadesingan 88.6972 Sarcasm-eng-Riloff 0 Sarcasm-eng-Walker 32.7703 Sarcasm-zho-Gong 33.378 Sentiment-5-eng-Socher 28.6425 Sentiment-ace-Winata 18.4448 Sentiment-amh-Muhammad 53.611 Sentiment-ara-Abdul 22.345 Sentiment-ara-Muhammad 38.5667 Sentiment-arq-Muhammad 32.8704 Sentiment-ary-Muhammad 21.5343 Sentiment-bam-Diallo 24.3056 Sentiment-ban-Winata 18.4448 Sentiment-bbc-Winata 18.4448 Sentiment-ben-Islam 17.648 Sentiment-ben-Patra 19.3237 Sentiment-bjn-Winata 18.4448 Sentiment-bos-Mozetic 18.3582 Sentiment-bug-Winata 18.4448 Sentiment-bul-Mozetic 22.9526 Sentiment-deu-Mozetic 24.3187 Sentiment-deu-Rei 30.3811 Sentiment-eng-Mozetic 21.3476 Sentiment-eng-Pang 50.0469 Sentiment-eng-Rosenthal 33.3333 Sentiment-eng-Socher 49.9176 Sentiment-fas-Ashrafi 23.0204 Sentiment-fin-Kajava 35.665 Sentiment-fre-Kajava 35.665 Sentiment-hau-Muhammad 16.4581 Sentiment-heb-Amram 68.2476 Sentiment-hin-Patra 20.9847 Sentiment-hrv-Mozetic 22.9917 Sentiment-hun-Mozetic 22.907 Sentiment-ibo-Muhammad 26.9148 Sentiment-ind-Wilie 24.5614 Sentiment-ita-Basile 38.4811 Sentiment-ita-Basile 41.088 Sentiment-ita-Kajava 35.665 Sentiment-ita-Rei 31.4528 Sentiment-jav-Winata 18.4448 Sentiment-jpn-Suzuki 32.08 Sentiment-kan-Chakravarthi 41.6279 Sentiment-kin-Muhammad 21.2171 Sentiment-kor-Jang 17.6543 Sentiment-mad-Winata 18.4448 Sentiment-mal-Chakravarthi 42.0524 Sentiment-mar-Kulkarni 33.3333 Sentiment-min-Winata 18.4448 Sentiment-mlt-Dingli 39.3617 Sentiment-nij-Winata 18.4448 Sentiment-nor-Velldal 9.42017 Sentiment-pcm-Muhammad 40.1983 Sentiment-pcm-Oyewusi 24.9628 Sentiment-pol-Kocon 13.1881 Sentiment-pol-Mozetic 19.9171 Sentiment-pol-Rybak 9.75232 Sentiment-por-Brum 18.2949 Sentiment-por-Mozetic 18.7427 Sentiment-ron-Dumitrescu 35.9504 Sentiment-rus-Mozetic 19.4554 Sentiment-slk-Mozetic 22.8953 Sentiment-slv-Mozetic 20.6409 Sentiment-spa-Mozetic 21.3737 Sentiment-spa-Rei 31.8005 Sentiment-sqi-Mozetic 21.5589 Sentiment-srp-Mozetic 19.3361 Sentiment-sun-Winata 18.4448 Sentiment-swe-Mozetic 19.1571 Sentiment-swh-Muhammad 44.2199 Sentiment-tam-Chakravarthi 45.0694 Sentiment-tel-Marreddy 23.4611 Sentiment-tha-Suriyawongkul 23.8177 Sentiment-tso-Muhammad 30.7423 Sentiment-Tw-eng-Thelwall 58.6703 Sentiment-twi-Muhammad 30.505 Sentiment-yor-Muhammad 25.3312 Sentiment-yor-Shode 33.3333 Sentiment-Yt-eng-Thelwall 68.0385 Sentiment-zho-Tan 33.4073 Sentiment-zho-Wan 33.1048 Sexism-fre-Chiril 40.3607 Subject-ita-Basile 42.5646 Subject-ita-Basile 39.5081 Subjective-ces-Priban 50 Subjective-kor-Jang 9.75781 Subjective-spa-Barbieri 39.4729 Subjevtive-eng-Pang 50
30	Zero-shot	BLOOM-7B		27.9418		2023-11-01 11:37:10
Submission (Zero-shot) Model (BLOOM-7B) Results Task Score Task Score Task Score Task Score Aggressive-hin-Kumar 51.0559 Dangerous-ara-Alshehri 46.865 Emotion-ara-Abdul 5.07795 Emotion-ara-Mohammad 19.1157 Emotion-ben-Iqbal 10.4335 Emotion-deu-Bianchi 15.4806 Emotion-eng-Demszky 1.96032 Emotion-eng-Mohammad 16.4835 Emotion-eng-Plaza 5.30347 Emotion-eng-Wallbott 16.8571 Emotion-fas-Sabri 5.22766 Emotion-fin-Kajava 4.87965 Emotion-fin-Ohman 5.96109 Emotion-fre-Bianchi 20.3561 Emotion-fre-Kajava 4.24012 Emotion-hin-Debaditya 1.17036 Emotion-ind-Saputri 8.84735 Emotion-ind-Wilie 8 Emotion-ita-Bianchi 16.2115 Emotion-ita-Kajava 6.2136 Emotion-por-Cortiz 0.678823 Emotion-ron-Ciobotaru 11.373 Emotion-rus-Sboev 8.60641 Emotion-spa-Mohammad 15.5599 Emotion-spa-Plaza 5.63835 Emotion-tur-Guven 22.5 Emotion-vie-Ho 2.19213 Emotion-zho-Lee 14.1148 Hate-ara-Alakrot 54.2814 Hate-ara-Mubarak 35.6861 Hate-ara-Mulki 15.6225 Hate-eng-Basile 51.1111 Hate-eng-Davidson 7.99308 Hate-eng-Waseem 58.2566 Hate-fil-Cabasag 46.7923 Hate-Group-ara-Ousidhoum 3.86915 Hate-Group-fre-Ousidhoum 8.29339 Hate-ita-Bosco 44.6272 Hate-kor-Jeong 35.5509 Hate-kor-Moon 18.0334 Hate-pol-Ptaszynski 47.7727 Hate-por-Fortuna 48.0132 Hate-spa-Basile 46.6081 Hate-Target-ara-Ousidhoum 10.1504 Hate-Target-ben-Karim 11.1198 Hate-Target-fre-Ousidhoum 4.11483 Hate-Target-kor-Jeong 19.3721 Hate-tel-Marreddy 32.6733 Hate-zho-Deng 69.3126 Humor-eng-Meaney 26.1648 Humor-hin-Aggarwal 58.6 Humor-rus-Blinov 34.1238 Humor-spa-Chiruzzo 48.2475 Irony-ara-Ghanem 40.1005 Irony-eng-Hee 0 Irony-fas-Golazizian 51.7007 Irony-hin-Vijay 56.656 Irony-ita-Basile 46.9214 Irony-ita-Cignarella 34.6705 Irony-spa-Barbieri 46.4668 Irony-spa-Ortega 39.4673 Irony-Type-eng-Hee 18.8279 Irony-zho-Xiang 13.6495 Offense-Target-kan-Chakravarthi 16.69 Offense-Target-kan-Chakravarthi 24.0395 Offense-Target-kan-Chakravarthi 17.3243 Offense-Target-mal-Chakravarthi 16.69 Offense-Target-mal-Chakravarthi 24.0395 Offense-Target-mal-Chakravarthi 17.3243 Offense-Target-tam-Chakravarthi 16.69 Offense-Target-tam-Chakravarthi 24.0395 Offense-Target-tam-Chakravarthi 17.3243 Offensive-ara-Mubarak 43.6937 Offensive-ara-Zampieri 44.0716 Offensive-dan-Zampieri 46.6775 Offensive-ell-Zampieri 45.4744 Offensive-eng-Zampieri 42.0626 Offensive-Group-eng-Zampieri 28.7176 Offensive-slv-Novak 21.0236 Offensive-Target-eng-Zampieri 47.0199 Offensive-tur-Zampieri 44.3826 Sarcasm-ara-Abufarha 27.158 Sarcasm-ara-Farha 41.6667 Sarcasm-ces-Ptacek 46.9017 Sarcasm-eng-Bamman 48.6 Sarcasm-eng-Oraby 41.484 Sarcasm-eng-Ptacek 41.7715 Sarcasm-eng-Rajadesingan 77.6 Sarcasm-eng-Riloff 10.5263 Sarcasm-eng-Walker 45.2092 Sarcasm-zho-Gong 49.0388 Sentiment-5-eng-Socher 24.8 Sentiment-ace-Winata 23.3119 Sentiment-amh-Muhammad 54.5317 Sentiment-ara-Abdul 28.0485 Sentiment-ara-Muhammad 34.8 Sentiment-arq-Muhammad 35.2645 Sentiment-ary-Muhammad 23.2868 Sentiment-bam-Diallo 19.894 Sentiment-ban-Winata 21.9598 Sentiment-bbc-Winata 19.2327 Sentiment-ben-Islam 18.4971 Sentiment-ben-Patra 23.876 Sentiment-bjn-Winata 20.52 Sentiment-bos-Mozetic 24.5766 Sentiment-bug-Winata 19.0365 Sentiment-bul-Mozetic 22.0495 Sentiment-deu-Mozetic 17.3642 Sentiment-deu-Rei 11.6677 Sentiment-eng-Mozetic 26.7312 Sentiment-eng-Pang 51.6 Sentiment-eng-Rosenthal 33.6028 Sentiment-eng-Socher 56.4 Sentiment-fas-Ashrafi 10.2488 Sentiment-fin-Kajava 35.4839 Sentiment-fre-Kajava 35.7155 Sentiment-hau-Muhammad 24.8581 Sentiment-heb-Amram 64.8 Sentiment-hin-Patra 28.7326 Sentiment-hrv-Mozetic 19.348 Sentiment-hun-Mozetic 15.802 Sentiment-ibo-Muhammad 25.5822 Sentiment-ind-Wilie 18.357 Sentiment-ita-Basile 40.6035 Sentiment-ita-Basile 46.6092 Sentiment-ita-Kajava 59.4263 Sentiment-ita-Rei 27.9222 Sentiment-jav-Winata 20.1126 Sentiment-jpn-Suzuki 32 Sentiment-kan-Chakravarthi 27.4426 Sentiment-kin-Muhammad 19.9923 Sentiment-kor-Jang 2.96391 Sentiment-mad-Winata 22.4242 Sentiment-mal-Chakravarthi 25.8138 Sentiment-mar-Kulkarni 35.4 Sentiment-min-Winata 18.3908 Sentiment-mlt-Dingli 39.3617 Sentiment-nij-Winata 19.0098 Sentiment-nor-Velldal 0 Sentiment-pcm-Muhammad 28.0735 Sentiment-pcm-Oyewusi 24.9603 Sentiment-pol-Kocon 10.1651 Sentiment-pol-Mozetic 18.6921 Sentiment-pol-Rybak 8.72257 Sentiment-por-Brum 24.3814 Sentiment-por-Mozetic 32.204 Sentiment-ron-Dumitrescu 37.8214 Sentiment-rus-Mozetic 26.7687 Sentiment-slk-Mozetic 20.4923 Sentiment-slv-Mozetic 26.3382 Sentiment-spa-Mozetic 25.8368 Sentiment-spa-Rei 17.8566 Sentiment-sqi-Mozetic 18.253 Sentiment-srp-Mozetic 28.0591 Sentiment-sun-Winata 18.8735 Sentiment-swe-Mozetic 24.8531 Sentiment-swh-Muhammad 5.09301 Sentiment-tam-Chakravarthi 26.7311 Sentiment-tel-Marreddy 9.97732 Sentiment-tha-Suriyawongkul 20.648 Sentiment-tso-Muhammad 21.6498 Sentiment-Tw-eng-Thelwall 47.2 Sentiment-twi-Muhammad 22.3239 Sentiment-yor-Muhammad 14.1399 Sentiment-yor-Shode 33.2443 Sentiment-Yt-eng-Thelwall 42.4 Sentiment-zho-Tan 36.4035 Sentiment-zho-Wan 46.489 Sexism-fre-Chiril 24.9249 Subject-ita-Basile 50.004 Subject-ita-Basile 50.1428 Subjective-ces-Priban 51.8 Subjective-kor-Jang 2.32867 Subjective-spa-Barbieri 53.6726 Subjevtive-eng-Pang 56.8
31	three-shot in-context learning	mT5-XL		26.1172		2023-11-01 11:37:10
Submission (three-shot in-context learning) Model (mT5-XL) Results Task Score Task Score Task Score Task Score Aggressive-hin-Kumar 40.7308 Dangerous-ara-Alshehri 45.6845 Emotion-ara-Abdul 4.73186 Emotion-ara-Mohammad 17.6437 Emotion-ben-Iqbal 13.0955 Emotion-deu-Bianchi 17.7178 Emotion-eng-Demszky 0.317989 Emotion-eng-Mohammad 17.9725 Emotion-eng-Plaza 7.13121 Emotion-eng-Wallbott 7.58291 Emotion-fas-Sabri 12.3672 Emotion-fin-Kajava 6.01554 Emotion-fin-Ohman 6.51698 Emotion-fre-Bianchi 16.3141 Emotion-fre-Kajava 5.59698 Emotion-hin-Debaditya 1.49791 Emotion-ind-Saputri 8.13819 Emotion-ind-Wilie 8.72732 Emotion-ita-Bianchi 18.6206 Emotion-ita-Kajava 6.71383 Emotion-por-Cortiz 0.705394 Emotion-ron-Ciobotaru 12.6411 Emotion-rus-Sboev 11.0609 Emotion-spa-Mohammad 15.4128 Emotion-spa-Plaza 7.81203 Emotion-tur-Guven 28.75 Emotion-vie-Ho 8.02917 Emotion-zho-Lee 16.0287 Hate-ara-Alakrot 52.2321 Hate-ara-Mubarak 44.6195 Hate-ara-Mulki 28.8189 Hate-eng-Basile 41.0872 Hate-eng-Davidson 17.4054 Hate-eng-Waseem 24.5466 Hate-fil-Cabasag 46.1222 Hate-Group-ara-Ousidhoum 1.65605 Hate-Group-fre-Ousidhoum 0.107759 Hate-ita-Bosco 46.3562 Hate-kor-Jeong 43.8305 Hate-kor-Moon 26.5259 Hate-pol-Ptaszynski 43.9023 Hate-por-Fortuna 43.8158 Hate-spa-Basile 54.5004 Hate-Target-ara-Ousidhoum 17.8161 Hate-Target-ben-Karim 19.1689 Hate-Target-fre-Ousidhoum 10.8986 Hate-Target-kor-Jeong 7.24297 Hate-tel-Marreddy 39.8562 Hate-zho-Deng 41.4315 Humor-eng-Meaney 45.4945 Humor-hin-Aggarwal 41.8 Humor-rus-Blinov 49.9643 Humor-spa-Chiruzzo 41.5381 Irony-ara-Ghanem 43.4483 Irony-eng-Hee 40.5195 Irony-fas-Golazizian 56.4626 Irony-hin-Vijay 48.0033 Irony-ita-Basile 44.3826 Irony-ita-Cignarella 44.7432 Irony-spa-Barbieri 47.5 Irony-spa-Ortega 45.7646 Irony-Type-eng-Hee 18.8279 Irony-zho-Xiang 12.6554 Offense-Target-kan-Chakravarthi 6.6344 Offense-Target-kan-Chakravarthi 6.643 Offense-Target-kan-Chakravarthi 5.30579 Offense-Target-mal-Chakravarthi 6.6344 Offense-Target-mal-Chakravarthi 6.643 Offense-Target-mal-Chakravarthi 5.30579 Offense-Target-tam-Chakravarthi 6.6344 Offense-Target-tam-Chakravarthi 6.643 Offense-Target-tam-Chakravarthi 5.30579 Offensive-ara-Mubarak 23.4309 Offensive-ara-Zampieri 25.5807 Offensive-dan-Zampieri 22.7899 Offensive-ell-Zampieri 25.1569 Offensive-eng-Zampieri 23.208 Offensive-Group-eng-Zampieri 22.0051 Offensive-slv-Novak 6.4973 Offensive-Target-eng-Zampieri 10.1124 Offensive-tur-Zampieri 27.2637 Sarcasm-ara-Abufarha 47.0881 Sarcasm-ara-Farha 50.0499 Sarcasm-ces-Ptacek 42.4252 Sarcasm-eng-Bamman 52.8 Sarcasm-eng-Oraby 44.3531 Sarcasm-eng-Ptacek 50.021 Sarcasm-eng-Rajadesingan 62.8 Sarcasm-eng-Riloff 28 Sarcasm-eng-Walker 41.2426 Sarcasm-zho-Gong 48.4579 Sentiment-5-eng-Socher 26.8 Sentiment-ace-Winata 21.7406 Sentiment-amh-Muhammad 51.218 Sentiment-ara-Abdul 31.0765 Sentiment-ara-Muhammad 36.2 Sentiment-arq-Muhammad 36.4863 Sentiment-ary-Muhammad 21.5746 Sentiment-bam-Diallo 11.5688 Sentiment-ban-Winata 25.4577 Sentiment-bbc-Winata 23.5309 Sentiment-ben-Islam 21.0545 Sentiment-ben-Patra 18.3725 Sentiment-bjn-Winata 18.7267 Sentiment-bos-Mozetic 18.2465 Sentiment-bug-Winata 22.0791 Sentiment-bul-Mozetic 18.0657 Sentiment-deu-Mozetic 17.2818 Sentiment-deu-Rei 10.8915 Sentiment-eng-Mozetic 20.636 Sentiment-eng-Pang 51.4 Sentiment-eng-Rosenthal 36.4497 Sentiment-eng-Socher 48.8 Sentiment-fas-Ashrafi 12.2838 Sentiment-fin-Kajava 39.5465 Sentiment-fre-Kajava 43.9279 Sentiment-hau-Muhammad 20.6814 Sentiment-heb-Amram 32.8 Sentiment-hin-Patra 17.3514 Sentiment-hrv-Mozetic 16.774 Sentiment-hun-Mozetic 12.2189 Sentiment-ibo-Muhammad 19.6647 Sentiment-ind-Wilie 20.379 Sentiment-ita-Basile 44.086 Sentiment-ita-Basile 49.992 Sentiment-ita-Kajava 38.8932 Sentiment-ita-Rei 7.67462 Sentiment-jav-Winata 22.308 Sentiment-jpn-Suzuki 25.8 Sentiment-kan-Chakravarthi 25.1368 Sentiment-kin-Muhammad 24.9152 Sentiment-kor-Jang 17.1993 Sentiment-mad-Winata 20.0042 Sentiment-mal-Chakravarthi 26.4193 Sentiment-mar-Kulkarni 36.8 Sentiment-min-Winata 20.0582 Sentiment-mlt-Dingli 39.3617 Sentiment-nij-Winata 21.2034 Sentiment-nor-Velldal 3.21912 Sentiment-pcm-Muhammad 37.915 Sentiment-pcm-Oyewusi 14.6795 Sentiment-pol-Kocon 15.8822 Sentiment-pol-Mozetic 18.7763 Sentiment-pol-Rybak 4.71052 Sentiment-por-Brum 25.1786 Sentiment-por-Mozetic 23.3495 Sentiment-ron-Dumitrescu 30.265 Sentiment-rus-Mozetic 21.2122 Sentiment-slk-Mozetic 17.2887 Sentiment-slv-Mozetic 19.26 Sentiment-spa-Mozetic 14.1215 Sentiment-spa-Rei 8.40001 Sentiment-sqi-Mozetic 16.5902 Sentiment-srp-Mozetic 19.3655 Sentiment-sun-Winata 24.0298 Sentiment-swe-Mozetic 24.5968 Sentiment-swh-Muhammad 11.5001 Sentiment-tam-Chakravarthi 22.2427 Sentiment-tel-Marreddy 15.5739 Sentiment-tha-Suriyawongkul 17.0662 Sentiment-tso-Muhammad 23.7276 Sentiment-Tw-eng-Thelwall 45.2 Sentiment-twi-Muhammad 23.3539 Sentiment-yor-Muhammad 11.844 Sentiment-yor-Shode 34.6078 Sentiment-Yt-eng-Thelwall 34 Sentiment-zho-Tan 32.2981 Sentiment-zho-Wan 33.5106 Sexism-fre-Chiril 35.7972 Subject-ita-Basile 25.491 Subject-ita-Basile 38.3977 Subjective-ces-Priban 54.6 Subjective-kor-Jang 6.37047 Subjective-spa-Barbieri 41.7731 Subjevtive-eng-Pang 56
32	five-shot in-context learning	mT5-XL		25.4692		2023-11-01 11:37:10
Submission (five-shot in-context learning) Model (mT5-XL) Results Task Score Task Score Task Score Task Score Aggressive-hin-Kumar 33.7972 Dangerous-ara-Alshehri 48.9135 Emotion-ara-Abdul 5.14542 Emotion-ara-Mohammad 18.2479 Emotion-ben-Iqbal 13.4842 Emotion-deu-Bianchi 15.4563 Emotion-eng-Demszky 0.302847 Emotion-eng-Mohammad 17.1746 Emotion-eng-Plaza 4.13746 Emotion-eng-Wallbott 8.42734 Emotion-fas-Sabri 10.4531 Emotion-fin-Kajava 5.11276 Emotion-fin-Ohman 5.53768 Emotion-fre-Bianchi 16.1138 Emotion-fre-Kajava 4.21913 Emotion-hin-Debaditya 0.935065 Emotion-ind-Saputri 6.83148 Emotion-ind-Wilie 6.56769 Emotion-ita-Bianchi 25.5382 Emotion-ita-Kajava 5.97742 Emotion-por-Cortiz 0.183876 Emotion-ron-Ciobotaru 11.845 Emotion-rus-Sboev 9.67731 Emotion-spa-Mohammad 13.8903 Emotion-spa-Plaza 4.36181 Emotion-tur-Guven 25.25 Emotion-vie-Ho 4.82474 Emotion-zho-Lee 22.0096 Hate-ara-Alakrot 51.2574 Hate-ara-Mubarak 50.3374 Hate-ara-Mulki 26.571 Hate-eng-Basile 51.0708 Hate-eng-Davidson 9.76056 Hate-eng-Waseem 22.0655 Hate-fil-Cabasag 47.6942 Hate-Group-ara-Ousidhoum 1.97152 Hate-Group-fre-Ousidhoum 0.265957 Hate-ita-Bosco 47.8712 Hate-kor-Jeong 39.0056 Hate-kor-Moon 19.5703 Hate-pol-Ptaszynski 46.0073 Hate-por-Fortuna 47.0828 Hate-spa-Basile 52.2195 Hate-Target-ara-Ousidhoum 17.7543 Hate-Target-ben-Karim 14.7363 Hate-Target-fre-Ousidhoum 11.952 Hate-Target-kor-Jeong 6.8426 Hate-tel-Marreddy 46.0587 Hate-zho-Deng 40.9844 Humor-eng-Meaney 40.6422 Humor-hin-Aggarwal 40.8 Humor-rus-Blinov 39.3681 Humor-spa-Chiruzzo 40 Irony-ara-Ghanem 41.2359 Irony-eng-Hee 23.97 Irony-fas-Golazizian 56.1224 Irony-hin-Vijay 43.8228 Irony-ita-Basile 48.5169 Irony-ita-Cignarella 39.3402 Irony-spa-Barbieri 50.5188 Irony-spa-Ortega 40.2209 Irony-Type-eng-Hee 18.8279 Irony-zho-Xiang 13.315 Offense-Target-kan-Chakravarthi 6.07557 Offense-Target-kan-Chakravarthi 3.38578 Offense-Target-kan-Chakravarthi 3.68432 Offense-Target-mal-Chakravarthi 6.07557 Offense-Target-mal-Chakravarthi 3.38578 Offense-Target-mal-Chakravarthi 3.68432 Offense-Target-tam-Chakravarthi 6.07557 Offense-Target-tam-Chakravarthi 3.38578 Offense-Target-tam-Chakravarthi 3.68432 Offensive-ara-Mubarak 40.5571 Offensive-ara-Zampieri 39.3063 Offensive-dan-Zampieri 33.6393 Offensive-ell-Zampieri 41.484 Offensive-eng-Zampieri 34.3367 Offensive-Group-eng-Zampieri 19.4444 Offensive-slv-Novak 9.22128 Offensive-Target-eng-Zampieri 10.1124 Offensive-tur-Zampieri 40.1508 Sarcasm-ara-Abufarha 48.6116 Sarcasm-ara-Farha 49.2082 Sarcasm-ces-Ptacek 47.1277 Sarcasm-eng-Bamman 53.2 Sarcasm-eng-Oraby 38.036 Sarcasm-eng-Ptacek 41.4212 Sarcasm-eng-Rajadesingan 84.4 Sarcasm-eng-Riloff 21.0526 Sarcasm-eng-Walker 35.5771 Sarcasm-zho-Gong 38.8445 Sentiment-5-eng-Socher 25.8 Sentiment-ace-Winata 18.2565 Sentiment-amh-Muhammad 48.8733 Sentiment-ara-Abdul 25.165 Sentiment-ara-Muhammad 33.2 Sentiment-arq-Muhammad 35.0892 Sentiment-ary-Muhammad 19.4518 Sentiment-bam-Diallo 14.3158 Sentiment-ban-Winata 20.3918 Sentiment-bbc-Winata 22.3221 Sentiment-ben-Islam 20.2214 Sentiment-ben-Patra 17.1404 Sentiment-bjn-Winata 20.4962 Sentiment-bos-Mozetic 20.5386 Sentiment-bug-Winata 20.6502 Sentiment-bul-Mozetic 13.841 Sentiment-deu-Mozetic 15.028 Sentiment-deu-Rei 5.95769 Sentiment-eng-Mozetic 18.5772 Sentiment-eng-Pang 51.4 Sentiment-eng-Rosenthal 31.0665 Sentiment-eng-Socher 49 Sentiment-fas-Ashrafi 10.6632 Sentiment-fin-Kajava 35.6499 Sentiment-fre-Kajava 35.7155 Sentiment-hau-Muhammad 19.3029 Sentiment-heb-Amram 32.2 Sentiment-hin-Patra 15.0707 Sentiment-hrv-Mozetic 14.1222 Sentiment-hun-Mozetic 9.90532 Sentiment-ibo-Muhammad 19.1851 Sentiment-ind-Wilie 18.7738 Sentiment-ita-Basile 40.3551 Sentiment-ita-Basile 44.2891 Sentiment-ita-Kajava 35.9795 Sentiment-ita-Rei 8.4221 Sentiment-jav-Winata 20.8749 Sentiment-jpn-Suzuki 26 Sentiment-kan-Chakravarthi 23.2997 Sentiment-kin-Muhammad 23.5553 Sentiment-kor-Jang 14.7398 Sentiment-mad-Winata 19.6233 Sentiment-mal-Chakravarthi 23.7214 Sentiment-mar-Kulkarni 34.4 Sentiment-min-Winata 21.0697 Sentiment-mlt-Dingli 39.3617 Sentiment-nij-Winata 21.7705 Sentiment-nor-Velldal 3.5091 Sentiment-pcm-Muhammad 37.7194 Sentiment-pcm-Oyewusi 13.1684 Sentiment-pol-Kocon 15.3715 Sentiment-pol-Mozetic 19.535 Sentiment-pol-Rybak 4.12091 Sentiment-por-Brum 22.1328 Sentiment-por-Mozetic 24.9661 Sentiment-ron-Dumitrescu 30.265 Sentiment-rus-Mozetic 20.0291 Sentiment-slk-Mozetic 14.4184 Sentiment-slv-Mozetic 17.1026 Sentiment-spa-Mozetic 11.7757 Sentiment-spa-Rei 9.87549 Sentiment-sqi-Mozetic 12.2908 Sentiment-srp-Mozetic 20.8872 Sentiment-sun-Winata 21.9564 Sentiment-swe-Mozetic 21.8496 Sentiment-swh-Muhammad 8.55527 Sentiment-tam-Chakravarthi 17.2649 Sentiment-tel-Marreddy 14.2499 Sentiment-tha-Suriyawongkul 17.5154 Sentiment-tso-Muhammad 20.8586 Sentiment-Tw-eng-Thelwall 42.8 Sentiment-twi-Muhammad 22.5787 Sentiment-yor-Muhammad 10.1964 Sentiment-yor-Shode 35.0869 Sentiment-Yt-eng-Thelwall 31.8 Sentiment-zho-Tan 31.8801 Sentiment-zho-Wan 33.5106 Sexism-fre-Chiril 34.9644 Subject-ita-Basile 33.3549 Subject-ita-Basile 40.7959 Subjective-ces-Priban 58.2 Subjective-kor-Jang 5.216 Subjective-spa-Barbieri 47.188 Subjevtive-eng-Pang 51.4
33	Zero-shot	mT5-XL		21.4528		2023-11-01 11:37:10
Submission (Zero-shot) Model (mT5-XL) Results Task Score Task Score Task Score Task Score Aggressive-hin-Kumar 53.6699 Dangerous-ara-Alshehri 49.3088 Emotion-ara-Abdul 5.1733 Emotion-ara-Mohammad 12.7007 Emotion-ben-Iqbal 5.189 Emotion-deu-Bianchi 12.25 Emotion-eng-Demszky 0.308309 Emotion-eng-Mohammad 15.508 Emotion-eng-Plaza 2.93486 Emotion-eng-Wallbott 4.53716 Emotion-fas-Sabri 6.59223 Emotion-fin-Kajava 3.60591 Emotion-fin-Ohman 4.38946 Emotion-fre-Bianchi 12.1815 Emotion-fre-Kajava 3.74669 Emotion-hin-Debaditya 0.366412 Emotion-ind-Saputri 6.73013 Emotion-ind-Wilie 5.47137 Emotion-ita-Bianchi 16.8017 Emotion-ita-Kajava 5.62441 Emotion-por-Cortiz 0.182073 Emotion-ron-Ciobotaru 10.2469 Emotion-rus-Sboev 3.57013 Emotion-spa-Mohammad 12.5313 Emotion-spa-Plaza 3.35505 Emotion-tur-Guven 21.75 Emotion-vie-Ho 1.75876 Emotion-zho-Lee 23.9234 Hate-ara-Alakrot 24.1087 Hate-ara-Mubarak 8.36335 Hate-ara-Mulki 14.5043 Hate-eng-Basile 29.972 Hate-eng-Davidson 13.3648 Hate-eng-Waseem 18.6597 Hate-fil-Cabasag 32.9314 Hate-Group-ara-Ousidhoum 1.32275 Hate-Group-fre-Ousidhoum 0 Hate-ita-Bosco 25.553 Hate-kor-Jeong 35.772 Hate-kor-Moon 15.8797 Hate-pol-Ptaszynski 12.4094 Hate-por-Fortuna 29.7343 Hate-spa-Basile 31.0645 Hate-Target-ara-Ousidhoum 16.7551 Hate-Target-ben-Karim 12.112 Hate-Target-fre-Ousidhoum 2.07547 Hate-Target-kor-Jeong 4.27917 Hate-tel-Marreddy 0.599602 Hate-zho-Deng 30.5607 Humor-eng-Meaney 42.8275 Humor-hin-Aggarwal 52.2 Humor-rus-Blinov 45.0879 Humor-spa-Chiruzzo 34.2751 Irony-ara-Ghanem 33.8009 Irony-eng-Hee 1.0256 Irony-fas-Golazizian 56.4626 Irony-hin-Vijay 46.2831 Irony-ita-Basile 49.5874 Irony-ita-Cignarella 38.782 Irony-spa-Barbieri 48.8889 Irony-spa-Ortega 40.2187 Irony-Type-eng-Hee 18.8279 Irony-zho-Xiang 13.6495 Offense-Target-kan-Chakravarthi 4.26712 Offense-Target-kan-Chakravarthi 1.17188 Offense-Target-kan-Chakravarthi 2.26415 Offense-Target-mal-Chakravarthi 4.26712 Offense-Target-mal-Chakravarthi 1.17188 Offense-Target-mal-Chakravarthi 2.26415 Offense-Target-tam-Chakravarthi 4.26712 Offense-Target-tam-Chakravarthi 1.17188 Offense-Target-tam-Chakravarthi 2.26415 Offensive-ara-Mubarak 22.8645 Offensive-ara-Zampieri 27.2546 Offensive-dan-Zampieri 20.3463 Offensive-ell-Zampieri 33.9937 Offensive-eng-Zampieri 23.9719 Offensive-Group-eng-Zampieri 19.7308 Offensive-slv-Novak 8.19268 Offensive-Target-eng-Zampieri 10.6177 Offensive-tur-Zampieri 38.3117 Sarcasm-ara-Abufarha 20.6622 Sarcasm-ara-Farha 30.3392 Sarcasm-ces-Ptacek 33.9408 Sarcasm-eng-Bamman 49 Sarcasm-eng-Oraby 41.8274 Sarcasm-eng-Ptacek 45.2549 Sarcasm-eng-Rajadesingan 19.6 Sarcasm-eng-Riloff 36.3636 Sarcasm-eng-Walker 45.0118 Sarcasm-zho-Gong 38.8918 Sentiment-5-eng-Socher 27.6 Sentiment-ace-Winata 18.4448 Sentiment-amh-Muhammad 54.5317 Sentiment-ara-Abdul 24.1497 Sentiment-ara-Muhammad 34.4 Sentiment-arq-Muhammad 34.226 Sentiment-ary-Muhammad 14.1742 Sentiment-bam-Diallo 8.73694 Sentiment-ban-Winata 18.2698 Sentiment-bbc-Winata 18.4783 Sentiment-ben-Islam 18.4971 Sentiment-ben-Patra 13.6725 Sentiment-bjn-Winata 18.4448 Sentiment-bos-Mozetic 16.3142 Sentiment-bug-Winata 18.3908 Sentiment-bul-Mozetic 11.7518 Sentiment-deu-Mozetic 9.78835 Sentiment-deu-Rei 4.26115 Sentiment-eng-Mozetic 12.9032 Sentiment-eng-Pang 51.4 Sentiment-eng-Rosenthal 33.3333 Sentiment-eng-Socher 49 Sentiment-fas-Ashrafi 9.97732 Sentiment-fin-Kajava 35.6499 Sentiment-fre-Kajava 35.2332 Sentiment-hau-Muhammad 16.5501 Sentiment-heb-Amram 32.2 Sentiment-hin-Patra 11.5702 Sentiment-hrv-Mozetic 11.0184 Sentiment-hun-Mozetic 6.92951 Sentiment-ibo-Muhammad 12.25 Sentiment-ind-Wilie 16.1861 Sentiment-ita-Basile 38.4994 Sentiment-ita-Basile 40.7583 Sentiment-ita-Kajava 35.9795 Sentiment-ita-Rei 3.45208 Sentiment-jav-Winata 18.4448 Sentiment-jpn-Suzuki 25.8 Sentiment-kan-Chakravarthi 22.7707 Sentiment-kin-Muhammad 18.329 Sentiment-kor-Jang 13.0178 Sentiment-mad-Winata 18.4448 Sentiment-mal-Chakravarthi 22.2395 Sentiment-mar-Kulkarni 35 Sentiment-min-Winata 18.4448 Sentiment-mlt-Dingli 39.3617 Sentiment-nij-Winata 18.4448 Sentiment-nor-Velldal 1.92543 Sentiment-pcm-Muhammad 39.7347 Sentiment-pcm-Oyewusi 8.18713 Sentiment-pol-Kocon 13.0178 Sentiment-pol-Mozetic 14.338 Sentiment-pol-Rybak 3.83363 Sentiment-por-Brum 19.6798 Sentiment-por-Mozetic 18.2171 Sentiment-ron-Dumitrescu 30.265 Sentiment-rus-Mozetic 14.9871 Sentiment-slk-Mozetic 14.0904 Sentiment-slv-Mozetic 14.6646 Sentiment-spa-Mozetic 7.24896 Sentiment-spa-Rei 1.68941 Sentiment-sqi-Mozetic 9.97732 Sentiment-srp-Mozetic 16.9896 Sentiment-sun-Winata 18.4448 Sentiment-swe-Mozetic 19.66 Sentiment-swh-Muhammad 1.95942 Sentiment-tam-Chakravarthi 15.3976 Sentiment-tel-Marreddy 9.99432 Sentiment-tha-Suriyawongkul 13.3333 Sentiment-tso-Muhammad 18.5406 Sentiment-Tw-eng-Thelwall 41.2 Sentiment-twi-Muhammad 20.7379 Sentiment-yor-Muhammad 7.28926 Sentiment-yor-Shode 33.3333 Sentiment-Yt-eng-Thelwall 30.6 Sentiment-zho-Tan 31.8801 Sentiment-zho-Wan 33.5106 Sexism-fre-Chiril 49.1667 Subject-ita-Basile 20.6758 Subject-ita-Basile 43.4267 Subjective-ces-Priban 52.8 Subjective-kor-Jang 9.84768 Subjective-spa-Barbieri 47.7246 Subjevtive-eng-Pang 49.6