Irony-ara-Ghanem
Task Identifier: irony-2019-ghanem-ara
Cluster: Irony & Sarcasm
Data Type: ara
Score Metric: Macro-F1
Paper/GitHub/Website URL:


RankSubmission Title Model
URL
Score
Details
1
Finetuned LMs XLM-RoBERTa-Base
83.9505
2
Finetuned LMs InfoDCL
83.0786
3
Finetuned LMs Bernice
82.4519
4
Finetuned LMs XLM-RoBERTa-Large
82.2229
5
Finetuned LMs mBERT
82.1913
6
Finetuned LMs TwHIN-BERT
81.6553
7
Finetuned LMs XLM-Twitter
81.3179
8
Zero-shot Chatgpt
68.7755
9
Zero-shot Chatgpt with translated prompts
67.3967
10
Zero-shot BLOOMZ-P3-7B
51.4289
11
five-shot in-context learning BLOOMZ-P3-7B
50.8248
12
Zero-shot Bactrian-LLaMA-7B
49.7364
13
Baseline Random
48.3926
14
five-shot in-context learning BLOOM-7B
46.3051
15
three-shot in-context learning BLOOM-7B
45.5147
16
three-shot in-context learning mT5-XL
43.4483
17
three-shot in-context learning BLOOMZ-P3-7B
42.1081
18
five-shot in-context learning mT5-XL
41.2359
19
Zero-shot BLOOM-7B
40.1005
20
Zero-shot LLaMA-7B
39.1719
21
Zero-shot Vicuna-7B
35.9436
22
three-shot in-context learning LLaMA-7B
35.8638
23
five-shot in-context learning LLaMA-7B
35.5159
24
Zero-shot Alpaca-7B
34.4045
25
Zero-shot BLOOMZ-7B
34.2427
26
Baseline Majority
34.2054
27
five-shot in-context learning Vicuna-7B
34.0439
28
three-shot in-context learning Vicuna-7B
33.9288
29
Zero-shot mT5-XL
33.8009
30
five-shot in-context learning mT0-XL
33.8009
31
three-shot in-context learning mT0-XL
32.9522
32
Zero-shot Bactrian-BLOOM
32.6146
33
Zero-shot mT0-XL
32.6146