Irony-zho-Xiang
Task Identifier: irony-2020-xiang-zho
Cluster: Irony & Sarcasm
Data Type: zho
Score Metric: Macro-F1
Paper/GitHub/Website URL:


RankSubmission Title Model
URL
Score
Details
1
Finetuned LMs InfoDCL
33.3641
2
Finetuned LMs XLM-RoBERTa-Large
33.0427
3
Finetuned LMs mBERT
31.9621
4
Finetuned LMs TwHIN-BERT
31.5096
5
Finetuned LMs XLM-RoBERTa-Base
31.1896
6
Finetuned LMs XLM-Twitter
30.9597
7
Finetuned LMs Bernice
30.5227
8
Zero-shot Chatgpt
18.5828
9
Zero-shot BLOOMZ-7B
14.5644
10
five-shot in-context learning mT0-XL
14.3593
11
five-shot in-context learning LLaMA-7B
14.34
12
Zero-shot Bactrian-LLaMA-7B
14.1447
13
five-shot in-context learning Vicuna-7B
13.7863
14
Zero-shot BLOOM-7B
13.6495
15
Zero-shot mT5-XL
13.6495
16
Zero-shot Bactrian-BLOOM
13.6495
17
three-shot in-context learning mT0-XL
13.6328
18
Zero-shot LLaMA-7B
13.6148
19
Zero-shot mT0-XL
13.5501
20
Zero-shot Vicuna-7B
13.4004
21
five-shot in-context learning mT5-XL
13.315
22
Baseline Majority
13.211
23
three-shot in-context learning LLaMA-7B
12.9529
24
three-shot in-context learning mT5-XL
12.6554
25
three-shot in-context learning Vicuna-7B
12.6526
26
five-shot in-context learning BLOOMZ-P3-7B
12.3345
27
five-shot in-context learning BLOOM-7B
12.3058
28
three-shot in-context learning BLOOMZ-P3-7B
12.1006
29
three-shot in-context learning BLOOM-7B
11.94
30
Baseline Random
11.7073
31
Zero-shot Chatgpt with translated prompts
10.0563
32
Zero-shot BLOOMZ-P3-7B
9.89144
33
Zero-shot Alpaca-7B
0.629921