Irony-ita-Basile
Task Identifier: irony-2014-basile-ita
Cluster: Irony & Sarcasm
Data Type: ita
Score Metric: Macro-F1
Paper/GitHub/Website URL: N/A


RankSubmission Title Model
URL
Score
Details
1
Finetuned LMs XLM-RoBERTa-Large
67.3033
2
Finetuned LMs TwHIN-BERT
66.1162
3
Finetuned LMs InfoDCL
65.6678
4
Finetuned LMs XLM-Twitter
63.5828
5
Finetuned LMs mBERT
63.375
6
Finetuned LMs Bernice
63.1598
7
Finetuned LMs XLM-RoBERTa-Base
61.5351
8
Zero-shot Chatgpt
59.9097
9
five-shot in-context learning Vicuna-7B
55.5211
10
Zero-shot Vicuna-7B
55.4881
11
Zero-shot Chatgpt with translated prompts
55.0107
12
three-shot in-context learning Vicuna-7B
53.602
13
five-shot in-context learning LLaMA-7B
52.4457
14
Zero-shot BLOOMZ-P3-7B
50.9731
15
Zero-shot mT5-XL
49.5874
16
three-shot in-context learning LLaMA-7B
49.2109
17
Zero-shot LLaMA-7B
49.018
18
five-shot in-context learning mT5-XL
48.5169
19
five-shot in-context learning BLOOM-7B
46.9427
20
Zero-shot Bactrian-BLOOM
46.9214
21
Zero-shot BLOOM-7B
46.9214
22
three-shot in-context learning mT0-XL
46.9214
23
Zero-shot BLOOMZ-7B
46.9214
24
Zero-shot mT0-XL
46.9214
25
five-shot in-context learning mT0-XL
46.865
26
Baseline Majority
46.7236
27
five-shot in-context learning BLOOMZ-P3-7B
46.3795
28
three-shot in-context learning BLOOMZ-P3-7B
46.0352
29
three-shot in-context learning BLOOM-7B
45.1798
30
three-shot in-context learning mT5-XL
44.3826
31
Baseline Random
41.8671
32
Zero-shot Bactrian-LLaMA-7B
40.2341
33
Zero-shot Alpaca-7B
13.2659