Irony-spa-Ortega
Task Identifier: irony-2019-ortega-spa
Cluster: Irony & Sarcasm
Data Type: spa
Score Metric: Macro-F1
Paper/GitHub/Website URL:


RankSubmission Title Model
URL
Score
Details
1
Finetuned LMs InfoDCL
73.8797
2
Finetuned LMs Bernice
72.7872
3
Finetuned LMs XLM-Twitter
71.2292
4
Finetuned LMs XLM-RoBERTa-Large
71.2015
5
Finetuned LMs XLM-RoBERTa-Base
71.1768
6
Finetuned LMs TwHIN-BERT
70.5407
7
Finetuned LMs mBERT
67.4244
8
Zero-shot Chatgpt
62.9206
9
Zero-shot Chatgpt with translated prompts
61.6914
10
Zero-shot LLaMA-7B
60.6424
11
Zero-shot Vicuna-7B
56.7749
12
Zero-shot BLOOMZ-P3-7B
54.4583
13
five-shot in-context learning BLOOM-7B
53.668
14
five-shot in-context learning BLOOMZ-P3-7B
51.6181
15
three-shot in-context learning BLOOM-7B
48.673
16
three-shot in-context learning BLOOMZ-P3-7B
48.6359
17
five-shot in-context learning Vicuna-7B
47.072
18
Baseline Random
46.8355
19
three-shot in-context learning mT5-XL
45.7646
20
three-shot in-context learning Vicuna-7B
45.4259
21
Zero-shot Bactrian-LLaMA-7B
44.5473
22
three-shot in-context learning LLaMA-7B
43.3727
23
five-shot in-context learning LLaMA-7B
41.7805
24
five-shot in-context learning mT5-XL
40.2209
25
Zero-shot mT5-XL
40.2187
26
Baseline Majority
40
27
five-shot in-context learning mT0-XL
39.8562
28
Zero-shot mT0-XL
39.4673
29
Zero-shot Bactrian-BLOOM
39.4673
30
Zero-shot BLOOMZ-7B
39.4673
31
Zero-shot BLOOM-7B
39.4673
32
three-shot in-context learning mT0-XL
39.3939
33
Zero-shot Alpaca-7B
29.4675