Irony-hin-Vijay
Task Identifier: irony-2018-vijay-hin
Cluster: Irony & Sarcasm
Data Type: hin
Score Metric: Macro-F1
Paper/GitHub/Website URL:


RankSubmission Title Model
URL
Score
Details
1
Finetuned LMs XLM-RoBERTa-Base
73.2472
2
Finetuned LMs Bernice
72.9047
3
Finetuned LMs XLM-RoBERTa-Large
72.6831
4
Finetuned LMs TwHIN-BERT
72.428
5
Finetuned LMs XLM-Twitter
71.1992
6
Finetuned LMs InfoDCL
71.1626
7
Finetuned LMs mBERT
70.8993
8
five-shot in-context learning Vicuna-7B
59.0009
9
Zero-shot Chatgpt with translated prompts
57.9222
10
Zero-shot Vicuna-7B
57.7263
11
three-shot in-context learning Vicuna-7B
57.5479
12
Zero-shot BLOOM-7B
56.656
13
Zero-shot Bactrian-BLOOM
55.804
14
five-shot in-context learning BLOOM-7B
55.3012
15
three-shot in-context learning BLOOM-7B
55.226
16
Zero-shot Chatgpt
52.8912
17
Zero-shot LLaMA-7B
52.0233
18
Zero-shot BLOOMZ-P3-7B
51.3046
19
five-shot in-context learning BLOOMZ-P3-7B
50.37
20
three-shot in-context learning BLOOMZ-P3-7B
49.6625
21
three-shot in-context learning mT5-XL
48.0033
22
five-shot in-context learning LLaMA-7B
47.7753
23
Baseline Random
46.8825
24
Zero-shot mT5-XL
46.2831
25
three-shot in-context learning mT0-XL
45.411
26
three-shot in-context learning LLaMA-7B
45.2554
27
Zero-shot BLOOMZ-7B
43.9894
28
five-shot in-context learning mT5-XL
43.8228
29
Baseline Majority
42.5311
30
Zero-shot mT0-XL
42.5311
31
five-shot in-context learning mT0-XL
42.4116
32
Zero-shot Alpaca-7B
23.6098
33
Zero-shot Bactrian-LLaMA-7B
22.8497