Sarcasm-eng-Walker
Task Identifier: sarcasm-2012-walker-eng
Cluster: Irony & Sarcasm
Data Type: eng
Score Metric: Macro-F1
Paper/GitHub/Website URL:


RankSubmission Title Model
URL
Score
Details
1
Zero-shot Chatgpt with translated prompts
70.7925
2
Zero-shot Chatgpt
70.7925
3
Finetuned LMs Bernice
67.4526
4
Finetuned LMs XLM-RoBERTa-Large
66.8894
5
Finetuned LMs XLM-RoBERTa-Base
65.3593
6
Finetuned LMs TwHIN-BERT
63.8246
7
Finetuned LMs InfoDCL
63.6537
8
Finetuned LMs mBERT
63.3154
9
Finetuned LMs XLM-Twitter
63.1402
10
Baseline Random
53.3326
11
five-shot in-context learning BLOOM-7B
53.3143
12
five-shot in-context learning Vicuna-7B
53.1694
13
three-shot in-context learning mT0-XL
52.9983
14
five-shot in-context learning LLaMA-7B
51.2523
15
Zero-shot Bactrian-LLaMA-7B
51.0557
16
Zero-shot Alpaca-7B
50.4723
17
three-shot in-context learning BLOOM-7B
48.941
18
three-shot in-context learning Vicuna-7B
47.8773
19
five-shot in-context learning mT0-XL
47.0486
20
three-shot in-context learning LLaMA-7B
45.432
21
Zero-shot BLOOM-7B
45.2092
22
Zero-shot mT5-XL
45.0118
23
Zero-shot Bactrian-BLOOM
41.5385
24
three-shot in-context learning mT5-XL
41.2426
25
three-shot in-context learning BLOOMZ-P3-7B
37.7704
26
five-shot in-context learning mT5-XL
35.5771
27
five-shot in-context learning BLOOMZ-P3-7B
34.8529
28
Zero-shot LLaMA-7B
34.551
29
Zero-shot Vicuna-7B
33.3779
30
Zero-shot BLOOMZ-P3-7B
33.2289
31
Zero-shot mT0-XL
32.7957
32
Zero-shot BLOOMZ-7B
32.7957
33
Baseline Majority
32.7703