Sentiment-ara-Abdul
Task Identifier: sentiment-2021-abdul-ara
Cluster: Sentiment Analysis
Data Type: ara
Score Metric: Macro-F1
Paper/GitHub/Website URL:


RankSubmission Title Model
URL
Score
Details
1
Finetuned LMs TwHIN-BERT
77.6051
2
Finetuned LMs Bernice
77.3622
3
Finetuned LMs InfoDCL
77.298
4
Finetuned LMs XLM-RoBERTa-Large
76.9289
5
Finetuned LMs XLM-RoBERTa-Base
75.7481
6
Finetuned LMs XLM-Twitter
74.6354
7
Finetuned LMs mBERT
71.9639
8
Zero-shot Chatgpt
61.9022
9
Zero-shot Chatgpt with translated prompts
61.0304
10
Zero-shot BLOOMZ-P3-7B
44.4764
11
Zero-shot BLOOMZ-7B
42.9638
12
five-shot in-context learning BLOOMZ-P3-7B
40.9468
13
three-shot in-context learning BLOOMZ-P3-7B
37.8206
14
three-shot in-context learning BLOOM-7B
36.8541
15
three-shot in-context learning LLaMA-7B
35.7143
16
five-shot in-context learning BLOOM-7B
35.6872
17
five-shot in-context learning LLaMA-7B
35.2425
18
five-shot in-context learning Vicuna-7B
33.406
19
Zero-shot Bactrian-BLOOM
32.3569
20
three-shot in-context learning mT5-XL
31.0765
21
Baseline Random
29.1676
22
Zero-shot LLaMA-7B
28.4304
23
Zero-shot BLOOM-7B
28.0485
24
Zero-shot Alpaca-7B
27.5569
25
Zero-shot mT0-XL
26.6039
26
five-shot in-context learning mT5-XL
25.165
27
Zero-shot mT5-XL
24.1497
28
three-shot in-context learning mT0-XL
23.8528
29
five-shot in-context learning mT0-XL
23.1861
30
Baseline Majority
22.345
31
three-shot in-context learning Vicuna-7B
21.8464
32
Zero-shot Bactrian-LLaMA-7B
16.9976
33
Zero-shot Vicuna-7B
8.20589