Sentiment-yor-Muhammad
Task Identifier: sentiment-2022-muhammad-yor
Cluster: Sentiment Analysis
Data Type: yor
Score Metric: Weight-F1
Paper/GitHub/Website URL:


RankSubmission Title Model
URL
Score
Details
1
Finetuned LMs mBERT
67.8732
2
Finetuned LMs Bernice
66.7096
3
Finetuned LMs XLM-RoBERTa-Large
66.1496
4
Finetuned LMs XLM-Twitter
65.2847
5
Finetuned LMs TwHIN-BERT
64.9308
6
Finetuned LMs InfoDCL
64.8407
7
Finetuned LMs XLM-RoBERTa-Base
64.3761
8
Zero-shot Chatgpt
57.5721
9
Baseline Random
36.5619
10
Zero-shot Chatgpt with translated prompts
33.4316
11
Zero-shot BLOOMZ-7B
33.1365
12
five-shot in-context learning LLaMA-7B
32.2068
13
Zero-shot BLOOMZ-P3-7B
31.702
14
five-shot in-context learning BLOOMZ-P3-7B
31.5766
15
three-shot in-context learning mT0-XL
29.7345
16
Zero-shot mT0-XL
28.5847
17
three-shot in-context learning LLaMA-7B
28.4782
18
three-shot in-context learning BLOOMZ-P3-7B
28.3373
19
five-shot in-context learning mT0-XL
27.9228
20
Baseline Majority
25.3312
21
five-shot in-context learning Vicuna-7B
24.7122
22
three-shot in-context learning BLOOM-7B
24.2219
23
five-shot in-context learning BLOOM-7B
23.009
24
Zero-shot Bactrian-LLaMA-7B
22.7978
25
three-shot in-context learning Vicuna-7B
19.8263
26
Zero-shot Vicuna-7B
19.0134
27
Zero-shot Bactrian-BLOOM
18.8652
28
Zero-shot BLOOM-7B
14.1399
29
three-shot in-context learning mT5-XL
11.844
30
five-shot in-context learning mT5-XL
10.1964
31
Zero-shot LLaMA-7B
9.27091
32
Zero-shot Alpaca-7B
8.10629
33
Zero-shot mT5-XL
7.28926