Sentiment-ary-Muhammad
Task Identifier: sentiment-2022-muhammad-ary
Cluster: Sentiment Analysis
Data Type: ary
Score Metric: Weight-F1
Paper/GitHub/Website URL:


RankSubmission Title Model
URL
Score
Details
1
Finetuned LMs InfoDCL
53.4436
2
Finetuned LMs Bernice
52.6125
3
Zero-shot Chatgpt
52.1855
4
Zero-shot Chatgpt with translated prompts
51.1152
5
Finetuned LMs XLM-RoBERTa-Large
50.721
6
Finetuned LMs XLM-RoBERTa-Base
50.2095
7
Finetuned LMs TwHIN-BERT
49.9876
8
Finetuned LMs XLM-Twitter
49.7239
9
Finetuned LMs mBERT
46.5579
10
Zero-shot BLOOMZ-P3-7B
37.3966
11
five-shot in-context learning LLaMA-7B
37.2205
12
Baseline Random
35.9429
13
Zero-shot BLOOMZ-7B
34.4865
14
five-shot in-context learning BLOOMZ-P3-7B
32.7953
15
Zero-shot Bactrian-LLaMA-7B
31.7978
16
five-shot in-context learning Vicuna-7B
31.5994
17
three-shot in-context learning BLOOMZ-P3-7B
30.8981
18
three-shot in-context learning LLaMA-7B
30.7558
19
three-shot in-context learning BLOOM-7B
28.9682
20
five-shot in-context learning BLOOM-7B
27.8775
21
three-shot in-context learning mT0-XL
25.7653
22
Zero-shot Bactrian-BLOOM
23.9763
23
five-shot in-context learning mT0-XL
23.5331
24
Zero-shot mT0-XL
23.4064
25
Zero-shot BLOOM-7B
23.2868
26
three-shot in-context learning mT5-XL
21.5746
27
Baseline Majority
21.5343
28
Zero-shot LLaMA-7B
20.1098
29
five-shot in-context learning mT5-XL
19.4518
30
three-shot in-context learning Vicuna-7B
18.7222
31
Zero-shot Alpaca-7B
18.0159
32
Zero-shot Vicuna-7B
16.6359
33
Zero-shot mT5-XL
14.1742