Sentiment-ban-Winata
Task Identifier: sentiment-2022-winata-ban
Cluster: Sentiment Analysis
Data Type: ban
Score Metric: Macro-F1
Paper/GitHub/Website URL:


RankSubmission Title Model
URL
Score
Details
1
Finetuned LMs XLM-Twitter
79.7713
2
Finetuned LMs InfoDCL
79.4897
3
Finetuned LMs XLM-RoBERTa-Large
79.268
4
Finetuned LMs Bernice
76.8574
5
Finetuned LMs mBERT
75.9647
6
Finetuned LMs XLM-RoBERTa-Base
74.7922
7
Finetuned LMs TwHIN-BERT
74.3692
8
Zero-shot Chatgpt
60.9115
9
Zero-shot Chatgpt with translated prompts
41.9833
10
Zero-shot BLOOMZ-P3-7B
41.8955
11
five-shot in-context learning LLaMA-7B
40.8412
12
three-shot in-context learning LLaMA-7B
36.4018
13
three-shot in-context learning BLOOM-7B
35.9507
14
three-shot in-context learning BLOOMZ-P3-7B
35.3758
15
Zero-shot BLOOMZ-7B
34.9994
16
five-shot in-context learning BLOOMZ-P3-7B
33.0815
17
five-shot in-context learning BLOOM-7B
31.2528
18
three-shot in-context learning mT0-XL
31.0585
19
Baseline Random
30.14
20
Zero-shot mT0-XL
29.9075
21
five-shot in-context learning Vicuna-7B
29.3339
22
five-shot in-context learning mT0-XL
25.7645
23
three-shot in-context learning mT5-XL
25.4577
24
Zero-shot Bactrian-BLOOM
23.1242
25
Zero-shot BLOOM-7B
21.9598
26
five-shot in-context learning mT5-XL
20.3918
27
Zero-shot LLaMA-7B
19.7992
28
three-shot in-context learning Vicuna-7B
19.3502
29
Baseline Majority
18.4448
30
Zero-shot Alpaca-7B
18.4448
31
Zero-shot mT5-XL
18.2698
32
Zero-shot Bactrian-LLaMA-7B
14.005
33
Zero-shot Vicuna-7B
13.8157