Sentiment-nij-Winata
Task Identifier: sentiment-2022-winata-nij
Cluster: Sentiment Analysis
Data Type: nij
Score Metric: Macro-F1
Paper/GitHub/Website URL:


RankSubmission Title Model
URL
Score
Details
1
Finetuned LMs XLM-RoBERTa-Large
78.3135
2
Finetuned LMs Bernice
78.1949
3
Finetuned LMs InfoDCL
77.2233
4
Finetuned LMs XLM-Twitter
76.1783
5
Finetuned LMs mBERT
73.8217
6
Finetuned LMs XLM-RoBERTa-Base
73.4731
7
Finetuned LMs TwHIN-BERT
73.1243
8
Zero-shot Chatgpt
57.6394
9
Zero-shot Chatgpt with translated prompts
57.0681
10
Zero-shot BLOOMZ-P3-7B
42.8628
11
five-shot in-context learning LLaMA-7B
42.2285
12
five-shot in-context learning BLOOMZ-P3-7B
36.8182
13
three-shot in-context learning BLOOMZ-P3-7B
35.3892
14
three-shot in-context learning BLOOM-7B
35.2748
15
Zero-shot BLOOMZ-7B
35.1815
16
Baseline Random
34.8569
17
three-shot in-context learning LLaMA-7B
33.9373
18
five-shot in-context learning BLOOM-7B
31.4342
19
three-shot in-context learning mT0-XL
28.8889
20
five-shot in-context learning Vicuna-7B
28.7149
21
Zero-shot Bactrian-BLOOM
27.6967
22
five-shot in-context learning mT0-XL
23.4547
23
Zero-shot mT0-XL
22.889
24
five-shot in-context learning mT5-XL
21.7705
25
three-shot in-context learning mT5-XL
21.2034
26
Zero-shot BLOOM-7B
19.0098
27
three-shot in-context learning Vicuna-7B
18.9314
28
Baseline Majority
18.4448
29
Zero-shot Alpaca-7B
18.4448
30
Zero-shot LLaMA-7B
18.4448
31
Zero-shot mT5-XL
18.4448
32
Zero-shot Bactrian-LLaMA-7B
18.2404
33
Zero-shot Vicuna-7B
15.2112