Sentiment-por-Brum
Task Identifier: sentiment-2018-brum-por
Cluster: Sentiment Analysis
Data Type: por
Score Metric: Macro-F1
Paper/GitHub/Website URL:


RankSubmission Title Model
URL
Score
Details
1
Finetuned LMs XLM-RoBERTa-Base
60.0005
2
Finetuned LMs InfoDCL
59.2868
3
Finetuned LMs XLM-Twitter
59.1729
4
Finetuned LMs TwHIN-BERT
59.0795
5
Finetuned LMs mBERT
59.0465
6
Finetuned LMs XLM-RoBERTa-Large
58.9215
7
Finetuned LMs Bernice
57.8542
8
Zero-shot Chatgpt
42.6383
9
Zero-shot Chatgpt with translated prompts
42.6139
10
Baseline Random
35.5937
11
three-shot in-context learning BLOOM-7B
35.0939
12
five-shot in-context learning BLOOM-7B
34.5935
13
Zero-shot Bactrian-BLOOM
34.2308
14
five-shot in-context learning LLaMA-7B
32.2885
15
five-shot in-context learning BLOOMZ-P3-7B
31.4399
16
three-shot in-context learning LLaMA-7B
30.966
17
three-shot in-context learning BLOOMZ-P3-7B
29.9656
18
Zero-shot BLOOMZ-P3-7B
29.3347
19
Zero-shot LLaMA-7B
28.1882
20
Zero-shot BLOOMZ-7B
26.7289
21
five-shot in-context learning Vicuna-7B
26.5428
22
Zero-shot Bactrian-LLaMA-7B
25.7696
23
Zero-shot Alpaca-7B
25.6294
24
three-shot in-context learning mT5-XL
25.1786
25
Zero-shot BLOOM-7B
24.3814
26
three-shot in-context learning mT0-XL
23.4619
27
five-shot in-context learning mT5-XL
22.1328
28
three-shot in-context learning Vicuna-7B
20.576
29
Zero-shot mT0-XL
20.314
30
Zero-shot mT5-XL
19.6798
31
Baseline Majority
18.2949
32
five-shot in-context learning mT0-XL
15.9229
33
Zero-shot Vicuna-7B
15.4877