Sentiment-swe-Mozetic
Task Identifier: sentiment-2016-mozetic-swe
Cluster: Sentiment Analysis
Data Type: swe
Score Metric: Macro-F1
Paper/GitHub/Website URL: N/A


RankSubmission Title Model
URL
Score
Details
1
Finetuned LMs XLM-RoBERTa-Large
73.1889
2
Finetuned LMs InfoDCL
70.9769
3
Finetuned LMs XLM-Twitter
70.4815
4
Finetuned LMs TwHIN-BERT
70.2541
5
Finetuned LMs Bernice
69.9278
6
Finetuned LMs XLM-RoBERTa-Base
68.8442
7
Finetuned LMs mBERT
64.6137
8
Zero-shot Chatgpt with translated prompts
62.3977
9
Zero-shot Chatgpt
60.103
10
three-shot in-context learning BLOOM-7B
34.7571
11
five-shot in-context learning LLaMA-7B
34.2454
12
five-shot in-context learning Vicuna-7B
34.0785
13
three-shot in-context learning LLaMA-7B
33.889
14
Baseline Random
33.3531
15
three-shot in-context learning BLOOMZ-P3-7B
29.6499
16
Zero-shot BLOOMZ-P3-7B
29.3059
17
five-shot in-context learning BLOOM-7B
28.4993
18
Zero-shot Bactrian-BLOOM
28.1366
19
five-shot in-context learning BLOOMZ-P3-7B
27.4527
20
Zero-shot BLOOMZ-7B
25.8372
21
Zero-shot BLOOM-7B
24.8531
22
three-shot in-context learning mT5-XL
24.5968
23
Zero-shot LLaMA-7B
24.5735
24
Zero-shot Bactrian-LLaMA-7B
24.1039
25
three-shot in-context learning mT0-XL
23.9352
26
three-shot in-context learning Vicuna-7B
23.6081
27
Zero-shot Alpaca-7B
22.5556
28
five-shot in-context learning mT5-XL
21.8496
29
Zero-shot mT0-XL
20.7673
30
Zero-shot mT5-XL
19.66
31
Baseline Majority
19.1571
32
five-shot in-context learning mT0-XL
17.1333
33
Zero-shot Vicuna-7B
16.0475