Sentiment-fin-Kajava
Task Identifier: sentiment-2018-kajava-fin
Cluster: Sentiment Analysis
Data Type: fin
Score Metric: Macro-F1
Paper/GitHub/Website URL:


RankSubmission Title Model
URL
Score
Details
1
Finetuned LMs XLM-RoBERTa-Large
86.949
2
Zero-shot Chatgpt
83.7714
3
Zero-shot Chatgpt with translated prompts
83.7108
4
Finetuned LMs XLM-RoBERTa-Base
83.4757
5
Finetuned LMs XLM-Twitter
82.3831
6
Finetuned LMs InfoDCL
82.3154
7
Finetuned LMs Bernice
79.8644
8
Finetuned LMs mBERT
78.8779
9
Finetuned LMs TwHIN-BERT
78.1968
10
five-shot in-context learning Vicuna-7B
59.4953
11
three-shot in-context learning Vicuna-7B
58.2278
12
Zero-shot mT0-XL
58.167
13
Zero-shot Vicuna-7B
57.756
14
three-shot in-context learning BLOOMZ-P3-7B
52.8005
15
Zero-shot Bactrian-LLaMA-7B
52.6481
16
five-shot in-context learning LLaMA-7B
52.0932
17
three-shot in-context learning LLaMA-7B
50.6733
18
Baseline Random
50.1118
19
three-shot in-context learning BLOOM-7B
49.8542
20
five-shot in-context learning BLOOMZ-P3-7B
49.5346
21
five-shot in-context learning BLOOM-7B
48.8131
22
three-shot in-context learning mT0-XL
47.4569
23
five-shot in-context learning mT0-XL
47.1196
24
Zero-shot Bactrian-BLOOM
41.3333
25
Zero-shot BLOOMZ-P3-7B
41.2409
26
Zero-shot Alpaca-7B
40.4066
27
three-shot in-context learning mT5-XL
39.5465
28
Zero-shot LLaMA-7B
38.381
29
Zero-shot BLOOMZ-7B
36.5491
30
Baseline Majority
35.665
31
Zero-shot mT5-XL
35.6499
32
five-shot in-context learning mT5-XL
35.6499
33
Zero-shot BLOOM-7B
35.4839