Sentiment-ben-Islam
Task Identifier: sentiment-2021-islam-ben
Cluster: Sentiment Analysis
Data Type: ben
Score Metric: Macro-F1
Paper/GitHub/Website URL:


RankSubmission Title Model
URL
Score
Details
1
Finetuned LMs XLM-RoBERTa-Large
69.4916
2
Finetuned LMs InfoDCL
68.5362
3
Finetuned LMs XLM-RoBERTa-Base
67.9863
4
Finetuned LMs XLM-Twitter
67.8919
5
Finetuned LMs TwHIN-BERT
66.8593
6
Finetuned LMs Bernice
66.7399
7
Finetuned LMs mBERT
62.9515
8
Zero-shot Chatgpt
55.759
9
Zero-shot BLOOMZ-P3-7B
45.1781
10
five-shot in-context learning BLOOMZ-P3-7B
43.5687
11
Zero-shot BLOOMZ-7B
42.8368
12
five-shot in-context learning LLaMA-7B
38.474
13
three-shot in-context learning BLOOMZ-P3-7B
38.1356
14
three-shot in-context learning BLOOM-7B
33.7466
15
three-shot in-context learning LLaMA-7B
33.3104
16
Baseline Random
31.1812
17
Zero-shot mT0-XL
30.7485
18
five-shot in-context learning BLOOM-7B
30.6405
19
Zero-shot Bactrian-BLOOM
29.1127
20
Zero-shot Chatgpt with translated prompts
28.0735
21
five-shot in-context learning Vicuna-7B
27.0991
22
three-shot in-context learning mT0-XL
24.88
23
five-shot in-context learning mT0-XL
23.5885
24
three-shot in-context learning mT5-XL
21.0545
25
five-shot in-context learning mT5-XL
20.2214
26
Zero-shot Alpaca-7B
18.4971
27
Zero-shot LLaMA-7B
18.4971
28
Zero-shot mT5-XL
18.4971
29
Zero-shot BLOOM-7B
18.4971
30
three-shot in-context learning Vicuna-7B
18.4535
31
Zero-shot Bactrian-LLaMA-7B
17.947
32
Baseline Majority
17.648
33
Zero-shot Vicuna-7B
15.0821