Sentiment-fas-Ashrafi
Task Identifier: sentiment-2020-ashrafi-fas
Cluster: Sentiment Analysis
Data Type: fas
Score Metric: Macro-F1
Paper/GitHub/Website URL:


RankSubmission Title Model
URL
Score
Details
1
Finetuned LM FaBERT
87.5152
2
Finetuned LMs XLM-RoBERTa-Base
84.7965
3
Finetuned LMs TwHIN-BERT
84.7255
4
Finetuned LMs XLM-Twitter
84.6543
5
Finetuned LMs Bernice
84.5643
6
Finetuned LMs InfoDCL
84.537
7
Finetuned LMs XLM-RoBERTa-Large
84.3953
8
Finetuned LMs mBERT
82.7048
9
Zero-shot Chatgpt
73.8723
10
Zero-shot Chatgpt with translated prompts
68.9162
11
Zero-shot mT0-XL
45.6881
12
Zero-shot BLOOMZ-P3-7B
41.3397
13
five-shot in-context learning BLOOMZ-P3-7B
36.6093
14
five-shot in-context learning mT0-XL
36.1412
15
five-shot in-context learning Vicuna-7B
35.9025
16
Zero-shot Bactrian-LLaMA-7B
34.9477
17
Zero-shot BLOOMZ-7B
33.7688
18
five-shot in-context learning LLaMA-7B
32.5796
19
three-shot in-context learning BLOOMZ-P3-7B
32.561
20
three-shot in-context learning LLaMA-7B
31.5636
21
three-shot in-context learning mT0-XL
30.5793
22
Baseline Random
30.5113
23
three-shot in-context learning Vicuna-7B
30.2168
24
three-shot in-context learning BLOOM-7B
26.1785
25
five-shot in-context learning BLOOM-7B
25.1344
26
Baseline Majority
23.0204
27
Zero-shot Vicuna-7B
17.6315
28
Zero-shot LLaMA-7B
12.7634
29
three-shot in-context learning mT5-XL
12.2838
30
five-shot in-context learning mT5-XL
10.6632
31
Zero-shot Alpaca-7B
10.2488
32
Zero-shot Bactrian-BLOOM
10.2488
33
Zero-shot BLOOM-7B
10.2488
34
Zero-shot mT5-XL
9.97732