Sentiment-kan-Chakravarthi
Task Identifier: sentiment-2022-chakravarthi-ka
Cluster: Sentiment Analysis
Data Type: kan
Score Metric: Macro-F1
Paper/GitHub/Website URL:


RankSubmission Title Model
URL
Score
Details
1
Finetuned LMs InfoDCL
82.9212
2
Finetuned LMs Bernice
82.3478
3
Finetuned LMs TwHIN-BERT
81.5862
4
Finetuned LMs XLM-RoBERTa-Large
81.1632
5
Finetuned LMs XLM-Twitter
80.6776
6
Finetuned LMs XLM-RoBERTa-Base
80.5461
7
Finetuned LMs mBERT
78.9198
8
Zero-shot Chatgpt
68.4389
9
Zero-shot BLOOMZ-P3-7B
61.8594
10
five-shot in-context learning LLaMA-7B
59.1679
11
five-shot in-context learning BLOOMZ-P3-7B
58.7532
12
three-shot in-context learning LLaMA-7B
58.387
13
three-shot in-context learning BLOOMZ-P3-7B
56.0628
14
Zero-shot BLOOMZ-7B
55.215
15
Zero-shot Bactrian-LLaMA-7B
52.5134
16
five-shot in-context learning mT0-XL
51.9703
17
Zero-shot Chatgpt with translated prompts
51.8358
18
five-shot in-context learning BLOOM-7B
50.339
19
Baseline Random
49.5489
20
three-shot in-context learning mT0-XL
48.3105
21
three-shot in-context learning Vicuna-7B
47.5912
22
three-shot in-context learning BLOOM-7B
47.5108
23
Zero-shot mT0-XL
47.5108
24
five-shot in-context learning Vicuna-7B
42.4955
25
Baseline Majority
41.6279
26
Zero-shot LLaMA-7B
29.2774
27
Zero-shot BLOOM-7B
27.4426
28
three-shot in-context learning mT5-XL
25.1368
29
Zero-shot Vicuna-7B
24.066
30
Zero-shot Bactrian-BLOOM
23.8182
31
Zero-shot Alpaca-7B
23.7496
32
five-shot in-context learning mT5-XL
23.2997
33
Zero-shot mT5-XL
22.7707