Sentiment-hin-Patra
Task Identifier: sentiment-2018-patra-hin
Cluster: Sentiment Analysis
Data Type: hin
Score Metric: Macro-F1
Paper/GitHub/Website URL:


RankSubmission Title Model
URL
Score
Details
1
Finetuned LMs XLM-RoBERTa-Large
62.3897
2
Finetuned LMs Bernice
62.2998
3
Finetuned LMs XLM-Twitter
60.9462
4
Finetuned LMs TwHIN-BERT
60.8642
5
Finetuned LMs InfoDCL
59.757
6
Zero-shot Chatgpt
59.4035
7
Finetuned LMs XLM-RoBERTa-Base
58.3081
8
Finetuned LMs mBERT
55.4579
9
Zero-shot Chatgpt with translated prompts
48.3042
10
five-shot in-context learning Vicuna-7B
34.7177
11
Zero-shot Bactrian-LLaMA-7B
32.2802
12
Baseline Random
31.6735
13
Zero-shot BLOOMZ-P3-7B
30.4467
14
three-shot in-context learning LLaMA-7B
30.3984
15
Zero-shot BLOOMZ-7B
28.7406
16
Zero-shot BLOOM-7B
28.7326
17
three-shot in-context learning Vicuna-7B
28.4892
18
Zero-shot Bactrian-BLOOM
28.2319
19
three-shot in-context learning BLOOM-7B
28.102
20
five-shot in-context learning BLOOMZ-P3-7B
27.8095
21
five-shot in-context learning LLaMA-7B
27.1462
22
Zero-shot mT0-XL
23.9632
23
three-shot in-context learning BLOOMZ-P3-7B
23.3289
24
Zero-shot Vicuna-7B
22.4477
25
three-shot in-context learning mT0-XL
22.0353
26
five-shot in-context learning BLOOM-7B
21.6458
27
Baseline Majority
20.9847
28
Zero-shot Alpaca-7B
20.5779
29
five-shot in-context learning mT0-XL
19.9257
30
three-shot in-context learning mT5-XL
17.3514
31
five-shot in-context learning mT5-XL
15.0707
32
Zero-shot LLaMA-7B
13.7976
33
Zero-shot mT5-XL
11.5702