Subjective-spa-Barbieri
Task Identifier: subjective-2016-barbieri-spa
Cluster: Subjectivity Analysis
Data Type: spa
Score Metric: Macro-F1
Paper/GitHub/Website URL:


RankSubmission Title Model
URL
Score
Details
1
Finetuned LMs XLM-RoBERTa-Large
77.7599
2
Finetuned LMs InfoDCL
77.326
3
Finetuned LMs XLM-Twitter
76.5084
4
Finetuned LMs Bernice
75.5373
5
Finetuned LMs TwHIN-BERT
74.4173
6
Finetuned LMs XLM-RoBERTa-Base
73.9234
7
Zero-shot Chatgpt
71.3788
8
Zero-shot Chatgpt with translated prompts
71.2122
9
Finetuned LMs mBERT
70.9503
10
five-shot in-context learning Vicuna-7B
64.4451
11
three-shot in-context learning Vicuna-7B
61.5173
12
five-shot in-context learning LLaMA-7B
54.6057
13
three-shot in-context learning LLaMA-7B
54.5982
14
Zero-shot BLOOM-7B
53.6726
15
Zero-shot LLaMA-7B
53.3279
16
Baseline Random
51.1324
17
Zero-shot mT5-XL
47.7246
18
five-shot in-context learning mT5-XL
47.188
19
Zero-shot mT0-XL
42.9391
20
three-shot in-context learning mT5-XL
41.7731
21
Zero-shot Bactrian-BLOOM
40.3255
22
three-shot in-context learning BLOOM-7B
39.7783
23
Zero-shot Bactrian-LLaMA-7B
39.7147
24
Baseline Majority
39.4729
25
Zero-shot Vicuna-7B
38.6048
26
three-shot in-context learning mT0-XL
37.3684
27
five-shot in-context learning BLOOM-7B
34.5597
28
five-shot in-context learning mT0-XL
30.375
29
Zero-shot BLOOMZ-P3-7B
27.8499
30
Zero-shot BLOOMZ-7B
27.8499
31
three-shot in-context learning BLOOMZ-P3-7B
27.8499
32
Zero-shot Alpaca-7B
27.8499
33
five-shot in-context learning BLOOMZ-P3-7B
27.8499