Hate-ara-Mubarak
Task Identifier: hate-2020-mubarak-ara
Cluster: Anti-Social
Data Type: ara
Score Metric: Macro-F1
Paper/GitHub/Website URL:


RankSubmission Title Model
URL
Score
Details
1
Finetuned LMs XLM-RoBERTa-Large
83.7121
2
Finetuned LMs InfoDCL
82.0002
3
Finetuned LMs Bernice
81.1622
4
Finetuned LMs XLM-RoBERTa-Base
79.6664
5
Finetuned LMs TwHIN-BERT
79.4788
6
Finetuned LMs XLM-Twitter
78.1985
7
Finetuned LMs mBERT
73.925
8
Zero-shot Chatgpt
60.7248
9
three-shot in-context learning Vicuna-7B
59.156
10
five-shot in-context learning Vicuna-7B
55.1712
11
five-shot in-context learning LLaMA-7B
54.8307
12
three-shot in-context learning LLaMA-7B
54.0698
13
Zero-shot Chatgpt with translated prompts
52.0445
14
five-shot in-context learning BLOOM-7B
50.7605
15
five-shot in-context learning mT5-XL
50.3374
16
three-shot in-context learning BLOOM-7B
49.9709
17
Baseline Majority
48.7048
18
Zero-shot BLOOMZ-P3-7B
48.6653
19
Zero-shot Vicuna-7B
48.6653
20
three-shot in-context learning BLOOMZ-P3-7B
48.6653
21
Zero-shot BLOOMZ-7B
48.6653
22
Zero-shot LLaMA-7B
48.6653
23
five-shot in-context learning BLOOMZ-P3-7B
48.6653
24
Zero-shot mT0-XL
48.6653
25
five-shot in-context learning mT0-XL
48.6653
26
three-shot in-context learning mT0-XL
48.6125
27
Zero-shot Alpaca-7B
48.5067
28
three-shot in-context learning mT5-XL
44.6195
29
Zero-shot Bactrian-LLaMA-7B
43.4847
30
Baseline Random
37.8382
31
Zero-shot BLOOM-7B
35.6861
32
Zero-shot Bactrian-BLOOM
34.0813
33
Zero-shot mT5-XL
8.36335