Hate-eng-Waseem
Task Identifier: hate-2016-waseem-eng
Cluster: Anti-Social
Data Type: eng
Score Metric: Weight-F1
Paper/GitHub/Website URL:


RankSubmission Title Model
URL
Score
Details
1
Finetuned LMs XLM-RoBERTa-Large
89.7468
2
Finetuned LMs XLM-RoBERTa-Base
89.3298
3
Finetuned LMs TwHIN-BERT
89.3121
4
Finetuned LMs XLM-Twitter
89.1202
5
Finetuned LMs InfoDCL
88.9332
6
Finetuned LMs Bernice
88.7944
7
Finetuned LMs mBERT
87.7364
8
Zero-shot Chatgpt with translated prompts
79.9793
9
Zero-shot Chatgpt
79.9793
10
five-shot in-context learning Vicuna-7B
70.3454
11
three-shot in-context learning Vicuna-7B
65.9756
12
Zero-shot BLOOMZ-7B
65.9635
13
five-shot in-context learning LLaMA-7B
64.1404
14
three-shot in-context learning LLaMA-7B
62.7483
15
Baseline Majority
62.2153
16
Zero-shot Vicuna-7B
61.6623
17
five-shot in-context learning mT0-XL
61.0119
18
three-shot in-context learning mT0-XL
60.8604
19
Zero-shot LLaMA-7B
60.4234
20
Zero-shot Bactrian-BLOOM
60.167
21
Zero-shot BLOOMZ-P3-7B
60.0731
22
three-shot in-context learning BLOOMZ-P3-7B
59.9301
23
Zero-shot mT0-XL
59.7501
24
Zero-shot BLOOM-7B
58.2566
25
Zero-shot Bactrian-LLaMA-7B
57.6606
26
three-shot in-context learning BLOOM-7B
55.3892
27
five-shot in-context learning BLOOMZ-P3-7B
43.8884
28
Baseline Random
41.5674
29
five-shot in-context learning BLOOM-7B
39.8514
30
Zero-shot Alpaca-7B
37.332
31
three-shot in-context learning mT5-XL
24.5466
32
five-shot in-context learning mT5-XL
22.0655
33
Zero-shot mT5-XL
18.6597