Cyberbullying Detection in Social Media Using Pre-Trained Language Models
Document Type
Article
Publication Date
3-3-2026
Abstract
The rapid integration of Information and Communication Technologies (ICT) has revolutionized online communication, yet it has also led to the emergence of cyberbullying, a harmful digital behaviour. This study addresses the urgency of combating cyberbullying and its negative impacts by using advanced pre-trained language models (PLMs) through transfer learning in detecting cyberbullying in social media. The goal is to enhance cyberbullying detection's effectiveness to create safer online spaces. Cyberbullying detection model using transfer learning, DistilBERT, DistilELECTRA, and MiniLM PLMs were explored. The PLMs' evaluation using the AMiCA dataset, MiniLM achieves the highest performance in detecting cyberbullying, with an accuracy of 97.84% in cross-validation and 98.57% in hold-out testing, while DistilBERT and DistilELECTRA also perform well, achieving accuracies of 97.34% and 98.03%, and 97.58% and 92.97%, respectively. MiniLM consistently maintains competitive F-measures, addressing class imbalance. Overall, MiniLM stands out with high accuracy and micro F1-scores, outperforming other models. Comparative analysis reaffirms MiniLM's excellence in binary classes and overall evaluation showcasing the effectiveness of transfer learning compared to previous studies. In conclusion, this study demonstrates the capabilities of PLMs for cyberbullying detection and suggests future research directions
Keywords
AMiCA Dataset, Cyberbullying Detection, Pre-trained Language Models, Text Classification, Transfer Learning
Publication Title
Malaysian Journal of Computer Science
ISSN
0127-9084
DOI
10.22452/MJCS.VOL38NO1.3
Recommended Citation
Bong, Jasmeen Kah Ying; Varathan, Kasturi Dewi; and Teng, Teoh Hwai, "Cyberbullying Detection in Social Media Using Pre-Trained Language Models" (2026). Research Publications (2026 to 2030). 1023.
https://knova.um.edu.my/research_publications_2026_2030/1023
Volume
38
Issue
1
First Page
29
Last Page
54
Publisher
Faculty of Computer Science and Information Technology