Beyond trolling: Fine-grained detection of antisocial behavior in social media during the pandemic

Kód výsledku v IS VaVaI

<a href="https://www.isvavai.cz/riv?ss=detail&h=RIV%2F00216275%3A25410%2F25%3A39923426" target="_blank" >RIV/00216275:25410/25:39923426 - isvavai.cz</a>

Výsledek na webu

<a href="https://www.mdpi.com/2078-2489/16/3/173" target="_blank" >https://www.mdpi.com/2078-2489/16/3/173</a>

DOI - Digital Object Identifier

<a href="http://dx.doi.org/10.3390/info16030173" target="_blank" >10.3390/info16030173</a>

Jazyk výsledku

angličtina

Název v původním jazyce

Beyond trolling: Fine-grained detection of antisocial behavior in social media during the pandemic

Popis výsledku v původním jazyce

Antisocial behavior (ASB), including trolling and aggression, undermines constructive discourse and escalates during periods of societal stress, such as the COVID-19 pandemic. This study aimed to examine ASB on social media during the COVID-19 pandemic by leveraging a novel annotated dataset and state-of-the-art transformer models for detection and classification of ASB categories. Specifically, this study examined ASB within a gold-standard corpus of tweets collected from Ghana during a 21-day lockdown. Each tweet was meticulously annotated into ASB categories or non-ASB, enabling a comprehensive analysis of online behaviors. We employed three state-of-the-art transformer-based language models (BERT, RoBERTa, and ELECTRA) and compared their performance against traditional machine learning models. The results demonstrate that the transformer-based approaches substantially outperformed the baseline models, achieving a high detection accuracy across both binary and multiclass classification tasks. RoBERTa excelled in binary ASB detection, attaining a 95.59% accuracy and an F1-score of 94.99%, while BERT led in multiclass classification, with a 94.38% accuracy and an F1-score of 93.92%. Trolling emerged as the most prevalent ASB type, reflecting the polarizing nature of online interactions during the lockdown. This study highlights the potential of transformer-based models in detecting diverse online behaviors and emphasizes the societal implications of ASB during crises. The findings provide a foundation for enhancing moderation tools and fostering healthier online environments.

Název v anglickém jazyce

Beyond trolling: Fine-grained detection of antisocial behavior in social media during the pandemic

Popis výsledku anglicky

Antisocial behavior (ASB), including trolling and aggression, undermines constructive discourse and escalates during periods of societal stress, such as the COVID-19 pandemic. This study aimed to examine ASB on social media during the COVID-19 pandemic by leveraging a novel annotated dataset and state-of-the-art transformer models for detection and classification of ASB categories. Specifically, this study examined ASB within a gold-standard corpus of tweets collected from Ghana during a 21-day lockdown. Each tweet was meticulously annotated into ASB categories or non-ASB, enabling a comprehensive analysis of online behaviors. We employed three state-of-the-art transformer-based language models (BERT, RoBERTa, and ELECTRA) and compared their performance against traditional machine learning models. The results demonstrate that the transformer-based approaches substantially outperformed the baseline models, achieving a high detection accuracy across both binary and multiclass classification tasks. RoBERTa excelled in binary ASB detection, attaining a 95.59% accuracy and an F1-score of 94.99%, while BERT led in multiclass classification, with a 94.38% accuracy and an F1-score of 93.92%. Trolling emerged as the most prevalent ASB type, reflecting the polarizing nature of online interactions during the lockdown. This study highlights the potential of transformer-based models in detecting diverse online behaviors and emphasizes the societal implications of ASB during crises. The findings provide a foundation for enhancing moderation tools and fostering healthier online environments.

Druh

J_imp - Článek v periodiku v databázi Web of Science

CEP obor

—

OECD FORD obor

10201 - Computer sciences, information science, bioinformathics (hardware development to be 2.2, social aspect to be 5.8)

Projekt

—

Návaznosti

S - Specificky vyzkum na vysokych skolach<br>I - Institucionalni podpora na dlouhodoby koncepcni rozvoj vyzkumne organizace

Rok uplatnění

2025

Kód důvěrnosti údajů

S - Úplné a pravdivé údaje o projektu nepodléhají ochraně podle zvláštních právních předpisů

Název periodika

Information

ISSN

—

e-ISSN

2078-2489

Svazek periodika

16

Číslo periodika v rámci svazku

3

Stát vydavatele periodika

JP - Japonsko

Počet stran výsledku

21

Strana od-do

173

Kód UT WoS článku

001452810500001

EID výsledku v databázi Scopus

2-s2.0-105001007660