Researchers develop online hate speech 'shockwave' formula

A George Washington University research team has created a novel formula that demonstrates how, why, and when hate speech spreads throughout social media. The researchers put forth a first-principles dynamical theory that explores a new realm of physics in order to represent the shockwave effect created by bigoted content across online communities.

This effect is evident in lightly moderated websites, such as 4Chan, and highly regulated social platforms like Facebook. Furthermore, hate speech ripples through online communities in a pattern that non-hateful content typically does not follow.

The article was published in Physical Review Letters on June 5, 2023.

The new theory considers recently gained knowledge on the pivotal role of in-built communities in the growth of online extremism. The formula weighs the competing forces of fusion and fission, accounting for the spontaneous emergence of in-built communities through the absorption of other communities and interested individuals (fusion) and the disciplinary measures moderators take against users and groups that violate a given platform’s rules (fission).

Researchers hope the formula can serve as a tool for moderators to project the shockwave-like spread of hateful content and develop methods to delay, divert, and prevent it from spiraling out of control. The novel theory could also be applied beyond social media platforms and online message boards, potentially powering moderation strategies on blockchain platforms, generative AI, and the metaverse.

“This study presents the missing science of how harms thrive online and, hence, how they can be overcome,” Neil Johnson, professor of physics at the George Washington University and co-author of the study, said. “This missing science is a new form of shockwave physics.”

More information:
Pedro D. Manrique et al, Shockwavelike Behavior across Social Media, Physical Review Letters (2023). DOI: 10.1103/PhysRevLett.130.237401