WIREDGOV

Research funded by the Economic and Social Research Council (ESRC) into the spread of online hate and its real-world impact is featured in a new BBC Ideas film.

Credit: imbarney22, Getty Images E+ via Getty Image

HateLab, led by Professor Matthew Williams of Cardiff University, has shown that spikes in online hate speech can be followed by increases in hate crime offline.

This highlights the growing consequences of digital harms for society.

The film, ‘Is the internet broken?’, explores how the internet has evolved and how research is helping to understand and respond to emerging online risks.

Understanding the scale of online harm

Online hate speech and misinformation have become major societal challenges, amplified by the growth of social media.

Between 2012 and 2023, police-recorded hate crimes in England and Wales rose by 252%, while more than half of young people aged 12 to 15 report seeing hateful content online.

HateLab, an ESRC-funded global data hub, brings together social and computer science to track and analyse hate speech and crime across online and offline spaces.

Interacting with digital platforms

Professor Williams, Director of HateLab and a leading international expert in cybercrime, online extremism and contemporary hate speech, explains how human behaviour interacts with digital platforms. He says:

We are threat-detecting machines. As humans, we are wired to notice danger, hostility and social conflict, and that made sense for most of our evolutionary history.

The problem is that platform engagement algorithms industrialise that instinct. Content that makes us anxious, angry or afraid is often content that keeps us watching, clicking and sharing.

That does not mean people are powerless, but it does mean we need to understand how human psychology and platform design interact if we want to build healthier digital spaces.

This means people are naturally drawn to negative or polarising content, something that engagement-driven algorithms can amplify.

From research to real-world impact

ESRC investment in HateLab has enabled the development of new tools to monitor and respond to online harms in real time.

Researchers have created AI-driven systems that can detect and classify harmful content at scale, forming the basis of the Hero platform now used by organisations to identify emerging threats and harmful narratives.

This research has also helped underpin Nisien.ai, the Cardiff University spinout from HateLab, which is developing applied artificial intelligence (AI) tools to help organisations identify, understand and respond to online harms.

Supporting policy and national security

It is already informing policy and practice.

HateLab’s work has contributed to the Welsh Government’s national approach to tackling hate crime and has been embedded in the UK National Cyber Hate Crime Hub, supporting policing and national security.

Its insights have also been used to inform responses to major events and online trends, demonstrating how research can help organisations act quickly to protect communities.

Shaping public discourse

ESRC executive chair, Stian Westlake, said:

Online hate and misinformation can have significant impacts, from affecting people’s mental health and wellbeing to shaping public discourse and, in some cases, contributing to real-world harm. These are complex challenges that require thoughtful, evidence-based responses.

Professor Williams’s work demonstrates the power of ESRC’s investment in social research to improve lives by exploring and addressing pressing societal issues. I am pleased to see it showcased by the BBC Ideas team.

How the internet changed

The BBC Ideas film traces the origins of the web to 1989, when Tim Berners-Lee proposed a system for openly sharing information.

In its early years, the internet was decentralised and shaped by independent websites and user creativity.

However, the rise of large platforms and online advertising has transformed how people experience the digital world.

The film explores how engagement-driven systems can prioritise attention-grabbing and sometimes harmful content, and how a small number of large platforms now shape much of the online environment.

Supporting safer online spaces

The film highlights how research such as HateLab is helping to better understand and respond to harmful online content.

It points to gaps in protections for people experiencing online harm, as well as the challenges of managing harmful content at scale.

HateLab’s work shows how data and technology can support more effective responses, from identifying harmful content to enabling organisations to intervene earlier.

Emerging tools based on this research are also exploring ways to respond to harmful behaviour online, using evidence-based approaches to reduce conflict and promote safer interactions.

Shaping the future of the internet

Despite the challenges, the film emphasises that change is possible.

In the film, Professor Williams highlights the role of users in shaping digital environments: “Ultimately the power does lie with the users.”

The film concludes that while the internet has changed significantly, ongoing research, policy development and public awareness will all play a role in determining its future.

By featuring ESRC-funded research, the BBC Ideas film helps bring evidence on online harms into the public conversation, connecting academic insight with lived experience and highlighting why research matters beyond academia.