Equality and Human Rights Commission (EHRC)
Equality watchdog takes action to address discrimination in use of artificial intelligence
The use of artificial intelligence by public bodies is to be monitored by Britain’s equality regulator to ensure technologies are not discriminating against people.
There is emerging evidence that bias built into algorithms can lead to less favourable treatment of people with protected characteristics such as race and sex.
The Equality and Human Rights Commission (EHRC) has made tackling discrimination in AI a major strand of its new three-year strategy.
It is today publishing new guidance to help organisations avoid breaches of equality law, including the public sector equality duty (PSED). The guidance gives practical examples of how AI systems may be causing discriminatory outcomes.
From October, the Commission will work with a cross-section of around 30 local authorities to understand how they are using AI to deliver essential services, such as benefits payments, amid concerns that automated systems are inappropriately flagging certain families as a fraud risk.
The EHRC is also exploring how best to use its powers to examine how organisations are using facial recognition technology, following concerns that the software may be disproportionately affecting people from ethnic minorities.
These interventions will improve how organisations use AI and encourage public bodies to take action to address any negative equality and human rights impacts.
Marcial Boo, chief executive of the EHRC, yesterday said:
“While technology is often a force for good, there is evidence that some innovation, such as the use of artificial intelligence, can perpetuate bias and discrimination if poorly implemented.
“Many organisations may not know they could be breaking equality law, and people may not know how AI is used to make decisions about them.
“It’s vital for organisations to understand these potential biases and to address any equality and human rights impacts.
“As part of this, we are monitoring how public bodies use technology to make sure they are meeting their legal responsibilities, in line with our guidance published today. The EHRC is committed to working with partners across sectors to make sure technology benefits everyone, regardless of their background.”
The monitoring projects will last several months and will report initial findings early next year.
The Artifical intelligence in public services guidance advises organisations to consider how the PSED applies to automated processes, to be transparent about how the technology is used and to keep systems under constant review.
In the private sector, the EHRC is currently supporting a taxi driver in a race discrimination claim regarding Uber’s use of facial recognition technology for identification purposes.
Press contact details
For more press information contact the Commission's media office on:
0161 829 8102
Latest News from
Equality and Human Rights Commission (EHRC)
Statement on Rico Quitongo’s race discrimination case24/11/2022 15:10:00
Footballer Rico Quitongo has been unsuccessful in his race discrimination claim against his former club and a club director.
Equality regulator briefs MSPs on gender recognition reform15/11/2022 13:38:00
Britain’s equality regulator, the Equality and Human Rights Commission, has advised the Scottish and UK governments on the implications of the Gender Recognition Reform (Scotland) Bill for the operation of the Equality Act 2010.
Report published following EHRC’s ‘A status’ grading10/11/2022 10:20:00
Following the news last month that we have retained our A-status as a National Human Rights Institution, the Global Alliance of National Human Rights Institutions (GANHRI) has now published its full report on all organisations it reviewed this session.
Britain’s equality watchdog takes action to prevent hair discrimination in schools27/10/2022 11:05:00
Pupils should not be stopped from wearing their hair in natural Afro styles at school, the Equality and Human Rights Commission (EHRC) says in new guidance today.
Equality and Human Rights Commission re-accredited as ‘A status’ organisation17/10/2022 12:10:00
We have been re-accredited as an ‘A status’ National Human Rights Institution (NHRI).
EHRC urges governments to work together on gender recognition reform05/10/2022 13:10:00
In January this year, we called for more detailed consideration of proposals to reform the legal gender recognition process in Scotland.
Our response to allegations about mistreatment of people in Edenfield Centre Mental Health Unit30/09/2022 13:10:00
The Equality and Human Rights Commission has a duty to enforce equality laws and defend human rights. We therefore consider all allegations of unlawful activities carefully and take action where necessary.
Health Department’s plan for detained patients falls well short of what’s needed27/07/2022 15:10:00
Chief Executive of the Equality and Human Rights Commission Marcial Boo responded to the Department of Health and Social Care’s (DHSC) Building Better Support plan to address the number of patients inappropriately detained in secure hospitals
28 organisations yet to report gender pay gap data06/07/2022 14:10:00
One-stop shopping giant Costco and aviation business Swissport are among 28 organisations that are yet to comply with their legal obligation and report their gender pay gap data for 2021–22, following the 30 March and 4 April deadlines.