Investigation launched into potential for bias in algorithmic decision-making in society
World-first Centre for Data Ethics and Innovation will partner with the Cabinet Office’s Race Disparity Unit to explore potential for bias in crime and justice
- Centre will investigate how to maximise the benefits in the use of algorithms in recruitment, local government and financial services
- Comes as organisation publishes its first full-year work programme and strategy setting out its priorities for the year ahead
The potential for bias in the use of algorithms in crime and justice, financial services, recruitment and local government will be investigated by the Centre for Data Ethics and Innovation (CDEI).
Algorithms have huge potential for preventing crime, protecting the public and improving the way services are delivered. But decisions made in these areas are likely to have a significant impact on people’s lives and public trust is essential.
Professionals in these fields are increasingly using algorithms built from data to help them make decisions. But there is a risk that any human bias in that data will be reflected in recommendations made by the algorithm. The CDEI wants to ensure those using such technology can understand the potential for bias and have measures in place to address. It also aims to help guarantee fairer decisions and where possible improve processes.
In crime and justice, algorithms could be used to assess the likelihood of re-offending and inform decisions about policing, probation and parole. For example, some police forces have already started to use algorithms to feed into their decision-making - such as the Harm Assessment Risk Tool in Durham which is being used to assist officers in deciding whether an individual is eligible for deferred prosecution based on the future risk of offending.
The establishment of the CDEI supports the government’s wider Industrial Strategy, and it was set up to make sure data-driven technologies and artificial intelligence are used for the benefit of society. It will partner with the Race Disparity Unit to explore the potential for bias based on ethnicity in decisions made in the crime and justice system.
Speaking ahead of a Downing Street event to mark the publication of the centre’s first work programme and strategy setting out the CDEI’s priorities, Digital Secretary Jeremy Wright yesterday said:
Technology is a force for good which has improved people’s lives but we must make sure it is developed in a safe and secure way.
Our Centre for Data Ethics and Innovation has been set up to help us achieve this aim and keep Britain at the forefront of technological development.
I’m pleased its team of experts is undertaking an investigation into the potential for bias in algorithmic decision-making in areas including crime, justice and financial services. I look forward to seeing the Centre’s recommendations to Government on any action we need to take to help make sure we maximise the benefits of these powerful technologies for society.
Roger Taylor, Chair of the Centre for Data Ethics and Innovation, yesterday said:
The Centre is focused on addressing the greatest challenges and opportunities posed by data driven technology. These are complex issues and we will need to take advantage of the expertise that exists across the UK and beyond. If we get this right, the UK can be the global leader in responsible innovation.
We want to work with organisations so they can maximise the benefits of data driven technology and use it to ensure the decisions they make are fair. As a first step we will be exploring the potential for bias in key sectors where the decisions made by algorithms can have a big impact on people’s lives.
I am delighted that the Centre is today publishing its strategy setting out our priorities.
The CDEI will also explore the opportunities for data-driven technology to address the potential for bias in existing systems and to support fairer decision-making. This may include increasing opportunities for those in the job or credit markets in existing recruitment and financial services systems. It will also explore opportunities to boost innovation in the digital economy.
In recruitment, computer algorithms can be used to screen CVs and shortlist candidates. This could help potentially limit the impact of unconscious bias, where people discriminate against candidates because of their background. But there have also been reports of such technology inadvertently exacerbating gender bias.
And in financial services data analysis has long been used to inform decisions about whether people can be granted loans. But the rise of data and AI machine-learning presents increased issues about the transparency and fairness of such decisions.
The CDEI yesterday set out its priorities in its first Work Programme and Strategy. This also includes plans for it to investigate how data is used to shape online experiences through personalisation and micro-targeting - for example where you search for a product and then adverts for similar products appear later in your browser.
This review will explore where, how and why online targeting approaches are used, and their impact on members of the public. The CDEI is launching a series of nationwide workshops to investigate public views on the acceptability of micro-targeting.
Both policy reviews will publish interim reports in the summer with final reports set to be published early next year.
Notes to editors
An algorithm is a series of instructions for performing a calculation or solving a problem, usually with a computer. They are often built using historical data (collected, for example, by police officers, doctors) and the computer identifies patterns in previous decisions to make future decisions.
The government established the UK’s pioneering Centre for Data Ethics and Innovation to ensure that people have confidence in how data and technologies, such as AI, are used. It is led by an independent board chaired by Roger Taylor. Find out more about the work of the CDEI.
The Race Disparity Unit (RDU) was established in the Cabinet Office, following the Prime Minister’s commission of a Race Disparity Audit in 2016. Its website Ethnicity facts and figures continues to highlight disparities in outcomes that people from different ethnic and social backgrounds experience from the public services they use. For more information about the RDU, and how it has been working with Departments and stakeholders to address disparities, visit the RDU page on GOV.UK.
The AI and Data Grand Challenge
The Industrial Strategy sets out Grand Challenges to put the UK at the forefront of the industries of the future, ensuring that the UK takes advantage of major global changes, improving people’s lives and the country’s productivity. Artificial intelligence and data is one of the 4 Grand Challenges which will see AI used across a variety of industries and put the UK at the forefront of the AI and data revolution.
Find our more about the Centre for Data Ethics and Innovation.
Contact the DCMS Press Office on 0207 211 2210.
Latest News from
Strengthening police powers to tackle unauthorised encampments15/11/2019 12:20:00
Consultation on measures to criminalise trespassing when setting up an unauthorised encampment in England and Wales.
Government announces plans to review pre-charge bail law06/11/2019 11:10:00
The Home Office will consider updating the rules to ensure the safety of victims is prioritised and police are supported in investigating all offences.
Government announces UK special envoy for countering violent extremism05/11/2019 13:20:00
John Woodcock MP has been announced as the UK special envoy for countering violent extremism.
Security Minister's speech on security and crime after Brexit31/10/2019 11:10:00
Security Minister Brandon Lewis yesterday spoke at a Policy Exchange event on Security and Crime after Brexit: keeping Britain safe.
New review will enhance response to serious and organised crime30/10/2019 11:10:00
The review announced by the Government will look to identify ways of bolstering the response to threats such as county lines, people trafficking and drugs.
Extension of pub opening hours for the 75th anniversary of VE Day28/10/2019 11:10:00
The Home Secretary has announced plans to extend pub licensing hours across England and Wales to mark the 75th anniversary of Victory in Europe (VE) Day.
UK wide summit announced to tackle drug deaths23/10/2019 16:15:00
Experts will gather in Glasgow to discuss the best approach.
Public inquiry into Manchester Arena Attack to be established22/10/2019 15:20:00
A public inquiry will be established to investigate the deaths of the victims of the 2017 Manchester Arena attack.