CDEI publish interim report on algorithmic bias in decision-making
techUK explores the recently published Centre for Data Ethics and Innovation interim report on algorithmic bias in decision-making.
The CDEI’s review focuses on exploring bias in four key sectors: policing, financial services, recruitment and local government. They have taken a phased approach to each sector, starting with policing and then moving onto financial services and recruitment, with work on local government starting in autumn 2019. Included in the interim report is a commitment from the CDEI to produce a briefing paper on Facial Recognition Technology (FRT) later in the autumn which will examine the wider ethical concerns surrounding the technology. This will not be limited to the use of FRT by the police.
The review seeks to answer three sets of questions:
- Data: Do organisations and regulators have access to the data they require to adequately identify and mitigate bias?
- Tools and techniques: What statistical and technical solutions are available now or will be required in future to identify and mitigate bias and which represent best practice?
- Governance: Who should be responsible for governing, auditing and assuring these algorithmic decision-making systems?
The interim report highlights that data itself is often the source of bias but, at the same time, it is a core element of tackling the issue. One issue raised is that some organisations are not collecting diversity information, due to nervousness of a perception that this data might be used in a biased way. This then limits the ability to properly assess whether a system is leading to biased outcomes. There is a tension between the need to create algorithms which are blind to protected characteristics while also checking for bias against those same characteristics.
Tools and techniques
CDEI’s early work suggests that new approaches to identifying and mitigating bias are required and that specific tools are already starting to be developed. However, there is limited understanding of the full range of tools and approaches available and what constitutes best practice. This makes it difficult for organisations that want to mitigate bias in their decision-making processes to know how to proceed and which tools and techniques they should use.
According to the review, there is currently limited guidance and a lack of consensus about how to balance significant trade-offs (for example between different kinds of fairness) or even how to have constructive and open conversations about them. In the policing sector, the CDEI are developing a Code of Practice in collaboration with the sector, to help to address this issue.
The report also highlights that a certain level of transparency about the performance of algorithms will be necessary for customers and citizens to be able to trust that they are fair. Giving developers of algorithms space and opportunity to test algorithms against standard datasets or to benchmark performance against industry standards may enable the development of a consensus about the appropriate definitions of fairness. The CDEI suggest that new functions and actors, such as third-party auditors, may also be required to independently verify claims made by organisations about how their algorithms operate.
The CDEI will submit a final report with recommendations to government in March 2020. If you’d like to find out more about this programme of work, please contact Katherine.
Latest News from
Guest blog: Fresh thinking needed on the National Data Strategy14/04/2021 14:15:00
Guest blog from Peter Dutton, Head of Public Sector, UKI at Elastic
techUK's Future Mobility Services in the UK Campaign Week12/04/2021 13:15:00
Get involved in techUK's first ever Future Mobility Services in the UK Campaign Week, running from 24 – 28 May!
New techUK guidance for SMEs on modern slavery12/04/2021 11:25:00
Modern slavery is a major crime that all businesses need to be aware of and is very prevalent in the UK with over 100,000 estimated victims.
Let’s use our heads to solve digital exclusion09/04/2021 16:05:00
On 20 April, techUK will host its Open Finance and Inclusion Summit. During the conference's final panel, sponsored by LexisNexis Risk Solutions, speakers will explore how to unlock digital finance for all.
Digital Inclusion Might be The Best Approach to The Future Of Cash09/04/2021 12:20:00
Few countries have taken to digital payments as enthusiastically as the UK. With Covid-19 accelerating pre-existing trends in consumer behaviour, digital payments have overtaken cash as the most popular means of paying for goods and services.
Financial Inclusion - The Global Issue09/04/2021 09:05:00
Financial exclusion is a major problem globally with billions of people unable to access standard financial services.
How banks can achieve the promise of open banking with a data mesh architecture08/04/2021 16:05:00
The changes that banking is set to undergo over the next decade will be both radical and fundamental. CDOs should use this opportunity to drive greater organisational agility through agile approaches to enterprise data architecture.
Sea of change requires a new agility to surge ahead in Open Banking08/04/2021 14:15:00
Banks, once so serene, now find themselves in a sea of change that demands a new type of agility.
Open Finance: why it is so important particularly in relation to geospatial and urban planning data08/04/2021 12:05:00
It has been said many times that data is the oil of the digital age, but this metaphor is frequently misunderstood.
Who owns your bank data?08/04/2021 10:20:00
For years, the answer to this question was straightforward: your bank. But then digitisation happened, and with it came many new services: Spotify suggested music you might like, Uber plotted your best route home. Slowly, people started to see the power of data to deliver more convenient and personal services.