ICO launch explainable AI interim report
The Information Commissioner’s Office, in collaboration with the Alan Turing Institute, publish their "Project ExplAIn" interim report.
The ICO, in collboration with the Alan Turing Institute, have published their Project ExplAIn interim report. The finding from this report are based on research, including citizens’ juries and industry roundtables, to gather views from a range of perspectives on explainable AI.
The report identifies three key themes that emerged from the research:
- The importance of context in explaining AI decisions
The strongest message from the research is that context is key. The importance of providing explanations to individuals, and the reasons for wanting them, change dramatically depending on what the decision is about.
People who took part in the citizen juries felt explaining an AI decision to the individual affected was more important in areas such as recruitment and criminal justice than in healthcare. Jurors wanted explanations of AI decisions made in recruitment or criminal justice settings in order to challenge them, learn from them, and check they have been treated fairly. In healthcare settings, however, jurors preferred to know a decision was accurate rather than why it was made.
- The need for education and awareness around AI
The findings showed a need to engage and inform the public in the use, benefits and risks of AI decision-making, through education and raising awareness. Although there wasn’t a clear message on who should be responsible for this, delivering a balanced message is important, suggesting a need for a diverse range of voices.
- The various challenges to providing explanations
Industry roundtable participants generally felt confident they could technically explain the decisions made by AI. However, they raised other challenges to ‘explainability’ including cost, commercial sensitivities and the potential for ‘gaming’ or abuse of systems. The lack of a standard approach to establishing internal accountability for explainable AI decision systems also emerged as a challenge.
Commenting on the report, Sue Daley, Associate Director, Technology and Innovation, yesterday said:
As artificial intelligence (AI) becomes more prevalent throughout society, a key goal for policymakers and industry alike must be to ensure public trust and confidence in the technology. The ICO’s citizen jury study provides a unique snapshot of public opinion on this complex issue and is a key step towards increasing public engagement on digital ethics issues across the UK, which is a key action from techUK’s Digital Ethics in 2019 report.
Companies need to ensure that decisions made by their AI systems are auditable, challengeable and ultimately understandable by the public. techUK stands ready to support the ICO and the Alan Turing Institute develop guidance assisting organisations with explaining AI decisions".
The findings from the Project ExplAIn interim report will directly feed-in to the ICO’s guidance for organisations; a key commitment made in the UK Government’s 2018 AI Sector deal. This guidance will go out for public consultation over the summer, with the final version being published in autumn. The project ExplAIn guidance will also inform the ICO’s AI auditing framework, which is currently being consulted on and which is due to be published in 2020.
techUK will be hosting a joint roundtable with the ICO and Turing in early September to discuss their proposed guidance on explainable AI for companies. If you’d like to attend this roundtable, please get contact Katherine.
Latest News from
Defence and Security SME Forum Survey Results24/09/2021 16:25:00
Over the summer, techUK’s Defence and Security SME Forum asked the SME community within techUK's membership to take part in a survey examining engagement with the UK Ministry of Defence (MOD).
UK National AI Strategy24/09/2021 11:25:00
Summary of major announcements from the UK Government's National AI Strategy.
Inclusive Economy Partnership (IEP) and Dell Technologies launch the Digital Inclusion Impact Group23/09/2021 15:15:00
techUK is a part of a group of industry, government, and civil society leaders to tackle digital exclusion in the UK.
Tackling greenwashing: CMA published new guidance on green claims21/09/2021 14:15:00
Companies have until the New Year to address potentially misleading claims
techUK industry briefing with the Greater Manchester Combined Authority21/09/2021 12:05:00
Insights from the GMCA Digital team
MHRA announce consultation on the future regulation of medical devices20/09/2021 16:20:00
The Medicines and Healthcare products Regulatory Agency (MHRA) is inviting members of the public to provide their views on possible changes to the regulatory framework for medical devices in the UK, aiming to develop a new regime for medical devices.
Tech Industry Gold accreditation extended to training programmes to help tackle digital skills shortages20/09/2021 15:20:00
TechSkills announces FDM as first to achieve Tech Industry Gold accreditation for training programmes.
Over a third of tech firms join Race to Zero campaign20/09/2021 13:15:00
Over a third of tech firms join Race to Zero campaign