Information Commissioner's Office
Blog: Reflecting on the first year of the ‘Explaining decisions made with AI’ guidance
Abigail Hackston, ICO Senior Policy Officer – Innovation looks back on the ICO’s work with organisations who use personal data and artificial intelligence (AI) to support, or to make decisions about individuals.
It is estimated that AI has the potential to help UK GDP grow by between 10 and 22 per cent by 2030. But with AI so often relying on people’s personal data to fuel innovation, those benefits are only possible where people trust their information will be used fairly.
To help organisations achieve this, the ICO worked with The Alan Turing Institute to produce our ‘Explaining decisions made with AI’ guidance, published in May 2020. This aimed to “develop a framework for explaining processes, services and decisions delivered by AI, to improve transparency and accountability.”
The guidance was produced as a best practice document to help organisations of various sizes from different sectors.
We were clear from the outset that we wanted to make this guidance as practical and useful as possible. This reflects a key ICO aim to enable innovation and economic growth in the AI sector. We can only do this if the guidance we produce is practically applicable to real life situations.
To understand the impact that the guidance has had, during the last year, we consulted with 56 organisations who make decisions about their customers using personal data and AI. This group included SMEs, public sector organisations and established technology organisations.
We asked these groups to tell us what worked well, what could be improved, and whether they had any further comments on the guidance.
The feedback was positive, and we are pleased that participants found the guidance useful and of high quality. We heard that the guidance provides a good foundation for improving awareness and understanding of the need for explanations relating to AI systems, and how to construct those explanations.
Respondents also said the guidance clearly defined the key elements needed to build explainable AI systems and when further detail was needed this was also easy to understand.
Areas the consultation identified to improve on included the length of the guidance. To address this point and ensure the key parts of the guidance are quickly accessible, we have added the “at a glance” sections separately alongside the guidance as a summary document. This pulls the fundamental elements of the guidance into one place and makes it easier to find them quickly.
There were concerns raised that some parts of the guidance were not particularly useful for SMEs. It was felt that the level of detail given was more suited to larger organisations, and some additional support may be needed for organisations that do not have the technical capabilities to build and support an AI system in-house. If you run an SME that processes personal data using AI, remember that you can get additional support from the ICO’s SME web hub.
We will add some case studies to the guidance, so that organisations can reference some practical examples of good practice in action. Our consultees indicated that this would be a valuable addition. If you feel you have an example of a good case study we might use, we would love to hear from you. Please get in contact with us via AI@ico.org.uk.
We are pleased that the feedback we received indicates that the guidance is having a material impact among the organisations who participated in this consultation. These comments give the ICO confidence that the guidance will be an effective tool for those who choose to use it.
The ICO will take the research findings into account in our future work on AI and in our production of further guidance on this and other related topics.
Abigail Hackston is a Senior Policy Officer for Innovation at the ICO.
Latest News from
Information Commissioner's Office
ICO and Ofcom strengthen partnership on online safety and data protection25/11/2022 15:20:00
The Information Commissioner’s Office (ICO) and Ofcom have today set out how we will work together to ensure coherence between the data protection and the new online safety regimes.
International transfers: empowering innovation and growth whilst protecting people’s personal information18/11/2022 12:25:00
Blog posted by: Emma Bate, 17 November 2022.
ICO launches consultation on how it prioritises FOI complaints09/11/2022 10:20:00
The Information Commissioner’s Office (ICO) has launched a consultation on how it prioritises the complaints it receives about public bodies’ handling of Freedom of Information (FOI) requests.
Department for Education warned after gambling companies benefit from learning records database08/11/2022 12:25:00
The Information Commissioner’s Office (ICO) has issued a reprimand to the Department for Education (DfE) following the prolonged misuse of the personal information of up to 28 million children.
ICO and Cabinet Office reach agreement on New Year Honours data breach fine03/11/2022 15:05:00
The UK Information Commissioner has agreed to reduce the £500,000 Monetary Penalty Notice (MPN) imposed on the Cabinet Office in 2021 in relation to the New Year Honours data breach to £50,000, which the Cabinet Office has agreed to pay, reflecting our new approach to working more effectively with public authorities.
Making our employment guidance work for you28/10/2022 09:05:00
A blog by Elanor McCombe, Group Manager - Policy
‘Immature biometric technologies could be discriminating against people’ says ICO in warning to organisations26/10/2022 09:10:00
The Information Commissioner’s Office (ICO) is warning organisations to assess the public risks of using emotion analysis technologies, before implementing these systems.
‘Biggest cyber risk is complacency, not hackers’ - UK Information Commissioner issues warning as construction company fined £4.4 million24/10/2022 12:25:00
The UK Information Commissioner has warned that companies are leaving themselves open to cyber attack by ignoring crucial measures like updating software and training staff.