AI risks having bias and discrimination ‘hard-wired’ in - BCS tells Standards in Public Life Report
A lack of diversity in teams developing artificial intelligence (AI) can lead to in-built bias and discrimination in its decisions says BCS, The Chartered Institute for IT - in a new report by a major government advisory body.
The report, published by the Committee for Standards in Public Life (CSPL), examines whether the existing frameworks and regulations around machine learning are sufficient to ensure high standards of conduct are upheld as technologically assisted decision-making is adopted widely across the public sector.
Dr Bill Mitchell OBE, Director of Policy at BCS, The Chartered Institute for IT said:
“Lack of diversity in product development teams is a concern as non-diverse teams may be more likely to follow practices that inadvertently hard-wire bias into new products or services.”
Sampling errors can also produce discriminatory outcomes. For example – a machine learning tool designed to diagnose skin cancer that has been trained only on white skin could be less accurate on black skin, the report explains. This bias in the training data may not be the result of active human prejudice, but can still result in a discriminatory outcome because the system is more likely to misdiagnose BAME people.
Dr Mitchell added:
“There is a very old adage in computer science that sums up many of the concerns around AI enabled public services: ‘Garbage in, garbage out.’ In other words, if you put poor, partial, flawed data into a computer it will mindlessly follow its programming and output poor, partial, flawed computations. AI is a statistical-inference technology that learns by example. This means if we allow AI systems to learn from ‘garbage’ examples, then we will end up with a statistical-inference model that is really good at producing ‘garbage’ inferences.”
Diverse teams will also make public authorities more likely to identify potential ethical pitfalls of an AI project, the report suggests. Many contributors emphasised the importance of diversity, telling the Committee that diverse teams would lead to more diverse thought, and that in turn this would help public authorities identify any potential adverse impact of an AI system.
Latest News from
‘A positive step that will reassure parents and keep children safer’ - BCS responds to the appointment of Ofcom as online harms regulator12/02/2020 11:43:00
BCS surveyed (Jan 2018) 6,500 young people on their views about online safety, coinciding with a Government consultation on its Internet Safety Strategy.
Students reaching university unprepared for online harassment and extortion, IT ethics Professor warns11/02/2020 12:20:00
On the 17th Safer Internet Day, Andy Phippen – a Fellow of BCS, The Chartered Institute for IT, and Professor of Digital Rights at Bournemouth University – considers how well the guidance rightly given to children all year round is serving older age groups – including students and vulnerable adults.
BCS’s response to Huawei announcement30/01/2020 14:33:00
Dr Bill Mitchell OBE, Director of Policy at BCS, The Chartered Institute for IT, yesterday responded to Huawei announcement.
BCS responds to the Information Commissioner's Office (ICO) Code of Practice to protect children's privacy online23/01/2020 15:20:00
The Age Appropriate Design Code (published 22 January) outlines 15 standards that online services should meet.
BCS response to the Royal College of Psychiatrists report on technology and mental health20/01/2020 11:11:00
Dr Bill Mitchell OBE, Director of Policy at BCS, The Chartered Institute for IT said: “We agree with the Royal College of Psychiatrists that access to data from social media firms is vital; it will give us the evidence on which to base future policy that keeps young people safe.
New FEDIP chief executive appointed14/01/2020 15:51:00
The Federation of Informatics Professionals (FEDIP) – the body leading on professionalism for the healthcare IT community – has appointed the former Director of the NHS Wales Informatics Service and Chief Information Officer, Andrew Griffiths, as the new chief executive of its management board.
BCS's Dr Bill Mitchell awarded OBE09/01/2020 14:20:00
Director of Policy at BCS, Dr Bill Mitchell has been awarded an OBE in the New Year's Honours for services to Computing and Artificial Intelligence Education.
Fancy a career in AI? BCS Launches AI Foundation Certificate03/12/2019 13:10:00
A recent report from PwC states that 7.2 million jobs in AI and related technologies will be created in the UK in the next 20 years.