AI risks having bias and discrimination ‘hard-wired’ in - BCS tells Standards in Public Life Report
A lack of diversity in teams developing artificial intelligence (AI) can lead to in-built bias and discrimination in its decisions says BCS, The Chartered Institute for IT - in a new report by a major government advisory body.
The report, published by the Committee for Standards in Public Life (CSPL), examines whether the existing frameworks and regulations around machine learning are sufficient to ensure high standards of conduct are upheld as technologically assisted decision-making is adopted widely across the public sector.
Dr Bill Mitchell OBE, Director of Policy at BCS, The Chartered Institute for IT said:
“Lack of diversity in product development teams is a concern as non-diverse teams may be more likely to follow practices that inadvertently hard-wire bias into new products or services.”
Sampling errors can also produce discriminatory outcomes. For example – a machine learning tool designed to diagnose skin cancer that has been trained only on white skin could be less accurate on black skin, the report explains. This bias in the training data may not be the result of active human prejudice, but can still result in a discriminatory outcome because the system is more likely to misdiagnose BAME people.
Dr Mitchell added:
“There is a very old adage in computer science that sums up many of the concerns around AI enabled public services: ‘Garbage in, garbage out.’ In other words, if you put poor, partial, flawed data into a computer it will mindlessly follow its programming and output poor, partial, flawed computations. AI is a statistical-inference technology that learns by example. This means if we allow AI systems to learn from ‘garbage’ examples, then we will end up with a statistical-inference model that is really good at producing ‘garbage’ inferences.”
Diverse teams will also make public authorities more likely to identify potential ethical pitfalls of an AI project, the report suggests. Many contributors emphasised the importance of diversity, telling the Committee that diverse teams would lead to more diverse thought, and that in turn this would help public authorities identify any potential adverse impact of an AI system.
Latest News from
Computer coding in scientific research must be professionalised to restore trust – BCS28/05/2020 14:33:00
The computer code behind the scientific modelling of epidemics like COVID-19 should meet independent professional standards to ensure public trust, according to BCS, The Chartered Institute for IT.
Most IT experts doubt contact tracing app will beat COVID-19, survey finds19/05/2020 13:38:00
Less than one quarter of IT professionals think the planned NHSX contact tracing app will be effective in containing COVID-19, a new survey has found.
New BCS study supports Coronavirus tracing app - if privacy measures convince the public01/05/2020 13:25:00
The implementation of an app that traces Coronavirus contacts is necessary but must overcome “perceived Big Brother elements” to ensure the public get on board, a new report from BCS, The Chartered Institute for IT has found.
Closure of schools has exposed the digital divide leaving poorer children unable to access learning - teachers tell Institute for IT23/04/2020 14:33:00
Lack of access to the internet, suitable computers and teaching resources means many children are now excluded from online learning warns BCS, The Chartered Institute for IT.
Winner of the CPHC/BCS Distinguished Dissertation Award announced21/04/2020 14:33:00
The winner has been announced of the Distinguished Dissertation award, a prestigious academic award, run jointly by BCS, The Chartered Institute for IT, in collaboration with the Council of Professors and Heads of Computing (CPHC).
BCS responds to Facebook's announcement to combat misinformation17/04/2020 14:33:00
BCS has responded to the announcement that Facebook is to begin showing messages to people who have interacted with misinformation about coronavirus, guiding them to official advice from the World Health Organisation (WHO).
BCS campaign recognises the vital role of IT workers in our national life02/04/2020 14:10:00
A new campaign highlights the essential role IT professionals are playing in connecting people personally and professionally, during the COVID19 crisis.
Help older people get tech-ready for self-isolation, says BCS19/03/2020 12:38:00
With people aged over 70 being asked to self-isolate for up to 12 weeks, now is the time to help your older friends, neighbours and loved ones get tech-ready, says BCS, the Chartered Institute for IT.