Algorithms must meet ethical and professional standards to recover public trust, report recommends
Algorithms that change people’s lives - for example when estimating students’ grades - should now meet strict standards of ethics and competence, according to a new report by the professional body for IT.
Government use of data science must achieve public service standards of openness, accountability and objectivity to avoid another ‘computer says no’ moment in education and other disciplines, the study by BCS, The Chartered Institute for IT found.
The new report: ‘The Exam Question: how do we make algorithms do the right thing?’ recommends government endorse and support professionalising of data science, in line with a plan already being developed by a collaboration of the Royal Statistical Society, BCS, The Royal Society and others.
It would mean algorithms whose creators did not meet a strict code of practice for ethics, professionalism and competence cannot decide issues such as exam grades or make estimates about the outcomes of pandemics like COVID-19 to government.
The BCS study concluded that policy makers should ensure ‘the best possible ethical and professional practice in algorithm design, development and testing is ubiquitous at information system level across government and industry.’
All algorithms and data with high-stakes consequences such as grades estimation or triggering lockdowns should be put through an impact assessment against widely recognised ethical standards, and open to public scrutiny, before ‘going live’, the BCS’ report added.
Dr Bill Mitchell OBE, Director of Policy at BCS, The Chartered Institute for IT said: “The exam crisis has given algorithms an undeserved reputation as ‘prejudice engines’ when in fact ethically designed algorithms fed on high quality data can result in massive benefit to our everyday lives.
“Lack of public confidence in data analysis will be very damaging in the long term. Information systems that rely on algorithms can be a force for good but, as students found out to huge cost, we have been using them to make high-stakes judgements about individuals based on data that is subjective, uncertain and partial.
“We need true oversight of the way algorithms are used, including identifying unintended consequences, and the capability at a system level to remedy harm that might be caused to an individual when something goes wrong.
“That means, first of all, professionalising data science so that the UK has the most trusted, ethical and sought-after data science teams in the world.”
Latest News from
Black women coders take a major new role in IT’s professional body28/10/2020 14:20:00
Coding Black Females (CBF), a non-profit organisation, will take a leading role in the professional body for computing, as part of a project to diversify the tech sector.
Barrier-breaking computer science professor awarded Honorary Fellowship of the Chartered Institute for IT21/10/2020 14:43:00
The UK’s only black (Afro-Caribbean) female professor of Computer Science, Dorothy Monekosso, has been awarded an Honorary Fellowship by BCS, The Chartered Institute for IT.
BCS to launch new group for racial diversity07/10/2020 11:43:00
Embrace – a new specialist group for racial diversity will be launched this month by BCS, The Chartered Institute for IT to support IT professionals from ethnic minorities and to advise BCS – the professional body for computing – on diversity matters.
IT professionals urge the government to intervene in ARM sale06/10/2020 14:33:00
The majority of IT experts believe the government should step in over the sale of technology giant ARM, according to a new survey by the industry’s professional body.
BCS backs plans for life-long learning as part of post-pandemic recovery plan30/09/2020 11:48:00
The Prime Minister’s pledge to guarantee life-long learning opportunities for those without A-Levels, and to increase funding for small and medium-sized enterprises taking on apprentices is a step in the right direction, according to BCS, The Chartered Institute for IT.
Contact tracing app is safe but plans to rate users’ lifestyles for risk are ‘alarming’, says leading software testing group28/09/2020 15:10:00
A planned development to the NHS Contact Tracing app which will score users’ lifestyles for COVID-19 risk is ‘alarming’ and needs clarity, software testers have warned.
Record numbers of women in IT - but black women still under-represented, new research finds23/09/2020 13:38:00
More women than ever are working in IT roles across the UK (326,000 in total) and now make up a record 20% share of the specialist IT workforce – according to new analysis from BCS, The Chartered Institute for IT.
The public don’t trust computer algorithms to make decisions about them, survey finds08/09/2020 13:20:00
The majority of people do not trust computers to make decisions about any aspect of their lives, according to a new survey.