Computer coding in scientific research must be professionalised to restore trust – BCS
The computer code behind the scientific modelling of epidemics like COVID-19 should meet independent professional standards to ensure public trust, according to BCS, The Chartered Institute for IT.
The lack of widely accepted software development standards in scientific research has allowed for the ‘politicised’ undermining of confidence in computational modelling, including in high-profile models informing COVID-19 policy, the Institute argues.
In a new policy paper, BCS calls for professional software development standards to be adopted for research that has a critical impact on society, like health, criminal justice and climate change. The underlying code should also be made open-source.
Dr Bill Mitchell OBE, Director of Policy at BCS, The Chartered Institute for IT said: “The politicisation of the role of computer coding in epidemiology has made it obvious that our understanding and use of science relies as much on the underlying code as on the underlying research.
“We welcome the government’s commitment to following science in developing policy responses to the coronavirus pandemic. We support the use of computational modelling in exploring possible outcomes of policy decisions, such as investigating which lockdown measures are likely to have the greatest public health benefits.
“At the same time we consider that - at present - the quality of the software implementations of scientific models appear to rely too much on the individual coding practices of the scientists (who are not computer scientists) who develop them, rather than professional software development practices being publicly evidenced against appropriate standards.”
Dr Mitchell cites an example of this issue – a recent article in the journal Nature reports that ‘Many machine-learning papers fail to perform an adequate set of experiments’, which has led to poor quality research being published. This is also highlighted in a BBC news article that claims ‘machine learning [is] causing [a] science crisis', again because some neural networks are being developed that are not following computer engineering best practice. Another recent Nature article has called for scientists to “publicly share both data and code, making it easier for others to attempt to reproduce a paper’s findings”.
Dr Mitchell continues: “We believe professional software development standards should be followed when implementing computational models for conducting scientific research where that research could be relied on by policy makers and which could have critical consequences for society, such as for example healthcare, criminal justice or climate change. The underlying software code should also be open sourced in line with government guidance.”
According to BCS, professionalising and using best practice software development in scientific research should lead to:
- The ability of different science research groups to share, combine, adapt and build upon software implementations of computational models, no matter whether they are in the same discipline, institution or country.
- The ability of scientists to correctly modify software implementations of computational models in times of crisis as rapidly as possible.
- Facilitating reproducibility of research findings and ensuring high quality research is published in peer reviewed journals.
- Providing reassurance to the public that policy decisions are based on robust evidence of the highest quality.
Given the seriousness of this issue and the significant consequences of not using relevant best practice and specialists, BCS will approach experts across the sector to discuss how to professionalise software development practice in scientific research including the Centre for Data Ethics and Innovation, the Alan Turing Institute, the Safety Critical Systems club, the British Insurance Association, Royal Society, the Royal Academy of Engineering, Cabinet Office, NHSX, UKRI, Public Health England.
Latest News from
Review of academic accreditation of Computer Science degrees launched02/07/2020 14:33:00
How will we ensure that computing graduates have the skills needed to drive economic recovery as data science and AI change the industry post COVID-19?
BAME IT workers better qualified, but less likely to be in top jobs24/06/2020 15:38:00
BAME IT professionals are less likely to be in positions of responsibility than those of white ethnicity – despite on the whole being better qualified, a new study has found.
IT Experts share their top five suggestions to win public support for contact tracing app05/06/2020 14:20:00
Prove that it works, address issues around trust, privacy and security – and ensure ease of use - are the top five measures that the government needs to tackle in order to win public support for the proposed contact tracing app.
Most IT experts doubt contact tracing app will beat COVID-19, survey finds19/05/2020 13:38:00
Less than one quarter of IT professionals think the planned NHSX contact tracing app will be effective in containing COVID-19, a new survey has found.
New BCS study supports Coronavirus tracing app - if privacy measures convince the public01/05/2020 13:25:00
The implementation of an app that traces Coronavirus contacts is necessary but must overcome “perceived Big Brother elements” to ensure the public get on board, a new report from BCS, The Chartered Institute for IT has found.
Closure of schools has exposed the digital divide leaving poorer children unable to access learning - teachers tell Institute for IT23/04/2020 14:33:00
Lack of access to the internet, suitable computers and teaching resources means many children are now excluded from online learning warns BCS, The Chartered Institute for IT.
Winner of the CPHC/BCS Distinguished Dissertation Award announced21/04/2020 14:33:00
The winner has been announced of the Distinguished Dissertation award, a prestigious academic award, run jointly by BCS, The Chartered Institute for IT, in collaboration with the Council of Professors and Heads of Computing (CPHC).
BCS responds to Facebook's announcement to combat misinformation17/04/2020 14:33:00
BCS has responded to the announcement that Facebook is to begin showing messages to people who have interacted with misinformation about coronavirus, guiding them to official advice from the World Health Organisation (WHO).