BCS, The Chartered Institute for IT, explains why abuses of facial biometric data means we need to get serious about safeguards
BCS, The Chartered Institute for IT, has warned against the rise of a ‘cavalier attitude’ by organisations using ‘flawed’ facial recognition technology to monitor crowds in public spaces.
Dr Bill Mitchell, Director of Policy at BCS says there is an unprecedented danger of the misuse of biometric data, including identity theft, because of a combination of flawed technology and a lack of ethical and rigorous safeguards around how that data is captured, stored and processed.
The top concerns expressed by IT professionals in consultations BCS have carried out over the last 18 months highlight the severe risks of biometric data misuse. These are:
- Poor data governance resulting in companies unable to effectively monitor how data is used, who is using the data, or where duplicates of data are stored, which may result in any unethical practice going undetected.
- Lack of diversity in product development teams leading to hard-wired unconscious bias in new products or services that are data-dependent.
- Using incomplete data to incorrectly infer personal characteristics.
- Allowing data to be improperly shared within organisations.
- Improperly aggregating data from different sources to infer personal characteristics.
- Incorrectly cleaning data
- Incorrectly restructuring data resulting in the wrong data being associated with an individual.
- Incorrectly merging different data pipelines from third parties.
- Not conducting proper due diligence to ensure correct provenance of data through the supply chain (which may well be offshored and distributed across different national jurisdictions).
- Using data analysis methodologies that are invalid in a particular context.
- Applying analytical models as part of decision-making processes that are poorly tested (including, for example, inappropriate Machine Learning based neural networks).
- Using invalid anonymisation techniques that do not provide enough protection against deanonymisation.
- Storing data insecurely so that it is at risk of being misappropriated.
Dr Mitchell says the feedback from these consultations has been quite clear: “Virtually every time we hear the same alarming worries about data governance practices. This directly links to worries about the current cavalier attitude to facial recognition technology. For instance, misappropriated facial biometric data could lead to opportunities for virtual doppelgängers, and poorly captured biometric data can lead to cases of mistaken identity that can have dire consequences that are hard to correct. Much of the concern has been focused on the immaturity of the technology. An even bigger concern is what your biometric data is used for, or rather misused for, once it’s been captured and added to a database.”
The concerns raised by the IT profession come after a series of recent revelations about the widespread use of facial recognition technology. This includes the release of a report by Big Brother Watch, a civil liberties and privacy campaigning organisation, that says there is a facial recognition ‘epidemic’ across privately owned sites in the UK. It says it has found major property developers, shopping centres, museums, conference centres and casinos using the technology. Also, the Information Commissioners Office, the UK’s privacy watchdog, has opened an investigation into the use of facial recognition cameras in a busy part of central London in Granary Square, close to King’s Cross station.
Dr Mitchell said: “All of this should mean we treat facial recognition technology with extreme caution.
For instance, in July 2019 the University of Essex published a report that found there have been ‘significant flaws’ in the way UK police forces have trialled AI-enabled facial recognition technology.
“If the police can’t get it to work properly, why should we assume that property developers, museums, or music festival organisers can make it work?”
Latest News from
CHIME and BCS The Chartered Institute for IT Launch Chapter in the UK05/09/2019 12:20:00
A landmark agreement has been signed between the College of Healthcare Information Management Executives (CHIME) and BCS The Chartered Institute for IT in the UK.
Results day: BCS congratulates GCSE Computer Science students22/08/2019 15:20:00
With exam results announced today – BCS, The Chartered Institute for IT says the continuing rise in the number of pupils opting to take GCSE Computer Science is a cause for celebration.
Results Day: BCS congratulates A Level Computer Science students15/08/2019 15:15:00
BCS, The Chartered Institute for IT congratulates A Level computer science students who get their exam results today - and welcomes the news that the number of pupils opting to take the subject is continuing to rise, for the sixth successive year. This is a strong indication that the subject continues to grow in popularity.
Statement on behalf of BCS, The Chartered Institute for IT about the incoming cabinet26/07/2019 12:43:00
BCS, The Chartered Institute for IT, congratulates the new cabinet. Right now, resolving the current Brexit impasse is everyone's priority, but we also need to think beyond Brexit.
BCS, The Chartered Institute for IT, welcomes the conferring of an honorary doctorate on its President.18/07/2019 10:20:00
The President of BCS, The Chartered Institute for IT, Michael S K Grant FBCS, has been awarded the honorary degree of Doctor of Technology by Solent University.
Dr Cristian Cadar announced as winner of BCS Roger Needham Award12/07/2019 15:33:00
Dr Cristian Cadar has been awarded the BCS Roger Needham Award for 2019 sponsored by Microsoft Research Cambridge. The award has been made in recognition of his outstanding work in the field of Software Reliability.
Oxford University Professor named as BCS Lovelace Medal Winner 201901/07/2019 12:20:00
Marta Kwiatkowska, Department of Computer Science, Trinity College, Oxford has been named as the recipient of the 2019 BCS Lovelace Medal, the top award in computing in the UK, awarded by BCS, The Chartered Institute for IT.
Greater diversity of AI MSc students holds the key to bridging skills gap, says BCS report11/06/2019 12:20:00
An independent report by BCS, The Chartered Institute for IT, (BCS) says in order to bridge the skills gap in Artificial Intelligence, (AI) more must be done to attract and retain under-represented groups in university computing departments, especially women.
2000th Digital apprentice completes final assessment with BCS, The Chartered Institute for IT21/05/2019 12:20:00
An Infrastructure Technician from Aztech IT Solutions in Milton Keynes is the 2000th digital apprentice to have successfully completed his final professional assessment* through BCS, The Chartered Institute for IT.