National Audit Office Press Releases
Challenges in using data across government
The National Audit Office (NAO) recently published a report examining how government uses data to implement its policies and reform public services. The report has found that data is not seen as a priority by government, the importance of investing in quality data is not well understood, and there is a culture of tolerating and working around poor data.
Data is crucial to how successfully government can: deliver services that work for the people who use them; improve its systems and processes; and support better decisions. The NAO has repeatedly highlighted the importance of evidence-based decision making in government, and the problems that arise when data is missing or low-quality. This report draws together the NAO’s experience of auditing government, and recent work that has identified where the quality and availability of data has been an issue.
The effectiveness of government programmes is often compromised because data is inadequate. The consequence of this is demonstrated by the Windrush situation1, where the Home Office took action without fully assessing the impact of the quality of its underlying data. Unless the quality and availability of data is high before new policies are implemented, it can be difficult for departments to assess their effectiveness or secure hoped for benefits.
Government recognises the value of using data more effectively. It plans to produce a new national data strategy in 2020, which will be led by the Department for Digital, Culture, Media and Sport (DCMS), working with Cabinet Office2. To achieve its ambitions, government will need to resolve challenges around how to use and share data safely and appropriately, and how to balance competing demands for public money in a way that allows it to invest in data. The NAO has found government has lacked leadership on developing its use of data, and DCMS has acknowledged that it needs to do more to embed its leadership role.
There are no cross-government standards on how to record data, which has led to inconsistent ways of recording information. The NAO found more than 20 different ways of identifying individuals and businesses across 10 departments and agencies, with no standard format for recording data such as name, address and date of birth. The problem is replicated for businesses and in local areas where information is recorded differently across boundaries. This makes it difficult for government to maximise its data, for example by allowing analysis across different sectors to help understand economic challenges or systematic problems.
Silo working can inhibit progress. While the Digital Economy Act 2017 has made it easier for departments to share data where it is appropriate to do so, many still lack confidence in how to share it legally. The NAO has found that civil servants are used to working within departmental boundaries, which is a hurdle to setting up and maintaining cross-departmental initiatives.
The NAO recommends that the Cabinet Office and DCMS use the 2020 data strategy to identify and address the barriers to better use of data. They should set up clearer cross-government accountability, governance and funding for data to help deliver the strategy. The datasets that are critical to government should also be identified, and it should be established how they can be improved and shared more easily.
“Government has lacked clear and sustained strategic leadership on data, and individual departments have not made enough effort to manage and improve the data they hold. This can reduce public confidence in government’s ability to collect and use people’s data effectively.
“The right processes, systems and conditions must now be put in place, otherwise the new data strategy will become yet another missed opportunity.”
Gareth Davies, the head of the NAO
Notes for Editors
- Handling of the Windrush situation, December 2018.
- DCMS has the main responsibility for data and for use and development of the Digital Economy Act 2017. In April 2018, it took responsibility for data-sharing, data ethics and data governance from the Government Digital Service (GDS), part of the Cabinet Office. GDS retained responsibility for supporting the digital, data and technology profession. The cross-government Data Advisory Board revised its Terms of Reference in January 2019 to include responsibility for the national data strategy, which includes promoting best practice and supporting development of cross-government policies and standards. It is also overseeing a cross-government project to improve data quality and accessibility, increase data use and improve public trust.
- Press notices and reports are available from the date of publication on the NAO website. Hard copies can be obtained by using the relevant links on our website.
- The National Audit Office (NAO) helps Parliament hold government to account for the way it spends public money. It is independent of government and the civil service. The Comptroller and Auditor General (C&AG), Gareth Davies, is an Officer of the House of Commons and leads the NAO. The C&AG certifies the accounts of all government departments and many other public sector bodies. He has statutory authority to examine and report to Parliament on whether government is delivering value for money on behalf of the public, concluding on whether resources have been used efficiently, effectively and with economy. The NAO identifies ways that government can make better use of public money to improve people's lives. It measures this impact annually. In 2018 the NAO's work led to a positive financial impact through reduced costs, improved service delivery, or other benefits to citizens, of £539 million.
NAO Press Office
+44 (0)20 7798 7400 or email email@example.com
Latest News from
National Audit Office Press Releases
Investigation into the free school meals voucher scheme02/12/2020 14:15:00
Today the National Audit Office (NAO) reports that after some schools and families experienced problems with the free school meals voucher scheme, steps taken by the Department for Education (DfE) and its contractor Edenred led to improvements over the life of the scheme.
Managing flood risk27/11/2020 13:15:00
Today’s report by the National Audit Office (NAO) finds that the government is on track to achieve its target for better protecting 300,000 more homes from flooding by March 2021 but does not have a comprehensive measure of its progress in reducing the overall level of flood risk across England.
The supply of personal protective equipment (PPE) during the COVID-19 pandemic26/11/2020 11:15:00
Yesterday’s report by the National Audit Office (NAO) finds that government was initially reliant on stockpiles of personal protective equipment (PPE) that proved inadequate for the COVID-19 pandemic. In a rapidly deteriorating situation government made a huge effort to boost supply, but it has paid very high prices due to unusual market conditions and many front-line workers reported shortages of PPE.
Investigation into government procurement during the COVID-19 pandemic19/11/2020 11:15:00
The National Audit Office (NAO) yesterday reported a lack of transparency and adequate documentation of some key decisions, such as why particular suppliers were chosen or how government identified and managed potential conflicts of interest, in the awarding of some contracts while government was procuring large volumes of goods and services at high speed to respond to the COVID-19 pandemic.
Achieving government’s long-term environmental goals12/11/2020 16:15:00
It is not yet clear that the government has in place what it needs to meet its long-term environmental goals, and it will need to shift momentum to achieve its ambition of improving the natural environment in England within a generation, according to yesterday’s report from the National Audit Office (NAO).
The UK border: preparedness for the end of the transition period06/11/2020 13:25:00
Today the National Audit Office (NAO) reports that although government departments have made progress in recent months implementing the changes required to systems, infrastructure and resources to manage the border at the end of the post-EU Exit transition period, it is still likely that widespread disruption will occur from 1 January 2021.
Implementing employment support schemes in response to the COVID-19 pandemic23/10/2020 12:10:00
Today the National Audit Office (NAO) reports that the government quickly developed schemes to protect jobs and support businesses financially during the COVID-19 pandemic, but the pace at which they were designed and implemented means there is a risk of considerable levels of fraud and error, particularly for the furlough scheme.
Improving Broadband19/10/2020 16:15:00
The recent (16 October 2020) report from the National Audit Office (NAO) finds that the Superfast Broadband Programme helped the Department for Digital, Culture, Media and Sport (the Department) to extend the UK’s superfast broadband coverage, although many people still experience poor broadband.
Investigation into the Bounce Back Loan Scheme08/10/2020 16:15:00
The National Audit Office (NAO) yesterday reported that the Bounce Back Loan Scheme succeeded in quickly supporting small businesses, but government faces a potential loss of £15 billion to £26 billion through businesses not being able to repay the loans and fraud.