Addressing major societal challenges by harnessing government data

27 Sep 2018 02:36 PM

Combined data from across government and hundreds of UK public bodies will be used to improve healthcare, education, business growth and the fight against crime by making it available to world-leading research teams.

The Administrative Data Research Partnership (ADRP) will maximise the potential of administrative data as a resource for high-quality innovative research in the UK. Supported by a £44 million investment from the Economic and Social Research Council (ESRC), part of UK Research and Innovation, the ADRP will provide a secure route for accredited researchers to use de-identified data from across government departments, local authorities and health authorities.

High quality research projects using the data will address major societal challenges such as improved public service provision across the areas of education, healthcare and crime. Examples of issues addressed could include: 

To meet the UK’s ambitions to be a world-leader in big data, the government is clear in the modern Industrial Strategy that we need the infrastructure to support these efforts, and over £1 billion was invested through the AI Sector Deal to create a country with world class digital capabilities.

Science Minister Sam Gyimah said: “Big data can unlock answers to big challenges with the ultimate goal of improving lives. Understanding links between childhood health problems and their education, or understanding how employees report their wellbeing can help tailor appropriate support to ensure people achieve their full potential.

“Putting big data at the fingertips of experts will help the UK maintain its place as a world-leader in innovative problem solving, a key ambition of our modern Industrial Strategy.”

The ADRP will adhere to established ethical practices regarding the use of data, with full safeguards in place for its use and for the protection of information. The Digital Economy Act 2017 has provided a legal gateway for researchers to access government data in a secure way, subject to meeting published criteria. 

The UK Statistics Authority will accredit researchers, projects and data processors, to ensure data are used securely and appropriately, that all analyses are in the public interest and that ethical standards, appropriate to the nature of the research, are observed.

With 25 Ministerial departments, three devolved administrations, 20 non-ministerial departments, 391 agencies and other public bodies, and at least 326 local authorities across the UK, government data provides a huge resource that could be used as a force for good by researchers working on issues ranging from productivity to education, crime to health care and business growth to wellbeing.

The ADRP led by the ESRC will strategically acquire and curate admin data to drive high-quality research and impact around prioritised policy themes within the UK. 

UK Research and Innovation Chief Executive, Professor Sir Mark Walport said: “Excellent policy making requires excellent evidence. The Administrative Data Research Partnership provides an exceptional opportunity for researchers to work with data brought together from many public bodies in a safe, secure environment. 

“This type of analysis has already started to prove valuable for analysing educational and work outcomes, in relation to social factors and participation in different educational programmes.  

“The opportunities to influence and support policy making in areas ranging from health and education, to productivity and national resilience, are enormous.”

ESRC will be working in close partnership with the Office for National Statistics (ONS), the executive office of the UK Statistics Authority, the UK’s National Statistical Institute, and largest independent producer of official statistics, and also alongside the chief statisticians for the devolved administrations and their teams to deliver the new data infrastructure.

Professor Jennifer Rubin, ESRC’s Executive Chair said: "Access to administrative data is of critical strategic importance for the social sciences and wider research in the UK, because it allows us to answer questions that will improve the provision of public services and a range of outcomes. The Administrative Data Research Partnership will provide a secure route for accredited researchers to access de-identified data to do so.

“UKRI will host a Strategic Hub which will be catalytic in enabling data that already exists across government to support high-quality research, that can produce insights into policy areas and help address major challenges that exist in society today across themes such as housing, education, health and wellbeing.

“I am delighted that ESRC is leading this work for UK Research and Innovation and partnering with the Office for National Statistics to bring about a step change in the way data infrastructure is used to drive improvements here in the UK.”

National Statistician and Permanent Secretary with executive responsibility for the Office for National Statistics, John Pullinger said: “The UK is experiencing a data revolution. New and previously unimaginable sources are becoming available along with the analytical tools and expertise that together will increase and improve the evidence available to decision makers in Government, business and beyond.  

“This partnership unites the skills and experience of the ONS, the ESRC and the devolved administrations and provides the crucial assurance that data will be used securely, ethically, transparently and firmly in the public interest.”

Further information

Notes for editors

  1. The ESRC is part of UK Research and Innovation, a new organisation that brings together the UK's seven research councils, Innovate UK and Research England to maximise the contribution of each council and create the best environment for research and innovation to flourish. The vision is to ensure the UK maintains its world-leading position in research and innovation.
  2. The ESRC is the UK’s largest funder of research on the social and economic questions facing us today. It supports the development and training of the UK’s future social scientists and also funds major studies that provide the infrastructure for research. ESRC-funded research informs policy-makers and practitioners and helps make businesses, voluntary bodies and other organisations more effective.
  3. UK Research and Innovation is a new body which works in partnership with universities, research organisations, businesses, charities, and government to create the best possible environment for research and innovation to flourish. We aim to maximise the contribution of each of our component parts, working individually and collectively. We work with our many partners to benefit everyone through knowledge, talent and ideas.
  4. ONS is the UK’s largest independent producer of official statistics and its recognised national statistical institute. We are responsible for collecting and publishing statistics related to the economy, population and society at national, regional and local levels. We also conduct the census in England and Wales every 10 years.  
  5. More information on ADRP will be made available as the programme evolves. In delivering three functions the ADRP will provide:

Operational details for the functions above will be confirmed later in the year.

For further information please see or email

ADRP will be funded until July 2021 and funds are being made available from the National Productivity Innovation Fund (NPIF).

  1. What is administrative data?
  1. ESRC is currently recruiting for the post of Strategic Hub Director to provide strategic leadership within the ADRP. Applications close on 1 October. 
  2. ESRC funded the Administrative Data Research Network (ADRN) for a period of five years from 2013. The ADRN is due to close in autumn 2018. The Administrative Data Research Network (ADRN) was a UK-wide partnership between universities, government departments and agencies, national statistics authorities, the third sector, funders and researchers. The ADRN was a new and innovative approach to a complex challenge and the new programme incorporates many of the lessons learned from the previous approach.