What impact does ADR UK’s work have?
Defining and measuring impact is key to assessing how successful ADR UK is in achieving its broader aims and objectives. ADR UK’s ultimate goal is to improve public service provision across the UK by enabling administrative data research that offers new and valuable insights into society.
We therefore measure impact according to the effects that the research we enable has on public policy, and in turn on the lives of the people that these policies effect. Impact in this sense therefore means tangible real-world change that makes a positive difference to life in the UK.
Alongside impact on policy outcomes, it is also important to ADR UK that we have a lasting impact on the underlying process by which administrative data is accessed for research and used to inform policy, strengthening the link between academics and government and creating a sustainable research resource. In this way, ADR UK can have a legacy impact that enables others to build on our success and create further policy impacts in the future, potentially far outliving the life of this investment.
Examples of some of the impact that research enabled by ADR UK partners has already had can be explored below, demonstrating the huge potential that work in this area has.
Tackling fuel poverty in Wales
This ongoing research is being undertaken by ADR Wales.
ADR Wales’ research using linked administrative data has provided valuable insights into the connection between fuel poverty and health.
In partnership with the Welsh Government, in 2017 ADR Wales discovered that those who accessed the government’s Warm Homes Nest scheme were less likely to seek help from the NHS and be admitted into hospital for cardiovascular and respiratory health issues. The ‘NEST’ measures appeared to have a protective effect, which was observed across all age groups.
This research suggested that fuel poverty schemes have a powerful impact beyond helping people heat their homes. Additionally, it led to an extension of funding for the scheme between 2018-21, as well as funding for the House Conditions Evidence Programme and the Housing Stock Analytical Resource.
The most recent output from this research was published in October 2019, and was the first study to directly compare the health impacts of two different home energy efficiency schemes – one demand-led and one area-based. The study showed that there was no impact from either scheme on whether recipients experienced a health condition in the first place. However, for both schemes there was a reduction in GP events for respiratory health when compared with their respective control groups. The consistent pattern in reductions across schemes, whilst not always reaching statistical significance, suggests both schemes improve respiratory health. The findings are expected to inform future fuel poverty schemes in Wales.
Improving the lives of farmers
This research was undertaken by ADR Northern Ireland.
One of the most impactful pieces of research undertaken by ADR Northern Ireland involved both academic researchers and researchers from the Northern Ireland Department for Agriculture, the Environment and Rural Affairs (DAERA).
One of DAERA’s key goals was to improve the lives of rural dwellers and farming communities, with prior research indicating that farmers are at a higher risk of health issues due to long working hours, physical labour, isolation and accidents. Another key target was to improve expertise and education among farming populations; in particular, IT literacy.
In conjunction with the ADRC-NI Statistical Methodological Officer at Queen’s University Belfast, this research project sought a better understanding of the health and educational issues within farming communities, linking these to DAERA policies and programmes. This allowed for comparison of the individual circumstances of farmers and farming families in order to better understand their livelihoods.
Utilising ADR NI’s ability to link data from the Northern Ireland Agricultural Census and the Population Census, researchers discovered key evidence to inform government policy, establish robust baseline information, provide evidence of need, and aid in research targeting and outcome monitoring.
This research has already saved DAERA £350,000 (the cost of conducting their own survey). You can find out more about the research and read the full report here.
Maternal employment and childcare
This research was undertaken by ADR Northern Ireland.
In the Spring of 2019 ADR Northern Ireland partnered with the Children for All Coalition to deliver a conference on childcare policy at Queen’s University, showcasing ADRC NI legacy research from Dr Corina Miller on factors affecting maternal employment and the positive role that co-resident grandparents can have in enabling mothers to get back into full and part-time employment.
This research was formed in partnership with several local NGOs after a series of thematic data workshops delivered by our Public Engagement and Impact Manager during the ADRN (Administrative Data Research Network, the predecessor to ADR UK) period. It has continued to flourish as a partnership, delivering results for the NGOs involved in the form of data-driven, Northern Ireland-specific research to use as evidence in advocacy and lobbying, and for the researcher, whose research benefitted from additional datasets gained through these stakeholder relationships.
A new Cross Party Working Group on Early Education and Childcare has begun meeting to draw up a Childcare Strategy for Northern Ireland. This group will be receiving evidence on an ongoing basis in order to develop the Strategy that will form the basis of any new legislation developed once devolved government is restored to Northern Ireland. It is anticipated that Dr Miller’s research will be a key piece of evidence, given our partnership with the Childcare for All Coalition who are key members of the Working Group.
This draws a direct line from ADR NI's public engagement work with the voluntary and community sector to influencing a crucial new piece of policy that will positively impact families in Northern Ireland.
Early years support in Wales
This ongoing research is being undertaken by ADR Wales.
Flying Start is the Welsh Government’s flagship early years programme for families with children under four years old living in some of the most disadvantaged areas of Wales. By looking at and linking individual level Flying Start intervention data from local authorities across Wales – together with hospital admissions, A&E attendances, and education absence data – the project aims to provide a picture of the outcomes of families whose children are eligible for the Flying Start programme compared to those who live outside of Flying Start eligible areas.
Led by our researchers working within academia and Welsh Government, this project has demonstrated the richness that can be drawn when linking data from policy areas and organisations that would otherwise have remained separate. The project has built an engaged stakeholder group, with representatives from the six local authorities involved in the pilot. The group has played a key role in guiding the direction of the project, including analysis based on their experiences of delivering the programme.
Initial research findings for the City and County of Swansea have been produced by analysing data from the Flying Start programme linked with other health and education data. When comparing children living in the Swansea area who had received Flying Start health services and children who had received no Flying Start health services, the study found: a limited, preliminary indication of a possible positive impact of Flying Start on low birth weight and births to teenaged mothers; no impact on overall A&E attendances; a possible ‘protective effect’ of Flying Start on hospital admissions; a possible positive impact of Flying Start on primary school absences; and a possible positive impact of Flying Start on unauthorised primary school absences.
It is anticipated that the findings of this project will help policymakers to evaluate the impact of the Flying Start programme which may, in turn, shape future policy and direction. The findings will also be relevant to other research to evaluate area-based initiatives and early interventions to tackle poverty.
You can find out more about the initial findings of this research here.
Effectiveness of burglary security in England and Wales
This research was undertaken by researchers at Nottinghham Trent University using linked administrative data provided via the Office for National Statistics (ONS) Secure Research Service (SRS), which is being expanded and improved with ADR UK funding.
This research was lead by Professor Andromachi Tseloni, and explores the security hypothesis concerning the domestic burglary drop in England and Wales since 1993.
It is common to use burglar alarms as a deterrent against domestic crime, and previous research has suggested that this has been proven to be effective. This study looked to corroborate these findings by linking data from the Crime Survey for England and Wales (CSEW) (2011/2012) and the British Crime Survey (1992-2010/2011) to compare security profiles of burgled households against all households, based on the CSEW Crime Prevention and Victim modules data.
It was found that a combination of window locks, indoor lights on a timer, door double locks or deadlocks, and external lights on a timer or sensor proves 49 times more protection than no security. A surprising discovery was that homes with just a burglary alarm and nothing else have a slightly higher burglary risk than homes with no security at all. Homes with no security experience a four-fold in incidents compared to homes with a combination of security devices.
This research won the ONS Research Excellence Awards 2019. It has already made a positive impact on the Neighbourhood Watch, the Rosetta Burglary Task Force, Nottinghamshire Police, Leicestershire Police, and Nottingham City Council.
Quality of paediatric epilepsy care and epilepsy-related deaths
This research was undertaken by researchers at Imperial College London, Univeristy College London, and the Nuffield Trust using administrative data made available via the Office for National Statistics (ONS) Secure Research Service (SRS), which is being expanded and improved with ADR UK funding.
The UK currently has higher rates of epilepsy-related deaths in young people than other countries do, with roughly one out of every 100 people diagnosed with epilepsy. This research was lead by Dr Dougal Hargreaves, and combines mortality data from the Office for National Statistics, Hospital Episode Statistics, and the Epilepsy 12 national audit for paediatric epilepsy services to study links between care quality and outcomes of children and young people with epilepsy. These three national datasets were used to investigate the association between unit performance when involving epilepsy specialists and the proportion of adolescents with epilepsy treated in each unit who died.
This research finds that 7.5% of adolescents with epilepsy who are admitted to hospital die within the study period (averaging 4.5 years, ranging from 3-6 years old). Adolescents who are managed within paediatric units that meet national guidelines on involving paediatric neurologists are less than half as likely to die in the period following transition to adult services compared to patients who are managed in other units.
Further findings indicate units where involvement of an Epilepsy Specialist Nurse (ESN) deteriorate over time experience a significant increase in standardised epilepsy admissions over the same period. In adjusted regression analysis, fully meeting guidelines for involving paediatric neurologists is associated with 4.6 fewer deaths per hundred patients.
This research could save lives. There are three core ways in which this research informs policy/planning decisions and discussions:
- National policy on services for young people with long-term conditions - used in discussions at the NHS England transformation board for children and young people.
- Work force planning - findings provide the first empirical basis for estimating the number of posts needed to ensure good outcomes.
- Local and regional planning decisions about paediatric epilepsy services - findings reinforce the clinical and business case for strengthening links between secondary and tertiary care.
This research was runner up for the ONS Excellence Awards 2019.
Pension evaluation in the public sector
This research was undertaken by researchers at the University of Sussex and the National Institute of Economic and Social Research using administrative data made available via the Office for National Statistics (ONS) Secure Research Service (SRS), which is being expanded and improved with ADR UK funding.
This research was lead by Professor Peter Dolton, and compares and measures Total Reward over the lifetime and compares it in different occupations within the public sector. Data from the Annual Survey of Hours and Earnings, Labour force Survey, British Household Panel Survey, and English Longitudinal Survey of Ageing was combined with a rigorous new economic theory to solve a practical recurrent problem in public sector pay evaluation.
Research findings illustrated that public sector workers are, on average, worse off in the recently introduced Career Average (CARE) Pension schemes. However, the average masks substantial occupational variation: those in the Prison Service, Teaching and NHS Nurses schemes, although still adversely affected, are less so than other groups. This research also found that doctors are also substantial losers in the move from Final Salar to CARE schemes.
The Police and Fire Services are much worse off. This research shows between £300k and nearly £500k 'lost' by the current CARE scheme members relative to their older counterparts in the Final Salary pre-2012 scheme. This analysis makes clear how these larges differences occur due to changing retirement ages and accrual rates.
Female teachers and doctors fare better under the CARE pension reforms than their male counterparts. When a comparison is made between public and private sector counterparts of directly comparable groups (such as teachers and nurses), it is shown that the public and private sector workers are in fact slightly better off in terms of Accumulated Lifetime Totle Reward (ALTR) levels.
This research will inform future discussions about:
- The consequences of recent pension reforms and how this could determine future pension changes.
- How pay and pension comparisons might be made in the future.
- The extent to which specific occupations have been affected by recent CARE pension changes and whether this needs to be tackled.
Find out more
If you are a policy maker or data holder interested in how ADR UK can help generate impact for you and the communities you serve, please get in touch.