Trials Unit
Our Trials Unit brings together expertise across IES from different research perspectives and subject disciplines, to share best practice and use the most robust counterfactual designs to get to the heart of understanding and evaluating interventions. This includes our work in randomised controlled trials (RCTs) both advising on design and the set- up phase as well as carrying out impact evaluations, and implementation and process evaluations. It also includes our work on other quasi-experimental designs such as matching designs using techniques such as Regression Discontinuity Designs, Propensity Score Matching and Difference in Differences.
We have worked for government departments, What Works Centres and sector specific funders across employment, HR and education and skills such as Department of Work and Pensions, Department for Education, Education Endowment Foundation, What Works for Children’s Social Care, The Sutton Trust, Esmeé Fairbairn Foundation, Cranfield University School of Management and RSSB. You can learn more about Trials Unit activities within the first year of operation here. What are RCTs? Learn more here.
We have experienced staff equipped to support RCTs across all the crucial elements:
- Impact evaluation - our team of economists are able to undertake randomisation (including using stratification and minimisation techniques), compliance analysis, cost analysis and impact analysis including multilevel modelling. Our impact evaluation specialists include Seemanti Ghosh and Susie Bamford.
- Implementation and process evaluation- from developing a theory of change through a wide range of qualitative and quantitative methods (including observations, surveys, remote and in-person interviewing, webinars and workshops) and analysis, our team are fully equipped to provide a range of support to projects. Our key IPE specialists are Becci Newton, Anneka Dawson, Alison Carter, Joy Williams, Clare Huxley and Ceri Williams
Our staff are experienced at managing RCT projects to the highest standards and following recommended CONSORT guidelines including registering trials on the appropriate trials’ websites (such as ISRCTN or the Open Science Framework). We produce protocols to describe the methodology, measures and timeline for the projects and statistical analysis plans to outline our approach to using the data so there is an open and rigorous approach to our work. We understand and follow the latest data protection guidelines such as GDPR for producing data sharing agreements, data protection impact assessments, legitimate interest assessments, privacy notices and ensuring secure methods of data transfer and storage. We have critical standards for quality assurance at all stages of production of research materials, analysis and reporting.
We also regularly advise clients on the best approach to research design which can include both RCTs and quasi experimental methods of the highest standards and we are happy to help clients with their early thinking about what would work for their projects - please do get in touch with Anneka Dawson to discuss this option further.
Related projects
- Evaluating mandatory maths and English training for young jobseekers: 18-21 Work Skills Pilot
- Mindfulness for strategic change readiness
- Understanding the conditions for successful mental health training for managers
- Qualitative research of the Intensive Activity Programme (not running the RCT element but process evaluation)
- Research into the ESA Claimant Trials
Additional projects are highlighted in the sidebar to the left.
We also advise on whether RCT’s are appropriate methodologies with feasibility projects such as:
- Fit for Work: Scoping the feasibility of an impact evaluation
- Evaluation of the W1 Skills Bootcamps and design of W2 evaluation
Evaluation Partners
We are proud to be members of a number of evaluation panels for organisations including:
- Education Endowment Foundation
- Youth Futures Foundation
- Foundations (The What Works Centre for Children & Families)
- What Works Centre for Local Economic Growth
- Youth Endowment Fund
- Centre for Homelessness Impact