This report describes a novel statistical theory for estimating impacts for randomized controlled trials (RCTs) for a wide range of designs used in social policy research. The report discusses a unified, non-parametric design-based approach for impact estimation using the building blocks of the Neyman-Rubin-Holland...
Related Publications for Analytic and Technical Support for Education Researchers and Practitioners
Statistical Theory for the RCT-YES Software: Design-Based Causal Inference for RCTsJun 04, 2015
Reporting What Readers Need to Know About Education Research Measures: A GuideSep 09, 2014
This brief provides five checklists to help researchers provide complete information describing (1) their study's measures; (2) data collection training and quality; (3) the study's reference population, study sample, and measurement timing; (4) evidence of the reliability and construct validity of the...
Forming a Team to Ensure High-Quality Measurement in Education StudiesSep 02, 2014
This brief provides tips for forming a team of staff and consultants with the needed expertise to make key measurement decisions that will ensure high-quality data for answering the study’s research questions.
Making the Most of Opportunities to Learn What Works: A School District's GuideJun 01, 2014
This guide for district and school leaders shows how to recognize opportunities to embed randomized controlled trials (RCTs) into planned policies or programs. Opportunistic RCTs can generate strong evidence for informing education decisions—with minimal added cost and disruption. The guide also outlines...
Graphic Design for ResearchersMay 30, 2014
This guide covers key concepts behind good graphic design and discusses how to use basic elements like photographs, images, color, tables, figures, and type to create useful publications and digital products. It also touches on how researchers can use data visualization to make complex concepts accessible....
508 Compliance: Preparing Presentations, Excel Files, Websites, and Multimedia ProductsMay 30, 2014
This guide offers tips and tools for making materials, including presentations, websites, and multimedia products, accessible. It is intended for those who have a basic understanding of the 508 process. The guide was prepared for the Institute of Education Sciences’ Regional Education Laboratories.
Understanding Variation in Treatment Effects in Education Impact Evaluations: An Overview of Quantitative MethodsMay 22, 2014
Variation in treatment effects has important implications for education practice—and for facilitating the most efficient use of limited resources—by informing decisions about how best to target interventions and how to improve the design or implementation of interventions. Understanding variation in...
Recognizing and Conducting Opportunistic Experiments in Education: A Guide for Policymakers and ResearchersApr 30, 2014
Opportunistic experiments are a type of randomized controlled trial to study the effects of a planned intervention or policy change with minimal added disruption and cost. This guide defines opportunistic experiments and provides examples, discusses issues to consider when identifying potential opportunistic...
First Impressions: Creating Newsflashes with ImpactSep 30, 2013
Posting a report on the web or sending out a press release used to be all that was needed to help get the word out about one's research findings. But times have changed. Today, effective dissemination depends on getting the right message to the right people at the right time in the right form.