Tag: RCTs

 

Will an RCT Change Anyone’s Mind? Should It?

Blog Post
We respond to critics of our evaluation of Liberia’s “partnership” school program, distinguishing legitimate concerns about the charter-style program itself—which can be turned into testable hypotheses—from methodological limitations to what an impact evaluation can show.
Publications

Motivated by our experience in designing a particular social program, skill set signaling for new entrants to the labor market in Peru, we articulate the need for, and explore the empirical consequences of, alternative learning approaches to the design of development projects. We suggest that project, program, and policy design must depend on more robust learning strategies than the attempt to directly apply results from ”systematic reviews” or move prematurely to an RCT.

Using “Random” Right: New Insights from IDinsight Team

Blog Post

The unfolding of “thesis, antithesis, synthesis” about the use of randomized control trials (RCTs) as a tool in improving development policies and practices has reached the “synthesis” stage.  A new paper in the 3ie working paper series “Evaluations with Impact” by Shah, Wang, Fraker and Gastfriend (hereafter IDinsight team and, full disclosure, three of which were students of mine) (2015) does an excellent job both in laying out the debate and in articulating a newly emerging conv

Mapping the Worm Wars: What the Public Should Take Away from the Scientific Debate about Mass Deworming

Blog Post

It was a big deal when various media outlets declared last week that the evidence to support mass deworming had been “debunked.” The debate now is not about whether children sick with worms should get treated (everyone says yes), but whether the mass treatment of all kids — including those not known to be infected — is a cost-effective way to raise school attendance. The healthiest parts of the debate have been about the need for transparency, data sharing, and more replication in science. Here, we’re going to focus here on the narrower question of the evidence for mass deworming specifically, which is where some journalists have gotten things quite wrong. 

The Final Word on Microcredit?

Blog Post

Two influential movements within the development industry collided head-on this month: the microcredit movement and the movement to subject development policies to rigorous impact evaluation.

The R-Word Is Not Dirty

Blog Post

Randomized controlled trials (RCTs) have been used to demonstrate the effectiveness of development interventions from cash transfers to tutoring. They are one of many tools used to evaluate policies, products, and services around the world.

RCTs in Development, Lessons from the Hype Cycle

Blog Post

Last month, I was on my way to speak at an IDB sponsored conference on evaluation.  Getting on the shuttle to DC I bumped into a friend of mine who is the head of a technology related company.   On the plane I was telling him I was on my way to talk about the fad of doing RCTs in my field of development.  He told me he had a great slide from the tech consulting company Gartner about the “Hype Cycle” in tech industries.  As you see, this wonderful graphic shows a typical cycle of a tech idea or tech

Pages