Tag: Impact Evaluation


Impact Evaluation: How the Wonkiest Subject in the World Got Traction

Blog Post

“3ie has made my job much easier.” This is what we heard last month from a high-ranking government official in Africa, referring to the International Initiative for Impact Evaluation (3ie), and it made us very proud. Creating 3ie was the outcome of the Evaluation Gap Working Group that we led along with Nancy Birdsall to address the limited number of rigorous impact evaluation of public policies in developing countries. As CGD celebrates its 15th year, it is worth considering what made that working group so successful, the obstacles we confronted, and the work that still remains to be done.

Using “Random” Right: New Insights from IDinsight Team

Blog Post

The unfolding of “thesis, antithesis, synthesis” about the use of randomized control trials (RCTs) as a tool in improving development policies and practices has reached the “synthesis” stage.  A new paper in the 3ie working paper series “Evaluations with Impact” by Shah, Wang, Fraker and Gastfriend (hereafter IDinsight team and, full disclosure, three of which were students of mine) (2015) does an excellent job both in laying out the debate and in articulating a newly emerging conv

PEPFAR Teams Are Designing Impact Evaluations: Retrospective, Prospective, and Randomized

Blog Post

Last year, PEPFAR submitted guidelines which encouraged country staff to submit a proposal to conduct an “impact evaluation” (IE) as part of their annual Country Operation Plan (COP).  Subsequently, they received four submissions, of which three were funded.  But they also learned that many PEPFAR staff – who are mostly program implementers, or the managers of program implementers – didn’t fully understand what they were being asked to do; what does PEPFAR mean by “impact evaluations”?

RCTs in Development, Lessons from the Hype Cycle

Blog Post

Last month, I was on my way to speak at an IDB sponsored conference on evaluation.  Getting on the shuttle to DC I bumped into a friend of mine who is the head of a technology related company.   On the plane I was telling him I was on my way to talk about the fad of doing RCTs in my field of development.  He told me he had a great slide from the tech consulting company Gartner about the “Hype Cycle” in tech industries.  As you see, this wonderful graphic shows a typical cycle of a tech idea or tech

The Parable of the Visiting Impact Evaluation Expert

Blog Post

Visitans Perito works at the World Bank as an education specialist, and has just set off on a two week mission to the country of Peripheria, a poor, land-locked former Soviet Republic in Central Asia, about which he knows very little, except that everyone seems to agree it has a totally dysfunctional public school system.