With rigorous economic research and practical policy solutions, we focus on the issues and institutions that are critical to global development. Explore our core themes and topics to learn more about our work.
In timely and incisive analysis, our experts parse the latest development news and devise practical solutions to new and emerging challenges. Our events convene the top thinkers and doers in global development.
Independent research & practical ideas for global prosperity
Evaluation Gap Update
The good news is that people are being more candid and open about their mistakes and field experiences. The bad news is that institutional attention spans seem to be short. But then, there’s good news about impact evaluations influencing policy. Unfortunately, there’s bad news that we couldn’t include all the items we found this month. Fortunately, there’s good news that I included a cartoon explanation of statistics - it was just too good to leave out. On balance? Mostly good news!
William D. Savedoff
Center for Global Development
Learning from failure
Researchers and policymakers increasingly admit that plans don't succeed all the time and are learning instead from mistakes, unforeseen events, and outright failures. The authors of "Learning from Experiments that Never Happened" share their experience to combat publication bias while giving other researchers an idea of what can go wrong in the field. (McKenzie and Goldstein blog about this too.) Or read about the top 5 evaluation mistakes from Christel Vermeersch who is seeking feedback on the World Bank's impact evaluation tool. The Millennium Challenge Corporation's openness about its recent farm extension evaluations also provides a window on how implementation can go awry. And 3ie has published field notes about studies conducted with its grants. This willingness to share problems is an encouraging sign of increasing maturity in the field.
Image: Flickr user Stefan Zabunov
European Commission less committed to evaluation?
Over the last 10 years, aid agencies have generally given greater resources and attention to improving independence and rigor of their evaluation programs. One manifestation of this trend has been the creation of high-level evaluation departments, often reporting directly to supervisory boards. Therefore, it is discouraging to read a blog from ECDPM about organizational change at the European Commission’s Directorate-General for Development and Cooperation (DEVCO). The blog notes that until this month, the organization’s evaluation unit “reported directly to DEVCO’s senior management based on best practice for safeguarding the independence of evaluations.” Now evaluation has been relegated to a lower category line unit.