A Bridge to the Future
Chapter 5 | The Piers Supporting Evaluation
Several programs operate in the background but serve as the backbone of IEG’s evaluation practice. IEG invests in the development of cutting-edge evaluation methods through its Methods Advisory Function, in ensuring the strength of Bank Group accountability through the MAR, and in staff learning through the IEG Academy.
Methods Advisory Function
IEG’s Methods Advisory Function is critical to enabling teams to use cutting-edge and rigorous evaluation methods. Indeed, a meta-evaluation to assess the credibility of IEG’s evaluation studies found that over the past five years, clarity of evaluation design has improved and more innovative methods are being used. In FY21, the Methods Advisory team held workshops on adapting evaluations to restrictions imposed by the pandemic.
The Methods Advisory Function also released the Evaluation of International Development Interventions: An Overview of Approaches and Methods, a key resource for evaluators to learn about approaches and methods.
Management Action Record
The Management Action Record (MAR) reports on action catalyzed by evaluations and is a key element of the Bank Group’s accountability framework. Early in FY21, the Committee on Development Effectiveness endorsed a reform of the MAR. Working together, IEG and Bank Group management adjusted the system to focus on strategic recommendations with both the clear potential to enhance the development effectiveness and the strong commitment of Bank Group senior management. IEG is committed to a more selective approach to making recommendations that is driven by the evidence and where each recommendation presents a compelling case for enhancing development effectiveness. Bank Group management will commit to taking actions that advance the institution toward IEG recommendations’ intended outcomes. The reformed MAR enables better and more meaningful tracking, dialogue, and self-assessment of Bank Group management’s implementation of IEG recommendations.
Table 5.1. Management Action Record Before and After Reform
The Prereform MAR System |
The New MAR System (starting FY21) |
IEG evaluations contained on average five recommendations linked to evaluations’ findings. |
IEG evaluations contain fewer recommendations, and those recommendations align more closely with the Bank Group’s strategic directions and have the clear potential to enhance the Bank Group’s development effectiveness. |
Some recommendations focused on specific actions, and some contained subrecommendations or multiple parts. |
Recommendations are outcome oriented and rarely contain subrecommendations. |
Management focused on action plans (which IEG usually found unambitious). |
Management reports annually on progress toward intermediate outcomes sought from implementing the recommendations. |
Note: MAR = Management Action Reform.
IEG Academy
The IEG Academy focuses on building and reinforcing the staff skills needed to carry out IEG’s mandate successfully. The FY21 Learning Days delivered 16 short, interactive learning sessions over four dedicated mornings to over 110 IEG staff and consultants in a fully virtual format. While addressing select learning needs of staff in all roles, the program focused on evaluation methods topics (such as Machine Learning for Economists, in collaboration with the IEG methods team), writing, and training on key soft skills such as unconscious bias and emotional intelligence.
In addition to the synchronous Learning Days, IEG Academy delivered learning through these offerings and modalities in FY21:
- Virtual classes and brown-bag lunches (49)
- On-the-job tools and coaching
- A pilot using virtual reality for staff to practice difficult conversations about selected workplace scenarios in a safe space
- An award-winning mentoring program, which supported pairs matched in FY20 who elected to continue working together remotely
- Onboarding guidance, resources, and training to orient new hires