Overall framework

The purpose of the independent evaluation function at the World Bank is to assess the performance of the institution's policies, projects, and processes (accountability) and to learn what works in what context (learning).  
  
As the scope of World Bank operations and its portfolio of products have grown, the Independent Evaluation Group (IEG) has continued to develop and adapt its approaches to evaluating development effectiveness. These approaches include assessing outcomes against stated objectives, benchmarks, standards, and expectations, or assessing what might have happened in the absence of the project, program, or policy (counterfactual analysis). For example, private sector investment projects are mainly assessed against absolute economic and financial performance criteria and the extent to which they contribute to private sector development. Public sector projects are assessed in relation to their relevance and the efficacy and efficiency with which they achieve their development objectives. Across projects, IEG looks at the patterns of what works under what circumstances. 
  
IEG's evaluation approach reflects and is harmonized with internationally accepted evaluation norms and principles, such as the quality standards for development evaluation of the OECD Development Assistance Committee, the good practice standards of the Evaluation Cooperation Group, and the norms and standards of the United Nations Evaluation Group. 

IEG adheres to a multi-layered quality assurance model, which includes in-depth review of intermediate and final evaluation products by internal (IEG) and external peers. A Methods Advisory Function was established to promote internal knowledge sharing on evaluation design issues and methodological innovation. 

IEG employs a number of different evaluation instruments which differ in terms of methodology and scope. 

Major Corporate, Thematic and Sectoral Evaluations 

To assess the Bank’s performance and identify lessons for improving Bank operations across projects with regard to a particular theme, sector or corporate process, IEG every year conducts a number of major evaluations. These are multi-level, multi-project evaluations which rely on elaborate mixed methods designs that usually combine synthetic analyses at the overall portfolio level with in-depth analyses at country, project or other levels of analysis. Within the framework of major evaluations, IEG employs a range of methodological approaches such as (e.g.) portfolio analyses, structured literature reviews, surveys and case study analyses. Data sources include internal (WBG and IEG) data, external data sets, internal and external (to the WBG) documentation, and interviews with different groups of stakeholders. Evaluation design, including (e.g.) issues of scope, delimitation, sampling and other data collection and analysis issues are discussed in (peer reviewed) approach papers. 

Country Program Evaluations (CPEs) 

Country Program Evaluations look at how well the WBG achieved its objectives over a period of up to 10 years for selected individual countries. Within a CPE, IEG assesses Bank performance primarily on the basis of contributory actions the Bank directly controlled. For each of the main objectives, the CPE evaluates: the relevance of the objective; the relevance of the Bank’s strategy toward meeting the objective, including the balance between lending and non-lending instruments; the efficacy with which the strategy was implemented; and the results achieved. Evaluators also assess the degree of country ownership of international development priorities, such as the Sustainable Development Goals, and Bank corporate advocacy priorities, such as safeguards. CPEs employ similar methods as IEG’s major evaluations. 

Completion and Learning Review Validations (CLRVs) 

At completion of each Country Partnership Framework (CPF), the WBG team prepares a Completion and Learning Review (CLR). The CLR is a critical input in the design and implementation of the next CPF. IEG conducts a desk-based review of the CLR and provides an independent validation and rating of the CLR. IEG’s submits the CLR to the Board in time for its discussion of the new CPF. In producing a CLR Validation (CLRV), IEG uses a shared methodology with WBG. It involves looking at what was achieved in terms of the stated objectives, how well the WBG designed and implemented the program, and the alignment with the WBG corporate strategy. IEG’s validation of the CLR provides an independent rating on two key dimensions: the CPF’s development outcomes and WBG’s performance. 

Implementation Completion and Results Report Reviews (ICRRs) 

To assess the Bank’s performance and identify lessons for improving Bank operations at project level, IEG undertakes a validation process for 100% of the World Bank’s Implementation Completion and Results Reports. The IEG Implementation Completion and Results Report Review (ICRR) is an independent, desk-based, critical validation of the evidence, content, narrative and ratings included in the World Bank’s Implementation Completion and Results Reports (ICR). The review is conducted within 180 days of the submission of the World Bank’s self-evaluation Implementation Completion and Results Report to IEG. Based on the evidence provided in the ICR and an interview with the last task team leader, IEG arrives at its own ratings for the project, based on the same evaluation criteria used by the World Bank project teams. IEG’s ICRRs serve as an independent validation of the results in the ICR and contribute to both learning and accountability. 

Project Performance Assessment Reports (PPARs) 

Also at the project level, IEG conducts Project Performance Assessment Reports (PPARs) for approximately 20% of the Bank’s project portfolio based on the review of self-evaluation reports prepared by Bank staff. Project Performance Assessment Reports (PPARs) are independent field-based project evaluations, and may be conducted at any point after a self-evaluation (ICR) has been completed. While they formally follow the same rating criteria as the ICRR, PPARs are evaluations rather than validation exercises, and they rely on a much broader set of evidence. PPARs rely on a mixed methods approach which usually includes (but is not limited to) literature review, portfolio analysis and a country mission, involving site visits and semi-structured interviews with different stakeholders. 

Evaluative Note (EvNote). 

The International Finance Corporation (IFC) project evaluation system is a self-evaluation system based on the Expanded Project Supervision Report (XPSR), independently validated by IEG. XPSRs are prepared for a representative random sample of 40% of mature operations, selected by IEG each year. In the last few years, the annual XPSR program covered between 70 and 90 projects. IFC’s investment staff complete the self-evaluation based on IFC corporate and IEG guidelines that define the content and scope of XPSRs as well as the criteria for attributing indicator and outcome ratings. IEG validates the XPSR findings and lessons and independently rates development results summarized in IEG’s Evaluative Note (EvNote). Due to their inclusion of confidential commercial information, neither the XPSR nor the EvNote are disclosed publicly. 

Project Completion Report Evaluative Notes (PCR Evaluative Notes) 

For IFC advisory projects, IFC completes a Project Completion Report (PCR). IEG independently validates about 50 percent of these through PCR Evaluative Notes. PCR Evaluative Notes follow PCR guidelines, which provide evaluation frameworks and performance rating criteria. They use an objective-based methodology that establishes minimum thresholds for rating and assessing project effectiveness. The PCR Evaluative Notes assess development effectiveness, IFC’s role and contribution, and IFC’s work quality, as well as the sustainability of results in the longer run. Due to their inclusion of confidential commercial information, neither the PCR nor the PCR Evaluation Notes are disclosed publicly. 

Project Evaluation Report Validation Notes 

For all Multilateral Investment Guarantee Agency (MIGA) guarantee projects that have reached early operating maturity, MIGA prepares a Project Evaluation Report (PER) that IEG independently validates through a PER Validation Note. The PER Validation Note follows PER guidelines, which provide the evaluation framework and performance rating criteria. PER Validation Notes use an objective-based and benchmark-based evaluation system and performance ratings. They assess development outcome, MIGA’s role and contribution, and MIGA’s work quality. Due to their inclusion of confidential commercial information, neither the PER nor the PER Validation Note are disclosed publicly. 

Results and Performance of the World Bank Group (RAP) 

The RAP is an annual report that aggregates and interprets evidence on World Bank Group performance, mainly using IEG’s validations of World Bank, International Finance Corporation (IFC), and Multilateral Investment Guarantee Agency (MIGA) self-evaluations of projects and country programs. These validations summarize the extent to which the Bank Group institutions have achieved key aspects of project and country program design, implementation, and results. The RAP series review performance over a 10-year period based on ratings from IEG validations using standardized methodologies. The series maintains the principle of symmetry across institutions by analyzing common or similar factors linked to performance while also acknowledging their differences. Hence, the RAP includes separate chapters for World Bank, IFC, MIGA, and country programs, which allows more in-depth discussion of performance trends and relevant topics for each institution. The RAP series also includes innovative analysis of specific themes or trends, such as specific levers related to project design and result monitoring that are associated with stronger performance and better outcomes. 

Management Action Record Validation (MAR) 

The Management Action Record (MAR) is integral to the World Bank Group’s accountability framework. It supports accountability, learning, and adaptation for the Bank Group management’s implementation of IEG recommendations. WBG Management prepares the MAR, an annual self-assessment, which IEG validates with an annual assessment and rating of progress toward achieving the outcomes of active recommendations and assesses the implementation challenges and strengths. WBG Management’s annual self-assessment, and IEG’s MAR validation are presented to the World Bank Board’s Committee on Development Effectiveness for its review and oversight.