Back to cover

The World Bank Group Outcome Orientation at the Country Level

Bibliography

Aghion, Philippe, and Jean Tirole. 1997. “Formal and Real Authority in Organizations.” Journal of Political Economy 105 (1): 1–29.

Andrews, Matt. 2013. The Limits of Institutional Reforms in Development: Changing Rules for Realistic Solutions. Cambridge: Cambridge University Press.

Andrews, Matt. 2018. “Public Policy Failure: ‘How Often?’ and ‘What is Failure, Anyway? A Study of World Bank Project Performance.” CID Faculty Working Paper 344, Center for International Development, Harvard University. https://bsc.cid.harvard.edu/files/bsc/files/public_policy_failure_cidwp344.pdf.

Andrews, Matt, Lant Pritchett, and Michael Woolcock. 2013. “Escaping Capability Traps through Problem Driven Iterative Adaptation (PDIA).” Working Paper 299, Center for Global Development, Washington, DC. https://www.cgdev.org/sites/default/files/1426292_file_Andrews_Pritchett_Woolcock_traps_FINAL_0.pdf.

Aronsson, Inga-Lill, and Hur Hassnain. 2019. “Value-Based Evaluations for Transformative Change.” In Evaluation for Transformational Change: Opportunities and Challenges for the Sustainable Development Goals, edited by R. D. van den Berg, C. Magro, and S. S. Mulder, 89–104. Exeter: International Development Evaluation Association (IDEAS).

ADB (Asian Development Bank) 2012. Managing for Development Results: Relevance, Responsiveness, and Results Orientation. Mandaluyong City: Asian Development Bank.

Australian National Audit Office. 2009. Innovation in the Public Sector: Enabling Better Performance, Driving New Directions. Canberra: Australian National Audit Office.

Barber, Michael, Paul Kihn, and Andy Moffit. 2011. “Deliverology: From Idea to Implementation.” McKinsey on Government 6: 32–9. https://www.mckinsey.com/~/media/McKinsey/Industries/Public%20and%20Social%20Sector/Our%20Insights/Deliverology%20From%20idea%20to%20implementation/Deliverology_From_idea_to_implementation.pdf.

Behn, Robert D. 2003. “Why Measure Performance? Different Purposes Require Different Measures.” Public Administration Review 63 (5): 586–606. http://www.csus.edu/indiv/s/shulockn/executive%20fellows%2004-05/behn%20why%20measure%20performance.pdf.

Bemelmans-Videc, Marie-Louise, Ray C. Rist, and Evert Vedung. 1998. Carrots, Sticks and Sermons: Policy Instruments and Their Evaluation. New Brunswick: Transaction Publishers.

Bester, Angela. 2012. “Results-Based Management in the United Nations Development System: Progress and Challenges.” Report prepared for the United Nations Department of Economic and Social Affairs, for the Quadrennial Comprehensive Policy Review. https://www.unjiu.org/sites/www.unjiu.org/files/rbm_full_report_english.pdf.

Birdsall, Nancy, ed. 2006. Rescuing the World Bank: A CGD Working Group Report and Selected Essays. Washington, DC: Center for Global Development. https://www.cgdev.org/sites/default/files/9781933286112-Birdsall-rescuing-world-bank.pdf.

Birdsall, Nancy, and D. Kapur. 2005. The Hardest Job in the World: Five Crucial Tasks for the New President of the World Bank. Washington, DC: Center for Global Development Working Group.

Brinkerhoff, Derick W., and Jennifer M. Brinkerhoff. 2015. “Public Sector Management Reform in Developing Countries: Perspectives beyond NPM Orthodoxy.” Public Administration and Development 35: 222–37.

Britt, Heather, and Richard Hummelbrunner. 2014. “Synchronizing Monitoring with the Pace of Change in Complexity.” Discussion Note. Monitoring and Evaluation Series. (September). Washington, DC: USAID. https://usaidlearninglab.org/sites/default/files/resource/files/pace_of_change_in_complexity_2014-09-25_final.pdf.

Britt, Heather, and Melissa Patsalides. 2018. “Complexity-Aware Monitoring.” Discussion Note. Monitoring and Evaluation Series. (December). Washington, DC: USAID. https://usaidlearninglab.org/sites/default/files/resource/files/cleared_dn_complexity-aware_monitoring.pdf.

Buffardi, Anne L., Paige Mason, Claire Hutchings, and Samuel Sharp. 2019. “Monitoring and Learning for Country-Level Portfolio Decision-Making and Adaptation.” Briefing Note (May), Overseas Development Institute, London.

Buntaine, Mark T., Bradley C. Parks, and Benjamin P. Buch. 2017. “Aiming at the Wrong Targets: The Domestic Consequences of International Efforts to Build Institutions.” International Studies Quarterly 61 (2): 471–88. https://academic.oup.com/isq/article-abstract/61/2/471/3866882?redirectedFrom=fulltext.

Busan Partnership for Effective Development Co-Operation. 2011. “Fourth High Level Forum on Aid Effectiveness.” Busan.

Casebourne, Jo. 2014. “Why Motivation Matters in Public Sector Innovation.” London: Nesta. https://media.nesta.org.uk/documents/why_motivation_matters_in_public_sector_innovation.pdf.

Cashin, Cheryl. 2011. Major Developments in Results-Based Financing (RBF) in OECD Countries: Country Summaries and Mapping of RBF Programs. Washington, DC: World Bank.

Clay, Edward J., Matthew Geddes, Luisa Natali, and Dirk Willem te Velde. 2008. “Thematic Study, The Developmental Effectiveness of Untied Aid: Evaluation of the Implementation of the Paris Declaration and of the 2001 DAC Recommendation on Untying ODA to the LDCs, Phase I Report.” London: Overseas Development Institute.

Dahler-Larsen, Peter. 2011. The Evaluation Society. Redwood City: Stanford University Press.

Evans, Alison. 2019. “Evaluation Measuring and Achieving Development Outcomes for the Executive Directors’ Seminar.” World Bank, Washington, DC.

Gaarder, Marie Moland, and Ulrich Bartsch. 2014. “Who Cares About Development Outcomes? Market Failures and the Role of the Evaluation Function.” Journal of Development Effectiveness 6 (4): 361–377. https://doi.org/10.1080/19439342.2014.966742.

Gauri, Varun, Sheheryar Banuri, and Stefan Dercon. 2015. The Biases of Development Professionals. World Bank, Washington, DC.

Global Partnership for Effective Development Cooperation. 2016. Nairobi Outcome Document. Nairobi, Kenya.

Gunasekaran, Angappa. Charbel José Chiappetta Jabbour, and Ana Beatriz Lopes de Sousa Jabbour. 2014. “Managing Organizations for Sustainable Development in Emerging Countries: An Introduction.” International Journal of Sustainable Development and World Ecology 21 (3): 195–7.

Højlund, Steven. 2014. “Evaluation Use in Evaluation Systems—The Case of the European Commission.” Evaluation 20 (4): 428–46.

Honig, Dan. 2018. Navigation by Judgment: Why and When Top-Down Management of Foreign Aid Doesn’t Work. New York: Oxford University Press.

Honig, Dan. 2019. “When Reporting Undermines Performance: The Costs of Politically Constrained Organizational Autonomy in Foreign Aid Implementation.” International Organization 73 (1): 171–201. DOI: https://doi.org/10.1017/S002081831800036X.

Honig, Dan. 2020. “Actually Navigating by Judgment: Towards a New Paradigm of Donor Accountability Where the Current System Doesn’t Work.” Policy Paper 169, Center for Global Development, Washington, DC.

Kenny, Charles. 2019. “Marginal, Not Transformational: Development Finance Institutions and the Sustainable Development Goals.” Policy Paper 156, Center for Global Development, Washington, DC.

Leeuw, Frans L., and Jan-Eric Furubo. 2008. “Evaluation Systems: What Are They and Why Study Them?” Evaluation 14 (2): 157–69.

Levine, Ruth, and William D. Savedoff. 2006. “The Evaluation Agenda.” In Rescuing the World Bank: A Working Group Report and Selected Essays, 183–93. Washington, DC: Center for Global Development.

López, Roberto García, and Mauricio García Moreno. 2011. Managing for Development Results: Progress and Challenges in Latin America and the Caribbean. Washington, DC: Inter-American Development Bank.

Mansbridge, Jane. 2014. “A Contingency Theory of Accountability.” In The Oxford Handbook of Public Accountability, edited by Mark Bovens, Robert E. Goodin, and Thomas Schillemans, 55–68. Oxford: Oxford University Press.

Mayne, John. 2015. “Useful Theory of Change Models.” Canadian Journal of Program Evaluation 30 (2): 119–42.

Michie, Susan, Maartje M. Van Stralen, and Robert West. 2011. “The Behaviour Change Wheel: A New Method for Characterising and Designing Behaviour Change Interventions.” Implementation Science, 6 (1): 42.

Muller, Jerry. 2018. The Tyranny of Metrics. Princeton: Princeton University Press.

Natsios, Andrew. 2011. The Clash of the Counter-Bureaucracy and Development. Washington, DC: Center for Global Development.

OECD (Organisation for Economic Co-operation and Development). n.d. Emerging Good Practice in Managing for Development Results: Emerging Good Practice in Managing for Development Results. First Issue. Paris: OECD. www.mfdr.org/Sourcebook.html/.

OECD. 2016. Evaluation Systems in Development Co-Operation: 2016 Review. Paris: OECD.

OECD. 2017. Strengthening the Results Chain: Synthesis of Case Studies of Results-Based Management by Providers. OECD Development Policy Papers 7, OECD, Paris. https://doi.org/10.1787/544032a1-en.

OECD. 2019. “Managing for Sustainable Development Results: Concept and Preliminary Draft Guiding Principles.” Discussion Paper for the OECD/DAC Results Community Workshop, Paris, 4–5 April.

OECD and UNDP. 2019. Making Development Co-operation More Effective: 2019 Progress Report. Paris: OECD Publishing. https://doi.org/10.1787/26f2638f-en.

OECD and World Bank. 2014. Measuring and Managing Results in Development Co-operation: A Review of Challenges and Practices among DAC Members and Observers. Paris: OECD.

Örtengren, Kari. 2016. A Guide to Results-Based Management (RBM), Efficient Project Planning with the Aid of the Logical Framework Approach (LFA)The LFA Method. Stockholm: Swedish International Development Cooperation Agency. https://www.sida.se/contentassets/9d257b83f4124113a324c61715150722/21920.pdf.

Ouye, Michael Michio, and Steven Toye Crocker. 2018. Dynamic Evaluation of Access Rights. US Patent 10,033,700, issued July 24, 2018.

Patton, Michael Quinn. 2008. Utilization-Focused Evaluation. Thousand Oaks: Sage Publications. https://www.betterevaluation.org/en/plan/approach/utilization_focused_evaluation.

Patton, Michael Quinn. 2010. Developmental Evaluation: Applying Complexity Concepts to Enhance Innovation and Use. New York: Guilford Press. https://www.betterevaluation.org/en/plan/approach/developmental_evaluation.

Patton, Michael Quinn. 2017. Principles-Focused Evaluation: The GUIDE. New York: Guilford Press.

Perakis, Rita, and William D. Savedoff. 2014. “An Introduction to Cash on Delivery Aid for Funders.” Note. Washington, DC: Center for Global Development. https://www.oecd.org/dac/peer-reviews/Introduction-cash-on-delivery-aid-funders.pdf.

Porter, Stephen, and Penny Hawkins. 2019. “Achieving Sustainability through Sustainable Organizational Evaluation Systems.” New Directions for Evaluation 162: 87–101.

Radin, Beryl A. 2006. Challenging the Performance Movement: Accountability, Complexity, and Democratic Values. Washington, DC: Georgetown University Press.

Ramalingam, Ben, Leni Wild, and Anne Buffarid. 2019. “Making Adaptive Rigour Work: Principles and Practices for Strengthening Monitoring, Evaluation and Learning for Adaptive Management.” Briefing Note, Overseas Development Institute, London. https://www.odi.org/sites/odi.org.uk/files/resource-documents/12653.pdf.

Rist, Ray C., and Nicoletta Stame, eds. 2006. Managing Evaluative Systems. Vol. 12 of From Studies to Streams. New York: Transaction Publishers.

Strode, Mary, Ian MacAuslan, Christine Spanneut, Mathew Powell, C. Willoughby, Philippe Ngango Gafishi, and T. Thomsen. 2009. Evaluation of the Implementation of the Paris Declaration: Thematic Study-Support to Statistical Capacity Building. Synthesis Report. London: DFID.

Sweetman, Roger, and Kieran Conboy. 2018. “Portfolios of Agile Projects: A Complex Adaptive Systems’ Agent Perspective.” Project Management Journal 49 (6): 18–38.

Thomas, Vinod. 2012. Managing for Development Results: Relevance, Responsiveness, and Results Orientation. Manila: Asian Development Bank.

UNSDG (United Nations Sustainable Development Group). 2011. Results-Based Management Handbook. New York: United Nations Development Group.

UNDP (United Nations Development Programme). 2000. “Results Based Management: Concepts and Methodology.” Technical Note 2000, UNDP, New York. http://web.undp.org/evaluation/documents/RBMConceptsMethodgyjuly2002.pdf.

UNFPA (United Nations Population Fund). 2019. Developmental Evaluation of Results-Based Management at UNFPA. New York: UNFPA. https://www.unfpa.org/admin-resource/developmental-evaluation-results-based-management.

UNICEF (United Nations Children’s Fund). 2017. Theory of Change Paper, UNICEF Strategic Plan, 2018–2021. Realizing the Rights of Every Child, Especially the Most Disadvantaged. New York: UNICEF. https://www.unicef.org/about/execboard/files/2017-EB11-Theory_of_Change-2017.07.19-EN.pdf.

UNICEF. 2018. UNICEF Strategic Plan 2018–2021: Executive Summary. New York: UNICEF. https://www.unicef.org/media/48126/file/UNICEF_Strategic_Plan_2018-2021-ENG.pdf.

USAID (United States Agency for International Development). 2018. Discussion Note: Adaptive Management. Washington, DC: USAID.

Vaessen, Jos, Sebastian Lemire, and Barbara Befani. 2020. Evaluation of International Development Interventions: An Overview of Approaches and Methods. Independent Evaluation Group. Washington, DC: World Bank.

Vähämäki, Janet, Martin Schmidt, and Joakim Molander. 2011. Results Based Management in Development Cooperation. Stockholm: Riksbankens Jubileumsfond. https://www.oecd.org/dac/peer-reviews/Vahamaki%202011%20RBM%20in%20dev%20cooperation.pdf.

Vähämäki, Janet, and Chantal Verger. 2019. Learning from Results-Based Management Evaluations and Reviews.” OECD Development Co-operation Working Paper 53, OECD, Paris. https://www.oecd-ilibrary.org/development/learning-from-results-based-management-evaluations-and-reviews_3fda0081-en.

World Bank. 2012a. Impact Evaluations: Relevance and Effectiveness. Independent Evaluation Group. Washington, DC: World Bank.

World Bank. 2012b. Nicaragua—Country Partnership Strategy for FY13–17. Washington, DC: World Bank.

World Bank. 2013a. Assessing the Monitoring and Evaluation Systems of IFC and MIGA: Biennial Report on Operations Evaluation. Independent Evaluation Group. Washington, DC: World Bank.

World Bank. 2013b. Results and Performance of the World Bank Group 2012. Independent Evaluation Group. Washington, DC: World Bank.

World Bank. 2014. World Bank Group Directive: Access to Information. OPCS 5.01-DIR.01. Issued and effective July 1, 2014. Operations Policy and Country Services. Washington, DC: World Bank.

World Bank. 2015a. “Albania—Country Partnership Strategy for FY11–14.” Completion and Learning Review, World Bank, Washington, DC.

World Bank. 2015b. “Arab Republic of Egypt—Country Partnership Strategy for FY06–14.” Completion and Learning Review, World Bank, Washington, DC.

World Bank. 2015c. Botswana—Country Partnership Framework for FY16–20. Washington, DC: World Bank.

World Bank. 2015d. “Honduras—Country Partnership Framework for FY11–15.” Completion and Learning Review, World Bank, Washington, DC.

World Bank. 2015e. Honduras—Country Partnership Framework for FY16–20. Washington, DC: World Bank.

World Bank. 2015f. Indonesia—Country Partnership Framework for FY16–20. Washington, DC: World Bank.

World Bank. 2015g. Learning and Results in World Bank Operations: Toward a New Learning Strategy: Evaluation 2. Independent Evaluation Group. Washington, DC: World Bank.

World Bank. 2015h. Results Frameworks in Country Strategies: Lessons from Evaluations. Independent Evaluation Group. Washington, DC: World Bank.

World Bank. 2015i. Serbia—Country Partnership Framework for FY16–20. Washington, DC: World Bank.

World Bank. 2015j. Serbia—Systematic Country Diagnostic. Washington, DC: World Bank.

World Bank. 2015k. World Development Report 2015: Mind, Society, and Behavior. Washington, DC: World Bank.

World Bank. 2016a. Behind the Mirror. A Report on the Self-Evaluation Systems of the World Bank Group. Independent Evaluation Group. Washington, DC: World Bank.

World Bank. 2016b. Bulgaria—Country Partnership Framework for FY17–22. Washington, DC: World Bank.

World Bank. 2016c. Program-for-Results: An Early-Stage Assessment of the Process and Effects of a New Lending Instrument. Independent Evaluation Group. Washington, DC: World Bank.

World Bank. 2016d. Results of the World Bank RAS Program in Romania, 2012–2015: Changing Institutions to Achieve Development Goals. Washington, DC: World Bank.

World Bank. 2016e. Sri Lanka–Country Partnership Framework for FY17–20. Washington, DC: World Bank.

World Bank. 2016f. “Sri Lanka—Country Partnership Strategy for FY13–16.” Completion and Learning Review, World Bank, Washington, DC.

World Bank. 2016g. World Bank Operations Evaluation Department: The First 30 Years. Operations Evaluation Department. Washington, DC: World Bank.

World Bank. 2017a. Data for Development: An Evaluation of World Bank Support for Data and Statistical Capacity. Independent Evaluation Group. Washington, DC: World Bank.

World Bank. 2017b. The International Finance Corporation’s Approach to Engaging Clients for Increased Development Impact. Independent Evaluation Group. Washington, DC: World Bank.

World Bank. 2017c. Nicaragua—Paving the Way to Faster Growth and Inclusion. Systematic Country Diagnostic. Washington, DC: World Bank.

World Bank. 2017d. Results and Performance of the World Bank Group 2016. Independent Evaluation Group. Washington, DC: World Bank.

World Bank. 2017e. World Bank Group Joint Projects: A Review of Two Decades of Experience. Lessons and Implications from Evaluation. Independent Evaluation Group. Washington, DC: World Bank.

World Bank. 2018a. Benin—Country Partnership Framework for FY19–FY23. Washington, DC: World Bank.

World Bank. 2018b. “Benin—Country Partnership Strategy for FY13–18.” Completion and Learning Review, World Bank, Washington, DC.

World Bank. 2018c. Enhancing Self-Evaluation in the World Bank Group toward Achieving Better Performance through Monitoring and Evaluation and Results Measurement: An IEG Retrospective Review. Independent Evaluation Group, Washington, DC: World Bank.

World Bank. 2018d. Nicaragua—Country Partnership Framework for FY18–22. World Bank: Washington, DC.

World Bank. 2018e. “Nicaragua—Country Partnership Strategy FY13–17.” Completion and Learning Review, World Bank, Washington, DC.

World Bank. 2018f. Results and Performance of the World Bank Group 2018. Independent Evaluation Group. Washington, DC: World Bank.

World Bank. 2018g. “Sustainable Financing for Sustainable Development: World Bank Group Capital Package Proposal.” Report to Governors at 2018 Spring Meetings. April 2018. Washington, DC: World Bank.

World Bank. 2018h. World Bank Group Guidance: Country Engagement Bank Access to Information. OPS5.01-GUID.106. Operations Policy and Country Services. Washington, DC: World Bank.

World Bank. 2018i. “World Bank/IMF Spring Meetings 2018: Development Committee Communiqué.” Press Release No. 2018/150/ECR. Washington, DC: World Bank. https://www.worldbank.org/en/news/press-release/2018/04/21/world-bankimf-spring-meetings-2018-development-committee-communique.

World Bank. 2019a. “Albania—Country Partnership Framework for FY15–19.” Completion and Learning Review, World Bank, Washington, DC.

World Bank. 2019b. “Arab Republic of Egypt—Country Partnership Framework for FY15–19.” Completion and Learning Review, World Bank, Washington, DC.

World Bank. 2019c. “Assurance Review of the Use of the Bank’s Corporate Scorecard.” GIA Report IBRD FY19–08. July 16, 2019. Washington, DC: World Bank.

World Bank. 2019d. Bank Directive: Program-for-Results Financing. OPS5.04-DIR.106. Issued June 20. Operations Policy and Country Services. Washington, DC: World Bank.

World Bank. 2019e. “Benin—Country Partnership Framework for FY13–18.” Completion and Learning Review, World Bank, Washington, DC.

World Bank. 2019f. CODE Retreat Summary: Prioritizing CODE’s FY19–21 Work Program. Independent Evaluation Group. Washington, DC: World Bank.

World Bank. 2019g. “Ethiopia—Co-Chairs’ Summary.” IDA19 Second Replenishment Meeting, Addis Ababa, Ethiopia. Kristalina Georgieva, Chief Executive Officer of the World Bank and Antoinette Sayeh, External IDA19 Replenishment Co-chair. June 18–20, 2019. Washington, DC: World Bank.

World Bank. 2019h. Including a Lens on Fragile, Conflict and Violent Situations in CPFs. Washington, DC: World Bank.

World Bank. 2019i. The IDA 19 Results Measurement System. Washington, DC: World Bank.

World Bank. 2019j. India—Assessing Results and How to Use Lessons Learned. Washington, DC: World Bank.

World Bank. 2019k. The Key Role of Results Frameworks in CPFs. Washington, DC: World Bank.

World Bank. 2019l. “A Look into the New World Bank Group and World Bank Corporate Scorecards.” Corporate Secretariat. Technical Briefing, Wednesday, July 31, 2019. Washington, DC: World Bank.

World Bank. 2019m. Morocco—Country Partnership Framework for FY19–24. Washington, DC: World Bank.

World Bank. 2019n. Preparing a CPF: Practical Advice to Make This a Successful Experience. Washington, DC: World Bank.

World Bank. 2019o. Program-for-Results: Proposal to Remove the Cap on Commitment Authority. Washington, DC: World Bank.

World Bank. 2019p. Results and Performance of the World Bank Group 2018. Independent Evaluation Group. Washington, DC: World Bank.

World Bank. 2019q. “Serbia—Country Partnership Framework for FY16–20.” Performance and Learning Review. World Bank, Washington, DC.

World Bank. 2019r. Theory behind Country Engagement Cycle: Country Engagement—Overview. Washington, DC: World Bank.

World Bank. 2019s. World Bank Group Joint Projects: A Review of Two Decades of Experience Lessons and Implications from Evaluation. Independent Evaluation Group. Washington, DC: World Bank.

World Bank. 2019t. World Bank Group Procedure: Country Engagement. Washington, DC: World Bank.

World Bank. 2019u. “World Bank Group Procedure: Country Engagement Bank Access to Information.” IBRD/IDA/IFC/MIGA Procedure. OPS5.01-PROC.105. Issued May 6, 2019. Washington, DC: World Bank.

World Bank. 2020a. “Honduras—Country Partnership Framework for FY16–20.” Completion and Learning Review, World Bank, Washington, DC.

World Bank. 2020b. Results and Performance of the World Bank Group 2020. Independent Evaluation Group. Washington, DC: World Bank.

World Bank. 2020c. “Serbia—Country Partnership Framework for FY16–20.” Completion and Learning Review, World Bank, Washington, DC.

World Bank. 2020d. “Sri Lanka–Country Partnership Framework for FY17–20.” Completion and Learning Review, World Bank, Washington, DC.

World Bank. 2020e. The World’s Bank: An Evaluation of the World Bank Group’s Global Convening. Independent Evaluation Group. Washington, DC: World Bank.

World Bank Group. n.d. Survey of Well-Being via Instant and Frequent Tracking and Iterative Beneficiary Monitoring. Washington, DC: World Bank Group. https://www.ifc.org/wps/wcm/connect/64f11adb-ab01-4207-93cd-dd2cc51af16c/SWIFT-booklet-05.pdf?MOD=AJPERES&CVID=m9Or9Ia.