Astbury, B., and F. L. Leeuw. 2010. “Unpacking Black Boxes: Mechanisms and Theory Building in Evaluation.” American Journal of Evaluation 31 (3): 363–81.

Bamberger, M., J. Rugh, and L. Mabry. 2011. Real World Evaluation: Working under Budget, Time, Data, and Political Constraints. 2nd ed. Thousand Oaks, CA: Sage Publications.

Bamberger, M., J. Rugh, M. Church, and L. Fort. 2004. “Shoestring Evaluation: Designing Impact Evaluations under Budget, Time and Data Constraints.” American Journal of Evaluation 25 (1): 5–37.

Bunge, M. 1997. Philosophy of Science: From Problem to Theory. New Brunswick: Transaction Publishers.

Campbell, Donald T., and Julian C. Stanley. 1963. Experimental and Quasi-Experimental Designs for Research. Ravenio Books.

Coleman, J. 1990. Foundations of Social Theory. New York: Belknap Press.

Cook, T. D., and D. T. Campbell. 1979. Quasi-Experimentation: Design and Analysis for Field Settings. Chicago: Rand McNally.

Dfid (Department for International Development). 2012. Broadening the Range of Designs and Methods for Impact Evaluations. Report of a study commissioned by the Dfid, UK, Working Paper 38.

Eig, L. 2014. Innovations and New Technology. What Is the Role of Research? Implications for Public Policy. VINNOVA—Swedish Governmental Agency for Innovation Systems.

Epstein, Lee, and Andrew D. Martin. 2014. An Introduction to Empirical Legal Research. Oxford University Press.

ECG (Evaluation Cooperation Group). 2012. Big Book on Evaluation Good Practice Standards. ECG.

Farrington, D. 2003. “Methodological Quality Standards for Evaluation Research.” The Annals of the American Academy of Political and Social Science 587: 49–68.

Fitzpatrick, J., Blaine R. Worthen, and James R. Sanders. 2004. Program Evaluation: Alternative Approaches and Practical Guidelines. Boston: Pearson/Allyn & Bacon.

Gorard, S. 2010. “Research Design, as Independent of Methods.” In Sage Handbook of Mixed Methods, edited by C. Teddlie and A. Tashakkori, 237–252. Thousand Oaks, CA: Sage Publications.

Hedges, L. V. 2017. “Design of Empirical Research.” In Research Methods and Methodologies in Education, edited by R. Coe, M. Waring, L. V. Hedges, and J. Arthur. Thousand Oaks, CA: Sage Publications.

Hedström, Peter, and Petri Ylikoski. 2010. “Causal Mechanisms in the Social Sciences.” Annual Review of Sociology 36.

Janesick, V. J. 1998. “The Dance of Qualitative Research Design: Metaphor, Methodolatry, and Meaning.” In Strategies of Qualitative Inquiry, edited by N. K. Denzin and Y. S. Lincoln, 35–55. Thousand Oaks, CA: Sage Publications.

Jewitt, Carey, Anna Xambo, and Sara Price. 2017. “Exploring Methodological Innovation in the Social Sciences: The Body in Digital Environments and the Arts.” International Journal of Social Research Methodology 20 (1): 105–20.

Kane, E. 1984. Doing Your Own Research: Basic Descriptive Research in the Social Sciences and Humanities. London: Marion Boyars.

Lee, Kelley, and David Fidler. 2007. “Avian and Pandemic Influenza: Progress and Problems with Global Health Governance.” Global Public Health 2 (3): 215–34.

Leeuw, F., and H. Schmeets. 2016. “Chapter 3: Research Problems.” Empirical Legal Research, A Guidance Book for Lawyers, Legislators and Regulators. Amsterdam: EE Publishers.

Lemire, S., A. Kwako, S. B. Nielsen, C. A. Christie, S. L. Donaldson, and F. L. Leeuw. 2020. “What Is This Thing Called a Mechanism? Findings from a Review of Realist Evaluations.” In J. Schmitt (Ed.), Causal Mechanisms in Program Evaluation. New Directions for Evaluation 167: 73–86.

Lund, Thorleif. 2020. “A Revision of the Campbellian Validity System.” Scandinavian Journal of Educational Research. 1–13.

Network of Networks for Impact Evaluation (NONIE). 2009. Impact Evaluations and Development. NONIE Guidance on Impact Evaluation. Washington, DC: NONIE.

Orata, P. 1940. “Evaluating Evaluation.” The Journal of Educational Research 33 (9): 641–66.

Organization for Economic Co-operation and Development—Development Assistance Committee (OECD-DAC). 2010. Development Evaluation Resources and Systems. Paris, France: OECD-DAC.

Ostrom, E. (2010). “Beyond Markets and States: Polycentric Governance of Complex Economic Systems.” American Economic Review 100: 641–72.

Pawson, R. 2013. The Science of Evaluation: A Realist Manifesto. Thousand Oaks, CA: Sage Publications.

Ragin, C. 2014. The Comparative Method: Moving Beyond Qualitative and Quantitative Strategies. Berkeley, CA: University of California Press.

Raub W., et al. 2012. “Micro-Macro Links and Microfoundations in Sociology.” The Journal of Mathematical Sociology 35: 1–25.

Scriven, M. 2015. The Meta-Evaluation Checklist. Claremont, CA: Claremont Evaluation Center.

Shadish, William R. 2002. “Revisiting Field Experimentation: Field Notes for the Future.” Psychological Methods 7 (1): 3.

Strauss, M., and G. T. Smith. 2009. “Construct Validity: Advances in Theory and Methodology.” Annual Review of Clinical Psychology 5 (1): 1–25.

Ultee, W. 2001. “Problem Selection in the Social Sciences: Methodology.” In International Encyclopedia of the Social and Behavioral Sciences, edited by N. Smelser and P. Baltes Amsterdam: Elsevier. 18: 12110–17.

United Nations Evaluation Group. 2016. Norms and Standards for Evaluation. New York: UNEG.

Vaessen, J. 2018. “Five Ways to Think About Quality in Evaluation.” (blog), December 11, 2018. https://ieg.worldbankgrou p.org/blog/five-ways-think-about-quality-evaluation.

Van Thiel, Sandra. 2014. Research Methods in Public Administration and Public Management: An Introduction. Routledge.

Vaus, D. de. 2001. Research Design in Social Research. London: Sage Publications.

White, H., and H. Waddington. 2012. “Why Do We Care about Evidence Synthesis? An Introduction to the Special Issue on Systematic Reviews.” Journal of Development Effectiveness 4 (3): 351–58.

White, P. 2010. Developing Research Questions: A Guide for Social Scientists. Houndmills, UK: Palgrave Macmillan.

White, P. 2013. “Who’s Afraid of Research Questions? The Neglect of Research Questions in the Methods Literature and a Call for Question-Led Methods Teaching.” International Journal of Research & Method in Education 36 (3): 213–27.

World Bank. 2014. World Development Report 2015: Mind, Society, and Behavior. Washington, DC: World Bank.

World Bank. 2015a. Financial Inclusion: A Foothold on the Ladder toward Prosperity? An Evaluation of World Bank Group Support for Financial Inclusion for Low-Income Households and Microenterprises. Independent Evaluation Group. Washington, DC: World Bank.

World Bank. 2015b. Learning and Results in World Bank Operations: How the Bank Learns. Independent Evaluation Group. Washington, DC: World Bank.

World Bank. 2015c. The Poverty Focus of Country Programs: Lessons from World Bank Experience. Independent Evaluation Group. Washington, DC: World Bank.

World Bank. 2015d. World Bank Group Support to Electricity Access, FY2000–2014. Independent Evaluation Group. Washington, DC: World Bank.

World Bank. 2015e. World Bank Support to Early Childhood Development. Independent Evaluation Group. Washington, DC: World Bank.

World Bank. 2016a. Behind the Mirror: A Report on the Self-Evaluation Systems of the World Bank Group. Independent Evaluation Group. Washington, DC: World Bank.

World Bank. 2016b. Industry Competitiveness and Jobs: An Evaluation of World Bank Group Industry-Specific Support to Promote Industry Competitiveness and Its Implications for Jobs. Independent Evaluation Group. Washington, DC: World Bank.

World Bank. 2016c. Program-for-Results: An Early-Stage Assessment of the Process and Effects of a New Lending Instrument. Independent Evaluation Group. Washington, DC: World Bank.

World Bank. 2016d. The World Bank Group’s Support to Capital Market Development. Independent Evaluation Group. Washington, DC: World Bank.

World Bank. 2017a. A Thirst for Change: The World Bank Group’s Support for Water Supply and Sanitation, with Focus on the Poor. Independent Evaluation Group. Washington, DC: World Bank.

World Bank. 2017b. Data for Development: An Evaluation of World Bank Support for Data and Statistical Capacity. Independent Evaluation Group. Washington, DC: World Bank.

World Bank. 2017c. Growing the Rural Nonfarm Economy to Alleviate Poverty: An Evaluation of the Contribution of the World Bank Group. Independent Evaluation Group. Washington, DC: World Bank.

World Bank. 2017d. Higher Education for Development: An Evaluation of the World Bank Group’s Support. Independent Evaluation Group. Washington, DC: World Bank.

World Bank. 2017e. Mobile Metropolises: Urban Transport Matters: An IEG Evaluation of the World Bank Group’s Support for Urban Transport. Independent Evaluation Group. Washington, DC: World Bank.

World Bank. 2017f. Toward a Clean World for All: An IEG Evaluation of the World Bank Group’s Support to Pollution Management. Independent Evaluation Group. Washington, DC: World Bank.

World Bank. 2017g. World Bank Group Country Engagement: An Early-Stage Assessment of the Systematic Country Diagnostic and Country Partnership Framework Process and Implementation. Independent Evaluation Group. Washington, DC: World Bank.

World Bank. 2018a. Carbon Markets for Greenhouse Gas Emission Reduction in a Warming World. Independent Evaluation Group. Washington, DC: World Bank.

World Bank. 2018b. Conducting a Structured Literature Review in the Framework of IEG (Major) Evaluations. Independent Evaluation Group. Washington, DC: World Bank.

World Bank. 2018c. Engaging Citizens for Better Development. Independent Evaluation Group, Washington, DC: World Bank.

World Bank. 2018d. Growth for the Bottom 40 Percent: The World Bank Group’s Support for Shared Prosperity. Independent Evaluation Group. Washington, DC: World Bank.

World Bank. 2018e. Mexico Country Program Evaluation: An Evaluation of the World Bank Group’s Support to Mexico (2008–17). Independent Evaluation Group. Washington, DC: World Bank.

World Bank. 2018f. The International Finance Corporation’s Approach to Engaging Clients for Increased Development Impact. Independent Evaluation Group. Washington, DC: World Bank.

World Bank. 2018g. World Bank Group Support to Health Services: Achievements and Challenges. Independent Evaluation Group. Washington, DC: World Bank.

World Bank. 2019a. ‘Creating Markets’ to Leverage the Private Sector for Sustainable Development and Growth: An evaluation of the World Bank Group’s Experience Through 16 case studies. Independent Evaluation Group. Washington, DC: World Bank.

World Bank. 2019b. Building Urban Resilience: An Evaluation of the World Bank Group’s Evolving Experience (2007–17). Independent Evaluation Group. Washington, DC: World Bank.

World Bank. 2019c. Grow with the Flow: An Independent Evaluation of the World Bank Group’s Support to Facilitating Trade 2006–17. Independent Evaluation Group. Washington, DC: World Bank.

World Bank. 2019d. Knowledge Flow and Collaboration under the World Bank’s New Operating Model. Independent Evaluation Group. Washington, DC: World Bank.

World Bank. 2019e. Two to Tango: An Evaluation of World Bank Group Support to Fostering Regional Integration. Independent Evaluation Group. Washington, DC: World Bank.

World Bank. 2019f. World Bank Group Support in Situations Involving Conflict-Induced Displacement. Independent Evaluation Group. Washington, DC: World Bank.

World Bank. 2020a. Evaluation of the World Bank’s Support to Improving Child Undernutrition and Its Determinants. Approach Paper. Independent Evaluation Group. Washington, DC: World Bank.

World Bank. 2020b. Results and Performance of the World Bank Group 2020. Washington, DC: World Bank.

World Bank. 2020c. The World’s Bank: An Evaluation of the World Bank Group’s Global Convening. Independent Evaluation Group. Washington, DC: World Bank.

World Bank, forthcoming. “Advanced Content Analysis: Can Artificial Intelligence Accelerate Theory-Driven Complex Program Evaluation?” IEG Methods and Evaluation Capacity Development Working Paper Series, World Bank, Washington, DC.

World Bank Group. 2019. World Bank Group Evaluation Principles. Washington, DC: World Bank Group.

Yeager, S. J. 2008. “Where Do Research Questions Come from and How Are They Developed?” In Handbook of Research Methods in Public Administration, 45–60. New York: Taylor & Francis Group.