Fifteen years ago, the global community came together and, in the form of the Millennium Development Goals, made some big commitments to fight poverty, setting a target date of 2015 for their completion.  Now, 15 years later, we are seeing celebrations of success, recognition of shortfalls, and renewed efforts to galvanize global commitments around the shared goals of eradicating extreme poverty and boosting shared prosperity. It is, in short, the pursuit of a more equitable society.

During this period, evaluation as a profession has also developed enormously. Thinking back 25 years to when I first started as an evaluator, I’m struck by the changes that have occurred.

Evaluation used to be donor driven. Today partner countries around the world have a much greater interest in evaluation, whether within their countries or in the boards of multilateral organizations. New methods have been developed, tested and battled over. Hopefully, we have come to a point of agreement that we need all evaluation methods and more in our toolkit. And, yes, within each of our contexts we have our own stories of success where an evaluation of ours influenced change and made a difference.

But what contribution have we made in helping to achieve the MDGs? Did evaluation evidence help accelerate success and stop mistakes from being repeated? Hard to tell.

Looking ahead, what will the next 15 years bring?

The world faces complex challenges, each by itself daunting, together deeply troubling:

  • Technology is a two-edged sword: on one hand providing incredible opportunities, but on the other diminishing the types of jobs that have in the past contributed to reducing poverty,
  • Systemic inequality is affecting  social cohesion and forcing us to rethink our development models, and
  • Climate change and the erosion of natural resources threaten progress made thus far.

Under these circumstances, realizing the ambition of an equitable society will be extremely challenging.  

Will we, as evaluators, be able to say more about our contributions to achieving the sustainable development goals by 2030? What will the world of evaluation look like in the future?

First, partner countries will be doing more evaluations themselves. They will move from evaluating aid programs to taking a more holistic view of development, looking at domestic resources, investments, transfers, trade, and aid moneys together. This will enhance ownership and allow for an examination of how all of these flows interact, contribute to progress or reverse trends. Our challenge as a global evaluation community is twofold: we need mechanisms that will safeguard the independence of evaluation systems and we need to agree on standards that will result in professionalization. Second, the complexity of the challenges and the solutions development partners are looking for mean we have to constantly sharpen and update our evaluation methods. Our work needs to contribute to a better understanding of the distribution effects of interventions and respond to shifts that are taking place in the development context, in particular:

  • From linear logframes to complex interdependent systems where evaluating multiplier and bounce-back effects will be needed;
  • From single sector projects to multi-sector, multi-instrument engagements where evaluating synergies will be essential;
  • From project, country, and regional perspectives to one of country groups that share development challenges and can share lessons from their experience, including from independent evaluation.

Third, we will have to swallow a bit of our own medicine and plan for the influence we want to have by setting ourselves clear objectives. How can we best bring our evaluation evidence to bear and who do we want to influence with it? A results framework for evaluation is a necessary next step to becoming more strategic – not just with one evaluation, but with the function of evaluation more broadly. We must be willing to hold ourselves to the standards to which we hold others so that when we look back 15 years from now, we will be able to identify how we contributed to development efforts becoming more effective. 

 


Pictured above: Young women at a vocational education and training center. Vocational education and training center; National Initiative for Human Development Support Project (INDH). Photo: Dana Smillie / World Bank

Comments

Submitted by Kassem on Wed, 10/08/2014 - 08:01

Permalink
Given the pitfalls of the MDGs, it is crucial that the post 2015 development agenda (SDGs) cater for an objective around data capabilities/ monitoring and hence evaluation. Though the proposed SDG list has it, but there are voices and reports issued around the "bad ROI" of the objective 17! (refer to the Copenhagen Consensus report. I am skeptical that that obj 17 be sacrificed given the 169 objectives. Our role is then to ensure such element is on the port 2015 development agenda dashboard. Data is one of key enablers of the development map post 2015, and evaluation is the compass. I would therefore call for more lobbying with decision makers and HLP among others to stress on the need to have a dedicated objectives for data/ monitoring & transparency on one hand; and to vote for the declaring 2015 the international year of evaluation. Both are key pillars in taking "evaluation" forward as a discipline (hence working on the professionalization and standardization -if needed).

Submitted by Caroline Heider on Wed, 10/08/2014 - 02:14

In reply to by Kassem

Permalink
Kassem, interesting idea, but I am a bit torn about it: each of the goals and targets should be measurable and corresponding systems to monitor and evaluate should be set up. Looking at the Global Monitoring Report of MDG implementation and the increased awareness and commitment to measuring progress, I think we will see better data collection, at least initially. In addition, the number of SDGs is already so large that the international community will probably negotiate to prioritize them and bring the number of goals down rather than adding another one. Should we worry about it? Rather the contrary: as evaluators we should keep reminding everyone about the commitments made, evaluate results and progress, and "keep the fire" up to ensure the goals are not forgotten.

Submitted by M.I.Zuberi on Tue, 12/09/2014 - 21:34

Permalink
Thanks...without entering into the complicated issues regarding theories, mechanisms and monitoring/evaluation...I would like to note that in all strata of the system..these goals and their implementation actions were more restricted to the 'upper levels'..within countries and international...failed to reach to the levels of the real - primary stakeholders - eg the poor or the biodiversity or.... May be in the SDG era some more trickling down will occur...but will that be enough ? With time passing the Goals are becoming more distant to achieve. I observe this from my experience in Ethiopia and Bangladesh...doing not bad in MDG era.

Submitted by Caroline Heider on Tue, 12/09/2014 - 20:02

In reply to by M.I.Zuberi

Permalink
The track record on the MDGs is actually rather good, at least for some of them, even though it is a few countries that really make a difference. What I am hoping is that the interventions have broad-based inclusive growth effects rather than hoping for trickle down that does not guarantee poverty reduction effects. We are increasingly addressing this question in our evaluations and identify what are the factors that explain success and failure. The evidence should help shape the future.

Add new comment