Gartner, a leading IT research company, recently published its annual “Hype Cycle for Emerging Technologies,” which plots the hype level of new technological innovations (spoiler alert: “big data” is just hitting the “peak of inflated expectations” and is headed to the “trough of disillusionment”!) In today’s world, new fads burst on the scene every fifteen minutes, the speed of life seems to accelerate in measure with ever greater development challenges from climate change to poverty eradication.
Will these fads come to the rescue when dealing with complex problems? Yes, we need to innovate, but no: we need to base those new solutions on past experience. We at the Independent Evaluation Group are fortunate to draw on several decades of experience and analysis on what works and what doesn’t, sifting through all the stories and data to identify relevant solutions that are grounded in the reality of demonstrated results. This blog is about how evaluation can be a transformational source of evidence to accelerate the impact and effectiveness of development work.
I have been a professional evaluator for more than 25 years in a variety of international development agencies. In those years, I have seen how good evaluation work can help generate critical insights to help development professionals tackle development challenges in a better way, as well as cases where weak evaluation has muddied the waters – more in a later blog.
One thing that has been essential to come up with difficult messages and new perspectives is independence, which gives us evaluators the invaluable opportunity to
- reflect whether and how things could have worked differently and better,
- add value by looking for patterns and making connections others might miss, and
- critically reflect on commonly held positions and seek evidence to stimulate the debate when paradigms need questioning.
The Luxury of Stepping Back. Time is ticking, deadlines are a constant, and many stakeholders have different demands and ideas; these are just few of the challenges in the daily life of development practitioners. As evaluators we enjoy an often undervalued luxury: of stepping back to take another look and exercise the wisdom of hindsight. So: that is about learning from the past, but doesn’t it keep us stuck right there, generates lessons we have long left behind, and is void of the most pressing new challenges? It all depends. Looking at a portfolio over a 10-year period – something we typically do in our larger evaluations – includes more recent work, not from a perspective of outcomes but how the program has developed. And, benchmarking older policies, programs or investments against newer standards helps understand what is needed to close the gap to the latest standards. We use the advantage of hindsight to look at the past through a different lens and wonder: could we have known this at the outset, and what if we had?
Unexpected Connections. Data descends upon us like an avalanche and more and more programs are available to present information in smart looking ways, often automatically processing massive amount of details and churning out an image to help us understand the information overload. Or not: as we know, infographics can be confusing and misleading, word clouds are great, but don't tell us the deeper meaning of data. This is the mainstay of evaluation: we collect data and information, analyze it and pull it together to make sense of it all. The most influential evaluations reveal patterns people are not aware of or draw connections others have not seen, sometimes bridging disciplines and ideas in uncommon ways. Again, it is in this type of evaluative thinking and analysis that generates insights that will help practitioners learn from the past for a radically different future.
Iconoclastic Is Good. Many development practitioners face the challenging tension of working within a bureaucracy that requires certain behaviors while innovating to find new solutions to intractable development challenges. This is where the second luxury of evaluation comes in: that of asking the difficult questions, seeking and accepting evidence also when it does not confirm long-held convictions. It is also one of its most fundamental challenges as it requires us evaluators to overrule traditional wisdoms and impartially look at evidence – accepting truths that might run contrary to shared understandings – and have the courage to defend uncommon and sometimes uncomfortable truths. But, in this day of uncertainty about so many aspects of life, it is a quality that will help build bridges from the past into the future where long-held beliefs might prove untenable.
I am excited to use these unique advantages to share ideas and stimulate discussions. No fads from us – just some straight shooting reflections on how the development community can promote evidenced based solutions to help our clients.