A new agenda has been set for 2030. It provides opportunities to grow the evaluation practice, and with it the profession. Professionalization needs to incentivize rather than stifle the growth of the profession. 

Are we ready, will we ever be?

The conversation about professionalization in evaluation has a long history, and often raises much concern and interest. Over the 25 years that I have spent working in evaluation, there have been moments when I thought "haven't we discussed enough?" but come to think of it: many other professions took hundreds of years to shape their professional standards. 

Generally, we don't even think twice whether professional standards should exist. From carpenters to doctors and lawyers, professions have established principles and standards that aim to guarantee clients a certain quality of services. Professional standards are designed to create trust in the profession. Professionalization - recognizing individual practitioners as fit to abide by these standards - is a means to establish the same trust in recognized practitioners.

As we discuss professionalization, it is important to keep these principles and intended outcomes in mind: high quality of services, trust in the profession and the practitioners, and subsequent use and impact of evaluations. Whatever mechanisms for professionalization we put in place, they need to deliver these outcomes: higher quality evaluations and greater consistency in quality across the profession as the first tier, sustained trust in the evaluation profession as the second, and demonstrated influence on better informed decision making as the third. 

Any investment in professionalization, whether in the form of accreditation, credentialing, and certification, or formal tertiary education, needs to yield these results. 

In a number of countries, tertiary education has taken off to integrate evaluation in its course work. More and more graduates have masters and PhDs in evaluation. This is an exciting development! It is growing a different cadre of evaluation professionals. Evaluation capacity development should support investments in tertiary education systems, especially in partner countries. In addition, efforts should be made to network faculties that teach development evaluation to arrive at a shared understanding of competencies and skills that evaluators need. This would strengthen the global evaluation profession and practice, which is particularly relevant for development practitioners who work across borders.

In addition, accreditation, credentialing and certification, have been developed in a number of countries and regions. This has happened in recognition that it would take some time before professional standards will evolve through tertiary education. One does not exclude the other and each of you can probably think of professions where they complement each other. It is a way to get to professionalization ahead of the more time-consuming route via tertiary education. But, questions have come up whether and which parts of accreditation, credentialing, and certification produce the desired results of professionalization, and at what costs.  

Whichever avenue professionalization takes, it is important that it is able to prepare evaluators for the future. A new agenda has been set for 2030. It provides opportunities to grow the evaluation practice, and with it the profession. Professionalization needs to incentivize rather than stifle the growth of the profession. 

The new development agenda - the Sustainable Development Goals (SDGs) - provide opportunities not just to hone evaluation methods and explore new techniques. They have underlying implications for the professionalization of evaluation. Let me expand with a few examples that I find most interesting but also most challenging. 

Complexity. Evaluation has been intertwined with linear models like theory of change, logical frameworks, and the like. These tools were designed for clarity about how an intervention achieves its results. In that they simplified reality, albeit with provisions for risks and assumptions that could capture uncertainty, unintended effects, etc. Unfortunately, as many of us know these tools have not worked well, and least of all this part that deals with the complexity of real development situations. Going forward, complexity is part of our life, and mindsets and methods of evaluators will need to match that reality. For professionalization it means we need to codify professional standards that correspond to complexity rather than linear models.  

Values. Development and evaluation often contain intrinsic values. The SDGs suggest a more inclusive world that "leaves no-one behind" and promises greater equality. They also recognize that these goals need even greater partnership, and partners mean that different perspectives are at work. The question, therefore, must be asked whether inclusion or equality is defined as one development model based on one value system, or does inclusive development mean greater diversity. One way or another, as evaluators we need to hone our mindsets and tools for this challenge, whether it is to evaluate the effects of underlying values on outcomes and performance, or on our yardstick for assessing results. What does that have to do with professionalization? Professional standards may be defined rigidly and rooted in one set of values, or as competencies to recognize diverse values and understand how they affect evaluation design, conduct and results. 

Private sector and partnerships. In addition to the diversity of values and perspectives, working in partnership requires defining what success looks like. New frontiers that are evolving in the private sector to increase their social and environmental footprint, whether from big companies and institutional investors to more personalized impact investors. These partners bring new methods, technology, and language to the table. The opportunities for growing the profession are incredible, especially when it comes to technology that can help us become nimbler and more efficient in pulling together evidence. But, the ever growing "tent" of evaluation practitioners will probably make it even harder to agree on commonly agreed professional standards. Professionalization entails defining who is included in the profession and who is not. But, these boundaries need to be dynamic to absorb new developments to keep the profession at the cutting edge.

Tensions and trade-offs. All three of these challenges encapsulate tensions and trade-offs. In some instances, professional standards find easy solutions. In others, professionalization of evaluation will require making "holding of tensions" and assessing trade-offs as part of professional competences that evaluators need to demonstrate. 

Making a difference. Finally, evaluation practitioners are increasingly called upon to demonstrate what difference we make. As a profession, we have a long history that involves the use of evaluation and follow-up systems. The next frontier lies in understanding the kinds of behaviors evaluation incentivizes. These are institution-specific and need to define how self- and independent evaluation systems are set up. In terms of professionalization, defining professional standards that promote these skills and behaviors will be essential to our long-term success. 

Comments

Submitted by Nasir Ali on Sat, 10/31/2015 - 05:58

Permalink
Dear Caroline Heider very interesting contents of the article which articulate the new challenges of evaluation professionalism. Can you please suggest any resources/material to achieve such professional traits in terms of evaluation. The problem is that yes we know the challenges but how to cope with them is also a challenge.

Submitted by Caroline Heider on Sun, 11/22/2015 - 21:10

In reply to by Nasir Ali

Permalink
Nasir, there isn't one source that I could recommend. On complexity, Michael Bamberger et al are publishing a book shortly, which I am looking forward to. Some of the others challenges in this blog are recent and answers will have to evolve.

Submitted by Lawal Zakari on Fri, 10/30/2015 - 23:48

Permalink
An excellent initiative. Professionalization of evaluation the best way to drive development, to know what works and what does not for common humanity.

Submitted by Caroline Heider on Sun, 11/22/2015 - 21:11

In reply to by Lawal Zakari

Permalink
Thank you, Lawal for the endorsement.

Submitted by Ann Larson on Sat, 10/31/2015 - 04:37

Permalink
Just a quick Sunday morning thought. Given the incredible variety in the tasks and projects that evaluators take on, doesn't professional standards for the peice of work make more sense than the professional standards of individual evaluators?

Submitted by Caroline Heider on Sun, 11/22/2015 - 21:16

In reply to by Ann Larson

Permalink
Ann, you are right in that when evaluating projects sector and country contexts need to be taken into account, as much as a number of other factors to conclude on performance and results. Still, professional standards for evaluators sets out competencies and behaviors that evaluators should show doing their job, which is also important to ensure high and consistent quality. For instance, if you order a kitchen cabinet, the carpenter will adjust it to your taste and the layout of your kitchen, but you still would want the structural quality, joinery work and finishing to be of high quality regardless.

Submitted by Anonymous on Mon, 11/02/2015 - 06:27

Permalink
Much needed task. I believe Professionalism Is to promote and sustain the concept, practice and usefulness of evaluations to support the achievement of optimal performance and results across all sectors. Upcoming SDG evaluation needs all above with suitable mechanism. If we have not thought of lets starts now.

Submitted by isha wedasingh… on Mon, 11/02/2015 - 06:35

Permalink
Dear Caroline Do we have a Evaluation mechanism for SDG? Professionalism is key to a usefulness of evaluation to support the achievement of optimal performance and result across all sectors.

Submitted by Judita Jankovic on Sun, 11/01/2015 - 22:21

Permalink
Excellent article that I believe makes some very pertinent key points and clarifications on the intended outcomes of professionalization and on the developments and opportunities of the evaluation profession. It is also a reminder that inherently evaluation standards are value laden and we as humans and evaluators inevitably have our own biases that are shaped by our own value systems and experiences. Making a difference is also an issue that requires reflection and "understanding the kinds of behaviors evaluation incentivizes" is key to it. It would indeed be fascinating to gain insight into the behaviours that evaluation catalyzes at the individual, organizational and national levels.

Submitted by bashemi phillime on Wed, 11/04/2015 - 07:32

Permalink
I have attended IPDET for 2014 and 2015 and during the period i attended the workshop on Gender equality and evaluation. it was intresting and when i came back to Botswana i wrote a paper on Gender equality and urban planning, i am a town planner by profession from Botswana. I hope to send to you and advise me further.

Submitted by kumudu on Wed, 11/04/2015 - 04:10

Permalink
A good article addressing all issues, it is very important to do professionalization , which make evaluators accountable just like doctors etc,.. there will be a control of poor evaluations , unethical and Mal-practice , which some times happens

Submitted by Anonymous on Wed, 11/04/2015 - 05:43

Permalink
Buenos dias, me encanto la decision de este foro. sobre todo porque en la academia se discute la profesionalizacion de la docencia del curriculo de la planificación estratégica . pero muy pocas veces se discute la profesionalizacion de la evaluación de programas de proyectos, de instituciones entre otras. espero participar en los programas que tanta falta hace. saludos. prof. Arturo Rivera A.

Submitted by Jamie Hayes on Mon, 11/09/2015 - 23:43

In reply to by Anonymous

Permalink
(Translation) Good morning, I love the decision of this forum, especially because in academia the concept of “professionalization” of teaching of the curriculum of strategic planning is discussed. But very few times this professionalization is discussed with respect to the evaluation of programs and projects, of institutions among others. I hope to participate in the programs that we are in such need for. Regards, Professor Arturo Rivera A.

Submitted by Cristiane Camboim on Thu, 11/05/2015 - 03:12

Permalink
Caroline, sua fala é muito interessante, uma vez que cita pontos extremamente importantes no que se refere à própria qualificação do profissional da avaliação e monitoramento. Além disso, reforça essa prática enquanto mecanismo de implementação de melhorias em processos mais complexos. Aliás, como você mesma afirma: " Daqui para frente, a complexidade é parte da nossa vida, e mentalidades e métodos de avaliadores terão de corresponder à realidade".

Submitted by Jamie Hayes on Mon, 11/09/2015 - 23:44

In reply to by Cristiane Camboim

Permalink
(Translation) Caroline, your speech is very interesting, as you bring up very important points in regards to appropriate qualifications of monitoring and evaluation professionals. At the same time, it reinforces this practice as an implementation mechanism of improvements in the most complex processes. As you yourself reiterate: “going forward, complexity is part of life, and mindsets and methods of evaluation will have to adjust to reality.”

Add new comment