Robust, dispassionate, scientific
These are not words typically associated with creative methods of evaluation… tools that allow people to contribute to evaluation in an active manner using participatory, visual or creative verbal means. Why then am I writing a blog encouraging the use of these tools? Why am I not leaving the relationship map, evaluation wheel and video diary far behind me?
I am an advocate of creative evaluation because one size never fits all. As evaluators we have to consider the abilities and needs of the people whose experience or service we want to evaluate, the environment that we are working in and what we really want to know. How can we really capture people’s views, particularly if they are very young, have communication difficulties or come from a ‘seldom heard’ group? How can we ensure that we are ‘working with’ rather than ‘doing to’ the groups with whom our evaluations are concerned? Is a validated questionnaire delivered by an independent party, or another ‘traditional’ approach the best or only method? Which methods are really going to tell us something meaningful and useful about the difference we are making?
If the goal is to gather a large amount of anonymous information then a questionnaire is the best tool for that job. If we need to explore personal issues in a controlled 1-2-1 setting then an interview is the appropriate method. If we want to make discoveries about people’s journeys, if we want to understand the contribution of our work to our desired outcomes, if we want to tell our combined story for our peers, our funders and the policy makers then creative evaluation has a part to play.
Creative tools can give you meaningful data if they are clearly linked to your outcomes. Consistent use of these tools will allow people supported by services to reflect on their experience in a way that is comfortable and accessible for them. Molly Engle of Oregon State University develops this point in her blog, Evaluation is an everyday activity. If your work is process focussed in nature then your evaluation should be also. If your work is exploratory and unpredictable… (and fun?) then your evaluation should be also.
This blog post was contributed by Tom Scott, Evaluation Support Scotland
Tom is the Training Officer for Evaluation Support Scotland (ESS), a charity that works with voluntary organisations and funders so that they can evaluate what they do, learn from that evaluation and deliver better services. You can find many examples of creative evaluation tools and other supportive resources such as guides and templates on the ESS website. ESS is partnering with IRISS on Evaluation Exchange.
Enjoyed the post Tom. I wonder though if creative evaluation is good in itself or is it rather that our evaluation activities should ensure that people can engage and contribute – which involves thought, reflection and creativity. If people explore all kinds of creative evaluation approaches but this activity is divorced from trying to ensure all the relevant people with an interest in the topic can contribute then is that useful? Perhaps only if they reflect on what they’re up to?
All the best
Claire