Evidence and Innovation: dance, dance whatever you may be…

I am now two-thirds of the way through an IRISS project exploring the links between evidence and innovation in the context of Scotland’s social services.  Arguably, one of the most important parallels to have emerged so far is that both evidence and innovation are surrounded by voluminous, and at times contradictory, literatures.  In particular, diverse definitions and models have been developed to describe and explain these terms, and how they operate in organisational contexts.

In relation to evidence-based approaches, there is considerable debate surrounding two questions: How do policy-makers and social service practitioners use evidence, and what counts as ‘good’ evidence in this context?  In searching the extensive terrain of these debate we might start with Weiss’ (1979) influential seven-fold typology of evidence use, and trace its development into the three-fold model presented by Amara et al (2004) where research use is said to be either instrumental, conceptual or ideological.  In terms of gauging what counts as ‘good’ evidence, we might want to engage in on-going debates concerning the research design hierarchy in efficacy and evaluation research (see my previous blog post), or to broaden our remit and consider the value of practitioner and service-user experiences as important forms of evidence (Collins and Daly, 2011).

Likewise, our attempts to ‘pin down’ innovation may lead us in diverse and sometimes contradictory directions.  We might find the idea of an innovation spectrum a useful way to delineate radical from incremental innovation, or we might enjoy Kirby Ferguson’s refreshing view that ‘everything is a remix’.  We might want to focus on public sector orientated debates surrounding the many perceived barriers to innovative policy and practice in this context, (Burke, Morris & McGarrigle, 2012) or see what transferrable lessons we can learn from a range of other contexts and sectors including technology, music and international development (Ted, The Creative Spark Playlist, 2013).

Whichever route we choose to go down (and the above is just a taster of the possibilities available to us) what has become clear during the evidence and innovation project at IRISS is that how we define and conceptualise evidence and innovation influences the relationship(s) we perceive between them.  I will use one example as an illustration here.

In evidence-based approaches, evidence is sometimes viewed in an instrumental way.  This is where evidence is seen as the product of research and as a means to an end.  It is a piece of knowledge or information that is of direct practical use, telling us whether or not a policy or practice is capable of achieving a particular outcome (Amara et al, 2004, p. 76). This is the view of evidence which appears to underpin the ‘What Works’ agenda, viewed most recently in the discourse of the What Works Centres.  There are parallels with Weiss’ (1979) Knowledge-driven Model and Problem-solving Model (p. 427-8), where evidence is the “fruit” of research, from which “new policies emerge” (p. 426).

The appeal of this view of evidence is its apparent simplicity, rationality and pragmatism.  It implies that evidence is a bounded and useful entity, which can be directly used to guide decision-making.  Arguably, this fits with the move to create more accountable, transparent and rigorous public and social services throughout the UK since the 1980s (Munro, 2004). This model may better lend itself to the straightforward and transparent defensibility of decisions, enabling policy-makers and practitioners to claim  ‘the evidence told us this, so we did this’.  In the current context of scrutinised public spending, this may be a valued trait.

It is also perceived as a way to make social services, such as social work, more able to articulate what they do and more able to defend practice and decisions in the face of criticism.  There is a sense that, what would be required here would be a commitment to using those methods and practices that have been ‘proven’ to ‘work’, so that social workers can clearly articulate the logical and objective grounds for their decision making if something goes wrong.  However, some have suggested that, taken to its logical conclusion, this implies that there is one right way to do something, which could lead to the standardising of, or a “cookbook’ approach to, social work (Otto & Ziegler, 2008, p.  273; Forrester, 2010).

This is an interesting debate in itself, but what we are concerned with here is the impact of adopting this instrumental view of evidence when considering the relationship between evidence and innovation.  Theoretically, there may be a tension between the use of evidence as a means of standardising, accounting for, and defending social service practice, and the desire to boost innovation in this context.  These dual aims may sit together rather awkwardly given research that suggests that social service innovation is stifled in rigid, highly standardised and risk-averse contexts (Brown, 2010; Munro, 2011).  This may be particularly true if it is radical and transformative innovation that is being sought, as it is in the context of Scottish social service reform (The Scottish  Government, 2011).

So, when evidence is defined instrumentally, it may be in tension with innovation in a social service context.  In contrast, what happens if we adopt Weiss’ (1979) ‘enlightenment’ view of how evidence is used, which has been referred to elsewhere as the ‘conceptual’ use of research (Amara et al, 2004)?  What is being referred to here is the role evidence plays in influencing what is on the policy agenda and how it is framed, conceptualised and discussed.  Thus it is;

the concepts and theoretical perspectives that social science research has engendered that permeate the policy-making process… the imagery is that of social science generalizations and orientations percolating through informed publics and coming to shape the way in which people think about social issues (Weiss, 1979, p. 429).

So research and evidence can stimulate ideas and curiosity, which can lead to a reframing of the agenda and new ways of understanding the world, which, in turn, may suggest new ways of  “intervening and changing the world” (Nutley et al, 2003, p. 130; Gough, 2013, p. 163).  Adopting this conceptualisation of evidence-use may, theoretically, mean that evidence and innovation are mutually reinforcing agendas.  Both are about engaging with ongoing processes of reframing, rethinking and rearticulating as part of a wider process of change and reform.

The aim here has been to highlight the importance of spending time unraveling the definition, conceptualisation and usage of the key terms of this project, in order to develop a more nuanced understanding of the relationships between evidence and innovation.  It also reinforces the importance of considering one reform agenda (e.g. innovation) in the context of other, simultaneous reform agendas (e.g. evidence-based approaches).  As parallel reform discourses, evidence and innovation may be compared to dance partners*. They share a space and thus from time to time they will inevitably cross paths and step on one another’s toes. However, the particular dances they perform, and the extent to which they move as one or trip one another up, will, to some extent, be dictated by the ways they are discussed, defined, understood and operationalised by all those involved.

* Thanks to my colleague, Rhiann, for this helpful metaphor.

References:

Amara, N; Ouimet, M; Lndry, R (2004) New Evidence on Instrumental, Conceptual, and Symbolic Utilization of University Research in Government Agencies, Science Communication, 26:75, pp. 75-106.

Brown, L (2010) Balancing Risk and Innovation to Improve Social Work Practice, British Journal of Social Work, 40(4), pp. 1211-1228.

Burke, K; Morris, K; McGarrigle, L (2012) An Introductory Guide to Implementation, Dublin: Centre for Effective Services. http://www.effectiveservices.org/implementation/

Collins, E & Daly, E (2011) Decision making and social work in Scotland: The role of evidence and practice wisdom, Glasgow: IRISS.

Gough, D (2013) Theories, perspectives and research use, Evidence & Policy, 9:2, pp. 163-4.

Munro, E (2004) The impact of audit on social work practice, British Journal of Social Work, 34(8), pp. 1073-1095.

Munro, E (2011) The Munro Review of Child Protection: Final Report, London: Department for Education.

Nutley, S; Walter, I; Davies, H (2003) From Knowing to Doing, Evaluation, 9(2), pp. 125-148.

Otto, H & Ziegler, H (2008) The Notion of Causal Impact in Evidence-Based Social Work: An Introduction to the Special Issue on What Works? Research on Social Work Practice, 18:4, pp. 273-277.

Weiss, C (1979) The Many Meanings of Research Utilization, Public Administration Review, September/October, pp. 426-431.

 

 

 

 

4 thoughts on “Evidence and Innovation: dance, dance whatever you may be…”

  1. Hi Jodie, really enjoyed this post and the dance metaphor particularly. I think the grappling of the relationship between evidence and innovation is long overdue, indeed evidence-informed innovation surely is an ideal we can all subscribe to.

    I look forward to seeing the street dance of EIP as people realise the benefits of mixing creativity and evidence; there are so many barriers to evidence being used, and yet more to innovation being sustainable and scalable, merging them together seems like a fantastic idea.

    Keep dancing! G

    1. Hi George,

      Thanks for taking the time to comment, and for your expert twitter promotion of the blog, much appreciated! The dance metaphor was mentioned by one of my colleagues at Iriss and it really struck a cord with my own thinking around the project so I ran with it.

      I think it is a necessary and timely project, but I can perhaps see why other people may have been wary to begin it. It is pretty theoretical and complex (at least to begin with) and takes considerable untangling before it (hopefully) has some relevance for practitioners (which is, after all, the ultimate goal of Iriss projects).

      Let me know if you have any other thoughts,

      Best Wishes,

      Jodie

  2. I enjoyed your blog but I wouldn’t over-egg the gap between an instrumental vs enlightened view of evidence. You mention the ‘discourse’ around What Works and one approach is for us to be experimental in government and decision-making. I don’t mean just using experimental research techniques like RCTs, but experimental approaches to government and decision-making per se – test, learn, adapt (to borrow the Cabinet Office phrase) in an evidence ecosystem, and hopefully learning from things quickly, with minimal financial and political cost. For more, see here on the Future Directions for Scientific Advice in Whitehall and the chapter by Geoff Mulgan on ‘experts and experimental government’ http://www.alliance4usefulevidence.org/publication/future-directions-for-scientific-advice-in-whitehall/ or this on ‘experimentalist governance’: http://www2.law.columbia.edu/sabel/papers/Sabel%20and%20Zeitlin%20handbook%20chapter%20final%20(with%20abstract).pdf

    Is your project also looking at the innovation literature more widely – particularly social innovation? I couldn’t see any in your references. I agree that evidence and innovation can be ‘mutually reinforcing agendas’, both theoretically and in practice. From the point of view of innovators, they are also reliant on evidence to see that their social, tech or economic innovations are doing good. It’s not just about winging it, novelty for the sake of novelty, and fingers crossed! We want to see better outcomes for everybody. And evidence has to be at the heart of that – at every stage (if you allow me to be overly linear) of decision-making, from stimulating good ideas for policies, to scoping, scaling, implementing, decomissioning etc. Evidential approaches such as prototyping & experimenting, design-thinking, ethnography, behavioural research and insights are frequently intertwined with good innovation – as well as being part of the evidence landscape.

    I look forward to seeing how your project finishes! Get in touch if you want to discuss more.

    1. Dear Jonathan,

      Thank you for taking the time to respond, it is really helpful to get other views on the project.
      ‘What are the relationships between evidence and innovation’ seems to be a question capable of inspiring considerable debate. Our aim is to be able to convey some of this diversity of debates and definitions in the final report. With this in mind, I will certainly follow up the links you have posted and reflect on these in relation to the broader development of the project.

      In this post I was only able to represent a fraction of the overall scope of the project, but yes I am interested in social innovation too, and have been looking at a number of case studies around this.

      I may well take you up on the offer of further discussion once I have followed up these links,

      Best Wishes,

      Jodie

Comments are closed.