{"id":261,"date":"2013-10-18T16:49:11","date_gmt":"2013-10-18T15:49:11","guid":{"rendered":"http:\/\/blogs.iriss.org.uk\/innovate\/?p=261"},"modified":"2013-10-18T16:49:11","modified_gmt":"2013-10-18T15:49:11","slug":"valuing-and-improving-the-value-of-case-studies","status":"publish","type":"post","link":"https:\/\/blogs.iriss.org.uk\/innovate\/2013\/10\/18\/valuing-and-improving-the-value-of-case-studies\/","title":{"rendered":"Valuing, and Improving the Value of, Case Studies"},"content":{"rendered":"
Case studies written by individuals and organisations trying out innovations can be valuable learning tools.\u00a0 The trouble is they are not always produced, valued, or produced in a way that maximises their value.\u00a0 In hierarchies of evidence, case studies can often find themselves towards the bottom (Johnson & Austin, 2005; Nutley, Powell & Davies, 2012). \u00a0One of the reasons for this is the perception that case studies generate a lot of complex, situated data which does not necessarily provide definitive answers beyond the immediate context of discussion.\u00a0 This may not be popular in a Government, policy-making and practice era that favours unequivocal evidence to inform decisive decision-making.<\/a><\/p>\n And yet, in the world of social service innovation, where risk is a core concern (Mulgan, 2007; Brown, 2010), case studies are a way of building a more detailed understanding of the innovation process and of the context(s) of interest.\u00a0 This may be particularly useful if the innovation is later scaled, mediating some of the risks of perverse outcomes when the programme is introduced to a new context.<\/p>\n My experience of researching the relationships between evidence and innovation has further highlighted the value of case studies.\u00a0 I have found good case studies to be a vital source of learning on this topic.\u00a0 But \u2018good\u2019 is the operative word here.\u00a0 I have also experienced some shortcomings in the case studies I have encountered.\u00a0 So my aim here is to use examples from the IRISS project to explore some of the things we might need from case studies, and how we might encourage practitioners and organisations to do more of these things.<\/p>\n In order to illustrate what I have found useful in a case study I will refer to one example.\u00a0 Participle\u2019s Interim Report on The Life Programme<\/a> documents the implementation of an innovative approach to working with troubled families in Swindon, and later in Wigan, Lewisham and Colchester.\u00a0 This case study enabled useful learning because it was comfortable with acknowledging the initial shortcomings of the programme, and the glitches that occurred during implementation and scaling.\u00a0 For instance Participle note that, to begin with, their programme did not pay sufficient attention to young children\u2019s experiences within the family, which may have posed risks for child protection.\u00a0 They also documented the complexities they uncovered when it came to scaling-up The Life Programme, which stemmed from inadequate knowledge of the contexts of transfer (p. 22). In both cases Participle discuss how these problems were resolved, and in both cases this included the gathering of further evidence.<\/p>\n Given the remit of the IRISS project exploring the links between evidence and innovation, this provided important practice examples of what the innovation process is like, and how evidence is implicated in this.\u00a0 However, the documenting and sharing of innovations can have much broader benefits than this.\u00a0 There is evidence that one of the barriers to innovation and evidence-informed practice is a lack of applicable examples of these in use in a social service context (IRISS, 2010, p. 3-4).\u00a0 The Participle example contains important learning about the complexities of the innovation process; a process which is so often depicted as necessary, rational and straightforward in Government discourse.\u00a0 It provides practitioners with an alternative to this, at times, rose-tinted view.\u00a0 They could follow the innovation journey of other organisations and use this to reflect on their own decisions and processes.<\/p>\n However, case studies that document the innovation process do not always exist, and where they do they are not always presented in a way that enables the maximum amount of learning. \u00a0Organisations can show a reluctance to describe the innovation process in all of its complexity, which would mean drawing out the difficulties that arise along the way. \u00a0The Participle case study was, arguably, a rare find in this regard. \u00a0 This was the only social service specific case study that I found to have significant engagement with the difficulties of the innovation process. \u00a0Yet, even here there were other shortcomings. \u00a0This, and other cases studies, offered very little detail about evidence use.\u00a0 Indeed, throughout the IRISS project it has proved tricky to untangle when and how evidence is being used during the innovation process. \u00a0It is hardly surprising then that our understanding of the relationships between evidence and innovation is currently based more on theory than on practice examples.<\/p>\n There may be legitimate reasons why social service case studies are failing to adequately document the innovation process. \u00a0In part, this surely feeds back to the wider context of social service reform in Scotland, and across the UK, which is increasingly geared towards high-stakes accountability (The Scottish Government, 2011<\/a>; The Munro Report, 2011<\/a>). \u00a0In such a context individuals and organisations may not be comfortable with documenting their failings, in the interests of promoting a better understanding of the complexities of evidence-use and innovation, through fear that this may impact on their reputation or funding. \u00a0It may also be the case that, given the complex nature of these issues, some individuals and organisations do not feel equipped to engage in discussions which capture the complexity of the process, whilst still managing to present this information in an accessible way.<\/p>\n We need individuals and organisations to share by providing case studies of their innovations, and to share in an honest, detailed way.\u00a0 I am using \u2018case study\u2019 rather loosely here to refer to any form of story telling about the innovation process, not only by researchers but by practitioners and those who use services.\u00a0 This means shaking off long-standing ideas and ideals about what counts as evidence, who is the \u2018expert\u2019 and who can carry out research.\u00a0 Perhaps encouraging\u00a0and facilitating organisations and individuals to engage in \u2018real time\u2019 documenting of innovation processes would be one approach here. \u00a0Not only would this be of benefit to future work on evidence and innovation, but it would also be extremely valuable to other individuals and organisations attempting their own innovations.<\/p>\n So important questions to consider going forward are how can individuals and organisations be encouraged and supported to provide quality descriptions and analyses of the innovation process, and how can this information be better shared with other individuals and organisations?<\/p>\n <\/p>\n References:<\/strong><\/p>\n Brown, L (2010) Balancing Risk and Innovation to Improve Social Work Practice, British Journal of Social Work<\/i>, 40(4), pp. 1211-1228.<\/p>\n Johnson, M & Austin, M (2005) Evidence-based Practice in the Social Services: Implications for Organizational Change<\/i>, University of California, Berkeley. Mulgan, G (2007) Ready or Not? Taking Innovation in the Public Sector Seriously<\/i>, London: NESTA.<\/p>\n Nutley, S; Powell, A; Davies, H (2012) What counts as good evidence?<\/i> St Andrews: Research Unit for Research Utilisation.<\/p>\n","protected":false},"excerpt":{"rendered":" Case studies written by individuals and organisations trying out innovations can be valuable learning tools.\u00a0 The trouble is they are not always produced, valued, or produced in a way that maximises their value.\u00a0 In hierarchies of evidence, case studies can often find themselves towards the bottom (Johnson & Austin, 2005; Nutley, Powell & Davies, 2012). … <\/p>\n
\nAccessed 23\/09\/13: http:\/\/www.cfpic.org\/children\/pdfs\/EvidBasedPractFinalFeb05.pdf<\/a><\/p>\n