{"id":177,"date":"2013-08-27T14:43:22","date_gmt":"2013-08-27T14:43:22","guid":{"rendered":"http:\/\/blogs.iriss.org.uk\/innovate\/?p=177"},"modified":"2017-02-03T12:44:41","modified_gmt":"2017-02-03T12:44:41","slug":"what-when-why-where-for-whom-works","status":"publish","type":"post","link":"https:\/\/blogs.iriss.org.uk\/innovate\/2013\/08\/27\/what-when-why-where-for-whom-works\/","title":{"rendered":"What (when, why, where, for whom) works?"},"content":{"rendered":"

This week I have been reviewing the literature on evidence, and its role in informing policy and practice in the context of Scotland\u2019s social services.\u00a0 Evidence-based approaches have been borrowed from medicine where they have existed for centuries, although they have only been explicitly labelled \u00a0\u2018evidence-based\u2019 since the early 1990s (Claridge & Fabian, 2005).\u00a0 This approach to the delivery of services can be defined as \u201cthe conscientious, explicit and judicious use of current best evidence in making decisions about the care of individuals\u201d (Sackett, Richardson, Rosenberg, & Haynes, 1997 quoted in Johnson & Austin, 2005, p. 4).\u00a0 In light of this definition the idea of utilising evidence-based approaches in social services, which has had a presence in UK Government discourse since the mid 1990s, seems logical.\u00a0 The aim is to increase the efficiency and effectiveness of social services, in order to improve the level of care they are able to provide.\u00a0 This remains a popular goal given the context of reduced public sector budgets across the UK (The Scottish Government, 2011<\/a>).\u00a0 It also accords with the move towards greater and more transparent accountability in the spending of public money, which has been a powerful public sector reform discourse since the 1980s (Munro, 2004).\u00a0 This has led to the view that policy and commissioning decisions, as well as everyday social service practice, should be based-on, or informed and enriched by, the \u2018best\u2019 available evidence.<\/p>\n

Again this might seem logical, obvious even.\u00a0 As Oliver Letwin, Minister for Government Policy, said of evidence-based policy and practice, at the 2013 launch of the What Works Centres<\/a>:<\/p>\n

once you\u2019ve decided that you\u2019re trying to achieve something\u2026it does make abundant sense to try and find out whether the thing you are doing to achieve it has actually shown that it is capable of achieving it, and then to adjust it or remove it if it hasn\u2019t, and reinforce it if it has\u2026this is blindingly obvious stuff and I just feel ashamed, on behalf of not just our country but actually every country in the world almost, that this is regarded as revolutionary.\u00a0 It ought to be regarded as entirely commonplace.<\/em><\/p>\n

And yet evidence-based policy and practice remain elusive goals in many social service contexts (Johnson & Austin, 2005, p. 12).\u00a0 My aim here is to isolate one possible explanation for this apparent difficulty, which is particularly relevant to the social work profession.\u00a0 For the purposes of this discussion I will use the What Works Centre view of evidence as a product or output upon which to base a judgment or decision, although I am aware that this definition is subject to debate and criticism.<\/p>\n

Difficulties in implementing evidence-based approaches may exist due to the presence of hierarchies of research design in the area of evaluation and efficacy research.\u00a0 These hierarchies tend to prioritize experimental studies, or systematic reviews of existing experimental studies on a particular intervention (Johnson & Austin, 2005; The Social Research Unit at Dartington, 2013<\/a>).\u00a0 However, this hierarchy may be problematic if we are trying to encourage the use of evidence in a social work context.\u00a0 First, from the perspective of evidence-based policy, experimental studies such as Randomized Controlled Trials (RCTs) can be extremely useful at telling us whether or not an intervention works; i.e. achieves the outcomes we have assessed it against.\u00a0 However, this research design may be less adept at answering a host of other questions, which need to be answered if a social work intervention is to be rolled-out across services as best practice (Cartwright, 2013).\u00a0 For instance, we need to understand why<\/em> this intervention has or has not worked, and to understand in greater detail, how<\/em> it works.\u00a0 We also need to understand who <\/em>the intervention has worked for, when and where?\u00a0 The who<\/em> question enables us to identify which client group(s) the intervention has been used with, and the extent to which their characteristics and needs can be viewed as typical across a range of social work clients. Issues of spatiality and temporality are particularly important if we seek to scale-up an intervention.\u00a0 Put another way, what we are trying to get at is both the causal ingredient \u2013 i.e. the thing to which we can attribute the effectiveness of our intervention \u2013 and the necessary support factors required for this causal relationship to hold (Otto & Ziegler, 2008; Cartwright, 2013). These support factors could include organisational culture, the individual attributes of the practitioners involved, the practitioner-client dynamics, the availability of the necessary resources and so forth.\u00a0 RCTs alone cannot provide us with all of this information.\u00a0 We require a methodological mix of research, capable of providing a more holistic picture, including evidence regarding the transportability of an intervention.\u00a0 Thus there is a need for greater recognition of the role of other study designs, and indeed of mixed-method evaluations, for successful evidence-based policy in social work.<\/p>\n

Greater encouragement of mixed-method approaches may also be helpful in addressing a second concern about the research design hierarchy, which pertains to its impact on evidence-based practice. There may be a disjuncture between the ontological and epistemological positions which underpin experimental methods \u2013 that is the views about what kinds of things there are in the world, and how we can come to \u2018know\u2019 them \u2013 and the ontological, epistemological, professional and value-orientated views of social workers.\u00a0 In order to make decisions, social workers will draw on, and piece together, a variety of different types of knowledge and evidence (Collins and Daly, 2011).\u00a0 This will include case notes from a range of professionals, their own observations and previous knowledge and experiences, and service user views.\u00a0 The interpretive skills of social workers are therefore paramount in making sense of the complex, multi-faceted and, often, incomplete picture they have of a client or situation (Shonkoff, 2000; Otto & Ziegler, 2008).\u00a0 These are skills that may be more closely aligned with interpretive research traditions, which seek to understand and interpret the actions and meanings of agents, and advocate the existence of multiple truths. \u00a0If social workers are to make better use of research-based evidence, it needs to be capable of improving their understanding of complex and fluctuating scenarios.<\/p>\n

That is not to suggest that RCTs have no role to play, they do.\u00a0 They are useful at telling us what works, and we should encourage greater quantitative literacy amongst social workers so that they can read the latest evidence on interventions and reach their own conclusions about them.\u00a0 However, on their own RCTs may be insufficient to develop evidence-based approaches in social work.\u00a0 Not only are they unable to provide adequate detail of the conditions needed for causal factors to operate, which is crucial in a social service context which is characterized by diversity and contextual nuance, but such research may also seem ontologically and epistemologically removed from the professional foundations of social work.\u00a0 For evidence-based approaches to thrive we need practitioners on side.\u00a0 So, as well as continuing with RCTs which look at what works and encouraging quantitative literacy amongst the social service workforce, we also need to encourage the use of other, and mixed, methodological approaches (Cartwright, 2013). Not only will this make better use of the proficient interpretive skills social workers already have (Nutley et al, 2010, p. 135-6), it will also provide the well-rounded, nuanced evidence that is required for evidence-based approaches to be more valuable in a social work context.<\/p>\n

In relation to the Evidence and Innovation Project at Iriss<\/a>, this discussion suggests that there may be a role for innovation in informing and inspiring new methodological approaches and combinations in order to improve the effectiveness and take-up of evidence-based approaches in a social work context.\u00a0 It might also be the case that the view of evidence underpinning the \u2018What Works\u2019 agenda \u2013 i.e. which situates evidence as a product or output upon which to base a decision or judgment \u2013 has limitations.\u00a0 In the context of the Evidence and Innovation Project, it may be important to explore other, broader, and potentially \u2018innovative\u2019 understandings of what evidence is and can be used for.\u00a0 These issues will guide my thinking over the forthcoming weeks and will be returned to in future blog posts.<\/p>\n

Jodie Pennacchia
\n<\/em>The University of Nottingham
\n<\/em>Follow: @jpennacchia<\/em><\/p>\n

\u00a0References<\/strong><\/p>\n

Cartwright, Nancy (2013), Knowing what we are talking about: why evidence doesn\u2019t always travel, Evidence & Policy<\/em>, 9:1 pp. 97-112.<\/p>\n

Claridge, J and Fabian, T (2005), History and Development of evidence-based medicine, World Journal of Surgery<\/em>, 29:5 pp. 547-553.<\/p>\n

Cnaan, R and Dichter, M E (2008), Thoughts on the Use of Knowledge in Social Work Practice, Research on Social Work Practice<\/em>, 18:4, pp. 278-284.<\/p>\n

Collins, C and Daly, E (2011), Decision making and social work in Scotland: The role of evidence and practice wisdom<\/a>, Glasgow: The Institute for Research and Innovation in Social Services.<\/p>\n

Johnson, M and Austin, M (2005), Evidence-based Practice in the Social Services: Implications for Organisational Change<\/a>, University of California, Berkeley.<\/p>\n

Munro, E (2004), The impact of audit on social work practice<\/a>, British Journal of Social Work<\/em>, 34(8), pp. 1073-1095.<\/p>\n

Nutley, S;\u00a0 Morton, S; Jung, T; Boaz, A (2010), <\/em>Evidence and policy in six European countries: diverse approaches and common challenges, Evidence & Policy<\/em>, 6:2, pp. 131-44.<\/p>\n

Otto, H and Ziegler, H (2008), The Notion of Causal Impact in Evidence-Based Social Work: An Introduction to the Special Issue on What Works? Research on Social Work Practice<\/em>, 18:4, pp. 273-276.<\/p>\n

Shonkoff, J (2000), Science, Policy, and Practice: Three Cultures in Search of a Shared Mission, Child Development,<\/em> 71:1, pp. 181-187.<\/p>\n","protected":false},"excerpt":{"rendered":"

This week I have been reviewing the literature on evidence, and its role in informing policy and practice in the context of Scotland\u2019s social services.\u00a0 Evidence-based approaches have been borrowed from medicine where they have existed for centuries, although they have only been explicitly labelled \u00a0\u2018evidence-based\u2019 since the early 1990s (Claridge & Fabian, 2005).\u00a0 This … <\/p>\n

Continue reading “What (when, why, where, for whom) works?”<\/span><\/a><\/p>\n","protected":false},"author":62,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"_coblocks_attr":"","_coblocks_dimensions":"","_coblocks_responsive_height":"","_coblocks_accordion_ie_support":""},"categories":[1],"tags":[],"_links":{"self":[{"href":"https:\/\/blogs.iriss.org.uk\/innovate\/wp-json\/wp\/v2\/posts\/177"}],"collection":[{"href":"https:\/\/blogs.iriss.org.uk\/innovate\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/blogs.iriss.org.uk\/innovate\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/blogs.iriss.org.uk\/innovate\/wp-json\/wp\/v2\/users\/62"}],"replies":[{"embeddable":true,"href":"https:\/\/blogs.iriss.org.uk\/innovate\/wp-json\/wp\/v2\/comments?post=177"}],"version-history":[{"count":0,"href":"https:\/\/blogs.iriss.org.uk\/innovate\/wp-json\/wp\/v2\/posts\/177\/revisions"}],"wp:attachment":[{"href":"https:\/\/blogs.iriss.org.uk\/innovate\/wp-json\/wp\/v2\/media?parent=177"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/blogs.iriss.org.uk\/innovate\/wp-json\/wp\/v2\/categories?post=177"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/blogs.iriss.org.uk\/innovate\/wp-json\/wp\/v2\/tags?post=177"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}