{"id":49,"date":"2022-11-16T09:06:31","date_gmt":"2022-11-16T09:06:31","guid":{"rendered":"https:\/\/blogs.ncl.ac.uk\/lively\/?p=49"},"modified":"2022-11-16T09:06:33","modified_gmt":"2022-11-16T09:06:33","slug":"staying-faithful-exploring-the-challenges-of-treatment-fidelity-in-practice-and-research","status":"publish","type":"post","link":"https:\/\/blogs.ncl.ac.uk\/lively\/2022\/11\/16\/staying-faithful-exploring-the-challenges-of-treatment-fidelity-in-practice-and-research\/","title":{"rendered":"Staying Faithful: Exploring the challenges of treatment fidelity in practice and research"},"content":{"rendered":"\n<p>Treatment fidelity has been an important consideration in the research process of the LIVELY project, to ensure that the Research Assistants (RAs) carried out the interventions consistently, in line with the manual and in line with each other. &nbsp;Treatment fidelity has implications for the internal validity of the LIVELY project; however, it also bears on the future ability to apply the interventions to real clinical settings (Hinckley &amp; Douglas, 2013).&nbsp;<\/p>\n\n\n\n<p>We reflect on the challenges, processes and importance of standardising interventions to be used reliably by different researchers and ideally in the future by varying teaching staff, in differing locations, and with a range of children. Key are issues of developing approaches that can be individualised to support children\u2019s specific needs.<\/p>\n\n\n\n<p>Key areas of consideration for high treatment fidelity are:<\/p>\n\n\n\n<p><strong>Manualisation of the Interventions<\/strong><\/p>\n\n\n\n<ul class=\"wp-block-list\"><li>BEST already had a manual prior to the project. The LIVELY RAs worked with Cristina McKean, Mark Masidlover and Christine Jack to create a manual for the adapted version of the DLS<\/li><li>Clear assessment and intervention protocols were created to support the RAs to deliver the interventions consistently<\/li><\/ul>\n\n\n\n<p><strong>Consistency of resources<\/strong><\/p>\n\n\n\n<ul class=\"wp-block-list\"><li>The team had to ensure that all toys and resources used in the interventions were exactly the same. Resources were adapted due to the pandemic \u2013 the toys selected were wipeable to ensure they could be cleaned after each use.<\/li><\/ul>\n\n\n\n<p><strong>Development of treatment fidelity checklists<\/strong><\/p>\n\n\n\n<ul class=\"wp-block-list\"><li>A stand-alone treatment fidelity tool had previously been created for the BEST intervention. A treatment fidelity checklist was created to use with the DLS intervention to ensure it was being delivered consistently.<\/li><\/ul>\n\n\n\n<p><strong>Methods of supporting parents to access and engage with homework<\/strong><\/p>\n\n\n\n<p>The involvement of parents in a child\u2019s speech and language intervention has been highlighted as a significant factor of its success. &nbsp;Engagement of parents with homework resources can be tricky to control, however, methods of support to try and engage parents with activities were put in place:<\/p>\n\n\n\n<ul class=\"wp-block-list\"><li>Simple and easy to use homework activities: lotto games, short stories, turn-taking and matching activities<\/li><li>Video instructions for all homework activities<\/li><li>Written instructions for all homework activities \u2013 including QR codes to access the video instructions<\/li><li>Text messages sent to parents after each session with a link to the homework resources and video instructions<\/li><li>Providing teachers with homework instructions so they can support any parent questions or queries<\/li><\/ul>\n\n\n\n<p>During the LIVELY project, treatment fidelity was monitored throughout the intervention period. RAs kept weekly reflections regarding any barriers and enablers, what worked well, what could be improved and how. The RAs could not see each other\u2019s reflections during the project to ensure they remained blind to the treatment arm. Intervention sessions 3 and 4 were also video recorded, watched by the RA and then rated using the treatment fidelity checklist. The videos and self-reflections were then sent to a supervisor who also watched the videos and used the treatment fidelity tool to score the intervention session and provide feedback to the RA. The comprehensive manuals and protocols discussed earlier were put in place to try and mitigate any compromise to the treatment fidelity of the interventions.<\/p>\n\n\n\n<p>For more information on treatment fidelity in the LIVELY project, please see the presentation attached which was presented at the virtual Research Symposium.<\/p>\n\n\n\n<p><a href=\"https:\/\/drive.google.com\/file\/d\/16ariyPGYd480VZJqFLm_VCZ82bU06-8l\/view\">Staying%20Faithful_RS%20presentation.pptx &#8211; Google Drive<\/a><\/p>\n\n\n\n<p><strong>Authors: Emily Preston, Jo Baker, Kate Conn<\/strong><\/p>\n\n\n\n<p><strong>References<\/strong><\/p>\n\n\n\n<p>The following list includes references from the presentation and articles that may be of further interest to you:<\/p>\n\n\n\n<p>Bellg, A. J., Borrelli, B., Resnick, B., Hecht, J., Minicucci, D. S., Ory, M., . . . Treatment Fidelity Workgroup of the, N.I.H.B.C.C. (2004). Enhancing treatment fidelity in health behavior change studies: best practices and recommendations from the NIH Behavior Change Consortium. <em>Health Psychol, 23<\/em>(5), 443-451. Doi: 10.1037\/02786133.23.5.443. <a href=\"https:\/\/www.ncbi.nlm.nih.gov\/pubmed\/15367063\">https:\/\/www.ncbi.nlm.nih.gov\/pubmed\/15367063<\/a><\/p>\n\n\n\n<p>Bruinsma, G., Wijnen, F., &amp; Gerrits, E. (2020). Focused Stimulation Intervention in 4- and 5-Year-Old Children With Developmental Language Disorder: Exploring Implementation in Clinical Practice. <em>Lang Speech Hear Serv Sch, 51<\/em>(2), 247-269. doi:<a href=\"https:\/\/pubs.asha.org\/doi\/10.1044\/2020_LSHSS-19-00069\">10.1044\/2020_LSHSS-19-00069<\/a><\/p>\n\n\n\n<p>Carroll, C., Patterson, M., Wood, S., Booth, A., Rick, J., &amp; Balain, S. (2007). A conceptual framework for implementation fidelity. <em>Implement Sci, 2<\/em>, 40. doi:<a href=\"https:\/\/implementationscience.biomedcentral.com\/articles\/10.1186\/1748-5908-2-40\">10.1186\/1748-5908-2-40<\/a><\/p>\n\n\n\n<p>Fricke et al, (2017). The efficacy of early language intervention in mainstream school settings: a randomized controlled trial. <em>Journal of Child Psychology and Psychiatry, 58<\/em>(10), 1141-1151. DOI: <a href=\"https:\/\/onlinelibrary.wiley.com\/doi\/abs\/10.1111\/jcpp.12737\">10.1111\/jcpp.12737<\/a><\/p>\n\n\n\n<p>Gearing, R. E., El-Bassel, N., Ghesquiere, A., Baldwin, S., Gillies, J., &amp; Ngeow, E. (2011). Major ingredients of fidelity: a review and scientific guide to improving quality of intervention research implementation. <em>Clin Psychol Rev, 31<\/em>(1), 79-88. doi:10.1016\/j.cpr.2010.09.007: &nbsp;<a href=\"https:\/\/www.ncbi.nlm.nih.gov\/pubmed\/21130938\">https:\/\/www.ncbi.nlm.nih.gov\/pubmed\/21130938<\/a><\/p>\n\n\n\n<p>Glogowska, M., &amp; Campbell, R. (2000). Investigating parental views of involvement in pre-school speech and language therapy. <em>International Journal of Language &amp; Communication Disorders, 35<\/em>(3), 391-405. doi: <a href=\"https:\/\/onlinelibrary.wiley.com\/doi\/abs\/10.1080\/136828200410645?sid=nlm%3Apubmed\">10.1080\/136828200410645<\/a><\/p>\n\n\n\n<p>Hinckley, J. J., &amp; Douglas, N. F. (2013). Treatment fidelity: its importance and reported frequency in aphasia treatment studies. <em>Am J Speech Lang Pathol, 22<\/em>(2), S279-284. doi:10.1044\/1058-0360(2012\/12-0092):&nbsp;<a href=\"https:\/\/www.ncbi.nlm.nih.gov\/pubmed\/15367063\">https:\/\/www.ncbi.nlm.nih.gov\/pubmed\/15367063<\/a><\/p>\n\n\n\n<p>Klatte,I. S., Harding, S., &amp; Roulstone, S. (2019). Speech and language therapists\u2019 views on parents\u2019 engagement in Parent-Child Interaction Therapy (PCIT). <em>International Journal of Language and Communication Disorders, 54<\/em>(4), 553-564.&nbsp; doi: <a href=\"https:\/\/onlinelibrary.wiley.com\/doi\/abs\/10.1111\/1460-6984.12459?af=R\">10.1111\/1460-6984.12459<\/a>.<\/p>\n\n\n\n<p>McKean, C., Benson, K., Jack, C., Letts, C. A., Pert, S., Preston, E., Trebacz, A., Stringer, H., &amp; Wareham, H. (2020).&nbsp;ISRCTN10974028:&nbsp;Language Intervention in the Early Years &#8211; comparing the effectiveness of language intervention approaches for pre-school children with language difficulties&nbsp;ISRCTN doi: <a href=\"https:\/\/doi.org\/10.1186\/ISRCTN10974028\">10.1186\/<\/a><a href=\"https:\/\/doi.org\/10.1186\/ISRCTN10974028\">ISRCTN10974028<\/a><\/p>\n\n\n\n<p>Michie, S., Richardson, M., Johnston, M., Abraham, C., Francis, J., Hardeman, W., \u2026 &amp; Wood, C. E. (2013). The Behavior Change Technique Taxonomy (v1) of 93 Hierarchically Clustered Techniques: Building an International Consensus for the Reporting of Behavior Change Interventions. <em>Annals of Behavioral Medicine : a Publication of the Society of Behavioral Medicine<\/em>,&nbsp;<em>46<\/em>(1), 81\u201395. <a href=\"https:\/\/doi.org\/10.1007\/s12160-013-9486-6\">https:\/\/doi.org\/10.1007\/<\/a><a href=\"https:\/\/doi.org\/10.1007\/s12160-013-9486-6\">s12160-013-9486-6<\/a><\/p>\n\n\n\n<p>Ory MG, Jordan PJ, Bazarre T. The Behavior Change Consortium: setting the stage for a new century of health behavior-change research. Health Educ Res. 2002;17(5). doi: <a href=\"https:\/\/doi.org\/10.1093\/her\/17.5.500\">10.1093\/her\/17.5.500<\/a><\/p>\n\n\n\n<p>Roulstone, S. (2015). Exploring the relationship between client perspectives, clinical expertise and research evidence. <em>International Journal of Speech-Language Pathology, 17<\/em>(3), 211-221. doi: <a href=\"https:\/\/www.tandfonline.com\/doi\/abs\/10.3109\/17549507.2015.1016112\">10.3109\/17549507.2015.1016112<\/a>.<\/p>\n\n\n\n<p><\/p>\n","protected":false},"excerpt":{"rendered":"<p>Treatment fidelity has been an important consideration in the research process of the LIVELY project, to ensure that the Research Assistants (RAs) carried out the interventions consistently, in line with the manual and in line with each other. &nbsp;Treatment fidelity &hellip; <a href=\"https:\/\/blogs.ncl.ac.uk\/lively\/2022\/11\/16\/staying-faithful-exploring-the-challenges-of-treatment-fidelity-in-practice-and-research\/\">Continue reading <span class=\"meta-nav\">&rarr;<\/span><\/a><\/p>\n","protected":false},"author":10256,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[1],"tags":[],"class_list":["post-49","post","type-post","status-publish","format-standard","hentry","category-uncategorised"],"_links":{"self":[{"href":"https:\/\/blogs.ncl.ac.uk\/lively\/wp-json\/wp\/v2\/posts\/49","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/blogs.ncl.ac.uk\/lively\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/blogs.ncl.ac.uk\/lively\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/blogs.ncl.ac.uk\/lively\/wp-json\/wp\/v2\/users\/10256"}],"replies":[{"embeddable":true,"href":"https:\/\/blogs.ncl.ac.uk\/lively\/wp-json\/wp\/v2\/comments?post=49"}],"version-history":[{"count":7,"href":"https:\/\/blogs.ncl.ac.uk\/lively\/wp-json\/wp\/v2\/posts\/49\/revisions"}],"predecessor-version":[{"id":117,"href":"https:\/\/blogs.ncl.ac.uk\/lively\/wp-json\/wp\/v2\/posts\/49\/revisions\/117"}],"wp:attachment":[{"href":"https:\/\/blogs.ncl.ac.uk\/lively\/wp-json\/wp\/v2\/media?parent=49"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/blogs.ncl.ac.uk\/lively\/wp-json\/wp\/v2\/categories?post=49"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/blogs.ncl.ac.uk\/lively\/wp-json\/wp\/v2\/tags?post=49"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}