Ever since I first qualified as a speech and language therapist we have been discussing the need to measure the outcome of our interventions. Almost twenty years ago when I was a service manager in Newcastle we knew that we would need to provide data about our outcomes to our managers and commissioners. In an attempt to get ahead of the game and be well prepared for when the request came, we invited Pam Enderby up to Newcastle to talk to us about her newly developing Therapy Outcome Measures (TOMs). Based on the principles of the newly emerging WHO ICF (since redeveloped and modified) TOMs was, as far as I know, the first outcome measurement tool that considered multiple aspects of the client and did so in a holistic way (Enderby & John, 1999). At that time we really collected data for our own edification and amusement as no one ever asked us for it.
We live in a different world now and the need to demonstrate the effectiveness of our interventions has become pressing, as the structure and drivers behind commissioning have changed. However, we have no set of outcome measures that are acceptable to all and the danger we have now is that services will develop outcome measures independently that are not comparable. Commissioners will not be able to accurately or appropriately compare services with each other or evaluate their outcomes and the consequence will have a negative impact on the quality of client care. As a profession we need to be able to rise above our fierce independence as autonomous practitioners and devise a system for measuring outcomes that enables us to compare like with like.
The Royal College of Speech and Language Therapists (RCSLT) has picked up the baton and is leading an initiative to develop national outcome measures by consensus through engaging as many SLTs in England as possible. On October 10th 2013 RCSLT held a Summit meeting in Birmingham to start the process. Although I am no longer working at the service delivery sharp end, I have been involved in the outcome measure work with RCSLT because it links into a research project that I am involved with in collaboration with RCSLT and Newcastle University Culture Lab (http://www.ncl.ac.uk/culturelab/). Consequently, at the Summit, I sat with the dysfluency group although I have no expertise and limited knowledge in that area. A Theory of Change (http://www.theoryofchange.org/what-is-theory-of-change/#6) process was used to develop some preliminary ideas at this meeting which we took forward with the North East Regional Dysfluency Clinical Excellence Network (NERDCEN) a fortnight later.
Theory of Change provided a framework for us to consider the outcomes of intervention for children, young people and adults with dysfluent speech. Theory of Change takes us from the ultimate outcomes of our intervention to consider the intermediate outcomes that contribute to them and then to the activities that we need to undertake in order to achieve the goals. The combined outstanding brain power in the room took remarkably little time to come to a consensus in each of these areas. I think this was partly down to the fact that they had been talking about outcome measures for several years and had a fairly good idea where they were heading and partly down to the structure provided by Theory of Change. Another contributing and helpful factor on the day was the presence of Dominique Lowenthal, Professional Development Services Manager at RCSLT, who has a lot of experience using Theory of Change in different RCSLT projects. Dominique guided us through each stage so that the relevant points were considered and everyone’s views were taken into account. The result is not yet an outcome measure (or two) but a path on the way and a consensus of the experts in this region. This work will continue with input from NERDCEN and RCSLT over the next few months. The aim is to have a set of outcome measures that are agreed across all SLTs that can be used in the RCSLT/Culture Lab/Speech & Language Sciences project. We are on our way to being able to compare apples with apples (even if some are red and some are green) rather than continuing to have apples in one hand and broccoli in the other while we vainly search for similarities.
Thanks to: @domlowenthal and all the NERDCEN SLTs.
Helen Stringer
References
Enderby, Pam ; John, Alex; (1999). Therapy outcome measures in speech and language therapy: comparing performance between different providers. International Journal of Language & Communication Disorders, 34(4), 417-429. doi: doi:10.1080/136828299247360