- Open Access
Factors predicting satisfaction in outpatient substance abuse treatment: a prospective follow-up study
Substance Abuse Treatment, Prevention, and Policy volume 15, Article number: 35 (2020)
While treatment satisfaction has been associated with better outcomes in substance abuse treatment, there is an obvious need for a more profound understanding of what predicts client’s satisfaction with treatment. This study elucidates factors relevant to treatment outcome measured at follow-up in terms of satisfaction with the treatment received.
The research was implemented as a multisite study in outpatient clinics (N = 7) in southern and western Finland. Data consists of therapists (N = 33) and their clients (N = 327). Each consenting client beginning a treatment period was accepted as a research subject and all therapists at the clinics in question participated. The study was conducted as part of the clinic’s normal activity. Clients were allocated to therapists according to a randomization list drawn up in advance. Apart from the randomisation and the completion of questionnaires, it did not interfere with the progress of treatment. Follow-up lasted 6 months. Multiple Classification Analysis (MCA) was used through combinations of variables organized by content, e.g. client demographics, previous substance use, therapist’s characteristics and client’s expectations. The analyses were based in part on conventional statistical testing (t -test, χ2-test, ANOVA).
Among 37 independent variables few were statistically significant in the final model. The results suggest that high treatment expectations at baseline are a strong predictor of satisfaction at follow-up. Also, previous substance use predicted treatment satisfaction; people using multiple substances were less satisfied than those taking only one substance. Stronger predictors reduced the statistical significance of those independent variables that were statistically significant in the first analyses. Therefore, therapist’s role in recovery and readiness to change should be also seen as antecedents to treatment satisfaction.
It seems that treatment expectations are fulfilled among those participating in follow-up. Yet many are lost during treatment and by follow-up. Service users have experiential knowledge that differs from professionals’ and policymakers’ knowledge. It is clinically relevant to understand what factors affect client’s satisfaction. Hence, it is possible to identify the population whose treatment should receive the most attention, how the client’s experience, their commitment to treatment, and treatment effectiveness could be improved.
Taking account of the client’s perspective is important when researching the treatment of substance use [1, 2]. Some work has been accomplished in this area by putting the focus on service users themselves (see e.g. [3, 4]) along with other stakeholders  in defining relevant outcome measures. The main idea is that service users have experiential knowledge that differs from professionals’ and policymakers’ knowledge, and this may be vital in posing the right questions in research and in practice. While substance-taking behaviour has been the primary outcome measure for alcohol treatment trials, and will continue to be so, it does not exclude other outcome measures like satisfaction with the treatment received.
In health research, the importance of measuring satisfaction with treatment is well documented , but this is not the case in substance abuse treatment . Treatment effectiveness has seldom been measured in terms of client satisfaction, although its importance is on the increase in treatment studies, both medical and psychological .
In earlier research, treatment satisfaction has been associated with positive therapy outcomes measured with conventional measures like retention or substance-taking behaviour (see e.g. [7, 9,10,11,12,13,14]), although opposite claims have also been made (see e.g. [15, 16]). Although many of these studies have obvious strengths, methodological deficiencies (e.g. cross-sectional data; small group of participants; varying client groups) impede conclusions in this area (see ). These somewhat contradictory findings rely on the quantity of research published and firmly corroborate the positive connection between satisfaction and other outcome measures. According to recent research, it seems plausible that a positive connection exists [7, 18], and even with more complicated client groups . Outcome indicators seem to be interconnected; client’s expectations on entering treatment and the whole process of treatment contribute to satisfaction with the treatment received and eventually treatment outcome [11, 20, 21].
Satisfaction is an important indicator of quality of services [22,23,24] and highlights the client’s perspective. The scientific significance of this study with a prospective research design is in providing information on treatment satisfaction as an outcome measure and its predictors selected on theoretical grounds. While accepting the notion about the interconnectedness of these outcome indicators, there is an obvious need for a more profound understanding of what predicts client’s satisfaction with treatment. Adamson and colleagues  in their systematic review found antecedents to treatment outcome such as baseline alcohol consumption, dependence severity, gender, treatment history, alcohol-related self-efficacy, motivation, socioeconomic status/income and treatment goal. When studying client characteristics, readiness for change (see e.g. ) and anger (see e.g. [26, 27]) have been found to be significant factors as regards treatment outcome. Similarly, therapist characteristics have been found to influence client outcome (see e.g. [28, 29]). While some research has concluded that the influence of these so-called common factors is far more important than therapy methods (see e.g. ), other research has repeatedly stressed the need to study the common factors present in the therapy situation but not specific to a specific therapeutic method (see e.g. ).
When treatment satisfaction is seen as an antecedent of better substance abuse treatment outcomes in terms, for instance, of retention in treatment or substance-abusing behaviour, it is clinically relevant to understand what factors affect the client’s satisfaction (see [17, 18]). Hence it is possible to identify the population whose treatment should receive the most attention, how the client’s experience could be improved and consequently also, their commitment to treatment and treatment effectiveness.
Even in the absence of an unambiguous definition of satisfaction , various measures have been applied to measure it in substance abuse treatment. Although there are some structured measures available such as the Client Satisfaction Questionnaire (CSQ-8) (see e.g. [32, 33]), the Treatment Perception Questionnaire (TPQ) , and the Verona Service Satisfaction Scale (SSS-30) [23, 35], they are usually modified and tailored to suit separate purposes (see e.g. ). Single-item measurements (see e.g. [14, 20, 37,38,39]), subscales of comprehensive measures (see e.g. ), questionnaires with composite scores (see e.g. [11, 19]) and even both simultaneously [7, 14, 40] have been used, but often treated as single satisfaction scores in the analyses . It has recently been argued that a single general question regarding overall satisfaction is adequate and predicts satisfaction equally well as a composite score or other items used so far. The clinical utility and convenience of a short question is undeniably a major asset  and the notion is well supported elsewhere .
In this study we take a closer look at treatment satisfaction measured with a one-item self-report measure 6 months after treatment: How satisfied you are with the help and support received from the therapist in the outpatient clinic? The responses used a five-point scale (1 = extremely dissatisfied,…, 5 = extremely satisfied). Analytically, the starting point for the empirical analysis is exploratory, using multivariate analysis. The research question is as follows: What factors predict client’s satisfaction at follow-up with treatment received?
Design and implementation
The research was implemented as a multi-centre study with the participation of 7 outpatient clinics in southern and western Finland. These clinics provide integrated care for substance use problems. In addition to psychosocial services, medication may be one part of the treatment. Rigorous principles were adhered to in the design and implementation of this prospective follow-up study . Thus, a naturalistic research approach was applied, meaning that the research was conducted as part of the clinic’s normal activity. Apart from the randomization of clients to therapists and the completion of questionnaires, it did not interfere with the progress of treatment. A further aim was to use a minimal number of burdensome tools. This was an attempt to minimize the effect of the research on treatment outcomes (see ). Clients participated in the study on a voluntary basis and were informed of their right to withdraw from it at any time. Withdrawing from the study did not adversely affect the care they received. Thus, the clients (N = 327, 111 women (33.9%), 216 men (66.1%)) were non-selected; each consenting client beginning a new treatment period due to a substance use problem was accepted as a research subject. All clients who had completed the baseline questionnaire were invited by letter to a follow-up appointment at the clinic 6 months after the start of treatment. No information was gathered on clients who declined to participate.
All therapists (N = 33) at the clinics in question participated. Information on the therapists was also gathered and aligned with client data. Clients were allocated to therapists according to a randomization list drawn up in advance to standardize background information. Client’s treatment outcome was monitored 6 months after commencement of treatment; it was the only specifically determined meeting in the procedure. The times for therapy sessions were determined by the client’s needs and the practices of the unit in question.
Figure 1 presents the progress of the study, the research materials used and numbers of clients in the various phases. Client participation began with the first visit to the unit’s reception. Having received a brochure describing the research, a client gave consent to being a research subject. The client was apprised of the research ethics. In this study we adhered to the guidelines of the Finnish codes of research ethics and governance [43, 44] and with the codes of research integrity in Europe  and the guidelines of the Finnish professional systems. This means among other things that participation was voluntary and anonymity of participants was protected.
Questionnaire and measurement instruments
Before commencing actual therapy clients completed a questionnaire (Fig. 1; 1), which combined questions eliciting e.g. demographic factors, information on substance use and attitudes to treatment. The questionnaire incorporated combined questions reportedly used in other Finnish studies [46, 47] and some structural measurements. The measurements used have been described in greater detail elsewhere [20, 21, 39, 48].
Data on independent variables was collected as part of the baseline questionnaire package, namely 6 months before data on treatment satisfaction was collected. Client self-efficacy was measured by the 12-item version of Alcohol Abstinence Self-Efficacy Scale (AASE) . The clients were given descriptions of various situations and moods, and were asked to use a five-point scale to describe how likely they were to have refused the use of substances during the past week (1 = extremely unsure,…, 5 = extremely sure). The alpha (α) reliabilities for the four scales and composite variable combining the scales were on the same level as in the original study (in parentheses): negative affect 0.80 (0.82), social/positive 0.83 (0.82), physical and other concerns 0.80 (0.83), craving and urges 0.81 (0.81) and composite variable 0.91 (0.91). The University of Rhode Island Change Assessment Scale (URICA)  was used to measure client’s readiness to change. The Finnish 12-item version of URICA-FI-12 was used [46, 47]. The clients responded to the URICA on a five-step numerical scale (1 = totally disagree,…, 5 = totally agree). The items were divided into four scales. The α reliabilities of the scales were on the same level as in the original study (in parentheses): pre-contemplation 0.71 (0.69), contemplation 0.76 (0.75), action 0.72 (0.82), maintenance 0.79 (0.80). The client’s anger was elicited using the 10-item Trait Anger Scale (TAS), which is a part of the State-Trait Anger Expression Inventory-2 (STAXI-2) . The clients responded on the form using a four-step numerical scale (1 = hardly ever,…, 4 = almost always). The composite score for the scale was used in the study and the α reliability was comparable to the measure of the STAXI-2 manual,Footnote 1 being 0.85 in the study at hand.
At the beginning of the research the background information of the therapist and therapeutic orientation were also elicited (Fig. 1; 2). Therapist’s interpersonal functioning was investigated at the same time using the method of Valle , where the rating criteria originated in Carkhuff and Berenson . Inter-rater reliability measured by Cronbach’s α was good and inter-vignette reliability (in parentheses) even higher: empathy 0.81 (0.87), genuineness 0.71 (0.90), respect for client 0.76 (0.90), concreteness 0.81 (0.89).
The research included a maximum of five sessions per client. A treatment period might continue thereafter but these subsequent sessions were no longer included in the study. All clients who completed the form for background information were invited by letter 6 months after the beginning treatment for a follow-up visit at the unit. The treatment follow-up questionnaire (Fig. 1; 3) elicited among other things satisfaction with help or support received from the therapist. The dependent variable, satisfaction with treatment, was elicited in a questionnaire at 6-month follow-up. The measurement was based on client self-report on a scale 1–5.
The analyses were carried out with Multiple Classification Analysis (MCA) (see e.g. [53, 54]), multi-method procedure which allows using multiple independent variables to explain variance in a dependent variable. It combines the main properties of analysis of variance (ANOVA) and regression analysis. MCA is considered to be a more robust method than regression analysis [55, 56]. Compared to ANOVA, MCA gives direct information not only on group differences but also on where these differences emerge. In the large dataset at hand, using MCA makes it possible to find multiple independent variables with explanatory power regarding the response variable, treatment satisfaction. In MCA it is possible to control for multiple background variables simultaneously and to examine changes in group differences while other variables are controlled for. In this situation, the analysis reveals the effect of background variables on the phenomenon of interest. MCA produces group specific means of the impact of these background variables on this phenomenon. In MCA the comparison is performed with respect to the average of the data as a whole. The statistically significant independent variables (with p-value <.05) for treatment satisfaction were sought and their predictive value was estimated.
The analysis advanced through combinations of variables organized according to content; in other words, treatment satisfaction was predicted by thematic, hierarchical blocks . Using of these hierarchical blocks was essential because large numbers of variables cannot be included at the same time. The analyses were done with MCA in hierarchical blocks (variables in parenthesis): client demographics and other baseline information (age group; gender; marital status; living with children; education; housing; employment status), client’s substance use at baseline (type of substance use; habit of using substance; duration of prolonged abstinence period; abstinent days during past 30 days; contacts with problem users; prior admission to the clinic in question), therapist’s interpersonal functioning (directiveness; empathy; concreteness; therapist’s total skills), client’s expectations (attitudes toward Alcoholics or Narcotics Anonymous, AA/NA; religiosity; voluntariness of admission; objectives regarding substance use; preferred gender of therapist; importance of medication; expectations regarding treatment outcome; therapist’s role in recovery), client’s characteristics (readiness for change, URICA; self-efficacy, AASE; anger, TAS). Variables expressing client’s substance use at follow-up (type of substance use; abstinence vs. controlled use; habit of using substance; duration of prolonged abstinence period; abstinent days during past 30 days; contacts with problem users; AA/NA attendance; other substance abuse treatment attendance) were also included in the analysis in order to study their effect on treatment satisfaction. Each hierarchical block was first analysed separately against the response variable using MCA. Statistically significant variables within these analyses were later considered as key independent variables in the MCA model.
Satisfaction with treatment received is attributable to natural causes (on a scale 1–5, M = 4.24; SD = 0.968) and is more centred around “more satisfied” than “less satisfied”, which is often the case in social sciences in general and also characteristic of measuring treatment satisfaction [38, 58].
Missing data is mostly due to the prospective research design of the study and non-response at 6-month follow-up. Attrition occurs when participants’ treatment retention is discontinued or when they choose not to participate in follow-up. No imputations were made, but attrition was analysed. The attrition analyses were based on conventional statistical testing (t -test, χ2 -test, ANOVA) comparing differences in independent samples.
Table 1 presents information on clients’ backgrounds and substance use. Regarding the demographics, it can be stated in general that the clients’ level of education was decidedly low and the level of unemployment correspondingly high. All in all, the demographic information largely corresponded to the picture provided by earlier Finnish research regarding clients in substance abuse treatment in the community .
Alcohol was the primary substance used, and there was a tendency towards the use of only one substance. As supplements to alcohol the most commonly used substances were benzodiazepines, cannabis and amphetamine. It is illustrative of the substance use problems that the consumption of only one fifth of the clients was limited to weekends. Almost half of the clients had had previous contacts with the clinic in question. Non-voluntary admission (26%) consisted of people entering outpatient treatment because of e.g. driving under the influence or requirements imposed by their workplace. On the other hand, the ability to control consumption emerged: approximately one fifth (19%) of clients had been totally abstinent for the last month before commencing treatment. In earlier international treatment research attention has likewise been paid to the fact that consumption is reduced prior to entering treatment [60, 61].
In line with earlier studies (see e.g. [39, 48]), almost half of the therapists had professional higher education. Two thirds of them were social workers (64%), while the rest were registered nurses. However, their job in all cases was therapy work with clients. Most of the therapists had worked in substance abuse treatment for a considerable time, 46% for 5–15 years and 30% for over 15 years. Methodological eclecticism was most common; 61% of therapists used combinations of different methods. Of the single technical approaches used by the therapist, cognitive therapies (12%), solution-focused therapies (12%), motivational interviewing (3%), and psychodynamic orientation (3%) emerged. Almost half of the therapist (46%) had lengthy training in therapy.
Although clients were randomly assigned to the therapists, attrition was analysed by two types of comparison. In order to exclude their effect, differences were examined by controlling for background variables selected on theoretical grounds. These included e.g. age, sex, previous contact with the treatment unit and client’s objectives for future substance use (abstinence/moderate use).
First, baseline variables were compared between clients who entered treatment unit without further entering therapy (n = 41) and those who entered therapy provided by the therapist (n = 286) differed from each other in terms of their expectations of treatment outcome, t(327) = − 2.489, p = .013. Those entering therapy had more positive expectations regarding treatment outcome.
Second, the same variables were used to compare clients who participated in the follow-up (n = 168) and those who did not (n = 159). There were significant differences in the following variables: age, t(325) = 3.464, p = .001; housing, χ2 (2, 327) = 15.353, p < .001 and using multiple substances, χ2 (1, 322) = 7.043, p = .008.Footnote 2 The clients who participated in the follow-up were about 4 years older than those who did not. They were also more often house owners or occupiers rather than living in a rented apartment, and they were more seldom homeless than the dropouts. Poly-substance use increased the likelihood of not attending follow-up. However, controlling for age largely explained the differences. The difference in housing was explained by the effect of age; younger clients lived in more deficient accommodation and were using multiple substances more often than were the older clients. These variables were considered as possible confounders in the final MCA model. Overall, it appeared that the stability of life context increased with increasing age and less problematic substance consumption supported treatment retention after treatment had begun. The client’s subjective reasons for not attending the follow-up appointment were not empirically assessed.
Treatment satisfaction mean within the sample was M = 4.24 on a five-point scale which seems relatively high. It should be taken into account that those who evaluated treatment satisfaction were those who participated in the follow-up (n = 168; 51.4%). It is highly likely that they are above average in evaluating treatment satisfaction compared to those who dropped out during treatment.
Some hierarchical blocks (client demographics and other baseline information, therapist’s interpersonal functioning) did not predict satisfaction. Statistically significant predictors were found in subsequent hierarchical blocks: client’s substance use at baseline, client’s expectations, client’s characteristics and client’s substance use at follow-up. Type of substance use (single- or poly-substance use) measured at baseline (F[1, 157] = 9.583, p = .002), expectations on treatment outcome: i.e. positive outcome will occur during the following 6 months (F[4, 160] = 3.753, p = .006) and therapist’s role in reco-very (F[4, 160] = 3.390, p = .011) predicted treatment satisfaction, as also did readiness for change (F[2, 162] = 4.923, p = .008). Type of substance use at follow-up was also statistically significant (F[1, 129] = 7.135, p = .009).
All variables found significant were included in the next model, which led to the deletion of two variables with no statistical significance in the model. Client attribution of recovery to the therapist was first removed from the analysis with non-significant p-value (.350). The predictive value of the modelFootnote 3 was R2 = .224. The variable “type of substance use at follow-up” with a p-value (.105) was next eliminated. The predictive value of the model increased slightly, R2 = .229. Type of substance use was measured similarly at baseline and at follow-up. They showed a mutual correlation despite the temporal difference between them.
Before the attribution variable was removed as a weakest independent variable, “readiness for change” was not yet statistically significant and its p-value was close to the attribution variable. Because the variables removed were statistically significant in previous analyses it was considered useful to analyse these variables more closely. Examination of the model was done by adding statistically significant variables one after another to the original client’s expectations block and gradually removing non-significant variables. In the course of this procedure, changes in the significance levels of the variables and predictive models were scrutinized. It appeared that readiness for change and attributing success to the therapist were almost uniform in explaining treatment satisfaction, but when both were entered into the model, they were not statistically significant. As a multivariate analysis, MCA seems to have similar properties since the assessment concerns the unique contribution of one variable over the rest; the strength of one explanatory variable may cause another borderline significant variable to become non-significant. This extension of the analysis proved constituent and revealed that how ready the client is to change his/her behaviour and how much the client attributes recovery to the therapist are both extremely relevant and should be included in examining treatment satisfaction. Therefore, the final model also included both these variables. At the final stage, statistically significant variables from the second attrition analysis (age-group; housing) were included in the model to study their potentially confounding effects. The variables included in the final model are presented in Table 2 below.
There were baseline differences in all variables included in the final model (Table 2). Once standardized, the differences remained similar. This speaks for the clear independent effect of these variables on treatment satisfaction. The best predictor of satisfaction with the therapist was outcome expectations at baseline: those participants with higher expectations of a positive outcome during the following 6 months were more satisfied with the treatment received. However, the connection was not perfect. A small population of those who were unsure regarding their expectations were quite satisfied. MCA as a method of analysis is good in capturing nonlinear connections. The results also showed that people using a single substance evaluated help and support received from the therapist more positively than did those using multiple substances. Those who were homeless at baseline evaluated satisfaction with the therapist more highly than others. High readiness for change also predicted treatment satisfaction, although in the final model it was not a statistically significant predictor. Attributing recovery to the therapist was similarly a non-significant predictor in the final model: the more success the client attributed to the therapist at baseline the more satisfied he/she was at follow-up. The predictive value of the final model was R2 = .299 (i.e. 30% of total variance).
Finally, we checked for a possible correlation between satisfaction and other outcome variables available in this study. Satisfaction did not correlate with retention in treatment. Instead, treatment satisfaction and percentage of days abstinent at follow-up had a positive, statistically significant correlation (r = .262, p = .001); treatment satisfaction grows as abstinent days increase.
This study was concerned with outpatient substance abuse treatment clientele and their satisfaction with treatment at follow-up. Given the nature of prospective follow-up data, we were able to answer to some of the key demands for future research set in earlier studies in determining the causal relationships between determinants and treatment satisfaction (see e.g. [17, 62]). Our findings add to the knowledge of previous studies about the factors related to client satisfaction in the Finnish outpatient substance abuse treatment system. It appeared that only few indicators had explanatory power regarding treatment satisfaction. The participants’ expectations regarding the therapist’s importance for their recovery had an effect on how they felt supported by their therapist at follow-up; satisfaction with the therapist was greatest when the pre-treatment expectations had been high. Alone, in a standardized situation, it explained almost 32% of variation in satisfaction with the treatment received. The results show that treatment expectations are a strong predictor of satisfaction at follow-up (see e.g. ). It seems that expectations regarding treatment for those clients who persevere with the treatment are fulfilled and that this becomes apparent in their evaluations of their satisfaction at follow-up.
Past substance use predicted treatment satisfaction. When standardized, it explained almost 19% of variation in treatment satisfaction. People using multiple substances were less satisfied than those using only one substance. Prior substance use has been found to be a significant predictor of treatment outcome in numerous studies [9, 18]. When the substance use problem was more complicated the client was less satisfied at follow-up. In this study, the stability of life context and how problematic the substance abuse had been before entering treatment also affected the attrition rate. In this respect, the predictive role of the complexity of the substance use problem in terms of prior use supports this same phenomenon: the more complex the problem, the greater the discrepancy between the client’s expectations and the treatment received (see e.g. ) The findings suggest that those who are most satisfied are the ones with the mildest problems. This relationship may be inverse; perhaps those respondents whose substance use is less problematic are more likely to be satisfied and compliant. It must be noted that a fairly small share of those clients who had been homeless at baseline and managed to participate in 6-month follow-up were extremely satisfied with the treatment they had received. There may have been a substantial improvement in their life situation. Housing explained 19% of variation in treatment satisfaction. Still, many were lost during treatment as the attrition analyses showed. Either way, the complexity of the substance use problem inevitably makes treatment more important. Nevertheless, according to this study, outpatient treatment has not been successful enough with this client group. An effort should be made to study how the treatment and retention of those clients with multiple problems could be improved. Both of these may reflect the important role of client’s expectations in addition to the actual treatment received (see e.g. ).
It is noteworthy that a large number of indicators did not seem to explain the variance in treatment satisfaction. We analysed 37 independent variables but only a few of them were statistically significant while others had no predictive power regarding satisfaction. For example, client demographics or therapist’s interpersonal functioning did not explain satisfaction with the help and support received from the therapist. Also, stronger predictors reduced the statistical significance of those independent variables that were statistically significant in the blocks. While testing these non-significant variables in a hierarchical block of client characteristics, readiness for change as the sole statistically significant variable predicted 24% of treatment satisfaction. Similarly, of client’s expectations, those attributed to the therapist predicted over 29% of the variance in treatment satisfaction. Therefore, the type of substance use at baseline and at follow-up, expectations regarding treatment outcome, therapist’s role in recovery and readiness to change should be all seen as antecedents to treatment satisfaction even though they were not statistically significant in the final model. In this regard, the variables were quite strongly associated with treatment satisfaction and thus the results represent a clinically meaningful relationship when studying the antecedents of satisfaction with treatment received.
It is also interesting that variables related to treatment satisfaction were primarily client-related rather than therapist-related. Our findings did not reveal many “quality of care” type measures (e.g. therapist’s interpersonal functioning) to be associated with satisfaction. Although therapist’s interpersonal characteristics, such as empathy or directiveness, have proven essential factors in terms of positive treatment outcome (e.g. [28, 29]), satisfaction seems more related to the client’s own pre-treatment expectations and views concerning treatment. Pre-treatment confidence in treatment or therapist has been found to predict good treatment outcome. Confidence is constructed as a combined effect of the client’s expectations regarding treatment and regarding themselves. (e.g. [20, 64]).
In addition, it is an advantage that this study was not profiled as a customer enquiry, which treatment units occasionally implement. The scientific impact of this study was in discovering factors that affect treatment satisfaction for those who persevere with their treatment. Systematic evaluation of treatment outcomes is increasingly becoming a customary procedure in therapeutic treatment in order to respond to emerging requirements imposed by funders, but also to inform clinical decision-making during treatment and to improve treatment effectiveness and client participation [22, 65,66,67].
The principles considered strengths in this study – i.e. prospective follow-up data gathered in naturalistic settings from the non-selected clients in several outpatient units in Finland - are dealt with in the section on methods. The study, however, has certain limitations that need to be borne in mind when evaluating the findings. The measurement of treatment satisfaction was based on the client’s own assessment. An assessment of a single-item on a scale of one to five may, however, be too crude to optimally reflect the complexity of satisfaction, although single-item measurement has been regarded as both empirically and clinically valid . Maybe a visual analog scale with low estimates to the left and high estimates to the right producing a continuous variable could be useful in examining changes in satisfaction over time by differentiating and broadening client’s experiences . By also being client-centred, measuring client satisfaction can be justified in that it serves additionally as an important measure of quality of care .
The group participating at follow-up was quite homogenous in terms of satisfaction. The treatment satisfaction mean was relatively high in this study. This may be due to the ceiling effect often observed in treatment satisfaction studies , when participants’ scores cluster toward the high end of the measure. This may also explain why therapist-related factors did not explain client satisfaction. Dropping out of treatment can be treated as an indicator of not being satisfied. Clients tend to “vote with their feet” when the therapeutic alliance is not satisfactory and the treatment received does not meet the client’s expectations [21, 39]. These people who drop out do not usually end up giving evaluations of the treatment. In this study, the follow-up rate of the study remained at 51.4%; almost half of the participants were lost to follow-up. Because of the attrition analyses performed, we know that clients with more stable life situations and less problematic substance use most likely continue with their treatment. Presumably the reasons for drop-out may vary from continued substance use to endeavours to recover naturally without treatment. Satisfaction or dissatisfaction with the help and support received from the therapist may be either uniform or varying between these groups.
The follow-up lasted 6 months and a maximum of 5 sessions per client. The duration of the follow-up period can be justified by the dynamics of addiction, in that relapses most typically occur during that period . Nevertheless, additional information on the clients’ subsequent coping would have been useful, although it was not possible to collect it within the project schedule. Treatment satisfaction, like other outcome measures, can access only one part of the entirety of treatment effectiveness. Diversity in outcome measures still pays off in treatment research. Treatment satisfaction should also be complemented with other indicators measuring treatment effectiveness (see e.g. ).
Within this study, nested design might have yielded additional information on between-therapist variation or differences between treatment units regarding their clients’ satisfaction. Due to the statistical software used, our ethical commitment not to compare different treatment units and our research goal to basically find predictive variables to treatment satisfaction, this was not studied. Also, it is entirely plausible that qualitative research methods could contribute to research in bringing the client’s experience into focus (see. e.g. ).
Many stakeholders expect treatment to be effective. Do these findings suggest that treatment satisfaction is not an important issue? Since this is a population that we know may not be satisfied, should we not engage in measuring this as researchers, clinicians and politicians?
Nowadays, researching treatment satisfaction is a choice emphasizing client-centredness (see e.g. [2, 60]). While it is important to obtain information about the factors affecting treatment effectiveness in terms of client satisfaction , on the other hand, it is important to address those problems caused by the demands of effectiveness, especially within substance abuse treatment. It has to be borne in mind that within the social services, the effectiveness of services does not always coincide with the disappearing of the client’s service needs. The problems are often complex and progress in treatment is slow.
When the demands of effectiveness and evaluation of services are seen as top-down administrative tools, they do not give a full picture of what is carried out at grass-roots level or of how these affect the clients’ lives. Paying attention to the client’s point of view renders the examination of effectiveness ethically sustainable. Systematic evaluation of treatment outcomes is becoming an increasingly customary procedure in therapeutic treatment in order to respond to emerging requirements imposed by funders, but also to inform clinical decision-making during treatment and to enhance treatment effectiveness and client participation [65,66,67]. The connection between client’s positive rating of the early therapeutic alliance and client’s satisfaction with treatment received has been reported in our earlier studies . Information about clients’ satisfaction with treatment can serve as a simple clinical tool with clear practical implications. It can help to develop treatment procedures and to improve the performance of treatment institutions, thereby contributing to social reintegration.
Availability of data and materials
Finnish Social Science Data Archive (FSD) handles the long-term preservation and dissemination of the research data. Data is accessible in accordance with the terms and conditions agreed upon by the depositor and the archive, and are available with approval from the corresponding author on reasonable request. Persistent identifiers: therapist data (urn:nbn:fi:fsd:T-FSD2688) and client data (urn:nbn:fi:fsd:T-FSD2687).
The reliability of the scale is only reported according to gender (0.86 for males, 0.84 for females) in Spielberger .
The tests of significance were carried out before a specifying elaboration. After this, the stability of inter-variable variance and the variation in the different categories were controlled.
R2 can be interpreted as a percentage of how much of the overall variance in satisfaction with treatment is explained by the selected explanatory variables included in the model.
The Alcohol Abstinence Self-Efficacy Scale
Analysis of Variance
The Client Satisfaction Questionnaire-8
Multiple Classification Analysis
State-Trait Anger Expression Inventory 2
Trait Anger Scale
Treatment Perceptions Questionnaire
University of Rhode Island Change Assessment Scale
University of Rhode Island Change Assessment Scale, the Finnish 12-item version
Kuussaari K, Partanen A. Administrative challenges in the Finnish alcohol and drug treatment system. Nordic Stud Alcohol Drugs. 2010;27(6):667–84. https://doi.org/10.1177/145507251002700611.
Orford J, Hodgson R, Copello A, John B, Smith M, Black R, Fryer K, Handforth L, Alwyn T, Kerr C, Thistlewaite G, Slegg G. UKATT research team: the clients' perspective on change during treatment for an alcohol problem: qualitative analysis of follow-up interviews in the UK alcohol treatment trial. Addiction. 2006;101(1):60–8. https://doi.org/10.1111/j.1360-0443.2005.01291.x.
Neale J, Strang J. Blending qualitative and quantitative research methods to optimize patient reported outcome measures. Addiction. 2015;110(8):1215–6. https://doi.org/10.1111/add.12896.
Neale J, Tompkins C, Wheeler C, Finch E, Marsden J, Mitcheson L, Rose D, Wykes T, Strang J. “You’re all going to hate the word ‘recovery’ by the end of this”: service users’ views of measuring addiction recovery. Drugs Educ Prev Policy. 2014;22(1):26–34. https://doi.org/10.3109/09687637.2014.947564.
Shorter GW, Heather N, Bray JW, Berman AH, Giles EL, O’Donnell AJ, Barbosa C, Clarke M, Holloway A, Newbury-Birch D. Prioritization of outcomes in efficacy and effectiveness of alcohol brief intervention trials: international multi-stakeholder e-Delphi consensus study to inform a core outcome set. J Stud Alcohol Drugs. 2019;80(3):299–309. https://doi.org/10.15288/jsad.2019.80.299.
Barbosa CD, Balp M-M, Kulich K, Germain N, Rofail D. A literature review to explore the link between treatment satisfaction and adherence, compliance, and persistence. Patient Prefer Adher. 2012;6(Jan):39–49. https://doi.org/10.2147/PPA.S24752.
Kendra MS, Weingardt KR, Cucciare MA, Timko C. Satisfaction with substance use treatment and 12-step groups predicts outcomes. Addict Behav. 2015;40(Jan):27–32. https://doi.org/10.1016/j.addbeh.2014.08.003.
Green SM, Hadjistavropoulos T, Sharpe D. Client personality characteristics predict satisfaction with cognitive behavior therapy. J Clin Psychol. 2008;64(1):40–51. https://doi.org/10.1002/jclp.20429.
Adamson SJ, Sellman JD, Frampton CMA. Patient predictors of alcohol treatment outcome: a systematic review. J Subst Abus Treat. 2009;36(1):75–86. https://doi.org/10.1016/j.jsat.2008.05.007.
Carlson MJ, Gabriel RM. Patient satisfaction, use of services, and one-year outcomes in publicly funded substance abuse treatment. Psychiatr Serv. 2001;52(9):1230–6. https://doi.org/10.1176/appi.ps.52.9.1230.
Dearing RL, Barrick C, Dermen KH, Walitzer KS. Indicators of client engagement: influences on alcohol treatment satisfaction and outcomes. Psychol Addict Behav. 2005;19(1):71–8. https://doi.org/10.1037/0893-164X.19.1.71.
Donovan DM, Kadden RM, DiClemente CC, Carroll KM. Client satisfaction with three therapies in the treatment of alcohol dependence: results from project MATCH. Am J Addict. 2002;11(4):291–307. https://doi.org/10.1080/10550490290088090.
Morris ZS, McKeganey N. Client perceptions of drug treatment services in Scotland. Drugs Educ Prev Policy. 2007;14(1):49–60. https://doi.org/10.1080/09687630600906437.
Zhang Z, Gerstein DR, Friedmann PD. Patient satisfaction and sustained outcomes of drug abuse treatment. J Health Psychol. 2008;13(3):388–400. https://doi.org/10.1177/1359105307088142.
McLellan AT, Hunkeler E. Patient satisfaction and outcomes in alcohol and drug abuse treatment. Psychiatr Serv. 1998;49(5):573–5. https://doi.org/10.1176/ps.49.5.573.
Tetzlaff BT, Kahn JH, Godley SH, Godley MD, Diamond GS, Funk RR. Working alliance, treatment satisfaction, and patterns of posttreatment use among adolescent substance users. Psychol Addict Behav. 2005;19(2):199–207. https://doi.org/10.1037/0893-164X.19.2.199.
Batbaatar E, Dorjdagva J, Luvsannyam A, Savino MM, Amenta P. Determinants of patient satisfaction: a systematic review. Perspect Public Health. 2017;137(2):89–101. https://doi.org/10.1177/1757913916634136.
Stallvik M, Flemmen G, Salthammer JA, Nordfjærn T. Assessing health service satisfaction among users with substance use disorders within the municipalities in Norway. Subst Abuse Treat Prev Policy. 2019;14:18. https://doi.org/10.1186/s1e3011-019-0207-4.
Boden MT, Moos R. Predictors of substance use disorder treatment outcomes among patients with psychotic disorders. Schizophr Res. 2013;146(1–3):28–33. https://doi.org/10.1016/j.schres.2013.02.003.
Kuusisto K, Knuuttila V, Saarnio P. Clients' self-efficacy and outcome expectations: impact on retention and effectiveness in outpatient substance abuse treatment. Addict Disorders Treat. 2011a;10(4):157–68. https://doi.org/10.1097/ADT.0b013e31820dd4ec.
Kuusisto K, Knuuttila V, Saarnio P. Pre-treatment expectations in clients: impact on retention and effectiveness in outpatient substance abuse treatment. Behav Cogn Psychothe. 2011b;39(3):257–71. https://doi.org/10.1017/S1352465810000846.
Myers B, Govender R, Koch JR, Mandelscheid R, Johnson K, Parry CDH. Development and psychometric validation of a novel patient survey to assess perceived quality of substance abuse treatment in South Africa. Subst Abuse Treat Prev Policy. 2015;10:44. https://doi.org/10.1186/s13011-015-0040-3.
Ruggeri M, Dall’Agnola RB, Bisoffi G, Greenfield TK. Factor analysis of the Verona service satisfaction Scale-82 and development of reduced versions. Int J Meth Psych Res. 1996;6(1):23–38.
Sidani S, Epstein DR. Toward a conceptualization and operationalization of satisfaction with nonpharmacological interventions. Res Theory Nurs Pract. 2016;30(3):242–57. https://doi.org/10.1891/1541-65188.8.131.52.
DiClemente CC, Prochaska JO. Toward a comprehensive, transtheoretical model of change. In: Miller W, Heather N, editors. Treating addictive behaviors. New York: Plenum Press; 1998.
Spielberger C. STAXI-2. State-trait anger expression inventory-2. Professional manual. Odessa: Psychological Assessment Recources; 1999.
Waldron HB, Miller WR, Tonigan JS. Client anger as a predictor of differential response to treatment. In: Longabaugh R, Wirtz PW, editors. Project MATCH hypothesis: results and causal chain analyses. Project MATCH monograph series Vol. 8. Bethesda: NIAAA; 2001.
Karno MP, Longabaugh R. Does matching matter? Examining matches and mismatches between patient attributes and therapy techniques in alcoholism treatment. Addiction. 2007;102(4):587–96. https://doi.org/10.1111/j.1360-0443.2007.01754.x.
Najavits LM, Crits-Christoph P, Dierberger A. Clinicians’ impact on the quality of substance use disorder treatment. Subst Use Misuse. 2000;35(12–14):2161–90.
Imel ZE, Wampold BE, Miller SD, Fleming RR. Distinctions without a difference: direct comparisons of psychotherapies for alcohol use disorders. Psychol Addict Behav. 2008;22(4):533–43. https://doi.org/10.1037/a0013171.
Wampold BE. How important are the common factors in psychotherapy? An update. World Psychiatry. 2015;14(3):270–7. https://doi.org/10.1002/wps.20238.
Larsen DL, Attkisson CC, Hargreaves WA, Nguyen TD. Assessment of client/patient satisfaction: development of a general scale. Eval Program Plann. 1979;2(3):197–207. https://doi.org/10.1016/0149-7189(79)90094-6.
Attkisson CC, Greenfield TK. The Client Satisfaction Questionnaire (CSQ) scales and the Service Satisfaction Scale-30 (SSS-30). In: Sederer LI, Dickey B, editors. Outcome Assessment in Central Practice. Baltimore: Lippincott William and Wilkins; 1996. p. 120–7.
Marsden J, Duncan S, Gossop M, Rolfe A, Bacchus L, Griffiths P, Clarke K, Strang J. Assessing client satisfaction with treatment for substance use problems and the development of the treatment perceptions questionnaire (TPQ). Addict Res. 2000;8(5):455–70. https://doi.org/10.3109/16066350009005590.
Ruggeri M, Lasalvia A, Dall’Agnola R, van Wijngaarden B, Knudsen HC, Leese M, Gaite L, Tansella M. Development, internal consistency and reliability of the Verona service satisfaction scale - European version. Epsilon study 7. Br J Psychiatry. 2000;177(Suppl 39):41–8. https://doi.org/10.1192/bjp.177.39.s41.
de los Cobos Perés J, Valero S, Haro G, Fidel G, Escuder G, Trujols J, Valderrama JC. Development and psychometric properties of the Verona Service Satisfaction Scale for methadone-treated opioid-dependent patients (VSSS-MT). Drug Alcohol Depend. 2002;68(2):209–14. https://doi.org/10.1016/S0376-8716(02)00196-5.
Grupp K. Women one year following gender-specific treatment for alcohol and/or other drug dependency. J Addict Nurs. 2006;17(1):5–11. https://doi.org/10.1080/10884600500521817.
Joe GW, Friend HJ. Treatment process factors and satisfaction with drug abuse treatment. Psychol Addict Behav. 1989;3(2):53–64. https://doi.org/10.1037/h0080570.
Knuuttila V, Kuusisto K, Saarnio P, Nummi T. Early working Alliance in outpatient substance abuse treatment: predicting substance use frequency and client satisfaction. Clin Psychol. 2012;16(3):123–35. https://doi.org/10.1111/j.1742-9552.2012.00049.x.
Morris ZS, Gannon M. Drug misuse treatment services in Scotland: predicting outcomes. Int J Qual Health C. 2008;20(4):271. https://doi.org/10.1093/intqhc/mzn019.
Andersson HW, Otterholt E, Gråwe RW. Patient satisfaction with treatments and outcomes in residential addiction institutions. Nordic Stud Alcohol Drugs. 2017;34(5):375–84. https://doi.org/10.1177/1455072517718456.
Kypri K, Langley JD, Saunders JB, Cashell-Smith ML. Assessment may conceal therapeutic benefit: findings from a randomized controlled trial for hazardous drinking. Addiction. 2007;102(1):62–70. https://doi.org/10.1111/j.1360-0443.2006.01632.x.
Responsible conduct of research and procedures for handling allegations of misconduct in Finland (2012). [https://www.tenk.fi/fi/tenkin-ohjeistot] Accessed on 17 Sept 2019.
The Ethical principles of research with human participants and ethical review in the human sciences in Finland (2019). [https://www.tenk.fi/fi/eettinen-ennakkoarviointi-suomessa] Accessed on 17 Nov 2019.
The European code of conduct for research integrity. Revised edition. Allea - All European Academics. [https://allea.org/code-of-conduct/] Accessed on 17 Nov 2019.
Saarnio P, Knuuttila V. A study of risk factors in dropping out from inpatient treatment of substance abuse. J Subst Use. 2003;8(1):33–8. https://doi.org/10.1080/1465989031000067227.
Saarnio P, Knuuttila V. A study of readiness to change profiles in alcohol and other drug abusers. J Addict Nurs. 2007;18(3):117–22. https://doi.org/10.1080/10884600701500602.
Knuuttila V, Kuusisto K, Saarnio P. Client characteristics and therapist style: a combined analysis of impact on retention and effectiveness in outpatient substance abuse treatment. Nordic Stud Alcohol Drugs. 2011;28(4):321–38. https://doi.org/10.2478/v10199-011-0028-x.
DiClemente CC, Carbonari JP, Montgomery RPG, Hughes SO. The alcohol abstinence self-efficacy scale. J Stud Alcohol. 1994;55(2):141–8. https://doi.org/10.15288/jsa.1994.55.141.
DiClemente CC, Hughes SO. Stages of change profiles in outpatient alcoholism treatment. J Subst Abus. 1990;2(2):217–35. https://doi.org/10.1016/s0899-3289(05)80057-4.
Valle S. Interpersonal functioning of alcoholism counselors and treatment outcome. J Stud Alcohol. 1981;42(9):783–90. https://doi.org/10.15288/jsa.1981.42.783.
Carkhuff R, Berenson B. Beyond counseling and therapy. New York: Holt, Rinehart and Winston; 1977.
Andrews F, Morgan J, Sonquist J. Multiple classification analysis: a report on a computer program for multiple regression using categorical predictors. Ann Arbor: Survey Research Center, Institute for Social Research; 1967.
Hardy MA, Baird CL. Multiple Classification Analysis (MCA). In: Lewis-Beck MS, Bryman A, Liao TF, editors. The SAGE encyclopedia of social science research methods. Thousand Oaks: Sage; 2011. [https://methods.sagepub.com/Reference/the-sage-encyclopedia-of-social-science-research-methods] Accessed on 17 Nov 2019.
Alkula T, Pöntinen S, Ylöstalo P. Sosiaalitutkimuksen kvantitatiiviset menetelmät. Helsinki: WSOY; 1995.
Jokivuori P, Hietala R. Määrällisiä tarinoita. Monimuuttujamenetelmien käyttö ja tulkinta. Helsinki: WSOY; 2007.
Connors GJ, Carroll KM, DiClemente CC, Longabaugh R, Donovan DM. The therapeutic alliance and its relationship to alcoholism treatment participation and outcome. J Consult Clin Psychol. 1997;65(4):588–98. https://doi.org/10.1037//0022-006x.65.4.588.
Fitzpatrick R. Surveys of patient satisfaction: I - important general considerations. Br Med J. 1991;302(6781):887–9. https://doi.org/10.1136/bmj.302.6781.887.
Saarnio P. Factors associated with dropping out from outpatient treatment of alcohol-other drug abuse. Alcohol Treat Q. 2002;20(2):17–33. https://doi.org/10.1300/J020v20n02_02.
Bergmark A. On treatment mechanisms: what can we learn from the COMBINE study? Addiction. 2008;103(5):703–5. https://doi.org/10.1111/j.1360-0443.2007.02073.x.
Stout R, Del Boca F, Carbonari J, Rychtarik R, Litt MD, Cooney NL. Primary treatment outcomes and matching effects: Outpatient arm. In: Babor TF, Del Boca FK, editors. Treatment matching in alcoholism. Cambridge: Cambridge University Press; 2003. p. 105–34.
Kelly PJ, Kyngdon F, Ingram I, Deane FP, Baker AL, Osborne BA. The client satisfaction Questionnaire-8: psychometric properties in a cross-sectional survey of people attending residential substance abuse treatment. Drug Alcohol Rev. 2018;37(1):79–86. https://doi.org/10.1111/dar.12522.
Messer SB, Wampold BE. Let’s face facts: common factors are more potent than specific therapy ingredients. Clin Psychol-Sci Pr. 2002;9(1):21–5. https://doi.org/10.1093/clipsy.9.1.21.
Cooney NL, Babor TF, DiClemente CC, et al. Clinical and scientific implications of project MATCH. In: Babor TF, Del Boca FK, editors. Treatment matching in alcoholism. Cambridge: Cambridge University Press; 2003.
Lambert MJ, Hansen NB, Finch AE. Patient-focused research: using patient outcome data to enhance treatment effects. J Consult Clin Psychol. 2001;69(2):159–72. https://doi.org/10.1037/0022-006X.69.2.159.
Lambert MJ, Whipple JL, Hawkins EJ, Vermeersch DA, Nielsen SL, Smart DW. Is it time for clinicians to routinely track patient outcome? A meta-analysis. Clin Psychol-Sci Pr. 2003;10(3):288–301. https://doi.org/10.1093/clipsy.bpg025.
Miller SD, Duncan BL, Brown J, Sparks JA, Claud DA. The outcome rating scale: a preliminary study of the reliability, validity, and feasibility of a brief visual analog measure. J Brief Ther. 2003;2(2):91–100 [https://www.researchgate.net/publication/242159752_The_Outcome_Rating_Scale_A_Preliminary_Study_of_the_Reliability_Validity_and_Feasibility_of_a_Brief_Visual_Analog_Measure].
Kirshenbaum AP, Olsen DM, Bickel WK. A quantitative review of the ubiquitous relapse curve. J Subst Abus Treat. 2009;36(1):8–17. https://doi.org/10.1016/j.jsat.2008.04.001.
Tiffany ST, Friedman L, Greenfield SF, Hasin DS, Jackson R. Beyond drug use: a systematic consideration of other outcomes in evaluations of treatments for substance use disorders. Addiction. 2011;107(4):709–18. https://doi.org/10.1111/j.1360-0443.2011.03581.x.
Funding for the design of the study, data collection, analysis, and interpretation of data was provided by the Academy of Finland (grant 118327) and in writing the manuscript by the Finnish Foundation for Alcohol Studies.
Ethics approval and consent to participate
Ethical approval for this study was received from The Ethical Committee of A-Clinic Foundation. Having received a brochure describing the research, a client gave consent to being a research subject. The client was apprised of the research ethics. In this study, we have adhered to established ethical rules in accord with the Helsinki Declaration and the guidelines of the Finnish codes of research ethics and governance and with the codes of research integrity in Europe and the guidelines of the Finnish professional systems.
Consent for publication
The authors declare that they have no competing interests.
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
About this article
Cite this article
Kuusisto, K., Lintonen, T. Factors predicting satisfaction in outpatient substance abuse treatment: a prospective follow-up study. Subst Abuse Treat Prev Policy 15, 35 (2020). https://doi.org/10.1186/s13011-020-00275-5
- Substance use
- Substance abuse treatment
- Client-centred evaluation
- Service user