Skip to main content

Psychometric validation of the Chinese Version of the stimulant relapse risk scale (SRRS) in patients with methamphetamine use disorder

Abstract

Background

Evaluating the risk of relapse is a pivotal step in the treatment of patients with methamphetamine use disorder (MUD). The 30-item Stimulant Relapse Risk Scale (SRRS) was originally developed in Japan to meet the demand. This study examined the reliability, validity, and factor structure of the Chinese version of the SRRS for patients with MUD.

Methods

247 patients with MUD self-rated the Chinese version of the SRRS. Cronbach’s alpha coefficients and inter-item correlation analysis were used to assess the internal consistency reliability. Construct validity was determined through confirmatory factor analysis (CFA), and concurrent validity was examined using the visual analogue scale (VAS) for drug craving and the severity of dependence scale (SDS). We followed the participants for 1 year and assessed the predictive validity based on the correlation of the scores of the Chinese version of the SRRS with the relapse rate within 3, 6, and 12 months of follow-up.

Results

CFA revealed satisfactory model fit estimates for the 22-item Chinese version of the SRRS that consisted of four subscales. The four-factored 22-item Chinese version of the SRRS had adequate internal consistency with Cronbach’s alphas ranging from 0.76 to 0.92. The 22-item Chinese version of the SRRS scores were significantly correlated with the VAS and SDS scores as well as the relapse rate within 3, 6, and 12 months, indicating good concurrent and predictive validity of this scale. The receiver operating characteristic curve revealed a cutoff score of 40 could discriminate between participants with (SDS score ≥ 4) and without (SDS score < 4) methamphetamine dependence (area under the curve = 0.71, p < 0.01).

Conclusions

The 22-item Chinese version of the SRRS that consists of four subscales is a valid and reliable instrument to assess the relapse risk in patients with MUD.

Introduction

Amphetamine-type stimulants are a group of psychostimulant drugs that are chemical derivatives of the parent compound alpha methylphenethylamine. Among these drugs, methamphetamine accounts for 95% of all manufactured amphetamine-type stimulants [1] and is the second most widely used illegal drug in the world [2, 3]. Methamphetamine use disorder (MUD) is a relapsing disorder that poses a significant threat to public health worldwide. According to the World Drug Report, In 2021, an estimated 36 million people aged 15–64 years old are estimated to have used amphetamines (methamphetamine and amphetamine) worldwide [4]. Long-term use of methamphetamine has been associated with adverse consequences including psychosis, depression, suicidality [5], cardiovascular and cerebrovascular diseases [6], sexually transmitted infection [7], and overdose [7, 8].

Because methamphetamine is highly addictive, MUD is associated with a high risk of relapse even after treatment. Studies involving patients with MUD who sought treatment have revealed post-treatment relapse rates ranged from 61% [9] to 69% ` [10]. Relapse is the major obstacle in substance use treatment and the most common outcome measure in substance-related research [11]. Evaluating the risk of relapse is a pivotal step in treating patients with MUD. This evaluation enables the design of a tailored intervention for patients with different risk levels, optimizing the efficient allocation of care services. Therefore, the development of a reliable tool to assess the relapse risk of those with MUD is indispensable in clinical service. Assessment of the relapse risk is complicated because various dimensions may jointly influence the risk of relapse, such as craving [12], stress [13], negative emotional states, and cognitive function [14, 15], and thus underscoring the necessity to incorporate multiple factors when developing tools to assess relapse risk for individuals who use substance. So far, only limited instruments have been developed to achieve this goal. The Advanced WArning of RElapse (AWARE) scale is a single-factored tool that has been validated to predict the relapse risk of substance use at 1-, 3-, and 6-months post-discharge [16]. Nevertheless, that study has theoretical limitation as the scale assesses reuse any substances, such as alcohol, marijuana, heroin, and cocaine, without accounting for the varying pharmacological effects, reasons for use, and user characteristics associated with each substance. Another recently published scale, the Risk of Relapse Assessment Scale (RRAS) was also demonstrated to be a good instrument measure the risk of relapse to methamphetamine use. The 16-item RRAS consisted of 3 dimensions, included ‘craving for methamphetamine’, ‘social recognition’, and ‘attitude towards methamphetamine’. Despite favorable construct validity and reliability of the RRAS, the predictive validity has not been assessed and validated [17]. With reference to the Marijuana Craving Questionnaire [18], Ogai et al. (2007) developed the Stimulant Relapse Risk Scale (SRRS) in Japan to measure the multiple facets of risk of stimulant reuse [19]. The SRRS is a multidimensional self-rated scale comprising 30 items in five dimensions: (1) anxiety and intention to use the drug (AI), (2) emotionality problems (EP), (3) compulsivity for the drug (CD), (4) positive expectancies and lack of control over the drug (PL), and (5) lack of negative expectancy for the drug (NE). The internal consistency, concurrent validity, and predictive validity of these subscales have been demonstrated to be adequate; thus, the SRRS is appropriate for predicting the relapse of stimulant use disorder, including MUD.

In Taiwan, methamphetamine surged to become the major illegal drug use since its epidemic in early 1990s. The recent two waves of National Survey of Substance Use respectively held in 2014 [20] and 2018 [21] reveal that methamphetamine remains the predominant illegal drug of use in Taiwan. Given the prevalence of methamphetamine use, it is imperative to have a reliable instrument to assess the relapse risks in people who use methamphetamine. Therefore, in the present study we aimed to examine the psychometric properties of the Chinese version of the SRRS by investigating its reliability, factor structure, and validity. In addition, we followed patients seeking MUD treatment for one year to explore the potential of the Chinese version of the SRRS to predict relapse during 3, 6, and 12 months.

Materials and methods

Participants and study design

This was a prospective study conducted in Taiwan. The study complied with the ethical standards described in the Declaration of Helsinki and received approval from the Institutional Review Board of the Taipei City Psychiatric Center (TCPC; ITCHIRB-10,810,018) before the study began. A thorough description of the study, encompassing its purpose, procedures, potential risks, benefits, the voluntary nature of their involvement, as well as the right to privacy protection and withdrawal from the study at any time, was provided prior to obtaining written informed consent for participation.

A total of 247 individuals who used methamphetamine and sought addiction treatment at the Department of Addiction Sciences, Taipei City Psychiatric Center of Taipei City Hospital, were recruited from January 1, 2016, to August 30, 2018. The treatment program was implemented in the outpatient setting for 12 months and was based on a standardized protocol that adopts a multicomponent approach involving a motivational interview, psychotherapy aimed at relapse prevention, and regular urine toxicology tests for methamphetamine and other illicit drugs. The inclusion criteria of our study were as follows: (1) age ≥ 18 years; (2) fulfillment of the Diagnostic and Statistical Manual of Mental Disorders, 5th Edition criteria for stimulant use disorder, amphetamine-type substance (methamphetamine), as verified by at least one board-certified psychiatrist; (3) with methamphetamine as the main drug of use in the past. The exclusion criteria were: (1) having a history of other substance use disorder, except tobacco; (2) inability to read Chinese and provide written informed consent. Research assistants were trained for collecting demographic data, administering the Chinese version of the SRRS, and conducting other psychological assessments.

Instruments and measures

The Chinese version of the SRRS

Consistent with the standard forward–backward translation procedure (WHO, www.who.int/substance_abuse/research_tools/translation/en/), the Chinese version of the SRRS was first translated from its original version (i.e., the SRRS) in Japanese [19] into Chinese by two independent translators. Inconsistencies identified between the two translators were addressed through discussion involving another unbiased, bilingual translator (one of the researchers). Following this, back-translation was carried out by the two independent translators. To verify the translation accuracy, the back-translated version underwent discussion with the original developer [19]. The pre-final version of the translated scale was modified and reviewed by several mental health experts until a consensus was reached on all items, resulting in the final version of the scale.

The Chinese version of the SRRS comprises 30 items distributed among five subscales and features five additional items (Items 4, 11, 13, 15, and 26) as supplementary questions for the construct insight into mental condition (Supplementary Table 1). The five subscales and the respective items are as follows: (1) anxiety and intention to use the drug (AI) (Items 1, 2, 6, 12, 22, 27, 33, and 35; total = 8); (2) emotionality problems (EP) (Items 3, 5, 7, 10, 16, 19, 23, and 25; total = 8); (3) compulsivity for the drug (CD) (Items 8, 28, 31, and 3; total = 4); (4) positive expectancies and lack of control over the drug (PL) (Items 18, 20, 24, 29, 30, and 32; total = 6); and (5) negative expectancy for the drug (NE) (Items 9, 14, 17, and 21; total = 4). We examined the inner structure without the supplementary questions by using factor analysis. All items are listed in Supplementary Table 1. Item scores range from 1 (strongly disagree) to 5 (strongly agree), except for five items (Items 9, 12, 14, 17, and 21), which were reversely coded.

Measurements for concurrent validity

To evaluate the concurrent validity, we explored the correlation of the Chinese version of the SRRS scores with the severity of craving and methamphetamine dependence respectively. The severity of craving was measured by visual analogue scale (VAS) of the subjective intensity of craving for methamphetamine. Participants responded to the question “How strong is your craving for methamphetamine?” on a 0–100 scale, with “no craving” and “extreme craving” being the anchors on the extreme left and right of the scale, respectively [22, 23]. With regard to the severity of methamphetamine dependence, participants self-administered the 4-item Severity of Dependence Scale (SDS), the Chinese version of which was previously validated [24]. A score of ≥ 4 on the scale is indicative of the presence of severe methamphetamine dependence [25]. We also determined the potential of the Chinese version of the SRRS to distinguish the participants with or without a possible presence of methamphetamine dependence, analogous to the severe form of MUD.

Measurements for predictive validity

To assess predictive ability of the baseline scores on the Chinese version of the SRRS for relapse risk, the records of relapse within the subsequent 3, 6, and 12 months of follow-up were collected. Relapse was operationally defined as “any positive urine toxicology result for methamphetamine or verbal report of methamphetamine use during the follow-up period.”

Statistical analysis

Calculated Cronbach’s alpha coefficients and inter-item correlation matrix analysis were used to assess the internal consistency reliability of the total Chinese version of the SRRS and its subscales. Cronbach’s alpha value of ≥ 0.7 [26] and item–total correlation of > 0.4 [27] were considered statistically acceptable.

Confirmatory factor analysis (CFA) was conducted to examine construct validity based on the original subconstructs suggested by [19]Ogai et al. (2007) using the CALIS procedure in SAS version 9.4 (SAS Institute, Cary, NC) CFA was performed using the robust maximum likelihood estimator method to determine the goodness of fit. Five indices were analyzed to evaluate the model fit: chi-square (χ2), normed chi-square (CMIN/DF ≈ 2) [28], adjusted goodness of fit index (AGFI) > 0.8 [29]; comparative fit index (CFI) > 0.9 [30]; standardized root mean square residual (SRMR) < 0.06 [23]; and root mean square error of approximation (RMSEA) < 0.08 [22]. Lagrange multiplier (LM, called a modification index in AMOS) estimates of item loadings of different factors were assessed to identify complex items and potential ways to improve the model [31]. The CFA model was modified until all the model fit indices met the established criteria. Notably, all deletions and modifications were incorporated one by one, and the CFA model was respecified following each modification.

The concurrent validity was determined by Pearson’s correlation analysis of the Chinese version of the SRRS with VAS and SDS scores.The receiver operating characteristic (ROC) curves with Youden’s index were used to determine the optimal cutoff points for the Chinese version of the SRRS scores in participants with high or low methamphetamine dependence severity based on SDS ≥ 4 and < 4, respectively. An area under the ROC curve (AUC) of 0.7 and 0.9 indicates moderate accuracy, and an AUC above 0.9 indicates high accuracy (Fischer, 2003). Finally, to estimate the predictive validity, we calculated the correlation of the Chinese version of the SRRS scores with the relapse rate with 3, 6, 12 months of follow-up. The data of participants who dropped out during the follow-up period were excluded from Pearson correlation model.

All statistical analyses were conducted using SAS (version 9.4). Descriptive statistics were calculated for all variables (i.e., medians and interquartile ranges [IQRs] for continuous variables and percentages for categorical variables).

Results

Participant characteristics

A total of 247 patients were recruited. The mean age of the participants was 34 (IQR = 30–41) years, with men being predominant (n = 227; 90.7%). Most of the participants were unmarried (73.6%) and employed (89.07%). The average duration of methamphetamine use was 3 years. During the follow-up period of 3, 6, and 12 months, 56 (22.67%), 75 (30.36%), and 94 (38.05%) participants experienced relapse, respectively. Table 1 summarizes the other demographic and methamphetamine use characteristics including detailed relapse rate and drop-out rate.

Table 1 Baseline demographic and clinical characteristics of participants (N = 247)

Reliability analysis of internal consistency

Table 2 presents the item characteristics, descriptive statistics, and internal consistency reliability of the Chinese version of the SRRS. The Cronbach’s alpha coefficient for the total score of these items was 0.92, with item coefficient of “Cronbach’s alpha if item deleted” ranging from 0.91 to 0.92. The item–total correlations ranged from 0.02 to 0.73. Because of poor internal consistency, with item–-total correlations was less than 0.4 for each [27], four items (items 9, 14, 17, and 21) on the NE subscale were discarded. The Cronbach’s alpha coefficients for AI, EP, CD, and PL subscales ranged from 0.80 to 0.86, indicating satisfactory internal consistency across dimensions. A detailed overview of the aforementioned item characteristics and item–subscale total correlations are provided in Table 3. The remaining 26 items, representing a four-factor structure, were further analyzed in the CFA model.

Table 2 Item characteristics, item–total correlations, and Cronbach’s alpha values if an item is deleted in the Chinese version of the SRRS (N = 247)
Table 3 Item characteristics, item–total correlations, and Cronbach’s alpha values if an item is deleted in the Chinese version of the SRRS (N = 247)

Construct validity

CFA was used to examine the goodness of fit of the 26-item Chinese version of the SRRS (Supplementary Fig. 1). The goodness-of-fit indices revealed that the Chinese version of the SRRS did not fit the data well (normed χ2 = 2.18, AGFI = 0.80, CFI = 0.90, SRMR = 0.07, and RMSEA = 0.07). Four items (Items 2, 3, 23, and 35) had high LM scores, indicating cross-loadings on two or more factors. Hence, these four items were removed to maximize the item–remainder Cronbach’s alpha coefficients and factor loadings, yielding the final Chinese version of the SRRS composed of 22 items (Fig. 1). The modified 22-item Chinese version of the SRRS model fit the data well (normed χ2 = 1.93, AGFI = 0.84, CFI = 0.93, SRMR = 0.06, and RMSEA = 0.06). The CFA fit indices are presented in Table 4. Figure 1 illustrates the correlation matrices among the latent variables and factor loadings; all standardized factor loadings exceeded the threshold of 0.4, indicating that the item–total correlations of the Chinese version of the SRRS items were within acceptable ranges [32]. Regarding internal consistency, the subscales and total 22-item version had favorable Cronbach’s alpha coefficients, ranging from 0.76 to 0.92, respectively (Table 5)

Table 4 Confirmatory factor analysis fit indices (N = 247)
Table 5 Cronbach’s alpha of each subscale of the Chinese version of the SRRS and correlation with VAS, SDS, and relapse (N = 247)
Fig. 1
figure 1

Structural model with factor loading, error variance, and correlations

Single headed arrow reflects factor loading and error variance. Double headed arrows display correlation. Factor loading and correlation are presented as standardized estimates

Concurrent validity

The 22-item Chinese version of the SRRS and its subscales scores significantly correlated with the VAS (r = 0.59, p < 0.01 for the Chinese version of the SRRS total scores; r = 0.63 − 0.31, p < 0.01 for the subscales scores) and the SDS scores (r = 0.39, p < 0.01 for the Chinese version of the SRRS total scores; r = 0.42 − 0.15, p < 0.01–0.05 for the subscales scores), suggesting the Chinese version of the SRRS had favorable concurrent criterion validity (Table 5). ROC curve analysis revealed that the 22-item Chinese version of the SRRS had moderate accuracy to discriminate individuals with (SDS score of ≥ 4) and without (SDS score of < 4) methamphetamine dependence (estimate: 1.07; 95% confidence interval: 1.041.09), with an AUC of 0.71 (Fig. 2). Considering the maximum Youden’s J value, an optimal cutoff score of 40 could distinguish between patients with low and high methamphetamine dependence in the current analysis (Youden’s J = 1.38; sensitivity = 60%, specificity = 78%) (Supplementary Table 2).

Fig. 2
figure 2

The ROC curve of the 22-item Chinese version of the SRRS to discriminate between participants with or without methamphetamine dependence

Note: A cutoff score of 40 of the Chinese version of the SRRS yielded an AUC of 0.71, reaching 60% sensitivity and 78% specificity (p < 0.01)

Predictive validity

Table 5 presents the relationships of the 22-item Chinese version of the SRRS scores with relapse rates during the 3-, 6-, and 12-month follow-up periods. Except CD subscale, the total and AI/PE subscale scores were significantly correlated with the relapse rate at all time points, with the strength of the correlation decreasing over time (r = 0.22 − 0.18, p < 0.01 at 3- and 6- month, but r = 0.14, p < 0.05 at 12-month). EP also exhibited a similar trend—the correlation with the relapse rate was weak positive significant initially (at 3 and 6 months) but diminished at longer follow-ups (at 12 months).

Discussion

To the best of our knowledge, this is the first study to examine the factor structure, reliability, and validity of the Chinese version of the SRRS in patients with MUD. Our results indicated that the 22-item Chinese version of the SRRS with four subscales—AI, EP, CD, and PL— generally had satisfactory reliability and validity. The concurrent validity of the 22-item Chinese version of the SRRS and its four subscales was confirmed through its significant correlation with the VAS and SDS scores. The ROC curve results also revealed that with a cutoff score of 40, the 22-item Chinese version of the SRRS had a moderate accuracy to differentiate between individuals with high and low severity of methamphetamine dependence. Moreover, the significant correlation of the 22-item Chinese version of the SRRS scores with 3-, 6-, and 12-month methamphetamine relapse rates suggests the 22-item Chinese version of the SRRS has strong predictive validity. These observations collectively highlight that the present 22-item Chinese version of the SRRS may serve as a useful instrument for assessing the various aspects of relapse in patients with MUD.

The multidimensional structures of the Chinese version of the SRRS and the original SRRS have similarities and differences. In the initial reliability analysis of the Chinese version of the SRRS, the four items of the NE subscale (Items 9, 14, 17, and 21) demonstrated poor item–total correlations and were discarded, yielding a 26-item scale with a four-factor structure. This structure differs from that of the original Japanese version of SRRS, which contains five factors. The poor Cronbach’s alpha value for this subscale in our study is consistent with that obtained for the original version (0.545) [19]; that is, the internal consistency of this subscale was insufficient in both studies. The four items that constitute the NE subscale measure the lack of negative expectancy, referring to the influence of an individual’s expectations of substance-related outcomes on the initiation and maintenance of substance use [19, 33, 34]. Positive expectancies about substance use may increase the risk of relapse, whereas negative expectancies decrease the risk [33, 34]. However, evidence regarding the impact of negative expectancies on substance-taking behavior is limited [33, 34]. In addition, Item 14 (“I am afraid of hallucinations due to drug use”) and Item 17 (“I would not be able to control myself if I use the drug”), which previously formed a part of the NE subscale, were reverse-scored items. Reverse-scored items, designed to prevent a response bias, may lead to respondent confusion. In Asian culture, “not be able to control” may imply either a disinhibition effect secondary to drug use or poor control of personal impulsivity, and an experience of hallucination may imply “going crazy” or having an existing mental disorder. The potential for item misinterpretation and effect of societal stigma may result in unreliable answers to these two items.

Based on CFA results, four items (Items 2, 3, 23, and 35) were further discarded, yielding the final 22-item Chinese version of the SRRS, which is different from the original 30-item SRRS. The aforementioned four items exhibited high LM scores, indicating the items carried cross-loadings on two or more factors. For example, Items 2 and 35, which were derived from the AI subscale, and Item3 from the EP subscale exhibited substantial cross-loadings on non-targeted CD factor. The cross-loadings were also observed for Item 23, which was derived from the EP subscale but exhibited cross-loadings on non-targeted AI factors. The results for Item 2 (“There are times I want to use the drug “) and Item 35 (“Even though I know I will be arrested, I would use the drug”) could be explained based on the multidimensional manifestations of drug craving, which might result in divergent interpretation among individuals. The development process of craving has been conceptualized from distinct theoretical constructs; no conceptual construct can fully depict the complex phenomenon of craving. For instance, compulsivity, expectancy, anxiety about relapse, and intention to use drugs have all been proposed as key components of craving. In classical learning models and the obsessive-compulsive theory of substance dependence, which are characterized by conditioned reinforcement and compulsive drug use [12, 18, 35], craving is regarded as a conditioned and anticipatory response to drug-related stimuli such as drug-like or withdrawal-like effects [12, 36]. However, from the cognitive-behavioral perspective, craving is mediated by the anticipated effect of taking the drug [12, 36]. As a result, craving can take various forms, including liking, wanting, urges, desires, need, intention, expectancy, anticipation, or compulsion to use [19, 36]. According to obsessive–compulsive theory, the items on the CD subscale may reflect the craving phenomenon whereas the items on the AI subscale may reflect anxiety about relapse, anticipation of relapse, retrial of memory about using drugs, and intention to use drugs. Item 2 (“There are times I want to use the drug”) and Item 35 (“Even though I know I will be arrested, I would use the drug’) refer to the intention to use the drug in response to cravings and even further compulsion to use drug, despite harmful consequences. On the other hand, Item 3 and Item 23 were originally categorized into EP subscale, which reflects “common feelings and moods, especially negative emotional states observed before relapse of drug use”. However, for Item 3 (“I feel a constant need to put something in my mouth”), respondents might misinterpret “need to put something in my mouth” as the need or craving for the drug by ingestion or inhalation, rather than emotionality problems. “Regarding Item 23 (“I cannot control my feelings”), a notable cross-loading was observed, indicating a high correlation with AI, EP, and PE factors. In the Chinese context, the word “feeling” is vague and struggles to convey specific feelings or emotions. Moreover, many Asian cultures value conformity to norms, emotional self-control, and collectivism [37]. The display of emotions, particularly psychological distress or aggression may be perceived as a sign of mental illness and/or personal weakness, leading to stigmatization [37]. Asian culture groups tend to have more difficulty than Western culture groups in identifying and communicating emotions [38]. Item 23 in the Chinese version of the SRRS appears to be challenging to define accurately, leading to ambiguity and overlap among patients with MUD in Tiawan.

We used the SDS and VAS to examine the concurrent validity of the 22-item Chinese version of the SRRS. The Chinese version of the SRRS and its four subscales exhibited significantly positive correlation with the SDS and weak positive correlation with VAS scores. Furthermore, a cutoff score of 40 of the Chinese versions of the SRRS displayed the most favorable sensitivity and specificity in distinguishing individuals with and without methamphetamine dependence (i.e. severe MUD). The highest value for the Youden’s J statistic was 41 for the Chinese version of the SRRS; however, the difference between sensitivity and specificity was greater than that for the cutoff score of 40. Therefore, we suggest 40 as the optimal cutoff score for 22-item Chinese version of the SRRS for identifying the presence of severe MUD.

Regarding predictive validity, the total 22-item Chinese version of the SRRS and AI and PE subscale scores were significantly and positively correlated with the relapse rate within 3 and 6 months, but the correlation decreased at 12 month; this time-dependent reduction in the correlation over time was also observed in the EP and CD subscales. These results are similar to those obtained for the original version of the SRRS [19]. Research has revealed that the highest relapse rate for MUD is observed early in treatment, in particular within the first 6 months [9], suggesting that the risk of relapse might decline with time. In our study, we also found that the relapse rate was the highest in the first 3 months and decreased gradually during the 6- and 12-month follow-up periods. The Chinese version of the SRRS, therefore, may have the most favorable predictive value in the early stage of the treatment when the relapse risk is higher. The 22-item Chinese version of the SRRS also share certain similarities with previously validated measures of relapse risk such as the AWARE scale and the RRAS. The 22-item Chinese version of the SRRS and the AWARE scale both encompass some symptoms of negative affection and passivity. On the other hand, the nature of RRAS subscale ‘craving for methamphetamine’ is akin to the CD and AI subscales of the Chinese version of the SRRS. Additionally, “attitude towards methamphetamine” subscale of RRAS also implies expectations related to substance use, mirroring the PL subscale. On the contrary, the Chinese version of the SRRS did not assess social context like the ‘social recognition’ subscale in the RRAS.

This study has some limitations. First, the sample is not representative in terms of sex, with 90% of the respondents being men. Nevertheless, the predominance of men is consistent with a previous national survey in our country, which also reported that males using illegal drugs such as methamphetamine exceed 90% [20]. Second, we focused only on methamphetamine as the primary abused substance in this study. Although the total and subscale scores of the original SRRS did not differ significantly across stimulants such as methamphetamine, methylphenidate, and 3,4-methylenedioxymethamphetamine [19], the reliability and validity of the Chinese version of the SRRS in individuals who use other stimulants should be tested in the future. Third, we did not evaluate the psychiatric comorbidities, which are common in individuals with MUD [39]. Therefore, we are not able to understand the potential impact of these comorbidities on the psychometric properties of C-SRRS. Fourth, the Chinese version of the SRRS has a weak positive correlation with the relapse rates. A further study was needed to validate this result.

In conclusion, we demonstrated that the 22-item Chinese version of the SRRS is a reliable and valid instrument with favorable multidimensional psychometric properties for assessing the risk of relapse in patients with MUD.

Data availability

No datasets were generated or analysed during the current study.

Abbreviations

SRRS:

Stimulant Relapse Risk Scale

MUD:

Methamphetamine use disorder

CFA:

Confirmatory factor analysis

VAS:

Visual analogue scale

SDS:

The severity of dependence scale

RRAS:

The Risk of Relapse Assessment Scale

AI:

Anxiety and intention to use the drug

EP:

Emotionality problems

CD:

Compulsivity for the drug

PL:

Positive expectancies and lack of control over the drug

NE:

Lack of negative expectancy for the drug

AGFI:

adjusted goodness of fit index

CFI:

Comparative fit index

SRMR:

Standardized root mean square residual

RMSEA:

Root mean square error of approximation

LM:

Lagrange multiplier

ROC:

The receiver operating characteristic curves

AUC:

Area under the ROC curve

References

  1. United Nations Office on Drugs and Crime. World drug report 2022: Global overview of drug demand and drug supply 2022 [ https://www.unodc.org/unodc/en/data-and-analysis/wdr-2022_booklet-2.html

  2. Rawson RA. Current research on the epidemiology, medical and psychiatric effects, and treatment of methamphetamine use. J food drug Anal. 2013;21(4):S77–81.

    Article  PubMed  Google Scholar 

  3. Stoneberg DM, Shukla RK, Magness MB. Global methamphetamine trends: an evolving problem. Int Crim Justice Rev. 2018;28(2):136–61.

    Article  Google Scholar 

  4. United Nations Office on Drugs and Crime. World drug report 2022: drug market trends cocaine amphetamine_type stimulants new psychoactive substances 2022 [Available from: www.unodc.org/unodc/en/data-and-analysis/world-drug-report-2022.html

  5. Lee WC, Chang HM, Huang MC, Pan CH, Su SS, Tsai SY, et al. All-cause and suicide mortality among people with methamphetamine use disorder: a nation‐wide cohort study in Taiwan. Addiction. 2021;116(11):3127–38.

    Article  PubMed  Google Scholar 

  6. Huang M-C, Yang S-Y, Lin S-K, Chen K-Y, Chen Y-Y, Kuo C-J, et al. Risk of cardiovascular diseases and stroke events in methamphetamine users: a 10-year follow-up study. J Clin Psychiatry. 2016;77(10):11856.

    Article  Google Scholar 

  7. Farrell M, Martin NK, Stockings E, Bórquez A, Cepeda JA, Degenhardt L, et al. Responding to global stimulant use: challenges and opportunities. Lancet. 2019;394(10209):1652–67.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  8. Hedegaard H, Bastian BA, Trinidad JP, Spencer M, Warner M. Drugs most frequently involved in drug overdose deaths. United States; 2018. pp. 2011–6.

  9. Brecht M-L, Herbeck D. Time to relapse following treatment for methamphetamine use: a long-term perspective on patterns and predictors. Drug Alcohol Depend. 2014;139:18–25.

    Article  PubMed  PubMed Central  Google Scholar 

  10. McKetin R, Najman JM, Baker AL, Lubman DI, Dawe S, Ali R, et al. Evaluating the impact of community-based treatment options on methamphetamine use: findings from the M ethamphetamine T reatment E valuation S tudy (MATES). Addiction. 2012;107(11):1998–2008.

    Article  PubMed  Google Scholar 

  11. Bradizza CM, Stasiewicz PR, Paas ND. Relapse to alcohol and drug use among individuals diagnosed with co-occurring mental health and substance use disorders: a review. Clin Psychol Rev. 2006;26(2):162–78.

    Article  PubMed  Google Scholar 

  12. Hartz DT, Frederick-Osborne SL, Galloway GP. Craving predicts use during treatment for methamphetamine dependence: a prospective, repeated-measures, within-subject analysis. Drug Alcohol Depend. 2001;63(3):269–76.

    Article  CAS  PubMed  Google Scholar 

  13. Sinha R. The role of stress in addiction relapse. Curr Psychiatry Rep. 2007;9(5):388–95.

    Article  PubMed  Google Scholar 

  14. DiClemente CC. Addiction and change: how addictions develop and addicted people recover. Guilford; 2018.

  15. Kaviyani F, Khorrami M, Heydari H, Namvar M. Understanding the laps and relapse process: in-depth interviews with individual who use methamphetamine. Subst Abuse Treat Prev Policy. 2023;18(1):41.

    Article  PubMed  PubMed Central  Google Scholar 

  16. Kelly JF, Hoeppner BB, Urbanoski KA, Slaymaker V. Predicting relapse among young adults: psychometric validation of the advanced warning of relapse (AWARE) scale. Addict Behav. 2011;36(10):987–93.

    Article  PubMed  PubMed Central  Google Scholar 

  17. Xu S, Zhang K, Luo T. Development of the risk of Relapse Assessment Scale for methamphetamine abusers in China. Drug Alcohol Depend. 2021;227:108992.

    Article  PubMed  Google Scholar 

  18. Heishman SJ, Singleton EG, Liguori A. Marijuana craving questionnaire: development and initial validation of a self-report instrument. Addiction. 2001;96(7):1023–34.

    Article  CAS  PubMed  Google Scholar 

  19. Ogai Y, Haraguchi A, Kondo A, Ishibashi Y, Umeno M, Kikumoto H, et al. Development and validation of the stimulant relapse risk scale for drug abusers in Japan. Drug Alcohol Depend. 2007;88(2–3):174–81.

    Article  PubMed  Google Scholar 

  20. Chen WJ, Wu S-C, Tsay W-I, Chen Y-T, Hsiao P-C, Yu Y-H, et al. Differences in prevalence, socio-behavioral correlates, and psychosocial distress between club drug and hard drug use in Taiwan: results from the 2014 National Survey of Substance Use. Int J Drug Policy. 2017;48:99–107.

    Article  PubMed  Google Scholar 

  21. Taiwan Food and Drug Administration. National Survey of Substance Use. Taipei, Taiwan: TFDA; 2018.

    Google Scholar 

  22. Browne MW, Cudeck R. Alternative ways of assessing model fit. Sociol Methods Res. 1992;21(2):230–58.

    Article  Google Scholar 

  23. Lt H, Bentler PM. Cutoff criteria for fit indexes in covariance structure analysis: conventional criteria versus new alternatives. Struct Equation Modeling: Multidisciplinary J. 1999;6(1):1–55.

    Article  Google Scholar 

  24. Chin V, Chen H, Chen H, Lin T-Y, Chou H-H, Laia T-J et al. Severity of heroin dependence in Taiwan: reliability and validity of the Chinese version of the severity of dependence scale. Addict Behav. 2008;33(12).

  25. Topp L, Mattick RP. Choosing a cut-off on the severity of dependence scale (SDS) for amphetamine users. Addiction. 1997;92(7):839–45.

    CAS  PubMed  Google Scholar 

  26. Tavakol M, Dennick R. Making sense of Cronbach’s alpha. Int J Med Educ. 2011;2:53.

    Article  PubMed  PubMed Central  Google Scholar 

  27. Ware JE Jr, Gandek B. Methods for testing data quality, scaling assumptions, and reliability: the IQOLA Project approach. J Clin Epidemiol. 1998;51(11):945–52.

    Article  PubMed  Google Scholar 

  28. Hoelter JW. The analysis of covariance structures: goodness-of-fit indices. Sociol Methods Res. 1983;11(3):325–44.

    Article  Google Scholar 

  29. Doll WJ, Xia W, Torkzadeh G. A confirmatory factor analysis of the end-user computing satisfaction instrument. MIS Q. 1994:453–61.

  30. Bentler PM. Comparative fit indexes in structural models. Psychol Bull. 1990;107(2):238.

    Article  CAS  PubMed  Google Scholar 

  31. Hatcher L, O’Rourke N. A step-by-step approach to using SAS for factor analysis and structural equation modeling. SAS institute; 2013.

  32. Comrey A, Lee H. A first course in factor analysis: psychology press. Taylor and Francis Group New York, NY; 2013.

  33. Jones BT, Corbin W, Fromme K. A review of expectancy theory and alcohol consumption. Addiction. 2001;96(1):57–72.

    Article  CAS  PubMed  Google Scholar 

  34. Leventhal AM, Schmitz JM. The role of drug use outcome expectancies in substance abuse risk: an interactional–transformational model. Addict Behav. 2006;31(11):2038–62.

    Article  PubMed  Google Scholar 

  35. Newton TF, De La Garza R, Kalechstein AD, Tziortzis D, Jacobsen CA. Theories of addiction: methamphetamine users’ explanations for continuing drug use and relapse. Am J Addict. 2009;18(4):294–300.

    Article  PubMed  PubMed Central  Google Scholar 

  36. Drummond DC. Theories of drug craving, ancient and modern. Addiction. 2001;96(1):33–46.

    Article  CAS  PubMed  Google Scholar 

  37. Abdullah T, Brown TL. Mental illness stigma and ethnocultural beliefs, values, and norms: an integrative review. Clin Psychol Rev. 2011;31(6):934–48.

    Article  PubMed  Google Scholar 

  38. Ng CH. The stigma of mental illness in Asian cultures. Aust N Z J Psychiatry. 1997;31(3):382–90.

    Article  CAS  PubMed  Google Scholar 

  39. Fang SC, Hung CC, Huang CY, Huang SM, Shao JYH. Influence of Baseline Psychiatric disorders on mortality and suicide and their associations with gender and age in patients with Methamphetamine Use Disorder. Int J Mental Health Addict. 2023.

Download references

Acknowledgements

The authors sincerely thank all the participants for their timeand the administrative support from Institute of Substance Treatment and Research in Taipei (ISTART).

Funding

This work was supported by grants from National Science and Technology Council (MOST109-2314-B-532-004, 110-2314-B-532-005-MY3 [Ming-Chyi Huang] & 110-2314-B-715-013 [Su-Chen Fang]); Taipei City Government (TPECH 11101-62-029 & 11301-62-016 [Ming-Chyi Huang]); Taipei City Hospital (TPCH 111 − 56, 112 − 52 & 113 − 56 [Ming-Chyi Huang]), MacKay Medical College (MMC-RD-110-1B-P011 & MMC-RD-111–1 H-P007 [Su-Chen Fang]). The funding organizations did not have any involvement in the content or writing of the manuscript.

Author information

Authors and Affiliations

Authors

Contributions

JSL: Drafting the main manuscript; YO: Manuscript editing; CL, HMC and YCW: Recruited patients and assisted in data collection; SCF: Data analysis, manuscript editing; MCH: Study design, project management, manuscript editing;

Corresponding authors

Correspondence to Ming-Chyi Huang or Su-Chen Fang.

Ethics declarations

Ethics approval and consent to participate

The study received ethical approval from institutional review board of Taipei City Psychiatric Center of Taipei City Hospital (Internal Review Board Number of Approval: TCHIBO-10810018). All study participants consented to participation.

Consent for publication

Participants provided written consent for publication.

Competing interests

The authors declare no competing interests.

Additional information

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Electronic supplementary material

Below is the link to the electronic supplementary material.

Supplementary Fig. 1. Structural model with factor loading, error variance, and correlations.

Single-headed arrows indicate factor loading and error variance. Double-headed arrows display correlation. Factor loading and correlation are presented as standardized estimates.

Supplementary Material 2

Rights and permissions

Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article’s Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article’s Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated in a credit line to the data.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Lin, JS., Ogai, Y., Lin, C. et al. Psychometric validation of the Chinese Version of the stimulant relapse risk scale (SRRS) in patients with methamphetamine use disorder. Subst Abuse Treat Prev Policy 19, 34 (2024). https://doi.org/10.1186/s13011-024-00616-8

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/s13011-024-00616-8

Keywords