- Open Access
Effectiveness of school-based preventive interventions on adolescent alcohol use: a meta-analysis of randomized controlled trials
Substance Abuse Treatment, Prevention, and Policyvolume 9, Article number: 48 (2014)
Preventive interventions for adolescents are an important priority within school systems. Several interventions have been developed, but the effectiveness of such interventions varies considerably between studies. The purpose of this study was to assess the effectiveness of universal school-based prevention programs on alcohol use among adolescents by using meta-analytic techniques.
A systematic literature search in the databases, PubMed (Medline), PsycINFO (Ovid), EMBASE (Ovid) and WEB of Science (ISI) was conducted to search for empirical articles published in the period January 1990 to August 2014.
In total, 28 randomized controlled studies with 39,289 participants at baseline were included. Of these 28 articles, 12 studies (N = 16279) reported continuous outcomes (frequency of alcohol use and quantity of alcohol use), and 16 studies (N = 23010) reported categorical data (proportion of students who drank alcohol). The results of the random effects analyses showed that the overall effect size among studies reporting continuous outcomes was small and demonstrated a favorable effect from the preventive interventions (Hedges’ = 0.22, p < .01). The effect size among studies reporting categorical outcomes was not significant ( = 0.94, p = .25). The level of heterogeneity between studies was found to be significant in most analyses. Moderator analyses conducted to explore the heterogeneity showed neither significant difference between the different school levels (junior high schools and high schools), nor between the varied program intensities (low, medium and high intensity programs). The meta-regression analyses examining continuous moderators showed no significant effects for age or gender.
The findings from this meta-analysis showed that, overall, the effects of school-based preventive alcohol interventions on adolescent alcohol use were small but positive among studies reporting the continuous measures, whereas no effect was found among studies reporting the categorical outcomes. Possible population health outcomes, with recommendations for policy and practice, are discussed further in this paper.
Early onset of alcohol use is associated with problematic substance abuse in later adolescence [1–4]. The study of Health Behaviour in School-aged Children (HBSC) show that on average 39% have their first alcoholic drink at age 13 or younger . The prevalence rates and consequences of underage drinking warrant a comprehensive public health approach, grounded in evidence-based preventive interventions and policy-making . The European status report on alcohol and health noted that 40% of the European countries did not have a written national alcohol policy in 2009, whereas in most Western countries drug prevention in schools has been a top priority . Alcohol use among adolescents is a major public health concern and the political will to address this problem is considerable . A range of preventive interventions to reduce or postpone alcohol debut among adolescents has been developed, and schools are important settings for such programs because large numbers of adolescents may be reached while costs are kept relatively low. Numerous estimates have been made of the social costs of early alcohol use, indicating that school-based drug and alcohol prevention programs should be a good investment . The European Action plan states that those countries that are most active in implementing evidence-based alcohol policies and programs will profit from substantial gains in public health and well-being, productivity, and social development .
Universal school-based prevention is aimed at all students, regardless of their level of risk for alcohol use . However, it is unclear whether or not the universal prevention programs are, in fact, effective. Several literature reviews [6, 12–16] and meta-analyses [17–21] have been conducted in this field. Some well-designed studies have suggested that school-based programs have the potential to reduce alcohol use among adolescents, but at the same time research has indicated that most drug prevention programs have no effect [8, 17]. Tobler and colleagues  conducted a meta-analysis of 207 universal school-based drug prevention programs, including studies with alcohol use as an outcome variable. They stated that program delivery matters more than program content and characterized successful programs as being interactive; i.e. programs that actively involve students while also including peer leaders . This finding was also supported by a recent Cochrane review of 53 studies/programs, which concluded that the content of programs varied and suggested that program delivery may be more important for the effectiveness of the intervention than specific content .
It is argued that school-based interventions are most efficacious for preventing and reducing alcohol use among adolescents when delivered as primary prevention programs to youths who have not yet begun to experiment with alcohol [12, 22, 23]. Evidence suggests that prevention programs need to be initiated prior to seventh grade and that they need to address the associated risks of early drinking [24, 25]. The overall aim of school-based prevention is generally to delay the onset of drinking or to reduce alcohol consumption frequency. However, producing a meaningful effect on drinking behavior through school programs is a difficult task. Some research findings suggest that interventions aimed at preventing alcohol use are not likely to be effective [26–28], yet it is argued that large proportions of the resources in the prevention field are, in fact, dedicated to programs that have little potential to prevent and reduce alcohol abuse . There are limited findings supporting the “universality” of intervention effects on alcohol outcomes . For instance, a meta-analysis conducted by Rundall and Bruvold in 1988, evaluating the effect of school-based prevention programs, reported both a low short-term effect ( = 0.11) and a low long-term effect ( = 0.12) on alcohol use behavior. They also found that school-based alcohol use prevention programs had more instances of producing no effect or negative effects when compared to smoking prevention programs . Similar findings were reported by Tobler and colleagues , where significant results were obtained only in one out of three cases, showing an overall small effect size ( = 0.14).
The objective of the present investigation was to perform an up to date meta-analysis of well-controlled experimental studies examining the overall effects of universal school-based preventive programs on alcohol consumption among adolescents under the age of 18 years. Randomized controlled trials (RCT) have been found to yield larger program effects than studies using quasi-experimental designs [20, 30]. The majority of the existing reviews have included also non-randomized studies, whereas this paper aims to include only randomized studies, because RCTs in general have stronger internal validity than quasi-experimental designs . Different moderator analyses were conducted. First, we wanted to test if the effects of interventions vary between different school levels (elementary-, junior high- and high-school). Programs targeting adolescents in junior high schools are found to be marginally more effective than those targeting adolescents in elementary or high schools . The majority of adolescents begin drinking alcohol prior to reaching adulthood; therefore, prevention programs need to target school-aged children and adolescents before they have established expectations and beliefs surrounding alcohol consumption .
Tobler and colleagues  found that programs with a duration of 11 to 30 hours were significantly more effective than those with a duration of 10 hours or less. However, a systematic review conducted by Cuijpers in 2002 stated that there is no definite evidence that intense programs are more effective than less intensive programs. Gottfredson and Wilson  showed in their research that program with brief duration are generally as effective as those with longer duration. Due to these inconsistent conclusions in relation to how the number of program sessions (intensity) may impact the effect, we also wanted to test the intensity of the program [8, 17, 21].
Finally, we wanted to explore whether the effects of preventive interventions vary with age and gender . The prevalence of alcohol drinking increases significantly between the ages of 11 to 15 , and boys are generally found to drink more often and in greater quantities than girls. It is therefore likely that the effect of programs may differ between age groups and gender [16, 34–36].
Inclusion and exclusion criteria
Several inclusion and exclusion criteria were used to identify studies. Studies were included if they: (a) evaluated universal school-based prevention programs; (b) used randomized controlled trial (RCT) design with a control group; (c) assessed alcohol use outcomes; (d) provided sufficient information to calculate between-group effect size estimates; (e) included participants with a mean age of less than 18 years at pre-test; and (f) were published in English between January 1990 and August 2014.
Studies were excluded if the interventions: (a) were not described; (b) were designed for selective groups; or (c) were based on family and community components.
A systematic search was performed for studies published in the period January 1990 to August 2014. Articles were retrieved through the databases, PubMed (Medline), PsycINFO (Ovid), EMBASE (Ovid), WEB of Science (ISI), and through the reference sections of published studies and relevant reviews . Specific search methods were used for each database; e.g., medical subject headings (MeSH)  were used for the database MEDLINE (PubMED). Search details for MEDLINE (PubMED) were as follows: (((“Alcohols”[Mesh] OR “Alcohol Drinking”[Mesh]) AND “Alcohol Drinking/prevention and control”[Mesh]) AND “Adolescent”[Mesh]) AND (((“Early Intervention (Education)”[Mesh] OR “Intervention Studies”[Mesh]) OR “Evaluation Studies as Topic”[Mesh]) OR “Program Evaluation”[Mesh]) AND Randomized Controlled Trial. A similar search was conducted in WEB of Science (ISI).
In EMBASE (Ovid) and PsycINFO (Ovid), search phrases included: (School Based Intervention or Intervention or Treatment Outcomes or Primary Mental Health Prevention or Treatment Effectiveness Evaluation or Early Intervention, and (Alcohols or Binge Drinking or Alcohol Drinking Patterns or Alcohol Abuse), and (Adolescent Psychology or Adolescent Development or Adolescent Attitudes or adolescents), and (Drug Abuse Prevention or Prevention). The search was limited to human and English language.
Overall 370 published articles were identified (PubMed 75 studies, EMBASE 66 studies, WEB of Science 135 studies, and PsycINFO 94 studies) in addition to 19 studies from previously conducted meta-analyses and reviews.The process for determining the eligibility of studies to be included was conducted by two of the authors and consisted of a three-step process: 1) the title of the article was examined; 2) the abstract was reviewed; and 3) the full text was read. A total of 242 studies were excluded after screening the title and abstract of the papers. Additionally, 54 studies were eliminated after reading the full text because they did not fulfill the inclusion criteria. In addition, 20 duplicates were deleted. Thus, the final pool of included studies in the present meta-analysis consisted of 28 studies (Figure 1).
Coding of variables
According to the project protocol, the following variables were coded for each study: descriptive information (e.g., year of publication, country), sample information (baseline characteristics like sample size, gender, and age), school level (e.g., elementary school, junior high school, or high school), program intensity (low intensity of less than 1 to 5 hours, medium intensity of 6 to 10 hours, and high intensity of 11 to 15 hours or more), and measurement characteristics like time points of follow-ups (< 3 months, 4 to 12 months, and > 13 months). Alcohol use outcomes were coded as weekly drinking (7 days’ alcohol use), monthly drinking (30 days’ alcohol use), and lifetime alcohol use (e.g., Ever used alcohol). The categorical outcomes measured the percentages of students who consumed alcohol within a defined period of time. The continuous outcomes were reported as means and standard deviations and measured the frequency of alcohol use (the number of times alcohol was consumed within a defined period of time) and the quantity of alcohol consumption (the mean number of drinks within a defined period of time).
The studies were coded by the first and the second author. To assess inter-rater reliability, 6 of the 28 studies (21%) were randomly selected and coded by two of the other authors. The main variables included in the meta-analysis calculations and moderator analyses were selected for reliability check. Inter-rater agreement was estimated as Intra-class correlation coefficients (ICC; absolute agreement). There was 100% agreement between the coders for descriptive data (school-based studies and country). ICC was 0.92 for age, 0.99 for gender (proportion of boys), and 0.99 for effect size data.
The meta-analysis was conducted using the Comprehensive Meta-Analysis program version 2.2.057 . Descriptive data were analyzed using the Statistical Package for Social Sciences (SPSS 21.0).
Because we assumed that the true effect could vary from study to study, and that factors other than sampling error could contribute to the observed variation in effect sizes (e.g., study design, sample characteristics, and type of intervention), a random effects model was used for the meta-analysis calculations. Study weights are more equal under the random effects model compared to the fixed effect model. Mean effect sizes and other meta-analysis calculations were weighted according to the inverse variance statistics comprised of both random variation and variation between studies .
The heterogeneity test, Q, was used to examine variation between studies. A significant Q rejects the null hypothesis of homogeneity and indicates that the variability between the effect sizes is greater than subject-level sampling alone and that moderators should be examined . The ratio of true heterogeneity to the total variance across the observed effect estimates was reported as a I2 statistic. The I2 statistic ranges from 0-100% and is not affected by the number of included studies in a meta-analysis . A I2 statistic close to zero indicates non-significant variance.
Two different effect-size statistics were used in the meta-analysis, standardized mean differences (Hedges’ g) for continuous outcomes and odds ratios (OR) categorical outcomes respectively.
Hedges’ g was calculated as the difference between the mean post-test scores of the control group and the intervention group divided by the pooled standard deviation. A positive effect size was indicated by less frequent alcohol use and less quantity of alcohol consumed in the intervention group. According to Cohen’s criteria , effect sizes are denoted as follows: g = 0.2 denotes a small effect, g = 0.5 a medium effect, and g = 0.8 a large effect .
Effect sizes for studies reporting categorical types of data were calculated as OR, which is a measure of the association between exposure and outcome . A positive effect size was indicated by OR < 1 (fewer reporting alcohol consumption in the intervention group compared with the control group). Whereas an OR of 0.59 denotes a weak effect, an OR of 0.29 denotes a moderate effect, and an OR of 0.15 denotes a strong effect . A value of 1.00 indicates no difference in the rate of alcohol consumption between the intervention group and the control group. A negative effect (higher consumption in the intervention group compared with the control group) was indicated by OR > 1.
All of the studies included examined the effectiveness of school-based programs on preventing alcohol use among adolescents. Included studies used either schools (cluster RCT) or students (RCT) as the unit for randomization. Mixed effect analyses were conducted to examine whether there was any difference between studies using RCT and cluster RCT.
To calculate the overall mean effect size, the mean of all outcomes and time points was calculated within each study before the overall mean was calculated.
When studies reported the effect of several components, like a parent component or combined components, we used the outcomes of the student intervention only . When included studies used more than one intervention, we used the study as the unit for analysis and combined the effect sizes of the subgroups within each study . When studies distinguished between groups by reported alcohol use at baseline, we calculated the mean alcohol use for all subgroups in both the intervention and control groups . To test whether or not the observed overall effect was robust the Fail-safe N was calculated using Rosenthal’s procedure . The fail-safe N is the number of studies with null-findings required to reduce a significant mean effect into a non-significant result.
Moderator analyses were only conducted when the category included at least three studies. Categorical variables (school level and program intensity) were examined by using a mixed-effects analysis and continuous moderators (age and proportion of boys) by conducting meta-regression analyses.
Description of included studies
We identified 28 randomized studies from nine different countries, of which the majority came from the USA (61%) followed by Australia (14%). The mean publication year was 2003 (SD = 6.77). Demographic characteristics were only reported for the baseline samples. The total number of baseline participants was 39,289 with a mean age of 13.16 (SD = 1.96) years. The gender distribution was equal (50%). Sample sizes varied, ranging from 104 to 7,079 (M = 2017; SD = 1810). The majority of included studies were conducted in junior high schools (68%). Sixteen studies reported categorical measures on alcohol use (Table 1), and twelve studies reported continuous measures on alcohol use (Table 2).
The majority of the included studies used prevention strategies addressing normative and social influences. In addition, some interventions provided alcohol education and life skills training, including coping strategies and problem solving skills [44, 45, 48–51]. Furthermore, most of the studies measured outcomes like cigarette/marijuana and drug use, in addition to alcohol use [45, 48, 49, 52–55]. Two studies also assessed bullying and harmful behavior [50, 56].
Quality of studies
All included studies used a randomized control design. Two of the 16 studies using categorical measures, used the students as the unit for randomization (RCT) while 14 used the schools as the unit of assignment (cluster RCT). Among the 12 studies reporting the continuous outcomes, four studies used students and eight used the schools as the unit of assignment. Mixed effect analyses comparing the two groups (RCT versus cluster RCT) showed no significant differences for studies reporting the categorical outcomes (Q = 0.79, df = 1, p = .37) or continuous outcomes (Q = 1.56, df = 1, p = .21). The methods used for randomization included use of computer or online systems [50, 51, 57–59], coin tossing , simple random sampling (e.g., random assignment by an independent researcher) [44, 56, 61], and random assignment of numbers to the students to further assigned them to the condition . In the remaining 13 studies the method of randomization was unclear [45, 46, 48, 49, 53–55, 62–72]. One study additionally calculated and assumed random allocation of schools . Students were blind to group assignment in two studies [59, 61].
Follow-up assessments were conducted within a time range from one to 42 months, distributed among 12 different follow-up periods. Most common was one year follow-up (K = 15) followed by two year (K = 6), 18 months (K = 6), six month (K = 6), and three month follow-up periods (K = 6). Attrition rates were reported by seven of the 12 studies reporting continuous outcomes, and by ten of the 16 studies reporting categorical outcomes. Attrition rates varied from 5% to 52%.
For studies reporting continuous outcomes, the overall meta-analysis calculations resulted in a small and significant effect in favor of the intervention ( = 0.22, z = 2.99, p < .01) (Table 3). The value of the file drawer statistic indicated that at least 301 unpublished studies would be needed to reduce the obtained effect to a non-significant finding, which is considerably higher than the suggested limit (5 K + 10 = 70). The overall effectiveness for frequency of alcohol use was small, and not significant ( = 0.09, z = 1.94, p = .053). The intervention effects for the quantity of alcohol consumed was small and significant in favor of the interventions ( = 0.29, z = 2.46, p < .01). The overall mean effect size for studies reporting categorical outcomes was not significant ( = 0.94, z = −1.15, p = .25). The tests of heterogeneity showed a significant variance between the included studies, indicating that moderators may be present.
Different analyses were conducted to estimate the effect of preventive alcohol interventions over time (Table 3) and to compare the effect of the three primary outcomes that included weekly alcohol use, monthly alcohol use, and lifetime alcohol use for studies reporting the categorical outcomes (Table 4) and for the studies reporting continuous outcomes (Table 5).
Intervention effects < 3 months
Within the measure of a short-time interval (< 3 months), studies reporting continuous measures showed a small but significant positive effect size of alcohol preventive interventions. Studies reporting categorical outcomes showed a small but negative effect size on alcohol use, indicating that the intervention groups scored higher on alcohol use as compared to the control group (see Table 3). The test of heterogeneity was not significant, but this could be due to low power as there was a small number of included studies.
Intervention effects between 4–12 months
The effect sizes for the follow-up period from four to 12 months were small and significant for both OR and Hedges’ g, favoring the preventive intervention programs. Both heterogeneity tests were significant (see Table 3).
Intervention effects > 13 months
Long-term follow-up (> 13 months) showed non-significant effect sizes for the interventions. The level of heterogeneity was significant in studies reporting continuous outcomes but not significant among studies reporting categorical outcomes (see Table 3).
Weekly alcohol use
Overall nine studies measured weekly alcohol use [44–46, 57, 60, 61, 67, 68, 71]. The overall effect sizes were small and significant, demonstrating a positive intervention effect. The heterogeneity test was not significant (see Table 4 and Table 5).
Monthly alcohol use
Ten studies measured monthly alcohol use [46, 48, 51, 52, 58, 59, 62, 69, 71, 72]. The overall effect sizes were not significant. The test of heterogeneity within studies reporting continuous changes in monthly alcohol use was not found to be statistically significant, however, it was significant within studies reporting categorical outcomes (see Table 4).
Lifetime alcohol use
Twelve studies measured the lifetime use of alcohol [49, 50, 53–56, 59, 63–66, 70]. The overall effect sizes were not significant for OR or Hedges’ g. The level of heterogeneity was significant between studies reporting the alcohol quantity, but not significant in studies reporting the frequency of alcohol use (Table 5) or among studies reporting the categorical outcomes (Table 4).
The moderator analysis comparing different school levels did not show significant differences between interventions implemented at junior high school or high school (Table 6). Because there were only two studies conducted at elementary schools, these were not included in this analysis [63, 67].
The moderator analysis between different levels of program intensity showed no significant differences between medium intensity (6 to 10 hours) or high intensity programs (11 to >15 hours) (Table 6). Low intensity programs were not included in the moderator analysis as there was only one study reporting categorical outcomes  and only two studies reporting continuous outcomes [45, 58].
Meta regressions were conducted to examine the influence of the moderator variables, age and gender, on the effectiveness of preventive alcohol interventions.
Gender was coded as the proportion of boys in the study samples. The meta-regression results were not significant for gender in studies reporting continuous outcomes (β 1 = − 0.02, z = − 1.23, p = .22), nor in studies reporting categorical outcomes (β 1 = − 0.01, z = − 0.45, p = . 65).
Similarly, age was not found to be a significant moderator, both for studies reporting continuous outcomes (β 1 = 0.04, z = − 0.98, p = .33) and for studies reporting categorical outcomes (β 1 = − 0.01, z = − 0.45, p = .65).
The aim of the current meta-analysis was to estimate the effectiveness of school-based preventive programs on alcohol use among adolescents. To our knowledge, this is the first meta-analysis on this topic that exclusively included studies with randomized designs. Furthermore, the aim was to assess the effectiveness of the interventions over time and to examine whether the effect of the intervention differed according to the different school levels or level of program intensity.
The overall effect size among studies reporting continuous outcomes was small but significant, indicating that alcohol prevention interventions may have a positive influence on alcohol use among adolescents. However, the overall effect size of studies reporting categorical outcomes was weak and not significant. Categorization of continuous variables is common in health sciences and medical research, but there is a cost to dichotomizing continuous variables . Studies that report categorical or dichotomous data lose one-third to two-thirds of the information on the variance of the sample . This reduces the calculated effect sizes and, thus, the effectiveness of the intervention may be underestimated when using this approach. This might explain why there was no significant overall effect among studies reporting the categorical outcomes. Furthermore, this analysis showed a small but significant effect on adolescents’ weekly alcohol use. The effectiveness on monthly alcohol use was small and in a desired direction favoring the preventive programs in studies reporting the continuous outcomes, whereas this effect was not significant among studies reporting categorical data. The prevention programs did not affect general alcohol use among adolescents, measured by lifetime alcohol use, a finding that was expected. Outcomes measuring adolescents’ lifetime alcohol use include whole samples, of which the majority has not started to drink alcohol yet.
Results measuring the effectiveness of the preventive interventions after a short term follow-up (< 3 months) were mixed. The generalized preventive effect for studies reporting continuous outcomes was positive and in favor of the preventive program. This result is in line with other studies that have found that school-based alcohol interventions can be an effective approach to preventing alcohol use in the short term [6, 12]. Furthermore, the heterogeneity test was not significant, suggesting no significant variance between those studies. However, among studies reporting categorical measures, the results indicated a higher alcohol use rate in the intervention group as compared to the control group, which may indicate an adverse effect of the interventions. This finding should nonetheless be interpreted with caution, since only three of the included studies reported categorical outcomes at 3 months. Aside from this finding, all effects were in favor of the interventions although the effects were small.
The overall impression of the results was that the prevention effects on alcohol use are significant and positive, in addition to increasing over time for the follow-up period four to twelve months. The effect of school-based prevention was generally positive on adolescents’ alcohol use (weekly and monthly), however, such positive effect was not measured for lifetime drinking. This could indicate that preventive programs fail to postpone the onset of alcohol use or that the number of adolescents drinking alcohol in either group may be too low to demonstrate a statistically significant difference between the two groups. An implication of this finding is that studies should follow the adolescents for longer periods of time, at least long enough for experimentation of alcohol use to occur. This result held for studies reporting both continuous and categorical outcome measures.
Research has demonstrated that brief program duration of less than four months is generally as effective as those with a longer duration . Additionally, a recently conducted meta-analysis concluded that brief school-based alcohol interventions (shorter than five hours of duration) may be effective in reducing adolescents alcohol use . On the other hand, research has also showed that prevention programs seem to be more successful when they are maintained over several years, interactive , and incorporate more than one strategy; e.g., addressing social norms, building social resistance skills, providing booster-sessions, and using peer-leaders . Unfortunately, there was a general lack of detailed information on intervention strategies used among the included studies. Evaluation studies should provide more detailed information about potential moderators like implementation process, program fidelity, and attrition rate that will provide valuable information. This issue has also been raised elsewhere [16, 75].
The long-term results from this meta-analysis show no significant differences between intervention and control groups beyond the one year follow-up. The discontinuity in the development of drinking behavior during adolescence might explain the challenges that preventive intervention faces in reaching long-term effects . Some evidence from school-based prevention research indicates that intervention programs do not reduce alcohol use in the long term (> 12 months) . However, a review of the long-term effectiveness of alcohol prevention programs provides evidence of reduced alcohol use for up to 15 years after program implementation .
The majority of included studies was implemented at junior high school level. The moderator analysis in this meta-analysis showed no significant effect between different school levels. Furthermore, the moderator analysis did not show any statistically significant differences in the comparison of low, medium, and high intensity programs. Both findings are in line with the previous work conducted by Tobler and colleagues . They eliminated grade as an effective program predictor based on non-significant findings in addition to report no significant difference between high and low intensity of programs . As such, it is promising that treatment efforts with medium intensity do seem to obtain treatment effects comparable to programs of higher intensity due to possible cost-benefit gains. A national survey conducted among US schools showed that the effectiveness of preventive practices would be improved if schools increased the intensity of program activity .
Studies suggest that primary prevention programs for alcohol use should occur prior to sixth grade, particularly for the group at high risk of early use . Unfortunately, there were only two included studies in our analysis that reported on elementary schools and, therefore, we were not able to confirm this finding.
Our findings show that the preventive effects of school-based preventive interventions on adolescent alcohol use are small but generally positive, regardless of the intensity of the program. It is important to bear in mind that even small effects can make a difference. School-based alcohol interventions are found to be cost effective because they may avert costs associated with harmful drinking. Research by Caulkins and colleagues  estimated that even small effect sizes in universal prevention interventions could lead to important savings for the society. Implementing universal preventive interventions within schools, where a large number of adolescents are reached, can lead to positive health outcomes within the society as further suggested by this study. Delaying alcohol debut among adolescents is important and has several possible health gains such as well-being and social development, important to both the public and the individual .
This study could not find any evidence to suggest which school level is preferable for implementing a preventive intervention or which level of program intensity would be most efficacious. Neither were age nor gender found to be moderators for effectiveness, however, the overall effectiveness of school-based preventive alcohol interventions for adolescents was measured as preferable and significant up to a year from implementation. After one year, our findings show no significant results. Only three studies with continuous measures reported long-term treatment effect, whereas 10 studies reported no treatment effect on categorical measures of alcohol use.
This study has some limitations that should be taken into consideration when interpreting the results. The literature search resulted in relatively few studies that fulfilled the inclusion criteria. There were considerable differences in sample sizes between the studies, although the total number of adolescents included in the analysis is fairly large. Additionally, there was a significant heterogeneity between the studies, while the moderator variables could not explain this variability. This indicates widely dispersed results, meaning that the true effects most likely do vary . In addition, the moderator analyses included only a small number of studies, which led to low statistical power, and the variance in age and gender between studies was small. A non-significant p-value should not be taken as evidence that the effect sizes are consistent, since the lack of significance may be due to low power . One strong aspect of this meta-analysis is that we only included randomized controlled studies. This provided stronger evidence of the interventions’ effectiveness, since randomized studies have the highest possible internal validity.
Our findings show that school-based interventions overall have a small but positive effect on alcohol use among adolescents up to one year after program implementation for both boys and girls independent of age. Small effect sizes can make a difference, especially when it comes to universal preventive interventions. Alcohol education should be considered as part of a wider policy approach and should be based on educational practices that have been proven to be effective . Interventions should be focused on specific ingredients that lead to preventing alcohol use among adolescents. Future research needs to continue developing and testing the implementation of interventions already demonstrated to reduce alcohol use among adolescents. The evidence base related to school-based alcohol interventions must continue to develop in order to improve their effectiveness.
Belcher HE, Shinitzky HE: Substance abuse in children: prediction, protection, and prevention. Arch Pediatr Adolesc Med. 1998, 152: 952-960.
Maggs JL, Schulenberg JE: Initiation and course of alcohol consumption among adolescents and young adults. Recent Dev Alcohol. 2005, 17: 29-47. 10.1007/0-306-48626-1_2.
Pitkanen T, Lyyra AL, Pulkkinen L: Age of onset of drinking and the use of alcohol in adulthood: a follow-up study from age 8–42 for females and males. Addiction. 2005, 100: 652-661. 10.1111/j.1360-0443.2005.01053.x.
Bonomo YA, Bowes G, Coffey C, Carlin JB, Patton GC: Teenage drinking and the onset of alcohol dependence: a cohort study over seven years. Addiction. 2004, 99: 1520-1528. 10.1111/j.1360-0443.2004.00846.x.
Social Determinants of Health and Well-Being Among Young People. Health Behaviour in School-Aged Children (HBSC) Study: International Report from the 2009/2010 Survey. Edited by: Currie C, Zanotti C, Morgan A, Currie D, Looze M de, Roberts C, Samdal O, Smith ORF, Barnekow V. 2012, Copenhagen: WHO Regional Office for Europe
Spoth R, Greenberg MT, Turrisi R: Preventive interventions addressing underage drinking: state of the evidence and steps toward public health impact. Pediatrics. 2008, 121: 311-336. 10.1542/peds.2007-2243E.
World Health Organization: Global Status Report on Alcohol and Health. 2014, Geneva: World Health Organization
Cuijpers P: Effective ingredients of school-based drug prevention programs. A systematic review. Addict Behav. 2002, 27: 1009-1023. 10.1016/S0306-4603(02)00295-2.
Caulkins JP, Pacula RL, Paddok S, Chiesa J: What we can- and cannot expect from school-based drug prevention. Drug Alcohol Rev. 2004, 23: 79-87. 10.1080/09595230410001645574.
WHO: European Action Plan to Reduce the Harmful use of Alcohol 2012–2020. World Health Organization Regional Committee for Europe Sixty First Session. Edited by: Organization WH. 2011, Baku: Azerbaijan
Barry MM, Jenkins R: Implementing Mental Health Promotion. 2007, Edinburgh: Churchill Livingstone
Stigler MH, Neusel E, Perry CL: School-based programs to prevent and reduce alcohol use among youth. Alcohol Res Health. 2011, 34: 157-162.
Komro KA, Toomey TL: Strategies to prevent underage drinking. Alcohol Res Health. 2002, 26: 5-14.
Berg RC, Underland V: The Effectiveness of Primary Interventions to Prevent the use of Tobacco, Alcohol and Other Drugs Among Children and Adolescents. Report from Kunnskapssenteret. 2012, Oslo: Norwegian Knowledge Centre for the Health Services
White D, Pitts M: Educating young people about drugs: a systematic review. Addiction. 1998, 93: 1475-1487. 10.1046/j.1360-0443.1998.931014754.x.
Foxcroft DR, Tsertsvadze A: Universal school-based prevention programs for alcohol misuse in young people. Cochrane Db Syst Rev. 2011, 1-124.
Tobler NS, Roona MR, Ochshorn P, Marshall DG, Streke AV, Stackpole KM: School-based adolescent drug prevention programs: 1998 meta-analysis. J Prim Prev. 2000, 20: 275-336. 10.1023/A:1021314704811.
Rundall TG, Bruvold WH: A meta-analysis of school-based smoking and alcohol use prevention programs. Health Educ Behav. 1988, 15: 317-334. 10.1177/109019818801500306.
Tobler NS, Stratton HH: Effectiveness of school-based drug prevention programs: a meta-analysis of the research. J Prim Prev. 1997, 18: 71-128. 10.1023/A:1024630205999.
Hennessy E, Tanner-Smith E: Effectiveness of brief school-based interventions for adolescents: a meta-analysis of alcohol Use prevention programs. Prev Sci. 2014, 1-12.
Gottfredson DC, Wilson DB: Characteristics of effective school-based substance abuse prevention. Prev Sci. 2003, 4: 27-38. 10.1023/A:1021782710278.
Perry CL, Williams CL, Veblen-Mortenson S, Toomey TL, Komro KA, Anstine PS, McGovern PG, Finnegan JR, Forster JL, Wagenaar AC, Wolfson M: Project Northland: outcomes of a communitywide alcohol use prevention program during early adolescence. Am J Public Health. 1996, 86: 956-965. 10.2105/AJPH.86.7.956.
Griffin KW, Botvin GJ, Nichols TR, Doyle MM: Effectiveness of a universal drug abuse prevention approach for youth at high risk for substance use initiation. Prev Med. 2003, 36: 1-7. 10.1006/pmed.2002.1133.
Miller PM, Smith GT, Goldman MS: Emergence of alcohol expectancies in childhood: a possible critical period. J Stud Alcohol Drugs. 1990, 51: 343-349.
Stueve A, O’Donnell LN: Early alcohol initiation and subsequent sexual and alcohol risk behaviors among urban youths. Am J Public Health. 2005, 95: 887-10.2105/AJPH.2003.026567.
Room R, Babor T, Rehm J: Alcohol and Public Health. Lancet. 2005, 365: 519-530. 10.1016/S0140-6736(05)17870-2.
Paglia A, Room R: Preventing substance Use problems among youth: a literature review and recommendations. J Prim Prev. 1999, 20: 3-50. 10.1023/A:1021302302085.
Pape H: School-based programmes that seem to work: useful research on substance use prevention or suspicious stories of success?. Nordic Alc Drug. 2009, 26: 521-535.
Babor T, Caetano R, Casswell S, Edwards G, Giesbrecht N, Graham K, Grube JW, Hill AJ, Holder H, Homel R, Gruenewald P, Hill L, Livingston M, Österberg E, Rehm J, Room R, Rossow I: Alcohol: No Ordinary Commodity: Research and Public Policy. 2010, Oxford: Oxford University Press, 2
Wilson D, Gottfredson D, Najaka S: School-based prevention of problem behaviors: a meta-analysis. J Quant Criminol. 2001, 17: 247-272. 10.1023/A:1011050217296.
Shadish WR, Cook TD, Campbell DT: Experimental and Quasi-Experimental Designs for Generalized Causal Inference. 2002, Boston: Houghton Mifflin
DeWit DJ, Adlaf EM, Offord DR, Ogborne AC: Age at first alcohol use: a risk factor for the development of alcohol disorders. Am J Psychiatry. 2000, 157: 745-750. 10.1176/appi.ajp.157.5.745.
Jones BT, Corbin W, Fromme K: A review of expectancy theory and alcohol consumption. Addiction. 2001, 96: 57-72. 10.1046/j.1360-0443.2001.961575.x.
Borsari B, Murphy JG, Barnett NP: Predictors of alcohol use during the first year of college: implications for prevention. Addict Behav. 2007, 32: 2062-2086. 10.1016/j.addbeh.2007.01.017.
Hellandsjø Bu ET, Watten RG, Foxcroft DR, Ingebrigtsen JE, Relling G: Teenage alcohol and intoxication debut: the impact of family socialization factors, living area and participation in organized sports. Alcohol Alcoholism. 2002, 37: 74-80. 10.1093/alcalc/37.1.74.
Adolfsen F, Strøm HK, Martinussen M, Natvig H, Eisemann M, Handegård BH, Koposov R: Early drinking onset: a study of prevalence and determinants among 13-year-old adolescents in Norway. Scand J Psychol. 2014, 55: 505-512. 10.1111/sjop.12151.
Nelson SJ, Schopen M, Savage AG, Schulman JL, Arluk N: The MeSH translation maintenance system: structure, interface design, and implementation. Stud Health Technol Inform. 2004, 107: 67-69.
Borenstein M, Hedges LV, Higgins JPT, Rothstein HR: Comprehensive Meta-Analysis. Professional Edition. 2005, Englewood, NJ: Biostat, ISBN Professional edition, 2
Borenstein M, Hedges LV, Higgins JPT, Rothstein HR: Introduction to Meta-Analysis. 2009, Chichester, UK: John Wiley & Sons, Ltd
Lipsey MW, Wilson BD: Practical Meta-Analysis, Volume 49. 2000, Thousand Oaks: Sage Publications
Hedges LV, Olkin I: Statistical Methods for Meta-Analysis. 1985, Orlando: Academic
Cohen J: Statistical Power Analysis for the Behavioral Sciences. 1977, Hillsdale, NJ: Lawrence Erlbaum Associates, 2
Chen H, Cohen P, Chen S: How Big is a big odds ratio? interpreting the magnitudes of odds ratios in epidemiological studies. Commun Stat Simulat. 2010, 39: 860-864. 10.1080/03610911003650383.
Koning IM, Vollebergh WA, Smit F, Verdurmen JE, Van Den Eijnden RJ, Ter Bogt TF, Stattin H, Engels RC: Preventing heavy alcohol use in adolescents (PAS): cluster randomized trial of a parent and student intervention offered separately and simultaneously. Addiction. 2009, 104: 1669-1678. 10.1111/j.1360-0443.2009.02677.x.
D’Amico EJ, Fromme K: Brief prevention for adolescent risk-taking behavior. Addiction. 2002, 97: 563-574. 10.1046/j.1360-0443.2002.00115.x.
Ellickson PL, Bell RM: Drug prevention in junior high: a multi-site longitudinal test. Science. 1990, 247: 1299-1305. 10.1126/science.2180065.
Rosenthal R: The file drawer problem and tolerance for null results. Psychol Bull. 1979, 86: 638-641.
Warren JR, Hecht ML, Wagstaff DA, Elek E, Ndiaye K, Dustman P, Marsiglia FF: Communicating prevention: the effects of the keepin’ it REAL classroom videotapes and televised PSAs on middle-school students’ substance use. J Appl Commun Res. 2006, 34: 209-227. 10.1080/00909880600574153.
Furr-Holden C, Ialongo NS, Anthony JC, Petras H, Kellam SG: Developmentally inspired drug prevention: middle school outcomes in a school-based randomized prevention trial. Drug Alcohol Depend. 2004, 73: 149-158. 10.1016/j.drugalcdep.2003.10.002.
McCambridge J, Hunt C, Jenkins RJ, Strang J: Cluster randomised trial of the effectiveness of motivational interviewing for universal prevention. Drug Alcohol Depend. 2011, 114: 177-184.
Werch CE, Anzalone DM, Brokiewicz LM, Felker J, Carlson JM, Castellon-Vogel EA: An intervention for preventing alcohol use among inner-city middle school students. Arch Fam Med. 1996, 5: 146-152. 10.1001/archfami.5.3.146.
Griffin JP, Holliday RC, Frazier E, Braithwaite RL: The brave (building resiliency and vocational excellence) program: evaluation findings for a career-oriented substance abuse and violence preventive intervention. J Health Care Poor U. 2009, 20: 798-816. 10.1353/hpu.0.0174.
Reddy K, Arora M, Perry CL, Nair B, Kohli A, Lytle LA, Stigler M, Prabhakaran D: Tobacco and alcohol use outcomes of a school-based intervention in New Dehli. Am J Health Behav. 2002, 26: 173-181. 10.5993/AJHB.26.3.2.
Ringwalt C, Ennett ST, Holt KD: An outcome evaluation of Project DARE (Drug Abuse Resistance Education). Health Educ Res. 1991, 6: 327-337. 10.1093/her/6.3.327.
Spoth RL, Redmond C, Trudeau L, Shin C: Longitudinal substance initiation outcomes for a universal preventive intervention combining family and school programs. Psychol Addict Behav. 2002, 16: 129-134.
Bond L, Patton G, Glover S, Carlin JB, Butler H, Thomas L, Bowes G: The Gatehouse Project: Can a multilevel school intervention affect emotional wellbeing and health risk behaviours?. J Epidemiol Community H. 2004, 58: 997-1003. 10.1136/jech.2003.009449.
Newton NC, Andrews G, Teesson M, Vogl LE: Delivering prevention for alcohol and cannabis using the Internet: a cluster randomised controlled trial. Prev Med. 2009, 48: 579-584. 10.1016/j.ypmed.2009.04.009.
Werch C, Moore MJ, DiClemente CC, Bledsoe R, Jobli E: A multihealth behavior intervention integrating physical activity and substance Use prevention for adolescents. Prev Sci. 2005, 6: 213-226. 10.1007/s11121-005-0012-3.
Ringwalt CL, Clark HK, Hanley S, Shamblen SR, Flewelling RL: Project ALERT: a cluster randomized trial. Arch Pediatr Adolesc Med. 2009, 163: 625-632. 10.1001/archpediatrics.2009.88.
Bodin MC, Strandberg AK: The Orebro prevention programme revisited: a cluster-randomized effectiveness trial of programme effects on youth drinking. Addiction. 2011, 106: 2134-2143. 10.1111/j.1360-0443.2011.03540.x.
Vogl L, Teesson M, Andrews G, Bird K, Steadman B, Dillon P: A computerized harm minimization prevention program for alcohol misuse and related harms: randomized controlled trial. Addiction. 2009, 104: 564-575. 10.1111/j.1360-0443.2009.02510.x.
Clark HK, Ringwalt CL, Hanley S, Shamblen SR, Flewelling RL, Hano MC: Project SUCCESS’ effects on the substance use of alternative high school students. Addict Behav. 2010, 35: 209-217. 10.1016/j.addbeh.2009.10.004.
Shope JT, Dielman TE, Butchart AT, Campanelli PC, Kloska DD: An elementary school-based alcohol misuse prevention program - A follow-up evaluation. J Stud Alcohol. 1992, 53: 106-121.
Peleg A, Neumann L, Friger M, Peleg R, Sperber AD: Outcomes of a brief alcohol abuse prevention program for Israeli high school students. J Adolesc Health. 2001, 28: 263-269. 10.1016/S1054-139X(00)00216-0.
Wilhelmsen BU, Laberg JC, Klepp KI: Evaluation of two student and teacher involved alcohol prevention programmes. Addiction. 1994, 89: 1157-1165. 10.1111/j.1360-0443.1994.tb02792.x.
Caplan M, Weissberg RP, Grober JS, Sivo PJ, Grady K, Jacoby C: Social competence promotion with inner-city and suburban young adolescents: effects on social adjustment and alcohol use. J Consult Clin Psychol. 1992, 60: 56-63.
Schinke SP, Tepavac L, Cole KC: Preventing substance use among Native American youth: Three-year results. Addict Behav. 2000, 25: 387-397. 10.1016/S0306-4603(99)00071-4.
Caria MP, Faggiano F, Bellocco R, Galanti MR: Effects of a school-based prevention program on European adolescents’ patterns of alcohol use. J Adolescent Health. 2011, 48: 182-188. 10.1016/j.jadohealth.2010.06.003.
Sun P, Sussman S, Dent CW, Rohrbach LA: One-year follow-up evaluation of Project Towards No Drug Abuse (TND-4). Prev Med. 2008, 47: 438-442. 10.1016/j.ypmed.2008.07.003.
Clayton RR, Cattarello AM, Walden KP: Sensation seeking as a potential mediating variable for school-based prevention intervention: a two-year follow-Up of DARE. Health Commun. 1991, 3: 229-239. 10.1207/s15327027hc0304_5.
McBride N, Farringdon F, Midford R, Meuleners L, Phillips M: Harm minimization in school drug education: final results of the School Health and Alcohol Harm Reduction Project (SHAHRP). Addiction. 2004, 99: 278-291. 10.1111/j.1360-0443.2003.00620.x.
St. Pierre TL, Osgood DW, Mincemoyer CC, Kaltreider DL, Kauh TJ: Results of an independent evaluation of project ALERT delivered in schools by cooperative extension. Prev Sci. 2005, 6: 305-317. 10.1007/s11121-005-0015-0.
Altman DG, Royston P: The cost of dichotomising continuous variables. BMJ. 2006, 332: 1080-
Cohen J: The cost of dichotomization. Appl Psych Meas. 1983, 7: 249-253. 10.1177/014662168300700301.
Flay BR, Biglan A, Boruch RF, Castro FG, Gottfredson DC, Kellam S, Mościcki EK, Schinke S, Valentine JC, Ji P: Standards of evidence: criteria for efficacy, effectiveness and dissemination. Prev Sci. 2005, 6: 151-175. 10.1007/s11121-005-5553-y.
Norström T, Pape H: Associations between adolescent heavy drinking and problem drinking in early adulthood: implications for prevention. J Stud Alcohol Drugs. 2012, 73: 542-548.
Rey JM, Saltz RF: Preventing and Responding to Alcohol Misuse in Specific Context: Schools, Colleges, the Military. Young People and Alcohol: Impact, Policy, Prevention, Treatment. edn. Edited by: Saunders JB, Rey JM. 2011, Wiley-Blackwell, 170-193.
Skara S, Sussman S: A review of 25 long-term adolescent tobacco and other drug use prevention program evaluations. Prev Med. 2003, 37: 451-474. 10.1016/S0091-7435(03)00166-X.
Gottfredson DC, Gottfredson GD: Quality of school-based prevention programs: results from a national survey. J Res Crime Delinq. 2002, 39: 3-35. 10.1177/002242780203900101.
Pasch KE, Perry CL, Stigler MH, Komro KA: Sixth grade students who use alcohol: do we need primary prevention programs for “tweens”?. Health Educ Behav. 2009, 36: 673-695. 10.1177/1090198107308374.
World Health Organization: European Action Plan to Reduce the Harmful use of Alcohol 2012 - 2020. 2012, Copenhagen: WHO Regional office for Europe
This research was funded by UiT- The Arctic University of Norway, with an additional grant from the Norwegian Directorate of Health.
The authors declare that they have no competing interests.
HKS and FA conducted the search for articles and selected relevant studies. HKS carried out the statistical analyses and drafted the manuscript with contributions from FA and SK. SF and MM contributed to methodological supervision as well as revision and drafting of the manuscript. All authors read and approved the final manuscript.
Authors’ original submitted files for images
Below are the links to the authors’ original submitted files for images.