- Research
- Open access
- Published:
An exploratory cluster randomised trial of a university halls of residence based social norms marketing campaign to reduce alcohol consumption among 1st year students
Substance Abuse Treatment, Prevention, and Policy volumeĀ 8, ArticleĀ number:Ā 15 (2013)
Abstract
Aims
This exploratory trial examines the feasibility of implementing a social norms marketing campaign to reduce student drinking in universities in Wales, and evaluating it using cluster randomised trial methodology.
Methods
Fifty residence halls in 4 universities in Wales were randomly assigned to intervention or control arms. Web and paper surveys were distributed to students within these halls (nā=ā3800), assessing exposure/contamination, recall of and evaluative responses to intervention messages, perceived drinking norms and personal drinking behaviour. Measures included the Drinking Norms Rating Form, the Daily Drinking Questionnaire and AUDIT-C.
Results
A response rate of 15% (nā=ā554) was achieved, varying substantially between sites. Intervention posters were seen by 80% and 43% of students in intervention and control halls respectively, with most remaining materials seen by a minority in both groups. Intervention messages were rated as credible and relevant by little more than half of students, though fewer felt they would influence their behaviour, with lighter drinkers more likely to perceive messages as credible. No differences in perceived norms were observed between intervention and control groups. Students reporting having seen intervention materials reported lower descriptive and injunctive norms than those who did not.
Conclusions
Attention is needed to enhancing exposure, credibility and perceived relevance of intervention messages, particularly among heavier drinkers, before definitive evaluation can be recommended. A definitive evaluation would need to consider how it would achieve sufficient response rates, whilst hall-level cluster randomisation appears subject to a significant degree of contamination.
Trial registration
ISRCTN: ISRCTN48556384
Introduction
Excessive alcohol consumption among university students has been linked to educational difficulties, psychosocial problems, antisocial behaviours, injuries and risky sexual behaviours [1]. However, heavy alcohol consumption is perceived as a rite-of-passage by students in the United Kingdom (UK) [2], playing a central role in the construction of student identities [3, 4], with university students drinking more than peers who enter the workforce [5]. One survey found that half of 1st year students exceeded recommended weekly drinking limits [6], while a third did so into their 3rd year. Recent policy efforts to increase proportions of young people entering university have perhaps exposed more young people than ever to an environment where hazardous consumption of alcohol is widespread. Interventions in university settings are therefore increasingly seen as important in reaching young people at risk from hazardous drinking. However, much of the limited evidence to inform policy and practice comes from the US, where purchasing alcohol is an illicit behaviour for most undergraduates, with consumption lower than among UK students [5, 7].
One approach to reducing student drinking which shows promise in recent (largely US-based) studies is the social norms approach [8]. Social norms are central to a range of models in health psychology. For example, Social Learning Theory emphasises roles of descriptive norms (perceived behaviours of others) in shaping behaviours [9], while the Theory of Planned Behaviour emphasises roles of injunctive norms (perceived social approval of the behaviour) in forming behavioural intentions [10]. While most social norms interventions have emphasised descriptive norms (e.g. communicating that drinking isnāt as prevalent as students think), prospective research has shown injunctive and descriptive norms to be independent predictors of student drinking [11].
Advocates of social norms interventions focus upon the fallibility of normative perceptions, arguing that people overestimate the prevalence of unhealthy behaviours among peers. Overestimation of peer alcohol consumption amongst students has been widely reported [12ā16], including one UK study [17]. Social norms interventions aim to correct misperceptions through mailed, web-based or face-to-face feedback on peer drinking norms [18, 19], or social marketing campaigns [20, 21]. A 2009 Cochrane review [8] concluded that web-based or one-to-one feedback reduced consumption, though mailed or group feedback were ineffective, with findings for social norms marketing campaigns equivocal.
Caution should however be exercised in applying these findings to the UK. Given the high levels of consumption of alcohol in many UK universities, communicating āactualā drinking norms may perversely reinforce hazardous norms, whilst attempts to persuade students that heavy drinking is not the norm may lack credibility. At the time of the study, only one UK Randomised Controlled Trial (RCT) had evaluated impacts of a social norms intervention on student drinking, with students assigned to the intervention group significantly more likely to drop out of the study, perhaps indicating limited engagement with the intervention [18]. More recently, and in contrast to the conclusions of the earlier Cochrane review based largely on US evidence, one trial in 22 UK universities found no evidence of effects of web-based normative feedback on student drinking [22].
Despite limited UK evidence, plans for a social norms intervention in universities in Wales were announced in a 2010 report from the Cabinet Office Behavioural Insights Team [23]. A study was then commissioned to conduct a survey to inform the development of key messages, and a pragmatic evaluation of the intervention. First year students represent a priority group due to higher risk of hazardous drinking [6]. Whilst social norms studies have often focused on perceived norms in relation to a ātypical studentā, perceived norms of more specific groups have been shown to correlate more strongly with drinking behaviour [14]. Hence, intervention targeted first year students, with perceived norms relating to other first years, the same sex and in the same university. Halls of residence were selected as a distribution channel due to the high percentage of first years in Wales accommodated within them.
Though social norms interventions are typically evaluated with little exploration of the settings in which they are delivered, attempts to change behaviours without considering the contexts in which they are formed, are likely to be of limited and variable success [24, 25]. For example, one US based intervention, Project Northland, a community intervention to reduce alcohol misuse in adolescents, achieved promising impacts in rural settings [26], though weaker impacts in urban settings, with actions of the intervention perhaps drowned out by the multitude of pro-alcohol stimuli in the urban environment [27]. Hence, in the present evaluation, the social norms campaign was accompanied by a university-wide toolkit, with universities supported by a project officer in reviewing alcohol-related policies and practices, and implementing evidence-informed changes [28]. The development and implementation of this toolkit will be described in detail elsewhere.
This paper presents findings from the exploratory trial of the social norms campaign. Medical Research Council guidelines for developing and evaluating complex interventions emphasise the importance of exploring uncertainties in the implementation of the intervention and proposed methods of evaluation [29] prior to definitive evaluation. Hence, this exploratory trial aimed to inform decisions on whether, and how, to proceed to definitive evaluation, by addressing a number of research questions.
A key challenge in evaluating university-based interventions is achieving sufficient responses to be confident of representativeness. In the only peer-reviewed survey of drinking norms in a UK university, a response rate of 4% was achieved to a web-based survey [17]. The present study adopts web and paper based survey methods in order to boost responses. Deriving suitable comparison groups is also challenging for social marketing based campaigns, with many using cluster allocation but individual-level analysis, producing potentially spurious results [30]. In deriving comparison groups, there is perhaps a trade-off between the costs associated with a higher level unit of allocation and the risk of contamination. Randomising at the university level would mean that large numbers of universities would be required hence increasing evaluation costs, while randomisation at a lower level such as halls of residence may reduce cost, though increases the risk of contamination. The feasibility or contamination associated with cluster randomisation at the residence hall level will be explored in this study.
For a campaign to be successful, the target audience must not only be exposed to messages and understand them, but must find them credible and relevant [31]. Hence, this study quantifies the percentage of students exposed to a social norms intervention, as well as recall, perceived credibility and relevance of key messages. Perceived norms are one of a multiplicity of influences on drinking, at multiple socio-ecological levels [24], and hence changes in perceived norms are perhaps unlikely to be matched by behavioural changes of the same magnitude. Whilst this study will measure behavioural outcomes, it will likely be underpowered to detect small behavioural changes. Hence, the study will primarily will examine impacts upon hypothesised mediators of change (i.e. perceived descriptive and injunctive norms).
A key weakness of previous social norms evaluations is that outcomes are invariably based on self-report [8]. As described, social norms interventions aim to change behaviour through highlighting the undesirability of excessive drinking. Experimental studies indicate that communicating the undesirability of excessive drinking through exposing students to information about peer norms leads to biased estimates of studentsā own consumption [32]. Hence, these studies may have provided an over-optimistic view of behavioural impacts, with lower estimates in intervention arms arguably reflecting enhanced social desirability bias, rather than behavioural change. This study will therefore examine the acceptability of requesting hair samples as an objective method of quantifying alcohol consumption in any future definitive trial. While hair samples have shown potential as a means of measuring alcohol consumption, allowing detection of alcohol volumes consumed in the weeks prior to testing [33], the feasibility of this method in large scale studies, or with student populations, has been little explored.
Methods
The social norms intervention
The intervention is a social norm marketing campaign to correct misperceptions regarding behaviours and social expectations of peers among first year students, and thus influence alcohol consumption and alcohol related behaviours. Key messages (developed via survey of first year students in the same universities conducted in 2011) were delivered via placement of posters, drinks mats (coasters), drinking glasses, meal planners (i.e. 7-day calendar on which students can plan their meals for the week) and mirror stickers in halls of residence in 4 universities (see Tableā1). Drinks mats and glasses were placed in self-catering kitchens within residence halls. All messages highlighted discrepancy between studentsā perceptions of the behaviours (descriptive norms) or social expectations of others (injunctive norms) based on findings from an earlier survey. Messages emphasised both overestimation of risk behaviours (e.g. alcohol consumption) and underestimation of protective behaviours (e.g. including soft drinks in a night out). While most previous social norms interventions have involved communicating exact levels of drinking (e.g. āxx% of students drink xx times/units per week or lessā), in the Welsh sample, while reported drinking was lower than perceived norms, drinking levels were hazardous. That is, an average drinking occasion lay on the border of NHS definitions of binge drinking (8 units for men/6 for women), while most students did report drinking more than recommended weekly limits (21 units for men, 14 for women). Hence, communicating absolute values for drinking would risk further normalising hazardous drinking. A decision was therefore made to emphasise discrepancy rather than present absolute values. The intervention also differed from many social norms interventions in that it attempted to prevent uptake of risky behaviours rather than changing established patterns, with intervention messages communicated to students from entry to university onwards. Fuller details can be found in the published study protocol [28].
Sampling and recruitment
Six universities in Wales were invited to take part, of whom 4 agreed. Participants were 1st year undergraduates in university maintained halls of residence (nā=ā50) within these four universities (approximately 3800 eligible students).
Measures
Demographics
Students were asked to indicate their sex, age, course, ethnicity, home/international status, and which hall they lived in.
Intervention exposure/contamination, recall, evaluative responses and perceived impacts
For each material (posters, drinks mats, glasses), students were asked to indicate whether they had seen that material i) in their own hall of residence or ii) in another studentās hall of residence. Students were also asked to indicate whether they had been exposed to competing pro-alcohol communications in relation to i) happy hours, ii) on-campus student drinking nights (e.g. drink the bar dry) or iii) student drinking nights in off-campus bars and clubs.
To assess recall of intervention messages, those indicating having seen at least one material were presented with a list of messages, some of which were semantically consistent with messages in the campaign (e.g. other students drink less than you think) and some of which were not (e.g. other students drink more than you think), and asked to indicate whether they believed the message formed part of the campaign. Students were asked to indicate their level of agreement on a 5-point likert scale (strongly disagree to strongly agree) that materials were believable, relevant, changed their perceptions of other studentsā drinking, made them more conscious of moderating the impacts of alcohol, and made them limit their own alcohol consumption.
Perceived drinking norms
Descriptive norms were evaluated using the Drinking Norms Rating Form (DNRF); a modified version of the Daily Drinking Questionnaire on which students are asked to estimate how much a typical member of a reference group drinks on each day of a typical week. Injunctive norms were evaluated using 3 items of a 4-item scale previously used by Larimer and colleagues [11]. Students were asked to indicate the extent to which they felt other students would approve of i) drinking every day, ii) drinking every weekend, iii) drinking enough to pass out. For all normative questions, the reference group was āother students in your university, your academic year and of the same sex as youā. As the baseline survey indicated that asking students to report their own behaviour prior to perceived norms inflated normative estimates, questions on perceived norms preceded questions about students own consumption. For these, and subsequent items on alcohol consumption, a standard drink (or unit) was defined as half of a 175āml glass of wine, half a pint of normal strength lager or a single shot of spirits, with pictorial examples representing different numbers of units presented above all questions which asked for estimates of alcohol consumption.
Alcohol consumption
Alcohol consumption was assessed using the Daily Drinking Questionnaire (DDQ; [34]), comprising a grid in which students are asked to indicate how many standard drinks they drank each day of a typical week. The DDQ is widely used with university students, and demonstrates similar reliability whether administered as a paper and pencil measure or in web-based format [35]. Students were asked to provide responses in relation to a typical week in the current term (January-April 2012). Units per week were calculated by summing responses for each day. An additional measure of alcohol consumption was provided by the Alcohol Use Disorders Identification Tool Consumption (AUDIT-C) scale [36], in which students indicate on 5-point likert scales how often they drink alcohol, how many units they drink on a typical occasion and how regularly they drank 6 or more units for women, or 8 or more for men. A score of 3 or more for women or 4 or more for men has been shown to optimally identify higher risk drinkers [37]. Finally, students were asked how many units they drank on their heaviest drinking occasion in the current university term.
Pre-university alcohol consumption
It was infeasible to obtain baseline measures, as students came into contact with the intervention on entry to university. Hence, a modified AUDIT-C asked students to indicate their drinking levels in the year prior to starting university.
Acceptability of objective measures of alcohol consumption (hair samples)
Students were asked whether in any future alcohol related study they would be willing to provide an anonymised hair sample for research purposes: i) without requiring payment, ii) only if paid or iii) not under any circumstances. That samples would be anonymised, and would not be analysed for substances other than alcohol, were emphasised. Students who selected Option 2 were asked to indicate how much payment they would require: i) Ā£1-5, ii) Ā£5-10, iii) Ā£10-15, iv) Ā£15-20 and v) more than Ā£20.
Randomisation
Blind remote randomisation was used to allocate halls to intervention or control conditions. Halls were stratified by institution and halls allocated alternately in a list ordered by size, with group allocation determined by one random number within each stratum.
Procedures
Intervention materials, communicating messages developed from findings of a survey of first year students conducted in April 2011, were distributed in halls of residence in September 2011, and January 2012. Following ethical approval from the Cardiff University School of Social Sciences Research Ethics Committee (for the follow-up survey reported in this paper), each university was provided with copies of the questionnaire and participant information, and asked to consent to distribution. The follow-up survey was distributed in February 2012. The externally programmed web-links were emailed to nominated contacts for distribution via emails, postings on student union web pages and electronic notice boards. Regular updates were obtained from the survey company and as responses declined, distribution contacts were asked to refresh adverts and send reminder emails. Two reminders were distributed in two institutions, although one sent only one reminder due to conflict with another survey, whilst in another, delays identifying alternative distribution contacts following staff sickness meant that only one reminder was sent. Entry to a Ā£100 prize draw (one prize in each university), was offered as an incentive. On following the web-link, students were presented with an information sheet and consent form, and could proceed only after indicating that they had read and understood the information provided, understood their right to withdraw at any time and wished to take part. The questionnaire was offered in English and Welsh. All data were collated by the market research company, who supplied an SPSS data-set. Efforts were made to boost responses through providing paper questionnaires, with questionnaires, information sheets and consent forms posted under doors in halls of residence with freepost envelopes. To discourage duplicate entries, information sheets requested that students complete either web or paper versions and emphasised that one prize draw entry per student would be accepted.
Analysis
Response rates are broken down by institution and survey type (web / paper). In order to assess exposure and contamination, the number and percentage of students within intervention and control arms reporting seeing intervention materials in their own or another students hall are presented. Among students reporting seeing each material, percentages who accurately identify core messages are then presented. Among students who report seeing at least one material, the frequency and percentage agreeing with each statement relating to responses to and perceived impacts of the intervention are presented. Agreement scores were then correlated with pre-university drinking levels using Spearmanās rank correlation.
Due to the skewness of data relating to descriptive norms (skewnessā=ā3.2), linear regression analyses were deemed inappropriate. Hence, descriptive norms are divided into gender-adjusted ordinal categories, including ranges used by Bewick et al. [6], and the percentage reporting a norm within each risk category presented for intervention and control participants, prior to construction of ordinal regression models [38]. Regression models adjust for age, gender, survey type (web or paper), and university. Given that this was a cluster randomised trial, a random term for hall of residence was used to account for the clustered nature of the sample. Data were also analysed using linear regression analyses of log-transformed scores. As these gave the same results as the ordinal models, only the ordinal models are reported. Injunctive norms (for which data were normally distributed) were subjected to linear regression analyses. Primary analyses were conducted on an intention-to-treat basis (i.e. comparisons were made based on the group that students were randomly allocated to, regardless of whether or not they received, or were exposed to, the intervention). Secondary āper-protocolā analysis repeated the above analyses with students grouped by whether or not they had seen at least one intervention material. Intra-cluster correlations and standard deviations for total units per week are also presented. For drinking outcomes, while no formal analysis of statistical significance is conducted (as this was an exploratory trial which was not powered to definitively evaluation differences between intervention and control groups in terms of drinking behaviour) the percentages of students within intervention and control groups, and the percentage of students who had or had not seen intervention messages, reporting each level of alcohol consumption are presented. Finally percentages of students providing each response in relation to willingness to provide hair samples are presented.
Results
Response rates
In total, 554 students within 43 halls of residence (20 control/23 intervention) provided sufficiently complete responses (i.e. completed demographic details and a measure of perceived norms), equating to approximately 14.6% of students in the 50 halls selected for the study. Response rates were highest in sites who distributed two reminders and used email lists to target 1st years 19.5% and 25.3%, and weakest in those who distributed only 1 reminder and relied upon methods such as electronic notice boards (5.8% & 6.1%). In both intervention and control arms, 70% of responses were to the web survey, with the remainder from the paper survey. A check of email addresses provided for the prize draw revealed that no students completed both web and paper versions.
Sample characteristics
Sample characteristics by trial arm are presented in Tableā2. In both arms, more female than male responses were received. The vast majority of students were white British and home students, with a median age of 19āyears. In both trial arms, the most common course types were humanities, sciences, social sciences and geography/environmental sciences. Similar scores were observed on the adapted AUDIT-C which assessed drinking levels prior to university, with means of 5.4 and 5.3 in intervention and control groups.
Exposure and contamination
As indicated in Tableā3, a large majority of students in the intervention group reported having seen posters in their own hall, with meal planners seen by a little more than half. Portable materials (i.e. those not fixed to the wall) were seen by a minority. However, there was substantial contamination, with 11-26% students in control halls seeing materials in their own hall. Large numbers of students also report having seen the materials in other studentsā halls of residence. Overall, 43% of students in control halls report having seen posters, compared to 80% in the intervention group. Students were substantially more likely to report exposure to pro-alcohol promotions than to intervention materials. Overall, 429 (82.7%; 75.1% control students vs 79.8 intervention) reported having been exposed to promotions for happy hours, 430 (82.8%; 81.8% control students vs 83.6% intervention) reported exposure to promotions for drinking based events such as drink the bar dry, whilst 484 (93.4%; 92.4% control students vs 94.5% intervention) reported exposure to promotions for student drinking nights in off-campus bars and clubs.
Recall of messages
Among intervention students who reported seeing beer mats (nā=ā74), 79.7% (nā=ā59) correctly identified the message āother students drink less than you might thinkā, although 64.9% (nā=ā48) incorrectly identified the message āmost students underestimate how much other students drinkā. Of students who reported seeing the posters (nā=ā186), 86.6% (nā=ā161) correctly identified the message āother students drink less than you might thinkā, although 60.2% (nā=ā112) incorrectly identified the message āmost students underestimate how much other students drinkā. Of students who reported seeing the meal planners (nā=ā138), 19.6% (n =ā24) incorrectly indicated the message that students drink alcohol most days of the week. Of students who reported seeing mirror stickers 49.2% (nā=ā21) correctly identified the message āmost students disapprove of drinking everydayā. However, among students reporting seeing posters in their own hall, recall was substantially higher for intervention group students (89.0%; nā=ā154) than control students (50.0%; nā=ā35). Recall levels among students who reported seeing posters in another studentsā hall, but not their own were comparable for intervention (64.7%; nā=ā11) and control students (68.1%; nā=ā35).
Responses to and perceived impacts of intervention messages
Of intervention students who reported seeing at least one material, almost two-thirds (61.6%; nā=ā242) reported that messages were believable, and more than half (55.9%; nā=ā214) that they were relevant. Fewer (21.4%; nā=ā89) stated that materials influenced their perceptions of other studentsā drinking. About a third (31.9%; nā=ā122) stated that they made them more conscious of moderating the effects of alcohol, while 13.1% (nā=ā50) stated that materials had impacted their own alcohol consumption. For all statements, agreement was negatively correlated with reported drinking levels prior to attending university, with perceived credibility and impacts greatest amongst students who report having been more moderate drinkers prior to intervention. Credibility (nā=ā383; Spearmanās rank correlation coefficientā=ā-0.14, pā<ā0.01), perceived impacts on alcohol moderation behaviours (nā=ā383; Spearmanās rank correlation coefficientā=ā-0.11, pā=ā0.02) and alcohol consumption (nā=ā381; Spearmanās rank correlation coefficient,=ā-ā0.14, pā<ā0.01) were significantly negatively associated with past drinking, while negative associations of past drinking with perceived relevance (nā=ā383; Spearmanās rank correlation coefficientā=ā-0.09, pā=ā0.07) and perceived impacts on perceptions of other studentsā drinking (nā=ā381; Spearmanās rank correlation coefficientā=ā-0.09, pā=ā0.08) were significant only at the 10% level.
Impacts on normative perceptions
As indicated in Tableā4, among students in intervention halls, the largest proportion reported a perceived norm for weekly consumption in the āhazardousā range, whereas for students in control halls, the most common responses lay in the āharmfulā range. Hence, students in intervention halls appeared slightly less likely to perceive that normative drinking levels lay in the harmful range. There was little difference between groups in terms of geometric mean or median unit per week estimates. Larger differences were observed where students are classified according to exposure, with 41% of students who had not seen any of the materials reporting a perceived norm in the harmful range by comparison to 29% of students who had. Mean injunctive norm scores were 9.8 (95% CI; 9.4 to 10.3) and 10.5 (95% CI; 10.0 to 10.9) for intervention and control participants respectively. Where grouped according to reported exposure, mean scores of 10.0 (95% CI; 9.6 to 10.3) and 10.9 (95% CI; 10.2 to 11.7) were observed for those who had / had not seen the materials.
Ordinal regression models for descriptive norms indicate no significant between group differences in intention-to-treat analysis (see Tableā5). In per-protocol analysis, significantly lower perceived norms were reported among students reporting exposure to intervention materials, before and after adjustment for pre-university alcohol consumption. Similarly, linear regression models for injunctive norms indicate no significant between group difference in intention to treat analysis, though lower scores among students who reported having seen the materials than among those who had not.
Design parameters and impacts on consumption
A non-significant intra-cluster correlation of 0.01 was observed for log-transformed values for total units per week, indicating no significant variance at the hall level, with a standard deviation of 1.13. In both groups, approximately 7% of students reported being non-drinkers, whilst the largest proportion of students reported drinking within recommended limits. Small majorities of both groups reported drinking above recommended limits (21 weekly units for men and 14 for women). While not subjected to formal hypothesis testing, descriptive statistics indicate that there was less than 1 unit per week difference between geometric mean weekly consumption values for intervention and control groups, and between those who had or had not seen the intervention materials. Mean AUDIT-C scores, percentages of students classified as āhigher riskā drinkers and median units on the heaviest drinking occasion were similar for intervention and control groups, and for those who had or had not seen intervention materials (see Tableā6).
Figureā1 shows the percentage of students providing estimates of ātypical studentā consumption higher than their own (i.e. perceived that they were below average drinkers) by consumption level and exposure to intervention materials. Among students who reported drinking within recommended limits, those reporting exposure to materials were substantially less likely to perceive that a typical student drank more than them (93% vs 79%). A smaller discrepancy was observed between those exposed and not exposed to materials among students who drank in excess of recommended limits (61% vs 56%). Hence, a small majority of students drinking above recommended limits continued to perceived that they drank below typical levels.
Acceptability of objective methods of evaluating alcohol consumption
Overall, 37.9% (nā=ā192) of students reported that they would provide a hair sample as an objective measure of alcohol consumption without requiring payment, while a further 46.0% (nā=ā233) would do so if payment were offered. Only 16.2% (nā=ā82) would not provide a hair sample under any circumstances. Of those students who stated that payment would be required to persuade them to provide a sample, 11.9% (nā=ā28) stated that Ā£1-5 would be sufficient, 30.1% (nā=ā71) that they would require Ā£5-10, 22.0% (nā=ā52) that they would require between Ā£10-15, 20.8% (nā=ā49) that they would require Ā£15-20, and 15.3% that they would require more than Ā£20.
Discussion
This study offers a range of insights into the feasibility and acceptability of implementing a social norms intervention in university halls of residence, and evaluating it using cluster randomised controlled trial methods. Key challenges which would require further attention before progression to definitive trial could be recommended, centred around difficulties in obtaining sufficient response rates to be confident of representativeness, identifying effective communication channels to achieve widespread reach of intervention messages, reducing contamination between trial arms and ensuring the credibility of key intervention messages. Ultimately, the evaluation provided tentative evidence of changes in perceived norms, though little change in behavioural outcomes. Each of these key issues is now discussed before considering implications.
Whilst exceeding the 4% response rate achieved in the only UK-based peer reviewed survey of studentsā drinking norms to date [17], the response rate of 15% was perhaps insufficient to be confident of representativeness. Furthermore, rates were highly differentiated across sites; in sites achieving the best responses, bespoke email lists targeted first year students, with 2 reminder mailings sent. In sites achieving the poorest rates, distribution relied upon electronic notice boards, or email distribution via course representatives. In one, the survey was given a lower priority than an existing survey, with clashes meaning that access was denied to distribution channels such as electronic notice-boards. In another, illness of the nominated contact coincided with the start of the distribution period, with no plans made to cover this work, leading to delays in identifying alternative distribution channels. Response rates were boosted by addition of a pen and paper version of the survey, delivered by researchers where universities allowed this. In one of 2 sites who asked to arrange distribution themselves, surveys were not distributed prior to the end of term.
Most students in intervention halls reported seeing posters in their hall, though materials not affixed to the walls were seen by fewer. It is unclear whether the large proportions of students not seeing materials other than posters arose from non-placement, from not being sufficiently noticeable, or disposal by other students. Process evaluation observations reported elsewhere suggest that these factors combined. Although materials were evident throughout intervention halls at Phase 1 or 2, in some cases only one round appeared to have been placed, whilst materials such as meal planners had often been taken down and placed in recycling bins.
As argued by MacDonald and colleagues [31], for a campaign to be successful, messages must be understood, believed and viewed as relevant (although others have questioned the importance of relevance, arguing that people underestimate the influence of social norms on their behaviour [39]). Most students who reported seeing posters or drinks mats recognised descriptive norm messages, although injunctive norm messages were recognised by fewer. A slight majority perceived intervention messages as credible and relevant, though most felt that they would have little impact on behaviour. Furthermore, pre-university drinking levels and credibility were negatively correlated. This is perhaps unsurprising given that dissonance between current beliefs and normative communications is likely greater for heavier drinkers. However, it has implications for social norms interventions, in that whilst these commonly operate by targeting higher risk drinkers for feedback on āactualā norms [18], such individuals appear more likely to dismiss such information as lacking credibility.
Many control students reported exposure to materials, perhaps indicating that using residence hall as the unit of randomisation may not be feasible for definitive trials of similar interventions. However, while most who reported seeing posters in another studentsā hall correctly recalled their core message, only half of control participants reporting seeing the posters in their own hall did so compared to almost 90% of those in intervention halls. This perhaps indicates either misreporting of exposure among control students, consistent with researcher observations which found no intervention materials in control halls, or relatively brief exposure. Given that twice as many intervention as control participants were exposed to materials, and given the higher recall amongst āexposedā members of the intervention group, while reduced by contamination, one would perhaps still expect to have seen differences in normative perceptions between intervention and control groups if effects were large.
Between group comparisons offered equivocal evidence of impacts on perceived norms. In intention-to-treat analysis, a small and non-significant reduction in estimates of typical consumption among other students was observed. Comparisons between students exposed and not exposed to materials indicated larger discrepancies, which remained significant after adjustment for demographic variables and pre-university drinking levels. However, whilst not subjected to formal hypothesis testing, between group differences in relation to post-intervention drinking levels were small, regardless of whether compared by randomisation status or exposure to materials. One explanation for limited behavioural change, even where comparing students on the basis of exposure, lay in the fact that differences in normative perceptions appeared greater for students who drank within recommended limits, consistent with findings that heavier drinkers were more likely to reject messages as untrue.
In relation to acceptability of objective measures, most reported willingness to provide hair samples as an objective measure, though half stated that they would require payment to do so. Whilst it should be noted that this percentage is based on students who have engaged with the study, and cannot be generalised beyond this subsample, high willingness to provide sample is encouraging, and suggests that it may be feasible to adopt more objective measures in order to rule out chances that between group differences arise from differential reporting biases.
Limitations of this study include that only 4 universities were recruited, and whether feasibility challenges encountered would be reflected to a greater or lesser degree in a national roll-out is unclear. It may have been that universities which agreed to take part were more receptive to alcohol interventions than those who were not, or that drinking levels in these universities differed from those in other sites. Furthermore, consistent with previous UK university based alcohol surveys [6, 17], the study recruited more female than male undergraduates. Achieving higher overall response rates, and responses more representative in terms of factors such as gender, may be necessary to understand the reach and effects likely to be achieved by such campaigns. The development of the campaign was hampered by the fact that policy timetables did not allow for qualitative research with students to develop relevant and credible messages prior to implementation. Qualitative data conducted as part of the process evaluation, to be reported elsewhere, highlight a number of issues in relation to, which ideally would have been explored in developmental phases. Furthermore, outcomes are based on self-report. Nevertheless, the study benefitted from the fact that it was a pragmatic evaluation of a real world intervention, therefore offering high external validity, and highlighted challenges in relation to implementation and receipt often overlooked in social norms evaluations. Its findings demonstrate the importance of encouraging policy and practice partners to use exploratory trials prior to embarking on full-scale roll-outs or expensive definitive trials, and highlight a number of uncertainties and challenges which would need to be overcome in any definitive evaluation of a similar intervention.
Conclusions
In terms of intervention delivery and content, significant development appears to be needed before definitive evaluation can be considered. There is perhaps a need for more prolonged efforts to engage with universities, maximise buy-in and improve local ownership of the intervention. Greater efforts are needed to enhance the visibility, credibility and relevance of social norms intervention messages, particularly amongst more hazardous drinkers who were more likely to dismiss messages as untrue. Whilst intention-to-treat analysis indicated no effect on perceived norms, there is tentative suggestion of reductions in perceived drinking norms among students exposed to the social norms intervention. This non-randomised secondary analysis should be interpreted with the caveat that those exposed to the intervention may have differed from those not exposed in other ways which influence these perceptions. Furthermore, impacts on behaviour appear negligible, with little difference between groups even where participants were grouped by exposure.
In relation to evaluation design, establishing effectiveness would require significant improvements in response rates. The study was clearly in some cases given lower priority than other activities, such as annual student surveys, and a longer time period may be needed to build relationships with universities, enhance buy-in, and negotiate more effective distribution methods. Given the greater effectiveness of bespoke email lists in eliciting student responses, by comparison to electronic notice-boards, a definitive trial should aim to negotiate construction of email lists to target first year students in all sites, perhaps requiring funding to incentivise their creation. Another means of boosting response rates is use of incentives. Whilst entry to a Ā£100 prize draw was offered, many US based social norms surveys achieving response rates closer to 40% have included payment in the region of $10 for each participant [15, 19]. Offering Ā£5 per student would have inflated the cost of this study by approximately Ā£8000 if this were to achieve a 40% response rate, with this figure increasing in line with the increase in size of a fully powered trial. Using cluster randomisation at the hall-level appears associated with contamination between trial arms, although given that recall of key messages was so much poorer among control students than intervention group students, one would perhaps still expect to see between group differences if intervention effects were large. Research is needed to evaluate the acceptability and response rates achieved in practice where attempting to obtain hair samples from students as an objective measure of consumption.
References
Wechsler H, Lee JE, Kuo M, Lee H: College binge drinking in the 1990s: a continuing problem. Results of the Harvard school of public health 1999 college alcohol study. J Amer College Health. 2000, 48 (5): 199-10.1080/07448480009599305.
Carpenter R, Fishlock A, Mulroy A, Oxley B, Russell K, Salter C, Williams N, Heffernan C: After āunit 1421ā: an exploratory study into female students' attitudes and behaviours towards binge drinking at leeds university. J Public Health. 2008, 30 (1): 8-13. 10.1093/pubmed/fdm083.
Dempster S: I drink, therefore Iām man: gender discourses, alcohol and the construction of British undergraduate masculinities. Gend Educ. 2011, 23 (5): 635-653. 10.1080/09540253.2010.527824.
Piacentini MG, Banister EN: Getting hammered?ā„ā„ students coping with alcohol. J Consum Behav. 2006, 5 (2): 145-156. 10.1002/cb.41.
Gill JS: Reported levels of alcohol consumption and binge drinking within the UK undergraduate student population over the last 25 years. Alcohol Alcohol. 2002, 37 (2): 109-120. 10.1093/alcalc/37.2.109.
Bewick B, Mulhern B, Barkham M, Trusler K, Hill A, Stiles W: Changes in undergraduate student alcohol consumption as they progress through university. BMC Publ Health. 2008, 8 (1): 163-10.1186/1471-2458-8-163.
Delk EW, Meilman PW: Alcohol use among college students in Scotland compared with norms from the United States. J Amer College Health. 1996, 44 (6): 274-281. 10.1080/07448481.1996.9936855.
Moreira MT, Smith LA, Foxcroft D: Social norms interventions to reduce alcohol misuse in university or college students. Cochrane database system rev (Online). 2009, CD006748-3
Bandura A: Social learning theory. 1977, Englewood Cliffs, NJ: Prentice Hall
Ajzen I: The theory of planned behavior. Organ Behav Hum Decis Process. 1991, 50 (2): 179-211. 10.1016/0749-5978(91)90020-T.
Larimer ME, Turner AP, Mallett KA, Geisner IM: Predicting drinking behavior and alcohol-related problems among fraternity and sorority members: examining the role of descriptive and injunctive norms. Psych Addict Behav. 2004, 18 (3): 203-
Lewis MA, Neighbors C: Gender-specific misperceptions of college student drinking norms. Psych Addict Behav. 2004, 18 (4): 334-
Lewis MA, Neighbors C: Optimizing personalized normative feedback: the use of gender-specific referents. J Stud Alcohol Drugs. 2007, 68 (2): 228-
Larimer ME, Kaysen DL, Lee CM, Kilmer JR, Lewis MA, Dillworth T, Montoya HD, Neighbors C: Evaluating level of specificity of normative referents in relation to personal drinking behavior. J Stud Alcohol Drugs. 2009, S16 (121): 115-
Neighbors C, Dillard AJ, Lewis MA, Bergstrom RL, Neil TA: Normative misperceptions and temporal precedence of perceived norms and drinking. J Stud Alcohol. 2006, 67 (2): 290-
Riou Franca L, Dautzenberg B, Falissard B, Reynaud M: Peer substance use overestimation among French university students: a cross-sectional survey. BMC Publ Health. 2010, 10 (1): 169-10.1186/1471-2458-10-169.
McAlaney J, McMahon J: Normative beliefs, misperceptions, and heavy episodic drinking in a British student sample. J Stud Alcohol Drugs. 2007, 68 (3): 385-392.
Bewick B: Providing Web-based feedback and social norms information to reduce student alcohol intake: a multisite investigation. J Med Internet Res. 2010, 12 (5): e59-10.2196/jmir.1461.
Neighbors C, Lewis MA, Atkins DC, Jensen MM, Walter T, Fossos N, Lee CM, Larimer ME: Efficacy of Web-based personalized normative feedback: a Two-year randomized controlled trial. J Consult Clin Psych. 2010, 78 (6): 898-911.
DeJong W, Schneider SK, Towvim LG, Murphy MJ, Doerr EE, Simonsen NR, Mason KE, Scribner RA: A multisite randomized trial of social norms marketing campaigns to reduce college student drinking. J Stud Alcohol. 2006, 67 (7): 868-879.
DeJong W, Schneider SK, Towvim LG, Murphy MJ, Doerr EE, Simonsen NR, Mason KE, Scribner RA: A multisite randomized trial of social norms marketing campaigns to reduce college student drinking: a replication failure. Subst Abus. 2009, 30 (2): 127-140. 10.1080/08897070902802059.
Moreira MT, Oskrochi R, Foxcroft DR: Personalised normative feedback for preventing alcohol misuse in university students: Solomon three-group randomised controlled trial. PLoS One. 2012, 7 (9): e44120-10.1371/journal.pone.0044120.
Cabinet Office Behavioural Insights Team: Applying behavioural insights to health. 2010, London: The Cabinet Office
Ward BW: Identifying environmental effects on alcohol use and social-norms: the socio-environmental context model. J Human Behav Soc Environ. 2011, 21 (5): 502-520. 10.1080/10911359.2011.566802.
McLeroy KR, Bibeau D, Steckler A, Glanz K: An ecological perspective on health promotion programs. Health Educ Behav. 1988, 15 (4): 351-377. 10.1177/109019818801500401.
Perry CL, Williams CL, Komro KA, Veblen-Mortenson S, Stigler MH, Munson KA, Farbakhsh K, Jones RM, Forster JL: Project northland: long-term outcomes of community action to reduce adolescent alcohol use. Health Educ Research. 2002, 17 (1): 117-10.1093/her/17.1.117.
Komro K, Perry CL, Veblen-Mortenson S, Farbakhsh K, Toomey TL, Stigler MH, Jones-Webb RKCK, Pasch KE, Williams CL: Outcomes from a randomized controlled trial of a multi-component alcohol use preventive intervention for urban youth: Project Northland Chicago. Addiction. 2008, 103 (4): 606-618. 10.1111/j.1360-0443.2007.02110.x.
Murphy S, Moore G, Williams A, Moore L: An exploratory cluster randomised trial of a university halls of residence based social norms intervention in Wales, UK. BMC Public Health. 2012, 12 (1): 186-10.1186/1471-2458-12-186.
Craig P, Dieppe P, Macintyre S, Michie S, Nazareth I, Petticrew M: Developing and evaluating complex interventions: the new medical research council guidance. BMJ. 2008, 337: a1655-10.1136/bmj.a1655.
Gordon R, McDermott L, Stead M, Angus K: The effectiveness of social marketing interventions for health improvement: What's the evidence?. Public Health. 2006, 120 (12): 1133-1139. 10.1016/j.puhe.2006.10.008.
Macdonald G, Veen C, Tones K: Evidence for success in health promotion: suggestions for improvement. Health Educ Res. 1996, 11 (3): 367-376. 10.1093/her/11.3.367.
Klein WM, Kunda Z: Maintaining self-serving social comparisons: biased reconstruction of One's past behaviors. Personal Soc Psych Bull. 1993, 19 (6): 732-739. 10.1177/0146167293196008.
AuwƤrter V, Sporkert F, Hartwig S, Pragst F, Vater H, Diefenbacher A: Fatty acid ethyl esters in hair as markers of alcohol consumption. Segmental hair analysis of alcoholics, social drinkers, and teetotalers. Clin Chem. 2001, 47 (12): 2114-2123.
Collins RL, Parks GA, Marlatt GA: Social determinants of alcohol consumption: the effects of social interaction and model status on the self-administration of alcohol. J Consult Clin Psychol. 1985, 53 (2): 189-
Miller ET, Neal DJ, Roberts LJ, Baer JS, Cressler SO, Metrik J, Marlatt GA: Test-retest reliability of alcohol measures: is there a difference between internet-based assessment and traditional methods?. Psychol Addict Behav. 2002, 16 (1): 56-63.
Bush K, Kivlahan DR, McDonell MB, Fihn SD, Bradley KA: The AUDIT alcohol consumption questions (AUDIT-C): an effective brief screening test for problem drinking. Arch Intern Med. 1998, 158 (16): 1789-10.1001/archinte.158.16.1789.
Bradley KA, DeBenedetti AF, Volk RJ, Williams EC, Frank D, Kivlahan DR: AUDIT-C as a brief screen for alcohol misuse in primary care. Alcohol Clin Exp Res. 2007, 31 (7): 1208-1217. 10.1111/j.1530-0277.2007.00403.x.
Agresti A: Analysis of ordinal categorical data. 2010, New York: Wiley, 2
Nolan JM, Schultz PW, Cialdini RB, Goldstein NJ, Griskevicius V: Normative social influence is underdetected. Personal Soc Psych Bull. 2008, 34 (7): 913-923. 10.1177/0146167208316691.
Acknowledgements
The study was conducted in collaboration with Drinkaware, NUS Wales and the Welsh Governmentsā Health Improvement Division. The authors would like to thank all universities who agreed to take part in the survey and assisted with distribution, all students who completed measures.
Funding
This work was supported by an Alcohol Research UK grant funded by the Drinkaware trust (grant reference CR 11/12 07 DA). The work was undertaken with the support of The Centre for the Development and Evaluation of Complex Interventions for Public Health Improvement (DECIPHer), a UKCRC Public Health Research: Centre of Excellence. Funding from the British Heart Foundation, Cancer Research UK, Economic and Social Research Council (RES-590-28-0005), Medical Research Council, the Welsh Government and the Wellcome Trust (WT087640MA), under the auspices of the UK Clinical Research Collaboration, is gratefully acknowledged.
Author information
Authors and Affiliations
Corresponding author
Additional information
Competing interests
The authors declare that they have no competing interests.
Authorsā contributions
GM led the development, distribution and analysis of survey measures and drafted the paper. All authors contributed to trial design, commented on drafts and agreed the final manuscript.
Authorsā original submitted files for images
Below are the links to the authorsā original submitted files for images.
Rights and permissions
This article is published under license to BioMed Central Ltd. This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.
About this article
Cite this article
Moore, G.F., Williams, A., Moore, L. et al. An exploratory cluster randomised trial of a university halls of residence based social norms marketing campaign to reduce alcohol consumption among 1st year students. Subst Abuse Treat Prev Policy 8, 15 (2013). https://doi.org/10.1186/1747-597X-8-15
Received:
Accepted:
Published:
DOI: https://doi.org/10.1186/1747-597X-8-15