Research | Open | Published:
Non-response bias and hazardous alcohol use in relation to previous alcohol-related hospitalization: comparing survey responses with population data
Substance Abuse Treatment, Prevention, and Policyvolume 8, Article number: 10 (2013)
This study examines whether alcohol-related hospitalization predicts survey non-response, and evaluates whether this missing data result in biased estimates of the prevalence of hazardous alcohol use and abstinence.
Registry data on alcohol-related hospitalizations during the preceding ten years were linked to two representative surveys. Population data corresponding to the surveys were derived from the Stockholm County registry. The alcohol-related hospitalization rates for survey responders were compared with the population data, and corresponding rates for non-responders were based on the differences between the two estimates. The proportions with hazardous alcohol use and abstinence were calculated separately for previously hospitalized and non-hospitalized responders, and non-responders were assumed to be similar to responders in this respect.
Persons with previous alcohol-related admissions were more likely currently to abstain from alcohol (RR=1.58, p<.001) or to have hazardous alcohol use (RR=2.06, p<.001). Alternatively, they were more than twice as likely to have become non-responders. Adjusting for this skewed non-response, i.e., the underrepresentation of hazardous users and abstainers among the hospitalized, made little difference to the estimated rates of hazardous use and abstinence in total. During the ten-year period 1.7% of the population were hospitalized.
Few people receive alcohol-related hospital care and it remains unclear whether this group’s underrepresentation in surveys is generalizable to other groups, such as hazardous users. While people with severe alcohol problems – i.e. a history of alcohol-related hospitalizations – are less likely to respond to population surveys, this particular bias is not likely to alter prevalence estimates of hazardous use.
The trend in decreasing response rates in population surveys is a growing concern in epidemiological research because of the increased likelihood of non-response bias [1–4]. Low response rates threaten to compromise the generalizability of population survey data, not least because of the general underestimation of alcohol consumption when self-report measures are used in population surveys . As well as affecting prevalence estimates, the resulting skewness might change associations with other variables.
Both abstainers and hazardous alcohol users seem to be overrepresented among non-responders to population surveys [6–23]. Reasons for not responding to surveys among high consumers of alcohol are likely to include frequent changes of address, failing to show up for appointments, not being at home, irregular life styles, and current drinking problems, including binge drinking and chronic heavy drinking. Some high alcohol consumers also have periods of abstinence followed by relapse. Abstinence, moreover, can be recognised as a successful outcome for people with alcohol use disorders. The issue of alcohol-related non-response bias has been dealt with by follow-up of initial non-responders, thus increasing the response rates somewhat [6, 7]. Alternatively, in longitudinal surveys or clinical samples, attrition rates have been empirically evaluated [8–23]. With some exceptions [10, 17, 18], studies examining attrition have found that alcohol use is related to future non-response.
However, in previous studies, the issue of alcohol-related non-response has generally been examined in sub-samples of total non-response data, based on earlier or later responses. Since non-response appears to be non-random, more comprehensive evaluations may be needed so as better to understand the biases involved [24, 25]. These biases can be more accurately assessed if all non-responders are considered .
This study examines non-response as a whole by developing population parameters corresponding to survey estimates using registry data covering all alcohol-related hospitalizations over a 10-year period. This allows us to estimate and adjust for differing hospitalization rates among non-responders and to examine possible biases in estimates of alcohol use.
The study examines whether people with alcohol-related hospitalizations are overrepresented in non-response to population surveys, and whether this results in biased estimates of the prevalence of hazardous alcohol use and abstinence.
Material and methods
The study combines analyses of the Stockholm County registry with analyses of survey data linked to national registries in Sweden.
The pooled study sample (n=58 506, response rate 55.3 percent) is based on two postal surveys, carried out in 2006 and 2007. The sampling frames were stratified by gender and region to allow for breakdown of the county’s different municipalities and districts. After correcting for sampling probability, persons were randomly selected to be representative of Stockholm County’s population. The 2006 survey (n=34 707, response rate 61.3 percent) was a cross-sectional study, and the 2007 survey (n=23 797, response rate 49.7 percent) was the follow-up to a longitudinal study, which was undertaken in 2002. In 2007, responders to the baseline survey in 2002 were approached again. The response rate was 62.5 percent in 2002, and the follow-up response rate was 79.6 percent in 2007.
The 2006 survey included persons born between 1922 and 1988, while the 2007 survey included those born between 1918 and 1984. In order to equate age spans at the time of follow-up, 23–84 years, the 1921–1983 birth cohorts (n=32 626) were included from the 2006 survey, and the 1922–1984 birth cohorts (n=23 369) from the 2007 survey.
Both surveys were administered by Statistics Sweden. By linking the survey responders to national registries, it was possible to include information about their alcohol-related hospitalizations. People consented to the link with the registries when responding to the surveys. Hospitalizations that occurred outside Stockholm County were disregarded.
The population selection frames
Two population frames, corresponding to the sampling frames of the surveys above, were developed, based on Stockholm County’s registry of its inhabitants’ inpatient care. All alcohol-related care episodes in the county for the 1921–1983 cohorts in the period from 1997 to 2006, and for the 1922–1984 cohorts in the period from 1998 to 2007, were assessed. Persons who had died during the follow-up period or who had left the county were excluded (n=7333 in 1997–2006, and n=7374 in 1998–2007). To arrive at the population’s hospitalization rate, the estimated number of inpatients was divided by the corresponding population size at the end of the follow-up periods in 2006 (N=1 358 176) and in 2007 (N=1 361 698).
The diagnoses follow the International Classification of Diseases (ICD-10) . All care episodes from 1997–2006 and 1998–2007 were examined for each inpatient individually. In keeping with earlier studies, the first three diagnoses listed in all care episodes identified as alcohol-related by the National Board of Health and Welfare were evaluated [27, 28]. The following alcohol-related diagnoses were considered: alcohol intoxication, corresponding to F10.0, acute intoxication due to alcohol, or T51 toxic effect of alcohol; harmful use of alcohol F10.1; alcohol dependence F10.2; alcohol-induced chronic pancreatitis K86.0; alcoholic liver disease K70; alcohol-induced pseudo-Cushing's syndrome E24.4; degeneration of nervous system due to alcohol G31.2; alcoholic polyneuropathy G62.1; alcoholic myopathy G72.1; alcoholic cardiomyopathy I42.6; alcoholic gastritis K29.2; maternal care for (suspected) damage to foetus from alcohol O35.4; foetus and new-born affected by maternal use of alcohol P04.3; foetal alcohol syndrome Q86.0; blood alcohol level Y90; alcohol intoxication Y91; alcohol rehabilitation Z50.2; alcohol abuse counselling and surveillance Z71.4; and mental and behavioural disorders due to use of alcohol (F10), i.e., withdrawal state F10.3, delirium F10.4, psychotic disorder F10.5 & F10.7, amnesic syndrome F10.6, and other mental and behavioural disorders F10.8 & F10.9.
Alcohol consumption during a typical week was measured using a beverage-specific grid in the 2006 survey [29, 30]. The grid consisted of four rows, with a single row comprising the first four days of the week, and separate rows for the weekend days, Friday, Saturday, and Sunday. Different columns corresponded to the different beverages: spirits, fermented wine, wine, beer, and low alcohol beer. The responders filled in the estimated volume they had consumed by day of the week and beverage. In 2007, the AUDIT-C instrument [31, 32] was used instead of the grid. Both measures identified abstainers and hazardous alcohol users, and also non-hazardous users. Hazardous use is consumption in excess of 14 (men) or 9 (women) normal glasses (equivalent to 12g of pure alcohol) of alcoholic beverage per week (score 8+/6+ in AUDIT-C) .
The estimated hospitalization rates from the surveys were compared with the population-based figures using 95% confidence intervals. Then, the hospitalization rates of non-responders were estimated. Based on the population data, the number of hospitalized among the non-responders was calculated by adding the excess numbers deriving from the difference between the surveys and population data. That is, the number of hospitalized among the responders from the surveys was subtracted from the expected number of hospitalized among the responders based on their percentage in the population data. To this number was added the expected number of hospitalized among the non-responders, based on their percentage in the population data.
Next, the numbers of abstainers, non-hazardous users, and hazardous users of alcohol were estimated for the hospitalized and non-hospitalized responders, and the difference between them was evaluated. An adjustment was made to account for possible bias due to a lower response rate among the hospitalized. These estimated alternative figures for the prevalence of abstainers, non-hazardous users, and hazardous users of alcohol took the differing hospitalization rates among the non-responders into account. It was assumed that the proportions of abstainers, non-hazardous users, and hazardous users of alcohol were the same for non-responders and responders within each stratum of hospitalization, i.e., among the hospitalized and non-hospitalized. The corrected abstainer rates for non-responders were computed by adding the numbers of non-hospitalized and hospitalized in each category of alcohol use. Lastly, the totals of responders and the non-responders were added together to arrive at the adjusted grand total for each category. In this way, it was possible to adjust the proportions for the non-responders and for the entire survey samples.
The two survey samples were first analysed separately and then pooled. The samples were stratified and weighted using SAS software (PROC SURVEYFREQ, PROC SURVEYLOGISTIC) for frequency tables and logistic regression models.
The first analysis shows both the weighted and un-weighted hospitalization rates (the latter in footnotes). This was because there were no stratification data available for the non-responders, and the later analysis had to be based on un-weighted percentages. The weighting compensated for the overrepresentation of the county’s smaller municipalities and districts in comparison with the larger ones.
In order to examine the association between previous hospitalizations and current alcohol use, logistic regression was utilised to allow for control of gender and age group. Although the relative risks became somewhat smaller due to these controls, the results were generally similar. Accordingly, rather than presenting odds ratios, only the relative risks without control are presented.
Table 1 shows that, of the responders in the 2006 survey, 1.1 percent had been hospitalized during the preceding ten years. When compared with the population parameters, both surveys indicated significantly lower hospitalization rates. The resultant estimates for the non-responders are also shown.
The relative risks suggest that the persons who had been hospitalized were 2.2 times more likely to have become non-responders in the 2006 study, and 2.7 times more likely in the 2002–2007 study. Taken together, persons with previous alcohol-related hospitalization (either once or several times) were, on average, 2.4 times more likely to have become survey non-responders than others.
Table 2 shows the association between previous hospitalization and current alcohol use. Previously hospitalized responders were more likely to abstain from alcohol (relative risk, RR=1.58). They were also more likely to have engaged in hazardous alcohol use (RR=2.06), and less likely (RR=0.68) to have non-hazardous use. In further analyses (not shown here), the same pattern of results was obtained after controlling for gender and age group.
In 2007, those previously hospitalized were also more likely to avoid answering the survey’s alcohol-related items.
Table 2 also suggests that adjusting for a differing pattern of alcohol use among non-responders had only a marginal effect on the estimated percentages of alcohol use.
Persons who previously had been hospitalized for alcohol-related reasons were more likely than others to become non-responders in population health surveys, but adjusting for this particular source of non-response bias made little difference to the estimated prevalence of hazardous use or of abstinence.
The results were in line with previous studies [6–16], demonstrating higher risks (odds ratios up to 2.0) of becoming non-responders among excessive alcohol users. These studies have used alcohol consumption rather than hospitalization as a predictor of non-response, and had varying definitions of consumption levels and/or excessive drinking. In general, they have examined different sub-populations of all non-responders. By contrast, the current study analysed the entire samples, corresponding to a 100% response rate. It therefore also included the persons least likely to be reached by representative surveys. Examining non-random samples of non-responders can be misleading, which possibly explains the sometimes contradictory findings of previous studies. Our study indicates somewhat larger ORs than those reported in previous studies, which might suggest that non-response related to alcohol use is underestimated in designs based on earlier or later responses. But it might also reflect people with severe alcohol problems being more likely to become non-responders than people with less of a problem.
The current study also considered the hypothesis that previous hospitalization predicts current alcohol use. Only the opposite relationship has been shown previously . Further analysis and discussion of this particular result may be found in an accompanying article . In this context, alcohol-related hospitalization can reasonably be seen as a marker of deviant alcohol habits.
During the decades investigated, fewer than one in fifty adults received alcohol-related hospital care. Thus, only a small proportion of the population suffered this particular adverse consequence of their drinking behaviour. A history of alcohol-related morbidity, indicated here by hospitalization, suggests a life style of abuse and deviance. To our knowledge, the extent to which such a population is reached by general representative population surveys has not been examined previously. This is also the first study to present hospitalization rates over a period of time as long as ten years.
Although the bias caused by a small sub-population of non-responders may be rather modest, the true alcohol-related reporting bias may be larger than the adjustment for the non-response hospitalization rate in our study suggests. Only a small proportion of the population with alcohol problems receive hospital care for alcohol-related causes; most persons with alcohol-use disorders go untreated or undetected by the health care system . Also, few studies have examined the relationship between alcohol-related hospitalization and alcohol use . Thus, it is not clear whether people who receive alcohol-related hospital care resemble the larger population of people with alcohol problems with respect to reporting behaviour. It is, therefore, also unclear whether our results on those who have been hospitalized generalize to all people with alcohol-use disorders or possibly to an even larger population, such as hazardous users. Future studies may wish to examine hospitalization, alongside abstinence and hazardous use, as predictors of attrition. If hazardous users are also twice as likely to become non-responders than others, the prevalence of hazardous use may be seriously underestimated.
Non-response is likely to be related to factors other than hospitalization, such as gender, age, social class, etc., some of which are also likely to covary with alcohol use. A limitation to the study was that it was restricted solely to examining the bias from a different hospitalization rate among non-responders. Yet, there are other biases that probably affect estimated prevalence rates.
Self-rated alcohol consumption figures capture about half the population’s actual consumption . Like other studies of self-rated alcohol consumption, this study rests on the assumption that underrating in self-reports is proportionately distributed but otherwise random. But it remains unclear whether this is true. Underreporting may differ by sub-group; for example, heavy consumers may underreport to a greater degree.
The assumption of similar alcohol use among non-responders and responders for the different strata of hospitalization is questionable. But it was mainly because of the small proportion of the population hospitalized (just 1.7%) that the effects on estimated prevalence of hazardous use and of abstinence were insignificant. Even if hazardous alcohol use was more widespread among non-responders than among responders, the effects on prevalence would still have been small.
In this longitudinal study, consent to link response data with registry data was not sought from responders until follow-up in 2007, which meant that the hospitalization rate for non-responders between 2002 and 2007 was not available. It was, therefore, not possible to differentiate between non-response and attrition in the analyses. Although attrition is likely to contribute to selection bias, researchers usually have some information to go on, e.g., from baseline measures, and are therefore in a position to analyse it. Further, attrition bias can be mitigated because there are usually variables available that can be used to treat the missing data.
This study found that people with alcohol-related morbidity, i.e., the previously hospitalized, were twice as likely to become non-responders as people in the general population. It demonstrates that those who suffer the adverse consequences of alcohol abuse are reached in representative population surveys, albeit to a lesser extent than others. The study also illustrates that the effect of non-response bias associated with previous alcohol-related hospitalization is fairly small, or even trivial, on the estimated prevalence rates of hazardous alcohol use and abstinence.
Atrostic BK, Bates N, Burt G, Silberstein A: Nonresponse in U.S. goverment houshold surveys: consistent measures, recent trends, and new insights. Journal of Official Statistics. 2001, 17 (2): 209-226.
Smith TW: Trends in nonresponse rates. Int J Public Opin R. 1995, 7 (2): 157-171. 10.1093/ijpor/7.2.157.
Schoeni RF, Stafford F, McGonagle KA, Andreski P: Response rates in national panel surveys. Ann Am Acad Polit Ss. 2013, 645 (1): 60-87. 10.1177/0002716212456363.
Curtin R, Presser S, Singer E: Changes in telephone survey nonresponse over the past quarter century. Public Opin Quart. 2005, 69 (1): 87-98. 10.1093/poq/nfi002.
Knibbe RA, Bloomfield K: Alcohol consumption estimates in surveys in Europe: comparability and sensitivity for gender differences. Subst Abus. 2001, 22 (1): 23-38.
Wennberg P, Svensson J, Ramstedt M: The effects of missing data when surveying alcohol habits. Nordic Studies on Alcohol and Drugs. 2011, 28 (1): 43-50.
Hill A, Roberts J, Ewings P, Gunnell D: Non-response bias in a lifestyle survey. J Public Health Med. 1997, 19 (2): 203-207. 10.1093/oxfordjournals.pubmed.a024610.
Thygesen LC, Johansen C, Keiding N, Giovannucci E, Gronbaek M: Effects of sample attrition in a longitudinal study of the association between alcohol intake and all-cause mortality. Addiction. 2008, 103 (7): 1149-1159. 10.1111/j.1360-0443.2008.02241.x.
Morrison TC, Wahlgren DR, Hovell MF, Zakarian J, Burkham-Kreitner S, Hofstetter CR, Slymen DJ, Keating K, Russos S, Jones JA: Tracking and follow-up of 16,915 adolescents: minimizing attrition bias. Control Clin Trials. 1997, 18 (5): 383-396. 10.1016/S0197-2456(97)00025-1.
Psaty BM, Cheadle A, Koepsell TD, Diehr P, Wickizer T, Curry S, VonKorff M, Perrin EB, Pearson DC, Wagner EH: Race- and ethnicity-specific characteristics of participants lost to follow-up in a telephone cohort. Am J Epidemiol. 1994, 140 (2): 161-171.
Goldberg M, Chastang JF, Zins M, Niedhammer I, Leclerc A: Health problems were the strongest predictors of attrition during follow-up of the GAZEL cohort. J Clin Epidemiol. 2006, 59 (11): 1213-1221. 10.1016/j.jclinepi.2006.02.020.
Garcia M, Fernandez E, Schiaffino A, Borrell C, Marti M, Borras JM: Attrition in a population-based cohort eight years after baseline interview: the Cornella Health Interview Survey Follow-up (CHIS.FU) Study. Ann Epidemiol. 2005, 15 (2): 98-104. 10.1016/j.annepidem.2004.06.002.
de Graaf R, Bijl RV, Smit F, Ravelli A, Vollebergh WA: Psychiatric and sociodemographic predictors of attrition in a longitudinal study: the Netherlands Mental Health Survey and Incidence Study (NEMESIS). Am J Epidemiol. 2000, 152 (11): 1039-1047. 10.1093/aje/152.11.1039.
Eaton WW, Anthony JC, Tepper S, Dryman A: Psychopathology and attrition in the epidemiologic catchment area surveys. Am J Epidemiol. 1992, 135 (9): 1051-1059.
Slymen DJ, Drew JA, Wright BL, Elder JP, Williams SJ: Compliance with a 12-month assessment in an elderly cohort participating in a preventive intervention study: the San Diego Medicare Preventive Health Project. Int J Epidemiol. 1992, 21 (4): 701-706. 10.1093/ije/21.4.701.
Cotter RB, Burke JD, Loeber R, Mutchka J: Predictors of contact difficulty and refusal in a longitudinal study. Crim Behav Ment Health. 2005, 15 (2): 126-137. 10.1002/cbm.46.
Lissner L, Skoog I, Andersson K, Beckman N, Sundh V, Waern M, Zylberstein DE, Bengtsson C, Bjorkelund C: Participation bias in longitudinal studies: experience from the Population Study of Women in Gothenburg, Sweden. Scand J Prim Health Care. 2003, 21 (4): 242-247. 10.1080/02813430310003309-1693.
Lapham S, Baum G, Skipper B, Chang I: Attrition in a follow-up study of driving while impaired offenders: who is lost?. Alcohol Alcohol. 2000, 35 (5): 464-470. 10.1093/alcalc/35.5.464.
Nomamiukor N, Brown ES: Attrition factors in clinical trials of comorbid bipolar and substance-related disorders. J Affect Disord. 2009, 112 (1–3): 284-288.
Heath AC, Howells W, Kirk KM, Madden PA, Bucholz KK, Nelson EC, Slutske WS, Statham DJ, Martin NG: Predictors of non-response to a questionnaire survey of a volunteer twin panel: findings from the Australian 1989 twin cohort. Twin Res. 2001, 4 (2): 73-80.
Tambs K, Ronning T, Prescott CA, Kendler KS, Reichborn-Kjennerud T, Torgersen S, Harris JR: The Norwegian Institute of Public Health twin study of mental health: examining recruitment and attrition bias. Twin Res Hum Genet. 2009, 12 (2): 158-168. 10.1375/twin.12.2.158.
Torvik FA, Rognmo K, Tambs K: Alcohol use and mental distress as predictors of non-response in a general population health survey: the HUNT study. Soc Psychiatry Psychiatr Epidemiol. 2012, 47 (5): 805-816. 10.1007/s00127-011-0387-3.
Korkeila K, Suominen S, Ahvenainen J, Ojanlatva A, Rautava P, Helenius H, Koskenvuo M: Non-response and related factors in a nation-wide health survey. Eur J Epidemiol. 2001, 17 (11): 991-999. 10.1023/A:1020016922473.
Kypri K, Stephenson S, Langley J: Assessment of nonresponse bias in an internet survey of alcohol use. Alcohol Clin Exp Res. 2004, 28 (4): 630-634. 10.1097/01.ALC.0000121654.99277.26.
Lin IF, Schaeffer NC: Using survey participants to estimate the impact of nonparticipation. Public Opin Quart. 1995, 59 (2): 236-258. 10.1086/269471.
National Board of Health and Welfare: Klassifikation av sjukdomar och hälsoproblem 1997. 1996, Stockholm: National Board of Health and Welfare: Fritze: Systematisk förteckning [Classification of Diseases and Health Problems 1997. A Systematic List]. 1 edition
Ahacic K, Damström-Thakker K: Alkohol- och narkotikarelaterad vårdkonsumtion och dödlighet i Stockholms län: Rapport 2008 [Alcohol and drug-related health care utilization and mortality in Stockholm County: Report 2008]. 2008, Stockholm: Centrum för folkhälsa
Ahacic K, Damstrom-Thakker K, Kareholt I: Recurring alcohol-related care between 1998 and 2007 among people treated for an alcohol-related disorder in 1997: a register study in Stockholm County. BMC Publ Health. 2011, 11: 574-10.1186/1471-2458-11-574.
Romelsjo A, Leifman H, Nystrom S: A comparative study of two methods for the measurement of alcohol consumption in the general population. Int J Epidemiol. 1995, 24 (5): 929-936. 10.1093/ije/24.5.929.
Centrum för folkhälsa SLL: Folkhälsorapport 2007. 2007, Stockholm: [Public health report 2007]
Dawson DA, Grant BF, Stinson FS, Zhou Y: Effectiveness of the derived Alcohol Use Disorders Identification Test (AUDIT-C) in screening for alcohol use disorders and risk drinking in the US general population. Alcohol Clin Exp Res. 2005, 29 (5): 844-854. 10.1097/01.ALC.0000164374.32229.A2.
Meneses-Gaya C, Zuardi AW, Loureiro SR, Hallak JE, Trzesniak C, de Azevedo Marques JM, Machado-de-Sousa JP, Chagas MH, Souza RM, Crippa JA: Is the full version of the AUDIT really necessary? Study of the validity and internal construct of its abbreviated versions. Alcohol Clin Exp Res. 2010, 34 (8): 1417-1424.
Bergman H, Källmén H: Alcohol use among Swedes and a psychometric evaluation of the alcohol use disorders identification test. Alcohol Alcohol. 2002, 37 (3): 245-251. 10.1093/alcalc/37.3.245.
McDonald SA, Hutchinson SJ, Bird SM, Graham L, Robertson C, Mills PR, Hayes P, Dillon JF, Goldberg DJ: Association of self-reported alcohol use and hospitalization for an alcohol-related cause in Scotland: a record-linkage study of 23,183 individuals. Addiction. 2009, 104 (4): 593-602. 10.1111/j.1360-0443.2009.02497.x.
Ahacic K, Kennison RF, Kareholt I: Alcohol use a decade after one or several alcohol-related hospitalizations: register data linked to population representative postal survey. Submitted
Ahacic K, Allebeck P, Thakker KD: Being questioned and receiving advice about alcohol and smoking in health care: Associations with patients' characteristics, health behavior, and reported stage of change. Subst Abuse Treat Pr. 2010, 5:
We wish to thank Robert F. Kennison for his valuable help with the text. The study was made possible by Stockholm County Council and the Swedish National Institute of Public Health.
The authors are not aware of any conflicts of interest.
KA conceived the study, performed the statistical analysis, and wrote the draft of the manuscript. PA is responsible for the part about alcohol in the Stockholm County Public Health Surveys, and his concern about data quality was the study’s starting point. IK was the statistical adviser, and ARH is an expert in the area of treatment effects. All the four authors revised the draft critically for important intellectual content, and they have all read and approved the final manuscript.