Right sizing for vaccine effectiveness studies: how many is enough for reliable estimation?
DOI:
https://doi.org/10.33321/cdi.2019.43.20Keywords:
influenza, sentinel surveillance, vaccine effectiveness, random samplingAbstract
Background
The precision of vaccine effectiveness (VE) estimates is dependent on sample size and sampling methods. In Victoria, participating general practitioners (GPs) are not limited by the number of influenza-like illness (ILI) patients they collect respiratory samples (swabs) from in sentinel surveillance. However, in the context of scarce resources it is of interest to determine the minimum sample size needed for reliable estimates.
Methods
Following the test-negative design, patients with ILI were recruited by GPs and tested for influenza. Descriptive analyses were conducted to assess possible selection bias introduced by GPs. VE was calculated by logistic regression as [1 – odds ratio] x 100% and adjusted for week of presentation and age. Random 20% and 50% samples were selected without replacement to estimate the effect of swab rates on VE estimates.
Results
GPs swabbed a smaller proportion of patients aged ≥65 years (45.9%, n=238) than those <5 (75.6%, n=288), 5–17 (67.9%, n=547) and 18–64 (75.6%, n=2662) years. Decreasing the swab rate did not alter VE point estimates significantly. However, it reduced the precision of estimates and in some instances resulted in too small a sample size to estimate VE.
Conclusion
Imposing a 20% or 50% swabbing rate produces less robust VE estimates. The number of swabs required per year to produce precise estimates should be dictated by seasonal severity, rather than an arbitrary rate. It would be beneficial for GPs to swab patients systematically by age group to ensure there are sufficient data to investigate VE against a particular subtype in a given age group.
Downloads
References
Li-Kim-Moy J, Yin JK, Patel C, Beard FH, Chiu C, Macartney KK, et al. Australian vaccine preventable disease epidemiological review series: Influenza 2006 to 2015. Commun Dis Intell Q Rep 2016;40(4):E482– 495.
Beard F, McIntyre P, Gidding H, Watson M. Influenza related hospitalisations in Sydney, New South Wales, Australia. Arch Dis Child. 2006;91(1):20–25.
Wood J, Levandowski R. The influenza vaccine licensing process. Vaccine. 2003;21(16):1786–1788.
Jackson ML, Nelson JC. The test-negative design for estimating influenza vaccine effectiveness. Vaccine. 2013;31(17):2165–2168.
Barr IG, McCauley J, Cox N, Daniels R, Engelhardt OG, Fukuda K, et al. Epidemiological, antigenic and genetic characteristics of seasonal influenza A (H1N1), A (H3N2) and B influenza viruses: basis for the WHO recommendation on the composition of influenza vaccines for use in the 2009–2010 Northern Hemisphere season. Vaccine. 2010;28(5):1156–1167.
Sullivan SG, Feng S, Cowling BJ. Potential of the test-negative design for measuring influenza vaccine effectiveness: a systematic review. Expert Rev Vaccines. 2014;13(12):1571–1591.
Thursky K, Cordova SP, Smith D, Kelly H. Working towards a simple case definition for influenza surveillance. J Clin Virol. 2003;27(2):170–179.
Kelly H, Carville K, Grant K, Jacoby P, Tran T, Barr I. Estimation of influenza vaccine effectiveness from routine surveillance data. PLoS One. 2009;4(3):e5079.
Fielding JE, Grant KA, Papadakis G, Kelly HA. Estimation of type-and subtype-specific influenza vaccine effectiveness in Victoria, Australia using a test negative case control method, 2007–2008. BMC Infect Dis. 2011;11(1):170.
Sullivan S, Carville K, Chilver M, Fielding J, Grant K, Kelly H, et al. Pooled influenza vaccine effectiveness estimates for Australia, 2012–2014. Epidemiol Infect. 2016;144(11):2317–2328.
Kissling E, Valenciano M, Cohen JM, Oroszi B, Barret A-S, Rizzo C, et al. I-MOVE multi-centre case control study 2010–11: overall and stratified estimates of influenza vaccine effectiveness in Europe. PloS One. 2011;6(11):e27622.
Chilver M, Blakeley D, Stocks NP. The Australian Sentinel Practices Research Network, 1 October to 31 December 2016. Commun Dis Intell Q Rep. 2017;41(1):E111–E113.
Kissling E, Valenciano M, Falcao J, Larrauri A, Widgren K, Pitigoi D, et al. I-MOVE towards monitoring seasonal and pandemic influenza vaccine effectiveness: lessons learnt from a pilot multi-centric case-control study in Europe, 2008–9. Euro Surveill. 2009;14(44): pii: 19388.
Druce J, Tran T, Kelly H, Kaye M, Chibo D, Kostecki R, et al. Laboratory diagnosis and surveillance of human respiratory viruses by PCR in Victoria, Australia, 2002–2003. J Med Virol. 2005;75(1):122–129.
Nicol K. Efficacy/clinical effectiveness of inactivated influenza virus vaccines in adults. In Nicholson KG, Webster RG, Hay AJ, eds. Textbook of influenza, London: Blackwell Science,1998. p. 358–372.
Cowie GA, Cowie BC, Fielding JE. Influenza testing trends in sentinel surveillance general practices in Victoria 2007 to 2014. Commun Dis Intell Q Rep. 2017;41(1):E4–9.
Carville KS, Grant KA, Sullivan SG, Fielding JE, Lane CR, Franklin L, et al. Understanding influenza vaccine protection in the community: an assessment of the 2013 influenza season in Victoria, Australia. Vaccine. 2015;33(2):341–345.
Moore K, Black J, Rowe S, Franklin L. Syndromic surveillance for influenza in two hospital emergency departments. Relationships between ICD-10 codes and notified cases, before and during a pandemic. BMC Public Health. 2011;11(1):338.
Kelly HA, Sullivan SG, Grant KA, Fielding JE. Moderate influenza vaccine effectiveness with variable effectiveness by match between circulating and vaccine strains in Australian adults aged 20–64 years, 2007–2011. Influenza Other Respir Viruses. 2013;7(5):729–737.
Fielding J, Grant K, Tran T, Kelly H. Moderate influenza vaccine effectiveness in Victoria, Australia, Euro Surveill. 2012;17(11):pii:20115.
Kissling E, Valenciano M, Buchholz U, Larrauri A, Cohen J, Nunes B, et al. Influenza vaccine effectiveness estimates in Europe in a season with three influenza type/subtypes circulating: the I-MOVE multicentre case-control study, influenza season 2012/13. Euro Surveill. 2014;19:pii: 20701.
Cowling BJ, Chan K-H, Feng S, Chan EL, Lo JY, Peiris JM, et al. The effectiveness of influenza vaccination in preventing hospitalizations in children in Hong Kong, 2009–2013. Vaccine. 2014;32(41):5278–5284.
Iuliano AD, Roguski KM, Chang HH, Muscatello DJ, Palekar R, Tempia S, et al. Estimates of global seasonal influenza-associated respiratory mortality: a modelling study. Lancet. 2018;391(10127):1285–1300.
Newall AT, Wood JG, Macintyre CR. Influenza-related hospitalisation and death in Australians aged 50 years and older. Vaccine. 2008;26(17):2135–2141.
Rondy M, El Omeiri N, Thompson MG, Leveque A, Moren A, Sullivan SG. Effectiveness of influenza vaccines in preventing severe influenza illness among adults: A systematic review and meta-analysis of test-negative design case-control studies. J Infect. 2017;75(5):381–394.
‘Victoria (C) (Statistical Region)’ [Internet]. Australian Bureau of Statistics,. 2016 [cited 10 December 2018]. Available from: https://www.abs.gov.au/websitedbs/D3310114.nsf/home/census.
Cheng AC, Holmes M, Dwyer DE, Irving LB, Korman TM, Senenayake S, et al. Influenza epidemiology in patients admitted to sentinel Australian hospitals in 2015: the Influenza Complications Alert Network. Commun Dis Intell Q Rep. 2016;40(4):E521–E526.
Cheng AC, Holmes M, Dwyer DE, Irving L, Korman T, Senenayake S, et al. Influenza epidemiology in patients admitted to sentinel Australian hospitals in 2016: the Influenza Complications Alert Network (FluCAN). Commun Dis Intell Q Rep. 2017;41(4):E337–E347. PubMed.
Valenciano M, Kissling E, Ciancio BC, Moren A. Study designs for timely estimation of influenza vaccine effectiveness using European sentinel practitioner networks. Vaccine. 2010;28(46):7381–7388.
Department of Health. Influenza Canberra, Australia: Australian Government Department of Health 2017 [cited 2018 February 5]. Available from: http://www.immunise.health.gov.au/internet/immunise/publishing.nsf/Content/Handbook10-home~handbook10part4~handbook10-4-7 .
Beck CR, McKenzie BC, Hashim AB, Harris RC, Zanuzdana A, Agboado G, et al. Influenza vaccination for immunocompromised patients: systematic review and meta-analysis from a public health policy perspective. PLoS One. 2011;6(12):e29249.
Lane C, Carville KS, Pierse N, Kelly H. Seasonal influenza vaccine effectiveness estimates: Development of a parsimonious case test negative model using a causal approach. Vaccine. 2016;34(8):1070–1076.
Sullivan SG, Tchetgen Tchetgen EJ, Cowling BJ. Theoretical basis of the test-negative study design for assessment of influenza vaccine effectiveness. Am J Epidemiol. 2016;184(5):345–353.
Petrie JG, Monto AS. Untangling the Effects of Prior Vaccination on Subsequent Influenza Vaccine Effectiveness. J Infect Dis. 2017;215(6):841–843.
Published
How to Cite
Issue
Section
Categories
License
Copyright (c) 2019 Communicable Diseases Intelligence
This work is licensed under a Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International License.
