Case-control studies are commonly used to evaluate effectiveness of licensed vaccines after deployment in public health programs. Such studies can provide policy-relevant data on vaccine performance under ‘real world’ conditions, contributing to the evidence base to support and sustain introduction of new vaccines. However, case-control studies do not measure the impact of vaccine introduction on disease at a population level, and are subject to bias and confounding, which may lead to inaccurate results that can misinform policy decisions. In 2012, a group of experts met to review recent experience with case-control studies evaluating the effectiveness of several vaccines; here we summarize the recommendations of that group regarding best practices for planning, design and enrollment of cases and controls. Rigorous planning and preparation should focus on understanding the study context including healthcare-seeking and vaccination practices. Case-control vaccine effectiveness studies are best carried out soon after vaccine introduction because high coverage creates strong potential for confounding. Endpoints specific to the vaccine target are preferable to non-specific clinical syndromes since the proportion of non-specific outcomes preventable through vaccination may vary over time and place, leading to potentially confusing results. Controls should be representative of the source population from which cases arise, and are generally recruited from the community or health facilities where cases are enrolled. Matching of controls to cases for potential confounding factors is commonly used, although should be reserved for a limited number of key variables believed to be linked to both vaccination and disease. Case-control vaccine effectiveness studies can provide information useful to guide policy decisions and vaccine development, however rigorous preparation and design is essential.

The case-control methodology is frequently used to evaluate vaccine effectiveness post-licensure. The results of such studies provide important insight into the level of protection afforded by vaccines in a ‘real world’ context, and are commonly used to guide vaccine policy decisions. However, the potential for bias and confounding are important limitations to this method, and the results of a poorly conducted or incorrectly interpreted case-control study can mislead policies. In 2012, a group of experts met to review recent experience with case-control studies evaluating vaccine effectiveness; we summarize the recommendations of that group regarding best practices for data collection, analysis, and presentation of the results of case-control vaccine effectiveness studies. Vaccination status is the primary exposure of interest, but can be challenging to assess accurately and with minimal bias. Investigators should understand factors associated with vaccination as well as the availability of documented vaccination status in the study context; case-control studies may not be a valid method for evaluating vaccine effectiveness in settings where many children lack a documented immunization history. To avoid bias, it is essential to use the same methods and effort gathering vaccination data from cases and controls. Variables that may confound the association between illness and vaccination are also important to capture as completely as possible, and where relevant, adjust for in the analysis according to the analytic plan. In presenting results from case-control vaccine effectiveness studies, investigators should describe enrollment among eligible cases and controls as well as the proportion with no documented vaccine history. Emphasis should be placed on confidence intervals, rather than point estimates, of vaccine effectiveness. Case-control studies are a useful approach for evaluating vaccine effectiveness; however careful attention must be paid to the collection, analysis and presentation of the data in order to best inform evidence-based vaccine policies.

Meningitis and pneumonia are leading causes of morbidity and mortality in children globally infected with Streptococcus pneumoniae (pneumococcus), Neisseria meningitidis, and Haemophilus influenzae causing a large proportion of disease. Vaccines are available to prevent many of the common types of these infections. S. pneumoniae was estimated to have caused 11% of deaths in children aged <5 years globally in the pre-pneumococcal conjugate vaccine (PCV) era. Since 2007, the World Health Organization (WHO) has recommended inclusion of PCV in childhood immunization programs worldwide, especially in countries with high child mortality. As of November 26, 2014, a total of 112 (58%) of all 194 WHO member states and 44 (58%) of the 76 member states ever eligible for support from Gavi, the Vaccine Alliance (Gavi), have introduced PCV. Invasive pneumococcal disease (IPD) surveillance that includes data on serotypes, along with meningitis and pneumonia syndromic surveillance, provides important data to guide decisions to introduce PCV and monitor its impact.