Immunization Opportunities for Hospitalized Adolescents

Study Setting/Participants

A retrospective chart review was performed from July 2017 to June 2018 of adolescent patients (aged 11-19 years) discharged from the pediatric hospitalist service at a 150-bed tertiary care academic medical center located in the Pacific Northwest. All documentation was present in the electronic medical record (EMR) and care for all patients was provided by resident and attending physicians. No inpatient program existed to provide adolescents immunizations.

Inclusion and Exclusion criteria

All adolescent patients discharged from the pediatric hospitalist service from July 2017 to June 2018 were included in the study. This population consisted of patients admitted to the hospitalist service from an outside hospital ward, ICU or emergency department, and those patients transferred from the PICU or admitted from the emergency department within our own institution. In order to screen out patients who may have received immunizations in other states, patients needed at least one non-influenza immunization documented in the immunization registry to be included. If the patient had multiple admissions over the study time frame, the data from the first admission was only included in the analysis. No patients were excluded based on diagnosis. Participants were excluded if their primary home address in the EMR was outside the state of Oregon and if they did not have at least one non-influenza immunizations documented in the ALERT Immunization Information System in the EMR. In the state of Oregon, the ALERT Immunization Information System (ALERT IIS) is used to track patient immunization status through the use of medical records. ALERT IIS is a lifetime, statewide immunization registry that encompasses patients of all ages and consolidates immunization reports into a single record for each patient. All pediatric clinics, family medicine clinics, pharmacies, rural health clinics, migrant health centers, local health department clinics, federally qualified health centers and school-based health centers in the state of Oregon report to ALERT IIS. All providers participating in the “Vaccines for Children” program in the State of Oregon are required by the CDC to report all immunizations to ALERT IIS within 14 days.²⁰

Data Collection

Patients discharged from July 2017 to June 2018 were identified from the billing database of the hospital. The principal investigator trained two research assistants to be the primary data extractors. The research assistants would flag charts for review by the principal investigator if they had questions regarding data collection. Data were collected and entered into a secure REDCap database.

Data were collected on immunizations recommended for the adolescent population: quadrivalent meningococcal (MenACWY or MCV), tetanus and reduced diphtheria toxoids and acellular pertussis (Tdap), human papillomavirus (HPV) and influenza.²¹ The admission history and physical, transfer note (if applicable) and discharge summary were reviewed for provider documentation of immunization status. The admission history and physical note template included a section to free text immunization status while the transfer and discharge summary note templates did not include a dedicated section for immunization status. Resident physicians completed the majority of history and physical, transfer and discharge summary notes. The ACIP guidelines for adolescent vaccines and the patient’s age on the date of admission were used to determine the patient’s status for each vaccine using the ALERT IIS.²² The ALERT IIS immunization record is embedded in the EMR under an “Immunizations” tab in each patient’s chart. A patient was only considered overdue for the influenza immunization when it was available for administration from September 2017 to April 2018. The total number of non-influenza immunizations documented in ALERT IIS was also obtained from the EMR to serve as a marker for overall immunization history.

Dependent Variables

The primary outcome of interest was the concordance between provider documentation of immunization status and the immunization status present in the ALERT IIS. A secondary outcome of interest was the prevalence of delayed immunization status among the hospitalized adolescent population. Other outcomes of interest included the number of immunizations provided to this patient population during their hospitalizations.

Independent Variables

Demographic data including age, gender, race, ethnicity, insurance type and technology dependence, and admission data including primary discharge diagnosis category, length of stay, admit or transfer information and gender of admitting resident were obtained from the EMR.

Statistical Analysis

Immunization data were initially analyzed using descriptive statistics. Sensitivity, specificity, positive likelihood and negative likelihood ratios were calculated for each immunization using IBM SPSS Statistics.²³ For these calculations, provider documentation of the patient needing the immunization was considered “positive test” while documentation of the patient being eligible to receive the immunization in the ALERT IIS was considered “disease positive.” No provider documentation of the patient needing the immunization was considered “negative test”. If the patient was up-to-date on the immunization in ALERT IIS, this was considered “disease negative.” Thirty-three percent of patients had provider documentation that the immunization status was unknown, or no immunization information was documented by a provider.

Ethics

This study was deemed exempt by our Institutional Review Board. All charts were reviewed by study team members, and no personal health information was shared outside of the organization.

Sample Characteristics

A total of 207 adolescent patients were discharged from the pediatric hospitalist service during the study period. After EMR review, 160 patients were included in primary statistical analysis (Figure 1). Overall, the average age was 14.4 years and 53% of patients identified as female (Table 1). The majority were white, non-Hispanic, with public health insurance. The most common primary discharge diagnosis category was intentional ingestion, and the average length of stay was roughly 5 days. After reviewing the ALERT IIS, patients up-to-date on their immunizations had longer hospital stays compared to patients needing catch up immunizations (mean 8.6 days vs 4.3 days, P = 0.003).

• Download figure
• Open in new tab

Figure 1.

Flow diagram of inclusion and exclusion criteria.

Accuracy of Provider Documented Immunization Status

Provider documentation of immunization status underreported the need for immunizations when compared to the immunization registry ALERT IIS in the EMR. Providers documented that patients needed immunizations at the following rates: HPV 8%, MCV 6%, Tdap 2% and influenza 21% (Figure 2). On review of the ALERT IIS, 59%, 51%, 19% and 76% of patients needed the HPV, MCV, Tdap and influenza immunizations, respectively. Forty-eight percent of patients were documented by providers as up-to-date on their immunizations whereas 16% of patients were up-to-date in the ALERT IIS (Figure 2). The 95% confidence intervals for provider documented immunization status were statistically different compared with the 95% confidence intervals obtained from review of the ALERT IIS for all of the immunizations studied including when providers documented patients as up-to-date on their immunizations (Figure 2, Table 2).

• Download figure
• Open in new tab

Figure 2.

Parent/Patient self-report of immunization status compared to review of ALERT IIS

Thirty-three percent of the patients did not have provider documentation of their immunization status, or the immunization status was documented as unknown in the history and physical, transfer or discharge summary notes.

Provider documentation of immunization status for the HPV, MCV and Tdap immunizations displayed a low sensitivity (10-11%) but a high specificity (97-100%) using the ALERT IIS system as the standard (Table 2). If the patient was due to receive the immunization in ALERT IIS, providers only documented 10-11% of those patients as due for the immunization in the history and physical, transfer or discharge summary notes. Conversely, provider documented immunization status for the influenza immunization was associated with a high sensitivity (86%) and a low specificity (26%) (Table 2). If the patient was eligible to receive the influenza immunization in the ALERT IIS, providers documented that 86% of those patients needed the immunization. Provider documentation of up-to-date immunization status had a sensitivity of 60% and specificity of 55%.

Provider documented immunization status for the HPV, MCV, Tdap and influenza immunizations had positive likelihood ratios (LR+) of 3.5, 8.5, infinity, and 1.2 with negative likelihood ratios (LR-) of 0.9, 0.9, 0.9 and 0.5, respectively (Table 2).

Immunizations Given During Hospitalization

Of the 84% (135/160) of patients eligible to receive one or more immunizations in the ALERT IIS, 24% were provided immunizations prior to discharge. These 32 patients received 35 total immunizations: 3 HPV, 1 MCV, 1 Tdap, 28 influenza and 2 other immunizations. Of the patients eligible to receive the adolescent immunizations (HPV, MCV, Tdap) in the ALERT IIS, 1-3% of those patients received those immunizations prior to discharge. One patient received the HPV, MCV, Tdap and influenza immunizations. Of the 90 patients eligible to receive the influenza immunization in the EMR, 28 received influenza immunizations prior to discharge.

Limitations

This study has several limitations. This study was conducted at a single urban tertiary care academic children’s hospital with a fairly homogenous population and the results may not be able to be extrapolated to other populations. In addition, 33% of patients in this study either had documentation that the immunization status was unknown, or no documentation of immunization status was present in the admission history and physical, transfer note or discharge summary in the EMR. This represents a large percentage of our study population upon which we were unable to capture provider documentation data of immunization status.

We used the ALERT Immunization Information System (IIS) to determine actual need for immunizations. However, this system may not be 100% accurate and may underrepresent the number of immunizations children receive in the state. ALERT IIS does not currently participate in interstate data exchange so immunizations provided to patients outside the state may not be documented in the system.¹³ In this study, we excluded any patients with zero immunizations in ALERT IIS which may underrepresent the number of unimmunized patients in the population.