Skip to main content

Antibiotic use for inpatient newborn care with suspected infection: EN-BIRTH multi-country validation study

Abstract

Background

An estimated 30 million neonates require inpatient care annually, many with life-threatening infections. Appropriate antibiotic management is crucial, yet there is no routine measurement of coverage. The Every Newborn Birth Indicators Research Tracking in Hospitals (EN-BIRTH) study aimed to validate maternal and newborn indicators to inform measurement of coverage and quality of care. This paper reports validation of reported antibiotic coverage by exit survey of mothers for hospitalized newborns with clinically-defined infections, including sepsis, meningitis, and pneumonia.

Methods

EN-BIRTH study was conducted in five hospitals in Bangladesh, Nepal, and Tanzania (July 2017–July 2018). Neonates were included based on case definitions to focus on term/near-term, clinically-defined infection syndromes (sepsis, meningitis, and pneumonia), excluding major congenital abnormalities. Clinical management was abstracted from hospital inpatient case notes (verification) which was considered as the gold standard against which to validate accuracy of women’s report. Exit surveys were conducted using questions similar to The Demographic and Health Surveys (DHS) approach for coverage of childhood pneumonia treatment. We compared survey-report to case note verified, pooled across the five sites using random effects meta-analysis.

Results

A total of 1015 inpatient neonates admitted in the five hospitals met inclusion criteria with clinically-defined infection syndromes. According to case note verification, 96.7% received an injectable antibiotic, although only 14.5% of them received the recommended course of at least 7 days. Among women surveyed (n = 910), 98.8% (95% CI: 97.8–99.5%) correctly reported their baby was admitted to a neonatal ward. Only 47.1% (30.1–64.5%) reported their baby’s diagnosis in terms of sepsis, meningitis, or pneumonia. Around three-quarters of women reported their baby received an injection whilst in hospital, but 12.3% reported the correct antibiotic name. Only 10.6% of the babies had a blood culture and less than 1% had a lumbar puncture.

Conclusions

Women’s report during exit survey consistently underestimated the denominator (reporting the baby had an infection), and even more so the numerator (reporting known injectable antibiotics). Admission to the neonatal ward was accurately reported and may have potential as a contact point indicator for use in household surveys, similar to institutional births. Strengthening capacity and use of laboratory diagnostics including blood culture are essential to promote appropriate use of antibiotics. To track quality of neonatal infection management, we recommend using inpatient records to measure specifics, requiring more research on standardised inpatient records.

Key findings

What is known and what is new about this study?
 • Neonatal infections, including sepsis, pneumonia and meningitis account for over half a million neonatal deaths annually, yet most of these deaths are avoidable with appropriate antibiotic and supportive care management. Currently, there are no data from surveys or routine health information systems to track coverage of antibiotic treatment for newborn infections. Such data are increasingly important given rising antimicrobial resistance (AMR).
 • The Every Newborn-Birth Indicators Research Tracking in Hospitals (EN-BIRTH) study aimed to validate selected maternal and newborn indicators, including use of injectable antibiotics for treating inpatient newborns with clinically-defined infections. This is the first study to assess validity of this indicator in exit survey of women’s report, compared to inpatient case notes, and involved more than 1000 neonates in five hospitals in Bangladesh, Nepal and Tanzania.
Survey – what did we find and what does it mean?
 • Denominator: Maternal report of admission of a newborn to the inpatient ward had high sensitivity, but diagnoses of infection or specific infection syndromes were poorly reported, with high rates of “Don’t know” replies.
 • Numerator: Women’s report consistently underestimated the coverage of injectable antibiotics for treating newborns compared to the coverage defined by inpatient case note records, and specific antibiotic names were rarely reported correctly.
Gap analysis for quality of care and measurement
 • Inpatient case note records could be used to measure antibiotic coverage, but limited note keeping detail may impede abstracting specifics of antibiotic use (dose, duration, etc.).
 • Antibiotic stewardship is an issue in several of the EN-BIRTH study participating hospitals. Shockingly few inpatients (10.6%) had a blood culture done, and even fewer had a lumbar puncture (0.3%) despite a documented clinically-defined infection diagnosis. Importantly, in Nepal, there was a much higher rate of blood cultures in comparison to the other sites (81.7%). Few neonates received recommended antibiotics for the minimum duration of time. Both these practices are likely to contribute to overtreatment and/or inappropriate use of antibiotics, and may fuel AMR rates.
What next and research gaps?
 • Exit interview surveys of women’s report are not accurate for measuring coverage of antibiotics for neonatal infections, for denominator and especially for numerator regarding specific antibiotic names. This is consistent with previous research regarding antibiotics for childhood pneumonia, where survey report was inaccurate regarding both numerator and denominator. However, women’s report of admission to a neonatal ward holds promise for use in surveys and requires further research. This indicator could be analogous to other “contact” point indicators such as institutional birth, with scope to link with data on quality of care.
 • The gap for laboratory investigations of clinically-defined neonatal infections is a major challenge hence wider use of blood cultures and laboratory capacity strengthening are crucial and success in one of the five EN-BIRTH study hospitals shows this is possible in LMICs. Neonatal sepsis diagnostic innovation is an important investment gap especially given increasing AMR.
 • Implementation research is required to assess feasibility and utility of a ward register for inpatient small and sick newborn care focusing on major neonatal conditions including infection diagnoses and antimicrobial use, as well as the transition into electronic systems, with a minimal core dataset.

Background

Infections, including sepsis, pneumonia and meningitis, account for one-third of all newborn deaths globally [1, 2]. More than half a million newborns die every year due to infections, and the majority of these deaths occur in low- and middle-income countries (LMICs), mainly in south Asia and sub-Saharan Africa [3,4,5]. Without significantly accelerating the annual rate of reduction, global efforts will not be enough to achieve the ambitious Sustainable Development Goal (SDG) target of reducing the neonatal mortality rate to ≤ 12 per 1000 live births by 2030 [6,7,8]. Mortality is only the tip of this iceberg of disease burden, as there are an estimated 7 million episodes of possible severe infections among newborns every year, of which around 3.5 million are in south Asia and 2.6 million in sub-Saharan Africa [9]. In total estimated 30 million small and sick newborns require hospital admission, many of whom are given antibiotics [10]. The rate of hospital-acquired infections and antimicrobial resistant (AMR) infections among newborns may further increase due to the trend towards rapid increase in the proportion of births in health facilities in LMICs, and high use of antibiotics often without blood cultures or other diagnostics [11, 12].

Early appropriate management of neonatal infections is critical for newborn survival. The World Health Organization (WHO) recommends inpatient management of infections among newborns with injectable antibiotics [13]. Early administration of appropriate injectable antibiotics with supportive care could avert hundreds of thousands of deaths a year [14,15,16]. However, substantial gaps exist between such recommendations and implementation [17,18,19], and there is a dearth of studies to inform measuring the coverage and quality of inpatient management of infections, particularly in LMIC contexts.

Accurate data are crucial to track progress towards the SDGs and the global vision to end all preventable maternal and newborn mortality as well as stillbirths. The Every Newborn Action Plan (ENAP) identified a set of core and additional indicators to be measured globally to monitor and track the progress of newborn health. A multi-partner ENAP measurement improvement roadmap was developed to validate these indicators [20]. The proportion of hospitalized neonates with clinically diagnosed infections who received injectable antibiotics [denoted in this manuscript as “coverage” of injectable antibiotics in this target group] was included in the roadmap as one of the core coverage indicators for global monitoring after validation and feasibility testing.

The first step towards robust measurement of coverage is applying standardised case definitions. An important challenge is that neonatal infections are primarily defined based on symptoms and signs, which are often poorly codified, and sick neonates commonly have multi-organ dysfunction [21]. For outpatient and primary care settings WHO recommends a simplified clinical algorithm [22], designed to be highly sensitive and non-specific and hence the majority of cases likely have no bacterial infection [4]. For inpatient care of neonatal infections, with more experienced clinicians, a syndromic classification is used to try to separate sepsis, pneumonia and meningitis (Fig. 1a) and this inpatient context is the focus of the Every Newborn - Birth Indicators Research Tracking in Hospitals (EN-BIRTH) study. Blood culture remains the gold standard diagnosis, even though this may be negative in more than half of cases where skilled clinicians are confident of the diagnosis (Fig. 1b) [9, 23]. Importantly, meningitis cannot be distinguished from sepsis by clinical examination alone in a neonate and relies on consistent use of lumbar puncture. Laboratory diagnosis require at least a basic microbiological culture capacity, but to get more accurate measures for fastidious organisms such as Group B Streptococcus, requires specific approaches for culturing and more capacity [23].

Fig. 1
figure1

Case definitions and diagnosis for neonatal infections. a Approaches to diagnosis of neonatal infection, from simplest clinical algorithm, to infection syndromes through to gold standard with laboratory confirmation (Figure adapted from Seale et al, Lancet Infect Dis, 2014) [9]. b Case ascertainment for neonatal invasive bacterial disease showing the cascade affecting gold standard detection (Figure adapted from Lawn et al, Clinical Infectious Diseases, 2017) [23]

The next step is that coverage data should be routinely available at scale in either surveys or routine health management information systems (HMIS). Many LMICs still depend on population-based surveys such as The Demographic and Health Surveys (DHS) Program and Multiple Indicator Cluster Surveys (MICS) to report coverage for health care use including for management of childhood illnesses [24, 25]. One important issue is the challenge of measuring denominators of clinical need, especially in surveys. Previous research found challenges with accuracy of recall of denominators regarding childhood infections, notably pneumonia [26]. Another study found that survey-reported pneumonia had low validity with low true positive cases with high levels of false positives [27]. Studies have shown that more extended recall periods (classically 2–5 years in for MICS/DHS) for caregiver-reported symptoms of childhood illnesses especially for newborns, are prone to recall bias and recall error [28, 29].

Despite increasing opportunities to improve measurement in routine facility-based information systems, there has been little research on coverage validity for newborn care. This is an important opportunity, given that ~ 80% of the world’s births are now in facilities [30] coverage for newborn care has also increased, and many LMICs are adopting different digital innovations and transforming paper-based reporting system to digital platforms [31, 32]. However, the majority of the record-keeping system and registers are still paper-based, including for inpatient care. Moreover, collating other relevant data from various care areas make the documentation process more strenuous. In settings with limited resources, inpatient records are mostly based on case notes/case recording forms, that are not standardised and may have variable data quality [33].

As yet, no published studies have assessed the validity of survey report for clinically-defined neonatal infections, to inform the use of surveys to collect coverage data on this important aspect of universal health coverage, or explored feasibility for capture in facility data systems.

Objectives

This paper is part of a supplement based on the EN-BIRTH multi-country validation study, ‘Informing measurement of coverage and quality of maternal and newborn care’, and focuses on injectable antibiotic treatment of clinically-defined neonatal infections (sepsis, meningitis and pneumonia) amongst inpatients, addressing the following objectives:

  1. 1.

    VALIDATION of women’s report through exit survey to determine the accuracy/validity for

    1. a.

      Denominator options: The following denominator options were assessed-

      • Option d1- Reported the baby was admitted to newborn ward

      • Option d2- Reported the baby was admitted and had any infection

      • Option d3- Reported the baby was admitted and had any one of the clinically-defined infection syndromes. i.e. sepsis, pneumonia, meningitis

    2. b.

      Numerator options: The following numerator options were assessed-

      • Option n1- Reported the baby received any injection/antibiotic

      • Option n2- Reported the baby received any injection/antibiotic and reported the antibiotic name

  2. 2.

    QUALITY GAP ANALYSES for injectable antibiotic use to assess the gaps in coverage, quality and measurement from case note verification.

  3. 3.

    BARRIERS AND ENABLERS to understand the barriers and enablers of documentation practices from qualitative interviews.

Methods

The EN-BIRTH study was conducted in five referral hospitals: Maternal and Child Health Training Institute (MCHTI), Azimpur and Kushtia General Hospital in Bangladesh (BD), Pokhara Academy Health Sciences in Nepal (NP), and Muhimbili National Hospital and Temeke District Hospital in Tanzania (TZ) (Additional file 1). These hospitals were selected since all the maternal, and neonatal interventions of interest were available. The participants were consenting women (primary caregivers of newborns) whose baby was admitted to the hospital inpatient department (newborn and paediatric wards) and treated for neonatal infection. Detailed information regarding the research protocol, methods, and analysis were published separately [34, 35]. In this study, we compared clinically-defined neonatal infection verified through abstraction of data from inpatient case notes (gold standard) with women’s report collected through exit surveys (Fig. 2).

Fig. 2
figure2

EN-BIRTH study antibiotic coverage validation design comparing case note verification with exit interview survey [34]

Data collection

We adopted both quantitative and qualitative methods of data collection to address the study objectives. Data collection took place between July 2017 and July 2018. Details regarding the clinical management practices were verified by abstracting data from hospital inpatient case notes/case recording forms with a structured checklist. Exit surveys were conducted with a structured questionnaire to capture women’s report before discharge. These quantitative data collection tools were developed by team members from Bangladesh, Nepal, Tanzania and UK based on the global guidelines and validated tools [13, 36, 37]. The data collection tools were adapted to reflect country settings and contexts (health systems, language, culture, etc.) through formative research. Trained data collectors collected data using a custom-built android tablet-based electronic data capture system specially designed for the EN-BIRTH study. Separate researchers were assigned to verify the hospital inpatient case notes, in addition to those assigned to conduct the exit surveys. Around 5% of the case note verifications were re-checked by field supervisors to monitor the reliability of data collection.

In-depth interviews and focus group discussions were conducted by trained qualitative researcher to explore potential barriers and enablers related to documentation practices. Qualitative data collection tools were informed by the Performance of Routine Information System Management (PRISM) conceptual framework [38, 39]. We obtained ethical approval from the institutional review boards in all operating counties in addition to the London School of Hygiene & Tropical Medicine (Additional file 2).

Eligibility criteria

All babies aged ≤28 days at admission, weighing > 1500 grammes (g) at admission or discharge, or gestational age > 32 weeks, receiving inpatient management for clinically-defined infections, i.e. sepsis, pneumonia, meningitis were included for analysis in this paper. Babies with an obvious major congenital abnormality, neonatal encephalopathy (“severe asphyxia”) were excluded at recruitment. All inclusion and exclusion criteria were based on the data abstracted from hospital inpatient records.

Data analyses

Results are reported in accordance with STROBE Statement checklists for observational studies (Additional file 3). We reported the background characteristics of newborns treated for clinically-defined infections and the women (primary caregivers) who were successfully interviewed. Socioeconomic asset scores were generated using the standard principal component analysis procedure. The EN-BIRTH larger dataset was used for the assignment of wealth quintile to the neonatal infection cases [34, 35].

We reported the antibiotic coverage among newborns treated for clinically-defined infections for the following scenarios based on the hospital inpatient case note verification: any injectable antibiotic, any WHO recommended injectable antibiotic, any recommended injectable antibiotic for 2 days, any recommended injectable antibiotic for 7 days. Survey-reported antibiotic coverage was reported for two questions: general- reported any injection or antibiotic was given, and specific- reported the name of a specific antibiotic. We used descriptive statistics to report all point prevalence estimates with 95% confidence intervals. We reported all estimates separately for each of the five facilities, as well as pooled estimates through random effect models with heterogeneity statistics (I2 and τ2).

We conducted individual level validation analyses of women’s report for the different denominator and numerator options. Hospital inpatient case note verification was considered as gold standard, and women’s report during the exit survey was regarded as the ‘Test’ during this analysis (Fig. 2). The denominator options included whether the women could correctly report if the baby was admitted in the hospital (option d1), if the baby was admitted and had any infection (option d2), and if the baby was admitted and had any clinically-defined infection (option d3). The numerator options included whether the women could correctly report if their baby received an injection or antibiotics (option n1) and whether the women could specifically report the name of an antibiotic (option n2).

For validity measures, sensitivity and specificity were reported with 95% confidence interval for each of the selected hospital separately. Exit survey reported “Don’t know” category was considered as “No” during this analysis. Also, we reported the percent-agreement between the case note verification and the exit survey. Sensitivity and specificity analyses were only performed if the column total counts in two-way tables exceeded 10. For denominator validation, we did not report the sensitivity, specificity and percent agreement as we only had newborns treated for clinically-defined infections, i.e. no “true negatives.”

Structured Query Language (SQL) server was used to store and manage data. We used Stata (version 14) for conducting all quantitative analysis. NVivo 12 software was used to manage qualitative data during analysis.

Results

A total of 1015 cases were selected based on the inclusion and exclusion criteria (from 1523 recruited), among which 409 newborns were from Bangladesh, 344 were from Nepal, and 262 were from Tanzania. Among 1015 eligible cases, 910 women (primary caregivers of the newborns) were successfully interviewed, 57 women were lost to follow up, and 48 women did not consent to participate in the study. Figure 3 summarises the selection process, regarding the distribution of different inclusion and exclusion criteria among the overall sample.

Fig. 3
figure3

EN-BIRTH study flow diagram for newborns treated with severe infections (n = 1015)

Background characteristics, clinical history and results of physical examination of the newborns on admission as recorded in the hospital inpatient case notes are shown in Table 1. Among all newborns treated for clinically-defined infections, 78.3% in Azimpur BD, 76.9% in Kushtia BD and 75.5% in Muhimbili TZ, and around 99% in Pokhara NP and Temeke TZ were recorded as sepsis cases. Around 20% of the babies in Azimpur BD and Kushtia BD and less than 1% of the newborns in Pokhara NP and Temeke TZ were recorded as pneumonia cases. The majority of the newborns were less than 7 days of age, except in Muhimbili TZ (24.5%), where the majority were aged between 7 and 13 days (46.9%). 36.3% of the newborns in Kushtia BD and 12.3% in Muhimbili TZ had a history of low birthweight (< 2500 g). Weight on admission was not recorded for less than 10% cases in Azimpur BD and Kushtia BD, 22.4% in Muhimbili TZ and more than 70% in Pokhara NP and Temeke TZ.

Table 1 Characteristics of newborns in inpatient wards, case note verification, EN-BIRTH study (n = 1015 children)

Additional file 4 presents the characteristics of the mothers of the newborns who participated in the exit survey—the majority of these mothers were aged between 20 and 29 years. 28.8% women completed secondary education in Kushtia BD and 61.0% in Pokhara NP.

Objective 1: Denominator and numerator validation

Table 2 presents the denominator validation results of women’s reports during the exit survey, which were compared with hospital inpatient case note verification. Among the 910 women surveyed, 98.8% could report their baby was admitted in the hospital, which was consistent across all facilities. 47.1% of women could report their baby was admitted in the hospital and had any infection, which varied across different hospitals, ranging from 17.1% (6.5–33.6%) in Muhimbili TZ to 75.4% (70.1–80.1%) in Kushtia BD. Only 30.4% (10.0–55.91%) of women could report if their baby was admitted in the hospital and had a clinically-defined infection, which also varied substantially across different hospitals, ranging from 11.4% (3.2–26.7%) in Muhimbili TZ to 70.4% (64.9–75.5%) in Kushtia BD.

Table 2 Denominator validation results for coverage of injectable antibiotics, women’s exit interview survey, EN-BIRTH study (n = 901)

Overall, 74.7% (55.3–90.1%) of women could report their baby received any antibiotics/injections during their hospital stay: more than 80% in Azimpur BD, Temeke TZ and Muhimbili TZ; whereas only 58.1% in Kushtia BD and 46.8% in Pokhara NP (Fig. 4). Around one-third of women in Kushtia BD and one-fourth of women in Pokhara NP mentioned that they did not know or remember whether their baby received any antibiotic/injection. The sensitivity of women’s report whether their babies received any antibiotic/injection was 75.9% (Table 3, Additional files 5 and 6).

Fig. 4
figure4

Coverage of antibiotics − newborn care inpatient wards, EN-BIRTH study. *Random effects

Table 3 Individual-level numerator validation in exit survey report of injectable antibiotics coverage, EN-BIRTH study (n = 901)

12.3% (3.5–25.1%) of women could report the specific name of an antibiotic. 35.2% of women in Kushtia BD and 25.0% of women in Pokhara NP mentioned that they did not know or remember the specific name of the antibiotic. The sensitivity of reporting the name of the specific antibiotic was only 12.7%.

Objective 2: Gaps in coverage, quality and measurements

Table 4 describes the diagnostic practices received by newborns treated for infection, according to the hospital inpatient case note verification. Documentation of blood culture being performed was available only among 10.6% of newborns who were treated for clinically-defined infections. The rate was less than 5% in Bangladesh and Tanzania and 81.7% in Nepal. Less than 1% of newborns had any documented evidence of a lumbar puncture being performed. Among the seven cases which had on admission diagnosis of meningitis, a lumbar puncture was performed in only three cases (data not shown). Only one-fifth of all newborns treated for infection had any documented evidence of high white blood cell (WBC) count.

Table 4 Laboratory investigations and diagnostics, case note verification, EN-BIRTH study (n = 1015)

Table 5 presents the use of different types of antibiotic in various hospitals according to the case note verification. The choice of antibiotic differed across different hospitals despite the high coverage of antibiotics across all sites. In all hospitals except Kushtia BD, ampicillin (63.4–90.6% across facilities) and gentamicin (69.4–92.5% across facilities) were the most commonly used antibiotics. In Kushtia BD, gentamicin (71.6% with CI 66.1–76.6%), ceftazidime (69.3% with CI 63.7–74.4%) and meropenem (28.1% with CI 23.1–33.5%) were the most frequently used. In addition to ampicillin and gentamicin, ampicillin-cloxacillin (29.6% with CI 23.5–36.1%) was one of the most commonly used in antibiotics in Temeke TZ.

Table 5 Injectable antibiotic use and coverage, case note verification, EN-BIRTH study (n = 1015)

Figure 5 shows the gap analysis for coverage of antibiotic use among newborns treated for clinically-defined infections through the hospital inpatient case note verification (first six stacked bars from left) and gaps in measurements through women’s report at exit survey (the last two stacked bars). Among all the newborns treated for infection, 96.7% had documented evidence of receiving any WHO recommended injectable antibiotic for any duration, 73.3% receiving any recommended injectable for at least 2 days and 14.5% receiving any recommended injectable for at least 7 days.

Fig. 5
figure5

Gaps in coverage, quality and measurements in antibiotic use, EN-BIRTH study. (n = 1015 for case note verification and n = 910 exit interview survey). *All sites pooled using random effects model

Objective 3: Barriers and enablers to documentation practices in hospital inpatient case notes

We identified the following key themes regarding documentation practices in hospital inpatient case notes:

  • Enabler – awareness regarding the importance case note records: The health workers, i.e. doctors and nurses responsible for inpatient management of sick newborns, were aware of the importance of documentation in the inpatient case notes and medical record keeping. They acknowledged its importance for reviewing the patient’s condition and taking clinical decisions, communicating and coordinating within the clinical team (doctors’ instructions to the junior doctors and nurses, nurses’ action in response to the guidelines, etc.), and preparing discharge certificates.

  • Enabler – source of information for service reports: The health services providers, especially the nurses, regularly used case notes as a source of information for preparing different services reports (daily/monthly reports) and disease-specific registries.

  • Barrier – case note design and lack of standardization: The case notes had a basic structure outlining some key components (particulars of the patient, history, clinical features, laboratory investigations, drugs given, etc.). The design of the case notes varied substantially across countries, and it did not prioritize any standardized documentation of key clinical care elements. Consequently, the documentation practice was dependent on the preference and performance of the clinical service providers, leading to unstandardized documentation of details. The majority of the health service providers felt the need for specific training related to documentation of inpatient care.

  • Barrier – lack of coordination and duplication with other registers: In addition to case notes, nurses had to maintain other administrative registers such as drugs log, logistic requisition, etc. which also include various patient-related information (which are already available in the case notes) leading to duplication of efforts and documentations. One of the nurses from Bangladesh said:

“There are too many registers to fill up. Information related to neonatal infection is recorded into the admission book, patient case file, and monthly summary sheet. To do so in a proper way, it needs a considerable amount of time.”

- Health worker, BD

  • Barrier – clinical workload and documentation responsibilities: In addition to the clinical duties, the doctors and nurses were separately responsible for filling-in different sections of the case notes. The majority of the health workers felt that their clinical workload was overwhelming and affected the quality of case note documentation.

Discussion

This analysis, as part of EN-BIRTH study, is the first to validate potential coverage indicator measurement for antibiotic treatment of neonatal infections in hospitalised patients. Based on more than 1000 cases in five hospitals in Bangladesh, Nepal and Tanzania, we validated women’s report during exit survey against information abstracted from hospital inpatient case notes [35]. Given our findings of large measurement gaps of women’s report, we do not recommend incorporating this indicator in widely deployed population-based surveys like DHS and MICS [24, 25].

Maternal report of newborn admission in the inpatient ward had high sensitivity, but specific diagnosis or classifications were poorly reported, with high “Don’t knows”. Infections are a subset of the total neonatal admissions, varying by context and especially by level of facility, with reports between 6 and 68% of all neonatal admissions [40,41,42,43,44,45,46,47,48,49]. Using a contact indicator option (admission to a neonatal unit) in household surveys may be useful as marker of care for small and sick newborns, in a similar way that “contact” point indicators such as institutional birth or antenatal care coverage are used. We note that only women whose babies had been admitted were surveyed, so more research is required to also ask those whose baby was not admitted. Importantly this “contact” point indicator would also need to be linked to more detailed diagnosis and treatment information, from inpatient datasets for example.

More detailed questions to try to identify denominators of clinical diagnosis were asked in two ways (any infection, or specific infection syndrome), and both of these performed poorly in survey report. Around half of the women could correctly report whether their baby had any infection, and only around one-third could report any specific infection syndromes (sepsis, meningitis or pneumonia). Moreover, there were wide variations among different hospitals regarding the accuracy of women’s report on the second (if baby admitted in hospital and had any infection) (17.1–75.4%) and the last option (if baby admitted in hospital and had a presumed severe infection (11.4–70.4%). These findings are consistent with the previous studies which reported the challenges of identifying clinical symptoms through household surveys [26, 27, 50]. In our EN-BIRTH study, the sensitivity of women’s report was assessed through exit survey. In contrast, standard surveys like DHS and MICS accept a recall period of 14 days for identifying suspected cases suffering from acute respiratory infections. Since recall bias and recall error increase with longer recall periods, the accuracy of women’s report collected through the last two denominator options in household surveys may be further compromised [28, 29].

The numerators assessed involved questions regarding the use of injectable antibiotics. For use of any antibiotic, the sensitivity was 75.9%, with wide variation between the five participating hospitals. In terms of mothers’ knowledge regarding which antibiotic was given, sensitivity was only 12.7%. This was reasonably consistent across all hospitals. During hospital stay, a sick newborn may require different kinds of injectable drugs in addition to antibiotics [13]. Therefore, the general option (any injection) may overestimate the true coverage of injectable antibiotic for treating newborns with infections. Moreover, antibiotics are often prescribed using trade names (given by the manufacturing companies), making it even more difficult for women to report drug names correctly, and also challenging to differentiate an antibiotic from other drugs during analysis. Effective communication has been underemphasised as part of respectful family-centred care in many LMICs [51]. Such communication gaps might contribute to the limited sensitivity of women’s report and high rates of “Don’t know” responses for this option. Focusing only on hospitalised care might have underestimated the coverage of injectable antibiotic [52]. However, the focus on this study was to assess the validity of hospital inpatient record-keeping and its implications on estimating the antibiotic coverage.

Hospital records are another potential data source for tracking injectable antibiotic use, and could be linked to a “contact” point indicator in surveys to assess effective coverage [53]. We found gaps in the design of hospital inpatient case notes and inconsistencies in documentation practices by various health service providers, and between the hospitals. Introduction of clinical registers for inpatient management of sick newborns may help address such gaps [54] and contribute to better quality of care and patient outcomes [55,56,57]. Implementation research is required to evaluate the use of novel clinical registers. Shifting towards electronic inpatient records and adopting new technologies designed for resource-poor settings could improve the quality of documentation [58]. However, managing an extensive electronic database can be challenging in any context, and requires adequate resourcing [59, 60].

Antibiotic stewardship is an imperative in every country, and neonates are especially vulnerable to antimicrobial-resistant pathogens and more likely to die if infected [61]. There were gaps regarding the use of recommended antibiotics as included hospitals used around 30 types of injectable antibiotics for treating newborns. Furthermore, there are concerns regarding course completion, as less than 10% of the newborns treated for clinically-defined infections received the recommended antibiotics for 7 days or more. Injudicious use of antibiotics may lead to antibiotic resistance which is a critical public health concern in both resource-rich and resource-poor settings [62, 63]. Inappropriate provision or overuse of antibiotics also brings an economic burden on the health system and families through out-of-pocket expenditure [64]. Knowledge gaps among the doctors and patients’ expectations and lack of understanding of the importance of completing an antibiotic course by the family members may explain this inappropriate and irrational use of antibiotics for treating infections [65, 66].

In the EN-BIRTH study, verification of hospital inpatient case notes revealed that almost all (97%) newborns admitted in the hospital for clinically-defined infections received injectable antibiotics. However, very few (< 2%) had laboratory-confirmed evidence of any infection in Bangladesh and Tanzania. Importantly, in Nepal, there was a much higher rate of blood culture. Most likely this has happened as a result of the ongoing quality improvement initiatives in Nepal. Diagnostic tests are vital for managing newborns with infections [13, 67]. It is also an important aspect of antibiotic stewardship. Almost none of the newborns treated for clinically-defined infections in Azimpur BD, Kushtia BD, Temeke TZ and Muhimbili TZ had laboratory-confirmed evidence of any infection. Other supportive lab diagnoses such as a complete blood count (CBC) or WBC count were also not performed in Azimpur BD, Kushtia BD and Temeke TZ. This gap in diagnostic tests may be the result of inadequate provision of laboratory services in these resource-poor settings [68,69,70]. Ensuring the basic laboratory services with quality and standardisation in referral hospitals should be prioritised for improving the quality of care. It is important to explore and understand the enablers of such practices in Pokhara NP, and adapt learning for use in hospitals with similar settings.

Strengths and limitations

Our study has strengths, notably the large sample size and multi-country sites with standardised tools and training and a custom-built android tablet-based application that was designed specifically for this study [71]. Data abstraction from inpatient case notes was conducted by trained study nurses, supervised by study-physicians. Exit surveys with women were conducted by trained data collectors. These measures helped to ensure multi-site consistency and data quality through real-time monitoring.

It is also important to acknowledge limitations. Observations of the clinical practices in the selected hospitals and especially timed observations of antibiotic administered for neonatal infections were not feasible, and hence we used inpatient case notes as the gold standard to assess the validity of women’s report through the exit survey. Whilst this is the most commonly used gold standard in many validation studies, It is widely recognised that case note documentation has gaps, even in well-resourced settings [72]. Validity assessment may be affected by the potential inaccuracy of case note documentation however, we note that case notes are more likely to omit than have false record of giving treatment, so if anything our findings are conservative, and the gap between “truth” and reported coverage may be even higher. Within the quality gap analyses gaps may be related to documentation as well as gaps in quality of care. The survey and our analyses were limited to cases admitted for infection; therefore, we could not compare the true negatives for women’s report.

Conclusion

Survey report consistently underestimated the coverage of injectable antibiotics for treating newborns with infection, and had low sensitivity for both the numerator and denominator, hence we recommend this indicator not be added to population-based surveys. However, the high sensitivity of a “contact” point indicator of admission to a neonatal unit, at least amongst those admitted, holds promise for tracking coverage of small and sick newborn care. More investment and research on hospital inpatient records for newborns is crucial to enable linked data on content and quality of care. We particularly recommend improving the design of inpatient registers and case notes to address the identified gaps in measurements of quality of care. Strengthening capacities to do blood cultures and lumbar punctures is important in the short term, and in the longer term novel bedside diagnostics for bacterial and viral neonatal infections could be transformative and also to improve antibiotic stewardship and address AMR.

Availability of data and materials

The datasets generated during and/or analysed during the current study are available on LSHTM Data Compass repository, https://datacompass.lshtm.ac.uk/955/.

Abbreviations

AMR:

Antimicrobial resistance

CBC:

Complete blood count

BD:

Bangladesh

CIFF:

Children’s Investment Fund Foundation

CSF:

Cerebrospinal Fluid

DHS:

The Demographic and Health Surveys Program

ENAP:

Every Newborn Action Plan now branded as Every Newborn

EN-BIRTH:

Every Newborn-Birth Indicators Research Tracking in Hospitals study

g:

grammes

HMIS:

Health Management Information Systems

icddr,b:

International Centre for Diarrheal Disease Research, Bangladesh

IHI:

Ifakara Health Institute, Tanzania

LMIC:

Low- and middle-income countries

LP:

lumbar puncture

LSHTM:

London School of Hygiene & Tropical Medicine

MCHTI:

Maternal & Child Health Training Institute, Azimpur, Bangladesh

MICS:

Multiple Indicator Cluster Surveys

MUHAS:

Muhimbili University of Health and Allied Sciences, Tanzania

NP:

Nepal

PRISM:

Performance of Routine Information System Management

SDG:

Sustainable Development Goals

SQL:

Structured Query Language

TZ:

Tanzania

WBC:

White Blood Cell

WHO:

World Health Organization

References

  1. 1.

    Lawn JE, Blencowe H, Oza S, You D, Lee AC, Waiswa P, Lalli M, Bhutta Z, Barros AJ, Christian P. Every newborn: progress, priorities, and potential beyond survival. Lancet. 2014;384(9938):189–205.

    Article  Google Scholar 

  2. 2.

    WHO: Newborn death and illness. https://www.who.int/pmnch/media/press_materials/fs/fs_newborndealth_illness/en/. Accessed 17 Sept 2020.

  3. 3.

    UNICEF, WHO, World Bank Group, United Nations: Levels & Trends in Child Mortality- Report 2020: Estimates developed by the UN Inter-agency Group for Child Mortality Estimation. https://childmortality.org/wp-content/uploads/2015/10/Levels-and-Trends-in-Child-Mortality-Report-2015.pdf. Accessed 17 Sept 2020.

  4. 4.

    Saha SK, Schrag SJ, El Arifeen S, Mullany LC, Islam MS, Shang N, Qazi SA, Zaidi AK, Bhutta ZA, Bose A. Causes and incidence of community-acquired serious infections among young children in South Asia (ANISA): an observational cohort study. Lancet. 2018;392(10142):145–59.

    PubMed  PubMed Central  Article  Google Scholar 

  5. 5.

    Rahman AE, Herrera S, Rubayet S, Banik G, Hasan R, Ahsan Z, Siraj W, Ahmed A, Siddique AB, Rahman QS. Managing possible serious bacterial infection of young infants where referral is not possible: lessons from the early implementation experience in Kushtia District learning laboratory, Bangladesh. PLoS One. 2020;15(5):e0232675.

  6. 6.

    United Nations: Sustainable Development Goals. http://www.un.org/sustainabledevelopment/. Accessed 17 Sept 2020.

  7. 7.

    You D, Hug L, Ejdemyr S, Idele P, Hogan D, Mathers C, Gerland P, New JR, Alkema L. Global, regional, and national levels and trends in under-5 mortality between 1990 and 2015, with scenario-based projections to 2030: a systematic analysis by the UN inter-agency Group for Child Mortality Estimation. Lancet. 2015;386(10010):2275–86.

    PubMed  Article  PubMed Central  Google Scholar 

  8. 8.

    Grove J, Claeson M, Bryce J, Amouzou A, Boerma T, Waiswa P, Victora C. Maternal, newborn, and child health and the sustainable development goals—a call for sustained and improved measurement. Lancet. 2015;386(10003):1511–4.

    PubMed  Article  PubMed Central  Google Scholar 

  9. 9.

    Seale AC, Blencowe H, Manu AA, Nair H, Bahl R, Qazi SA, Zaidi AK, Berkley JA, Cousens SN, Lawn JE, pSBI Investigator Group. Estimates of possible severe bacterial infection in neonates in sub-Saharan Africa, South Asia, and Latin America for 2012: a systematic review and meta-analysis. Lancet Infect Dis. 2014;14(8):731–41.

  10. 10.

    World Health Organization: Survive and Thrive: Transforming Care for Every Small and Sick Newborn. https://www.unicef.org/reports/transforming-care-for-every-small-and-sick-newborn-2020. Accessed 13 Aug 2020.

  11. 11.

    Narayanan I, Nsungwa-Sabiti J, Lusyati S, Rohsiswatmo R, Thomas N, Kamalarathnam CN, Wembabazi JJ, Kirabira VN, Waiswa P, Data S. Facility readiness in low and middle-income countries to address care of high risk/small and sick newborns. Matern Health Neonatol Perinatol. 2019;5(1):10.

    PubMed  PubMed Central  Article  Google Scholar 

  12. 12.

    Okomo U, Akpalu EN, Le Doare K, Roca A, Cousens S, Jarde A, Sharland M, Kampmann B, Lawn JE. Aetiology of invasive bacterial infection and antimicrobial resistance in neonates in sub-Saharan Africa: a systematic review and meta-analysis in line with the STROBE-NI reporting guidelines. Lancet Infect Dis. 2019;19(11):1219–34.

    CAS  PubMed  Article  PubMed Central  Google Scholar 

  13. 13.

    World Health Organization: Pocket book of hospital care for children: guidelines for the management of common childhood illnesses. https://www.who.int/maternal_child_adolescent/documents/child_hospital_care/en/. Accessed 17 Sept 2020.

  14. 14.

    Darmstadt GL, Ahmed ANU, Saha SK, Chowdhury MA, Alam MA, Khatun M, Black RE, Santosham M. Infection control practices reduce nosocomial infections and mortality in preterm infants in Bangladesh. J Perinatol. 2005;25(5):331–5.

    PubMed  Article  PubMed Central  Google Scholar 

  15. 15.

    Edmond K, Zaidi A. New approaches to preventing, diagnosing, and treating neonatal sepsis. PLoS Med. 2010;7(3):e1000213.

    PubMed  PubMed Central  Article  CAS  Google Scholar 

  16. 16.

    Rahman AE, Iqbal A, Hoque DE, Moinuddin M, Zaman SB, Rahman QS, Begum T, Chowdhury AI, Haider R, Arifeen SE. Managing neonatal and early childhood syndromic sepsis in sub-district hospitals in resource poor settings: improvement in quality of care through introduction of a package of interventions in rural Bangladesh. PLoS One. 2017;12(1):e0170267.

  17. 17.

    Arifeen S, Bryce J, Gouws E, Baqui A, Black R, Hoque D, Chowdhury E, Yunus M, Begum N, Akter T. Quality of care for under-fives in first-level health facilities in one district of Bangladesh. Bull World Health Organ. 2005;83(4):260–7.

    CAS  PubMed  PubMed Central  Google Scholar 

  18. 18.

    Anwar I, Kalim N, Koblinsky M. Quality of obstetric care in public-sector facilities and constraints to implementing emergency obstetric care services: evidence from high-and low-performing districts of Bangladesh. J Health Popul Nutr. 2009;27(2):139.

    PubMed  PubMed Central  Article  Google Scholar 

  19. 19.

    Chowdhury S, Hossain SA, Halim A. Assessment of quality of care in maternal and newborn health services available in public health care facilities in Bangladesh. Bangladesh Med Res Counc Bull. 2009;35(2):53–6.

    PubMed  Article  PubMed Central  Google Scholar 

  20. 20.

    World Health Organization: The WHO technical consultation on newborn health indicators. http://apps.who.int/iris/bitstream/10665/184225/1/9789241509381_eng.pdf?ua=1. Accessed 17 Sept 2020.

  21. 21.

    Wiens MO, Kumbakumba E, Kissoon N, Ansermino JM, Ndamira A, Larson CP. Pediatric sepsis in the developing world: challenges in defining sepsis and issues in post-discharge mortality. Clin Epidemiol. 2012;4:319.

    PubMed  PubMed Central  Article  Google Scholar 

  22. 22.

    WHO: GUIDELINE - Managing possible serious bacterial infection in young infants when referral is not feasible. https://apps.who.int/iris/bitstream/handle/10665/181426/9789241509268_eng.pdf?sequence=1. Accessed 1 Sept 2020.

  23. 23.

    Lawn JE, Bianchi-Jassir F, Russell NJ, Kohli-Lynch M, Tann CJ, Hall J, Madrid L, Baker CJ, Bartlett L, Cutland C. Group B streptococcal disease worldwide for pregnant women, stillbirths, and children: why, what, and how to undertake estimates? Clin Infect Dis. 2017;65(suppl_2):S89–99.

    PubMed  PubMed Central  Article  Google Scholar 

  24. 24.

    The DHS Program, USAID: Demographic and Health Surveys (DHS). https://dhsprogram.com/what-we-do/survey-Types/dHs.cfm. Accessed 1 Sept 2020.

  25. 25.

    UNICEF: Multiple Indicator Cluster Surveys (MICS). https://mics.unicef.org/. Accessed 17 Sept 2020.

  26. 26.

    Hazir T, Begum K, El Arifeen S, Khan AM, Huque MH, Kazmi N, Roy S, Abbasi S, Rahman QS, Theodoratou E. Measuring coverage in MNCH: a prospective validation study in Pakistan and Bangladesh on measuring correct treatment of childhood pneumonia. PLoS Med. 2013;10(5):e1001422.

    PubMed  PubMed Central  Article  Google Scholar 

  27. 27.

    Campbell H, el Arifeen S, Hazir T, O'Kelly J, Bryce J, Rudan I, Qazi SA. Measuring coverage in MNCH: challenges in monitoring the proportion of young children with pneumonia who receive antibiotic treatment. PLoS Med. 2013;10(5):e1001421.

    PubMed  PubMed Central  Article  Google Scholar 

  28. 28.

    Feikin DR, Audi A, Olack B, Bigogo GM, Polyak C, Burke H, Williamson J, Breiman RF. Evaluation of the optimal recall period for disease symptoms in home-based morbidity surveillance in rural and urban Kenya. Int J Epidemiol. 2010;39(2):450–8.

    PubMed  PubMed Central  Article  Google Scholar 

  29. 29.

    Arnold BF, Galiani S, Ram PK, Hubbard AE, Briceño B, Gertler PJ, Colford JM Jr. Optimal recall period for caregiver-reported illness in risk factor and intervention studies: a multicountry study. Am J Epidemiol. 2013;177(4):361–70.

    PubMed  Article  PubMed Central  Google Scholar 

  30. 30.

    UNICEF: The State of the World’s Children 2019. Children, Food and Nutrition: Growing well in a changing world. https://www.unicef.org/sowc/. Accessed 13 Aug 2020.

  31. 31.

    Labrique AB, Wadhwani C, Williams KA, Lamptey P, Hesp C, Luk R, Aerts A. Best practices in scaling digital health in low and middle income countries. Glob Health. 2018;14(1):103.

    Article  Google Scholar 

  32. 32.

    Lewis T, Synowiec C, Lagomarsino G, Schweitzer J. E-health in low-and middle-income countries: findings from the center for health market innovations. Bull World Health Organ. 2012;90:332–40.

    PubMed  PubMed Central  Article  Google Scholar 

  33. 33.

    Assale M, Dui LG, Cina A, Seveso A, Cabitza F. The revival of the notes field: leveraging the unstructured content in electronic health records. Front Med. 2019;6:66.

    Article  Google Scholar 

  34. 34.

    Day LT, Ruysen H, Gordeev VS, Gore-Langton GR, Boggs D, Cousens S, Moxon SG, Blencowe H, Baschieri A, Rahman AE, et al. “Every Newborn-BIRTH” protocol: observational study validating indicators for coverage and quality of maternal and newborn health care in Bangladesh, Nepal and Tanzania. J Glob Health. 2019;9(1):010902.

  35. 35.

    Day LT, Rahman AE, Salim N, KC A, Ruysen H, Tahsina T, Masanja H, Basnet O, Gordeev VS, Zaman SB, Shabani J, Jha A. Assessment of the validity of the measurement of newborn and maternal health-care coverage in hospitals (EN-BIRTH): an observational study. Lancet Global Health. 2020. https://doi.org/10.1016/S2214-109X(20)30504-0.

  36. 36.

    UNICEF, Bangladesh Bureau of Statistics (BBS): Multiple Indicator cluster survey - provisional data: summary tables and findings (29 August, 2019). https://mics-surveys-prod.s3.amazonaws.com/MICS6/South%20Asia/Bangladesh/2019/Survey%20findings/Bangladesh%202019%20MICS%20Survey%20Findings_English.pdf. Accessed 17 Sept 2020.

  37. 37.

    National Institute of Population Research and Training (NIPORT), ICF: Bangladesh Demographic and Health Survey 2017–18: Key Indicators. https://dhsprogram.com/pubs/pdf/PR104/PR104.pdf. Accessed 17 Sept 2020.

  38. 38.

    MEASURE Evaluation: Performance of Routine Information System Management (PRISM). https://www.measureevaluation.org/our-work/routine-health-information-systems/performance-of-routine-information-system-management-prism. Accessed 15 Sept 2020.

  39. 39.

    Aqil A, Lippeveld T, Hozumi D. PRISM framework: a paradigm shift for designing, strengthening and evaluating routine health information systems. Health Policy Plan. 2009;24(3):217–28.

    PubMed  PubMed Central  Article  Google Scholar 

  40. 40.

    Ali SR, Ahmed S, Lohana H. Disease patterns and outcomes of neonatal admissions at a secondary care hospital in Pakistan. Sultan Qaboos Univ Med J. 2013;13(3):424.

    PubMed  PubMed Central  Google Scholar 

  41. 41.

    Okechukwu A, Achonwa A. Morbidity and mortality patterns of admissions into the special care baby unit of University of Abuja Teaching Hospital, Gwagwalada, Nigeria. Niger J Clin Pract. 2009;12(4):389–94.

  42. 42.

    Nahar J, Zabeen B, Akhter S, Azad K, Nahar N. Neonatal morbidity and mortality pattern in the special care baby unit of BIRDEM. Ibrahim Med Coll J. 2007;1(2):1–4.

    Article  Google Scholar 

  43. 43.

    Quddusi AI, Razzaq A, Hussain S, Hussain A. Pattern of neonatal admission at the children’s hospital and the institute of child health, Multan. J Ayub Med Coll Abbottabad. 2012;24(2):108–10.

    PubMed  PubMed Central  Google Scholar 

  44. 44.

    Toma BO, Ige OO, Abok II, Onwuanaku C, Abah RO, Donli A. Pattern of neonatal admissions and outcome in a tertiary institution in north Central Nigeria; 2013.

    Book  Google Scholar 

  45. 45.

    Yaqub A, Ghani Z. Frequency and Outcome of Neonatal Diseases in Neonatal Intensive Care Unit at Tertiary Care Hospital Islamabad. Isra Medical Journal. 2018; 10(5): 272–75.

  46. 46.

    Okomo UA, Dibbasey T, Kassama K, Lawn JE, Zaman SM, Kampmann B, Howie SR, Bojang K. Neonatal admissions, quality of care and outcome: 4 years of inpatient audit data from the Gambia's teaching hospital. Paediatr Int Child Health. 2015;35(3):252–64.

    PubMed  Article  PubMed Central  Google Scholar 

  47. 47.

    Shaker NZ. Disease Patterns and outcomes of Neonatal Admissions at Raparin Pediatric Teaching Hospital in Erbil City. Nurs Natl Iraqi Specility. 2015;28(2):39–46.

    Google Scholar 

  48. 48.

    Demisse AG, Alemu F, Gizaw MA, Tigabu Z. Patterns of admission and factors associated with neonatal mortality among neonates admitted to the neonatal intensive care unit of University of Gondar Hospital, Northwest Ethiopia. Pediatr Health Med Ther. 2017;8:57.

    Article  Google Scholar 

  49. 49.

    Sime H, Workneh N. Morbidity and mortality of neonates admitted in Jimma University specialized hospital Paediatrics neonatal Ward: a one year retrospective analysis. Ethiop J Pediatr Child Health. 2014;10(10):44–54.

    Google Scholar 

  50. 50.

    Rudan I, Theodoratou E, Nair H, Marušić A, Campbell H. Reducing the burden of maternal and neonatal infections in low income settings. J Glob Health. 2011;1(2):106.

    PubMed  PubMed Central  Google Scholar 

  51. 51.

    Simen-Kapeu A, Seale AC, Wall S, Nyange C, Qazi SA, Moxon SG, Young M, Liu G, Darmstadt GL, Dickson KE. Treatment of neonatal infections: a multi-country analysis of health system bottlenecks and potential solutions. BMC Pregnancy Childbirth. 2015;15(S2):S6.

    PubMed  PubMed Central  Article  Google Scholar 

  52. 52.

    Kozuki N, Guenther T, Vaz L, Moran A, Soofi SB, Kayemba CN, Peterson SS, Bhutta ZA, Khanal S, Tielsch JM. A systematic review of community-to-facility neonatal referral completion rates in Africa and Asia. BMC Public Health. 2015;15(1):989.

    PubMed  PubMed Central  Article  Google Scholar 

  53. 53.

    Marsh AD, Muzigaba M, Diaz T, Requejo J, Jackson D, Chou D, Cresswell JA, Guthold R, Moran AC, Strong KL. Effective coverage measurement in maternal, newborn, child, and adolescent health and nutrition: progress, future prospects, and implications for quality health systems. Lancet Glob Health. 2020;8(5):e730–6.

    PubMed  PubMed Central  Article  Google Scholar 

  54. 54.

    Moxon SG, Guenther T, Gabrysch S, Enweronu-Laryea C, Ram PK, Niermeyer S, Kerber K, Tann CJ, Russell N, Kak L. Service readiness for inpatient care of small and sick newborns: what do we need and what can we measure now? J Glob Health. 2018;8(1):010702.

  55. 55.

    Hoque DME, Kumari V, Hoque M, Ruseckaite R, Romero L, Evans SM. Impact of clinical registries on quality of patient care and clinical outcomes: a systematic review. PLoS One. 2017;12(9):e0183667.

    PubMed  PubMed Central  Article  CAS  Google Scholar 

  56. 56.

    Pirkle CM, Dumont A, Zunzunegui M-V. Medical recordkeeping, essential but overlooked aspect of quality of care in resource-limited settings. Int J Qual Health Care. 2012;24(6):564–7.

    PubMed  Article  PubMed Central  Google Scholar 

  57. 57.

    Zegers M, de Bruijne MC, Spreeuwenberg P, Wagner C, Groenewegen PP, van der Wal G. Quality of patient record keeping: an indicator of the quality of care? BMJ Qual Saf. 2011;20(4):314–8.

    PubMed  Article  PubMed Central  Google Scholar 

  58. 58.

    Brock TP, Smith SR. Using digital videos displayed on personal digital assistants (PDAs) to enhance patient education in clinical settings. Int J Med Inform. 2007;76(11–12):829–35.

    PubMed  Article  PubMed Central  Google Scholar 

  59. 59.

    Asogwa BE. The challenge of managing electronic records in developing countries: implications for records managers in sub Saharan Africa. Rec Manag J. 2012;22(3):198–211.

    Google Scholar 

  60. 60.

    Iwhiwhu BE. Electronic records management in Africa: problems and prospects. In: Handbook of research on information communication technology policy: trends, issues and advancements. edn. Hershey: IGI Global; 2011. p. 161–85.

  61. 61.

    Barlam TF, Cosgrove SE, Abbo LM, MacDougall C, Schuetz AN, Septimus EJ, Srinivasan A, Dellit TH, Falck-Ytter YT, Fishman NO. Implementing an antibiotic stewardship program: guidelines by the Infectious Diseases Society of America and the Society for Healthcare Epidemiology of America. Clin Infect Dis. 2016;62(10):e51–77.

    PubMed  PubMed Central  Article  Google Scholar 

  62. 62.

    Llor C, Bjerrum L. Antimicrobial resistance: risk associated with antibiotic overuse and initiatives to reduce the problem. Ther Adv Drug Saf. 2014;5(6):229–41.

    PubMed  PubMed Central  Article  Google Scholar 

  63. 63.

    Darmstadt GL, Batra M, Zaidi AK. Parenteral antibiotics for the treatment of serious neonatal bacterial infections in developing country settings. Pediatr Infect Dis J. 2009;28(1):S37–42.

    PubMed  Article  PubMed Central  Google Scholar 

  64. 64.

    Schultz L, Lowe TJ, Srinivasan A, Neilson D, Pugliese G. Economic impact of redundant antimicrobial therapy in US hospitals. Infect Control Hosp Epidemiol. 2014;35(10):1229–35.

    PubMed  PubMed Central  Article  Google Scholar 

  65. 65.

    Shapiro E. Injudicious antibiotic use: an unforeseen consequence of the emphasis on patient satisfaction? Clin Ther. 2002;24(1):197–204.

    PubMed  Article  PubMed Central  Google Scholar 

  66. 66.

    Bauchner H, Pelton SI, Klein JO. Parents, physicians, and antibiotic use. Pediatrics. 1999;103(2):395–401.

    CAS  PubMed  Article  PubMed Central  Google Scholar 

  67. 67.

    Dellinger RP, Levy MM, Rhodes A, Annane D, Gerlach H, Opal SM, Sevransky JE, Sprung CL, Douglas IS, Jaeschke R. Surviving Sepsis campaign: international guidelines for management of severe sepsis and septic shock, 2012. Intensive Care Med. 2013;39(2):165–228.

    CAS  PubMed  PubMed Central  Article  Google Scholar 

  68. 68.

    National Institute of Population Research and Training (NIPORT), Associates for Community and Population Research (ACPR), ICF International: Bangladesh Health Facility Survey 2014. https://dhsprogram.com/pubs/pdf/SPA23/SPA23.pdf. Accessed 15 Sept 2020.

  69. 69.

    National Institute of Population Research and Training (NIPORT), Associates for Community and Population Research (ACPR), ICF International: Bangladesh Health Facility Survey 2017 Preliminary Report. http://rdm.icddrb.org/wp-content/uploads/2019/07/PR105.pdf. Accessed 15 Sept 2020.

  70. 70.

    Ministry of Health/Nepal, New ERA/Nepal, Nepal Health Sector Support Program - NHSSP/Nepal, ICF: Nepal Health Facility Survey 2015. 2017. http://dhsprogram.com/pubs/pdf/SPA24/SPA24.pdf. Accessed 15 Sept 2020.

  71. 71.

    Ruysen H, Rahman AE, Gordeev VS, Hossain T, Basnet O, Shirima K, Rahman QS, Zaman SB, Rana N, Salim N, et al. Electronic data collection for multi-country, hospital-based clinical observation of maternal and newborn care: experiences from the EN-BIRTH study. BMC Pregnancy Childbirth. 2020. https://doi.org/10.1186/s12884-020-03426-5.

  72. 72.

    Pullen I, Loudon J. Improving standards in clinical record-keeping. Adv Psychiatr Treat. 2006;12(4):280–6.

    Article  Google Scholar 

Download references

Acknowledgements

Firstly, and most importantly, we also thank the women, their families, the health workers and data collectors. We credit the inspiration of the late Godfrey Mbaruku. We thank Claudia DaSilva, Veronica Ulaya, Mohammad Raisul Islam, Sudip Karki and Rabina Sarki for their administrative support and Sabrina Jabeen, Goutom Banik, Md. Shahidul Alam, Tamatun Islam Tanha and Md. Mohsiur Rahman for support during data collectors training.

We acknowledge the following groups for guidance and support:

National Advisory Groups:

Bangladesh: Mohammod Shahidullah, Khaleda Islam, Md Jahurul Islam.

Nepal: Naresh P KC, Parashu Ram Shrestha.

Tanzania: Muhammad Bakari Kambi, Georgina Msemo, Asia Hussein, Talhiya Yahya, Claud Kumalija, Eliudi Eliakimu, Mary Azayo, Mary Drake, Honest Kimaro.

EN-BIRTH validation collaborative group:

Bangladesh: Md. Ayub Ali, Bilkish Biswas, Rajib Haider, Md. Abu Hasanuzzaman, Md. Amir Hossain, Ishrat Jahan, Rowshan Hosne Jahan, Jasmin Khan, M A Mannan, Tapas Mazumder, Md. Hafizur Rahman, Md. Ziaul Haque Shaikh, Aysha Siddika, Taslima Akter Sumi, Md. Taqbir Us Samad Talha.

Tanzania: Evelyne Assenga, Claudia Hanson, Edward Kija, Rodrick Kisenge, Karim Manji, Fatuma Manzi, Namala Mkopi, Mwifadhi Mrisho, Andrea Pembe.

Nepal: Jagat Jeevan Ghimire, Rejina Gurung, Elisha Joshi, Avinash K Sunny, Naresh P. KC, Nisha Rana, Shree Krishna Shrestha, Dela Singh, Parashu Ram Shrestha, Nishant Thakur.

LSHTM: Hannah Blencowe, Sarah G Moxon.

EN-BIRTH Expert Advisory Group: Agbessi Amouzou, Tariq Azim, Debra Jackson, Theopista John Kabuteni, Matthews Mathai, Jean-Pierre Monet, Allisyn C. Moran, Pavani K. Ram, Barbara Rawlins, Jennifer Requejo, Johan Ivar Sæbø, Florina Serbanescu, Lara Vaz.

We are also very grateful to fellow researchers who peer-reviewed this paper.

About this supplement

This article has been published as part of BMC Pregnancy and Childbirth Volume 21 Supplement 1, 2021: Every Newborn BIRTH multi-country validation study: informing measurement of coverage and quality of maternal and newborn care. The full contents of the supplement are available online at https://bmcpregnancychildbirth.biomedcentral.com/articles/supplements/volume-21-supplement-1.

Funding

The Children’s Investment Fund Foundation (CIFF) is the main funder of the EN-BIRTH study, which is administered via The London School of Hygiene & Tropical Medicine. The Swedish Research Council specifically funded the Nepal site through Lifeline Nepal and Golden Community. We acknowledge the core funders for all the partner institutions. Publication of this manuscript has been funded by CIFF. CIFF attended the study design workshop but had no role in data collection, analysis, data interpretation, report writing or decision to submit for publication. The corresponding author had full access to study data and final responsibility for publication submission decision.

Author information

Affiliations

Authors

Consortia

Contributions

The EN-BIRTH study overall was conceived by JEL, who acquired the funding and led the overall design. Each of the three-country research teams contributed to the development of all data collection tools, review processes, data collection and quality assurance. The iccdr,b team (notably SEA, AER, TT, TH, QSR, SBZ, SA) led the development of the software application, data dashboards and database development with VG and the LSHTM team. QSR was the main lead for data management working closely with LTD. IHI and MUHAS team coordinated work on barriers and enablers for data collection and used, working closely with LTD. For this paper, iccdr,b (AER, TT, SBZ, SA and SEA) led the development of the verification form for infection case management with EK (MUHAS) and JEL (LSHTM). AER and ATH led the analyses and developed the first draft of the manuscript as joint first authors working closely with JEL and SEA as joint senior authors. QSR, LTD, KP and AA provided support in the analysis. JK with SBZ and LTD led the qualitative objective. HC, TDH, PKR, SAQ, SK, HR and LTD reviewed and revised the manuscript. NS and AKC led the data collection in Tanzania and Nepal and contributed in contextualising the findings. All authors gave final approval of the version to be published and agree to be accountable for the work. This paper is published with permission from the Directors of Ifakara Health Institute, the Muhimbili University of Health and Allied Sciences, icddr,b and Golden Community. The EN-BIRTH study group authors made contributions to the conception, design, data collection or analysis or interpretation of data. The authors’ views are their own, and not necessarily from any of the institutions they represent, including U.S. Agency for International Development or the U.S. Government, WHO and UNICEF.

EN-BIRTH study group

Bangladesh: Ahmed Ehsanur Rahman, Tazeen Tahsina, Sojib Bin Zaman, Shafiqul Ameen, Abu Bakkar Siddique, Aniqa Tasnim Hossain, Tapas Mazumder, Jasmin Khan, Taqbir Us Samad Talha, Rajib Haider, Md. Hafizur Rahman, Anisuddin Ahmed, Tanvir Hossain, Qazi Sadeq-ur Rahman, Shams El Arifeen.

Nepal: Omkar Basnet, Avinash K Sunny, Nishant Thakur, Rejina Jurung, Anjani Kumar Jha, Bijay Jha, Ram Chandra Bastola, Rajendra Paudel, Asmita Paudel, Ashish KC.

Tanzania: Nahya Salim, Donat Shamba, Josephine Shabani, Kizito Shirima, Menna Narcis Tarimo, Godfrey Mbaruku (deceased), Honorati Masanja.

LSHTM: Louise T Day, Harriet Ruysen, Kimberly Peven, Vladimir Sergeevich Gordeev, Georgia R Gore-Langton, Dorothy Boggs, Stefanie Kong, Angela Baschieri, Simon Cousens, Joy E Lawn.

Corresponding author

Correspondence to Ahmed Ehsanur Rahman.

Ethics declarations

Ethics approval and consent to participate

This study was granted ethical approval by institutional review boards in all operating counties in addition to the London School of Hygiene & Tropical Medicine (Additional file 2).

Voluntary informed written consent was obtained from all women (primary caregivers of newborns treated for infection), who were assured of anonymity and confidentiality. All women were provided with a description of the study procedures in their preferred language before abstraction of data from hospital inpatient case notes and offered the right to refuse or withdraw consent at any time during the data collection process. Voluntary informed written consent was obtained from the respondents (health service providers and data collectors) for the qualitative interviews who were assured of anonymity and confidentiality.

EN-BIRTH is study number 4833, registered at https://www.researchregistry.com.

Consent for publication

Not applicable.

Competing interests

The authors declare that they have no competing interests.

Additional information

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Supplementary Information

Additional file 1.

EN-BIRTH study data collection dates by site and time elapsed between birth and exit survey.

Additional file 2.

Ethical approval of local institutional review boards, EN-BIRTH study.

Additional file 3.

STROBE Statement—Checklist of items that should be included in reports of observational studies.

Additional file 4.

EN-BIRTH study background characteristics of the mothers of the newborns, exit interview survey (n = 910 mothers).

Additional file 5.

Neonatal infection individual-level validation two-way tables, EN-BIRTH study, Neonatal infection dataset (n = 1015, stratified by site).

Additional file 6.

Neonatal infection indicator individual-level validation results, EN-BIRTH study, Neonatal infection dataset (n = 1015, stratified by site).

Rights and permissions

Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated in a credit line to the data.

Reprints and Permissions

About this article

Verify currency and authenticity via CrossMark

Cite this article

Rahman, A.E., Hossain, A.T., Zaman, S.B. et al. Antibiotic use for inpatient newborn care with suspected infection: EN-BIRTH multi-country validation study. BMC Pregnancy Childbirth 21, 229 (2021). https://doi.org/10.1186/s12884-020-03424-7

Download citation

Keywords

  • Newborn
  • Neonatal infections
  • Sepsis
  • Antibiotics
  • Coverage
  • Quality of care
  • Hospital records
  • Survey
  • Validity
  • Antimicrobial resistance
\