- Research article
- Open Access
- Open Peer Review
Predicting stillbirth in a low resource setting
BMC Pregnancy and Childbirth volume 16, Article number: 274 (2016)
Stillbirth is a major contributor to perinatal mortality and it is particularly common in low- and middle-income countries, where annually about three million stillbirths occur in the third trimester. This study aims to develop a prediction model for early detection of pregnancies at high risk of stillbirth.
This retrospective cohort study examined 6,573 pregnant women who delivered at Federal Medical Centre Bida, a tertiary level of healthcare in Nigeria from January 2010 to December 2013. Descriptive statistics were performed and missing data imputed. Multivariable logistic regression was applied to examine the associations between selected candidate predictors and stillbirth. Discrimination and calibration were used to assess the model’s performance. The prediction model was validated internally and over-optimism was corrected.
We developed a prediction model for stillbirth that comprised maternal comorbidity, place of residence, maternal occupation, parity, bleeding in pregnancy, and fetal presentation. As a secondary analysis, we extended the model by including fetal growth rate as a predictor, to examine how beneficial ultrasound parameters would be for the predictive performance of the model. After internal validation, both calibration and discriminative performance of both the basic and extended model were excellent (i.e. C-statistic basic model = 0.80 (95 % CI 0.78–0.83) and extended model = 0.82 (95 % CI 0.80–0.83)).
We developed a simple but informative prediction model for early detection of pregnancies with a high risk of stillbirth for early intervention in a low resource setting. Future research should focus on external validation of the performance of this promising model.
Stillbirth is a major but silent contributor to perinatal mortality , and about 3 million third-trimester stillbirths [2, 3] occur annually, mainly (98 %) in low- and middle-income countries (LMICs) . Despite several calls for action to reduce the rate of stillbirth [1, 4–8], stillbirths are yet to be addressed in the Global Burden of Disease metrics [9, 10], and Sustainable Development Goals . Given that neither vital registration nor national stillbirth registers are adequately provided in LMIC [2, 12], together with the frequent omission from records of stillbirths that occur after 22 and before 28 weeks of gestation , the stillbirth rate has been underestimated. Studies have examined the associations between stillbirths and clinical [14–19] and non-clinical characteristics [20–22] of pregnant women but the knowledge generated is yet to have any positive impact on intrauterine survival in LMIC . This indicates limited application of research findings to clinical settings, notably in low-resource settings, due to the inability of healthcare providers to combine these multiple predictors of stillbirth accurately to identify pregnancies with a high risk of stillbirth for early interventions [5, 6].
Therefore, it is important to develop an easy-to-apply clinical decision making tool for early detection of pregnancies with a high risk of stillbirth as recommended by experts in maternal and child health . To date, only few attempts have been made to develop a decision making tool for early detection of pregnancies with a high risk of stillbirth but these models cannot be applied to low-resource settings. For example a prediction model for both stillbirth and neonatal death was developed in the United Kingdom  and subsequently validated in the United Kingdom and the Netherlands [25, 26]. This model predicts a different outcome (stillbirth and neonatal death in very preterm babies) and availability of routine data to validate it would be a great challenge in low-resource settings. Likewise, the prediction model developed by Akolekar et al.  contains some parameters such as Maternal Serum Pregnancy-Associated Plasma Protein-A and Reversed A-Wave in Ductus Venosus, that are not routinely assessed in low resource settings . In this study we aimed to develop a prediction model to be applied in the second trimester of a pregnancy to identify pregnancies at high risk of stillbirth using routine clinical and non-clinical profiles of pregnant women who received care at a tertiary hospital in a low resource setting.
A retrospective cohort of 6,573 pregnant women that delivered at Federal Medical Centre Bida, a tertiary hospital in Niger state, Nigeria, from January 2010 to December 2013 was utilized to develop a prediction model for stillbirth. Only those women who delivered at the hospital after 20 completed weeks of gestation and gave birth to babies with no life-threatening congenital malformation were recruited.
Paper-based health records of all the included patients were retrieved from the Department of Health Information, Federal Medical Center Bida. Information was collected on clinical and non-clinical profile of the participants by the use of data extraction form in an anonymous format. Information on data extraction forms was transmitted to an electronic database using double data entry.
The outcome of the study was stillbirth, defined as fetal death that occurred after 20 completed weeks of gestation.
For prediction modelling, the following candidate predictors were considered: maternal age, parity (number of previous pregnancies carried beyond viability i.e. up to 28 weeks gestational age), maternal education (woman who can read and write), maternal occupation, ethnicity, place of residence, previous fetal loss (number of previous pregnancy losses), bleeding in pregnancy (whether the woman had any complaint of vaginal bleeding during the index pregnancy), maternal height, number of previous caesarean sections, maternal weight, multiple gestation, sex, fetal presentation (part of the fetus closest the pelvic inlet, was categorized as cephalic, breech, and others), fetal growth rate (birth weight divided by gestational age at birth), and number of comorbid conditions. The following medical conditions, diagnosed by a physician were considered to generate a number of comorbid conditions: hypertension (defined as blood pressure of 140/90 mmHg and above) , pre-eclampsia (presence of hypertension and proteinuria) , diabetes (Diabetes is defined as Fasting Blood Sugar (FBS) > 7 mmol/L or 2-h Blood Sugar (RBS) > 11.1 mmol/L; Impaired Glucose tolerance is defined as Fasting Blood Sugar (FBS) 6.1–6.9 mmol/L or 2-h Blood Sugar (RBS) > 7.8–11 mmol/L) , sickle cell disease (presence of HbSS, HbSC or HbS β-thalassemia), renal disease (presence of clinical features, ultrasound findings, and elevated serum urea and creatinine), thyroid disease (presence of clinical manifestations and elevated serum free thyroxine and triiodothyroxine concentration) , syphilis (diagnosed using Venereal Disease Research Laboratory test) and pelvic inflammatory disease. All candidate predictors were selected based on availability, clinical experience and medical literature.
Sample size calculation
We expected 2,000 deliveries per year and the incidence of stillbirth was assumed to be 4 % [30, 31]. Thus, 320 cases of stillbirths were expected to have occurred among 8,000 pregnant women who delivered at the hospital from 2010 to 2013. We planned to recruit all the 8,000 pregnant women who delivered at the hospital retrospectively. Given that at least 10 events to a potential predictor will be adequate to build a prediction model , we expected to have a sufficient number of events to build a robust prediction model.
Data were inspected and descriptive analyses performed using the complete dataset. Categorical data were described in terms of numbers and percentages while numerical data were expressed as median and interquartile range; the percentage of missing data in each potential predictor was determined.
All potential predictors were entered into a multivariable logistic regression model and significant predictors were identified using stepwise backward selection with the Akaike Information Criterion (AIC) stopping rule. Predictors that were consistently retained in the model were selected and entered into a multivariable logistic regression. The best model was identified based on AIC and the results from each imputed dataset were pooled using Rubin’s rule . Eventually, a prediction model for stillbirth was developed which we called the basic model. Subsequently, the basic model was extended with the variable fetal growth rate to become the extended model. The extended model was developed for those patients who had information on obstetric ultrasound, a procedure that is not routinely done in low-resource settings.
Performance of the model
The predictive performance of the final models was assessed by evaluating calibration and discrimination. Calibration determines the level of agreement between the observed events and model’s prediction and was presented by the calibration plot . Discrimination examines how well the model can differentiate between participants with or without event and was expressed as C-statistic (which is equivalent to the area under the receiver operator curve) .
A bootstrap re-sampling technique was applied to the whole data to generate 200 testing datasets. The original models were re-fitted in the testing datasets and their shrinkage factors were estimated.
The shrinkage factor was used to adjust for over-optimism in each of the original models and the adjusted regression coefficients were calculated. The predictive performance of the final models was then re-assessed. All analyses were performed in R statistical software package .
Of the 6,808 pregnant women who were recorded to have given birth in the delivery register; 6,573 (96.5 %) of them were recruited into this study based on the inclusion criteria as shown in Fig. 1. A total of 6,956 newborns were delivered, 443 of them were lifeless at birth meaning that six in 100 newborns delivered at this center were lifeless at birth. Table 1 shows the descriptive characteristics of the study population and percentage of missing data in each characteristic of the patients. The median age of women who delivered at the center was 27 years with an average parity of two. About two-thirds of the women had at least primary education; half of them were unemployed. The Nupe ethnic group accounted for 72 % of the women and they dwelled mainly in the urban areas (89 %). Almost 90 % of the babies delivered were singleton fetuses in cephalic presentation and 51 % were male. The median birth weight was 3.1 kg and the mean gestational age at birth was 39 weeks. Average percentage of missing data per potential predictor was 11 %. About 23 % of the women have co-existing medical conditions, 30 % of them were nulliparous while one quarter of them have had fetal loss (Additional file 1: Table S1).
Multivariable prediction model
The results of the multivariable prediction model for stillbirth (i.e. the basic model) are shown in Table 2. The final model comprised maternal comorbidity, place of residence, maternal occupation, parity, bleeding in pregnancy, and fetal presentation as independent predictors of stillbirth. For every morbid condition co-existing with pregnancy the likelihood of stillbirth increased. Being an unemployed, rural-dwelling woman with a positive history of bleeding in pregnancy increased risk of stillbirth. As parity increased risk of stillbirth increased. Pregnancies in cephalic presentation lowered the risk of stillbirth. Subsequently, the basic model was extended by the variable fetal growth rate and the results of the multivariable prediction model (i.e. the extended model) are shown in Table 3. All predictors in the extended model showed similar associations as observed in the basic model. For fetal growth rate, the likelihood of stillbirth decreased as growth rate increased.
Performance of the model
The discriminative performance of the final basic model was very good with a C-statistic of 0.80 (95 % CI 0.78–0.83). The extended model (i.e. with obstetric ultrasound variable growth rate added) showed a slightly improved discriminative performance of 0.82 (95 % CI 0.80–0.85). Calibration for both models was good (Figs. 2 and 3).
In this study we developed an easy to use clinical prediction model to identify pregnancies at high risk of stillbirth for timely interventions. We also extended this basic model with the variable fetal growth rate (fetal weight divided by gestational age) to see whether this not routinely measured variable (obstetric ultrasound) would improve predictions. This study was reported based on the TRIPOD (Transparent reporting of a multivariable prediction model for individual prognosis or diagnosis) guidelines  and to the best of our knowledge, these are the first prediction models for stillbirth that can easily be applied in the second trimester of pregnancy in low-resource settings where 98 % of third-trimester stillbirths occur . This study reaffirms stillbirth as an important public health issue; 6 in every 100 newborns delivered at the center were lifeless at birth, justifying the clinical relevance of an easy to use prediction model to detect high risk pregnancies at an early stage (i.e. the 2nd trimester). The basic prediction model comprised six easy-to-measure, readily available, inexpensive parameters, promoting its easy use during antenatal visits in low-resource settings. A previous model  included more predictors, but also used Pregnancy-Associated Plasma Protein-A and Reversed Flow of A-wave in Ductus Venosus that are not routinely measured in low-resource settings. Age restriction was not included in the eligibility criteria so as to broaden its application among pregnant women. A large cohort was used to develop the model to increase the power of the study and lower the possibility of overfitting. The predictive performance of the model in terms of discrimination and calibration was very good also after internal validation. As a secondary analysis we generated fetal growth rate using birth weight and gestational age at birth. This proxy predictor was included in the extended model (Table 3) instead of using ultrasound estimated fetal weight and gestational age, because up to 60 % of the women did not undergo obstetric ultrasound investigation during antenatal care due to various reasons. To acknowledge the importance of monitoring intrauterine growth restriction in stillbirth, fetal growth rate was included in the extended multivariable model. We preferred to generate fetal growth rate from birth weight and gestational weight at birth instead of using obstetric ultrasound information because based on our knowledge of these data some of the reasons why obstetric ultrasound was not done might be related to the outcome e.g. antenatal visit. Missing data was observed in some of our predictors and multiple imputation was applied to address it instead of performing a complete case analysis which may give biased results. Studies have shown repeatedly that multiple imputation reduces the possibility of bias in the estimates compared to complete case analysis [40–42]. It is important to emphasize that this prediction model has not undergone external validation, and this is planned to be done in a future study; but its predictive performance remained unchanged after internal validation. Experts have expressed the need to develop a prediction model for stillbirth because of its clinical importance . It allows for early detection of pregnancies at high risk of stillbirth for timely allocation of targeted interventions and to benefit from closer monitoring throughout the pregnancy. Prioritization of care allocation is particularly relevant in low resource settings. Interventions to improve neonatal, intrauterine and maternal survival have been identified and integrated as a continuum of care because they are related [5, 6]; thus, it is expected that this prediction model may not only improve prevention of stillbirth but may also have a positive collateral effect on maternal and neonatal survival.
We developed a simple but informative prediction model for early detection of pregnancies at high risk of stillbirth for timely intervention in low resource settings. It is important for future studies to conduct an external validation of this prediction model at all levels of care using prospectively collected data and include information on maternal HIV status.
Akaike information criterion
Fasting blood sugar
Low- and middle-income countries
Random blood sugar
Transparent reporting of a multivariable prediction model for individual prognosis or diagnosis
Scott J. Stillbirths: breaking the silence of a hidden grief. Lancet. 2011;377(9775):1386–8.
Cousens S, Blencowe H, Stanton C, Chou D, Ahmed S, Steinhardt L, Creanga AA, Tuncalp O, Balsara ZP, Gupta S, et al. National, regional, and worldwide estimates of stillbirth rates in 2009 with trends since 1995: a systematic analysis. Lancet. 2011;377(9774):1319–30.
Stanton C, Lawn JE, Rahman H, Wilczynska-Ketende K, Hill K. Stillbirth rates: delivering estimates in 190 countries. Lancet. 2006;367(9521):1487–94.
Mullan Z, Horton R. Bringing stillbirths out of the shadows. Lancet. 2011;377(9774):1291–2.
Bhutta ZA, Yakoob MY, Lawn JE, Rizvi A, Friberg IK, Weissman E, Buchmann E, Goldenberg RL. Stillbirths: what difference can we make and at what cost? Lancet. 2011;377(9776):1523–38.
Pattinson R, Kerber K, Buchmann E, Friberg IK, Belizan M, Lansky S, Weissman E, Mathai M, Rudan I, Walker N, et al. Stillbirths: how can health systems deliver for mothers and babies? Lancet. 2011;377(9777):1610–23.
Goldenberg RL, McClure EM, Bhutta ZA, Belizan JM, Reddy UM, Rubens CE, Mabeya H, Flenady V, Darmstadt GL. Stillbirths: the vision for 2020. Lancet. 2011;377(9779):1798–805.
de Bernis L, Kinney MV, Stones W, Ten Hoope-Bender P, Vivio D, Leisher SH, Bhutta ZA, Gulmezoglu M, Mathai M, Belizan JM, et al. Stillbirths: ending preventable deaths by 2030. Lancet. 2016;387(10019):703–16.
Lawn JE, Lee AC, Kinney M, Sibley L, Carlo WA, Paul VK, Pattinson R, Darmstadt GL. Two million intrapartum-related stillbirths and neonatal deaths: where, why, and what can be done? Int J Gynaecol Obstet. 2009;107 Suppl 1:S5–18. S19.
Jamison DT, Shahid-Salles SA, Jamison J, Lawn JE, Zupan J. Incorporating Deaths Near the Time of Birth into Estimates of the Global Burden of Disease. In: Lopez AD, Mathers CD, Ezzati M, Jamison DT, Murray CJL, editors. Global Burden of Disease and Risk Factors. Washington: The International Bank for Reconstruction and Development/The World Bank Group; 2006.
Sustainable Development Goals and targets. [https://sustainabledevelopment.un.org/sdgsproposal]. Accessed 9 Apr 2015.
Lawn JE, Blencowe H, Pattinson R, Cousens S, Kumar R, Ibiebele I, Gardosi J, Day LT, Stanton C. Stillbirths: Where? When? Why? How to make the data count? Lancet. 2011;377(9775):1448–63.
Froen JF, Gordijn SJ, Abdel-Aleem H, Bergsjo P, Betran A, Duke CW, Fauveau V, Flenady V, Hinderaker SG, Hofmeyr GJ, et al. Making stillbirths count, making numbers talk - issues in data collection for stillbirths. BMC Pregnancy Childbirth. 2009;9:58.
Singh T, Leslie K, Bhide A, D’Antonio F, Thilaganathan B. Role of second-trimester uterine artery Doppler in assessing stillbirth risk. Obstet Gynecol. 2012;119(2 Pt 1):256–61.
Smith GC, Stenhouse EJ, Crossley JA, Aitken DA, Cameron AD, Connor JM. Early pregnancy levels of pregnancy-associated plasma protein a and the risk of intrauterine growth restriction, premature birth, preeclampsia, and stillbirth. J Clin Endocrinol Metab. 2002;87(4):1762–7.
Smith GC, Shah I, White IR, Pell JP, Crossley JA, Dobbie R. Maternal and biochemical predictors of antepartum stillbirth among nulliparous women in relation to gestational age of fetal death. BJOG. 2007;114(6):705–14.
Odibo AO, Cahill AG, Odibo L, Roehl K, Macones GA. Prediction of intrauterine fetal death in small-for-gestational-age fetuses: impact of including ultrasound biometry in customized models. Ultrasound Obstet Gynecol. 2012;39(3):288–92.
Andrade LG, Amorim MM, Cunha AS, Leite SR, Vital SA. Factors associated with stillbirth in a school maternity in Pernambuco: a case control study. Rev Bras Ginecol Obstet. 2009;31(6):285–92.
Sharma PP, Salihu HM, Kirby RS. Stillbirth recurrence in a population of relatively low-risk mothers. Paediatr Perinat Epidemiol. 2007;21 Suppl 1:24–30.
Little RE, Weinberg CR. Risk factors for antepartum and intrapartum stillbirth. Am J Epidemiol. 1993;137(11):1177–89.
Romero Gutierrez G, Martinez Ceja CA, Ponce Ponce de Leon AL, Abrego Olvira E. Risk factors for stillbirth. Ginecol Obstet Mex. 2004;72:109–15.
Gardosi J, Madurasinghe V, Williams M, Malik A, Francis A. Maternal and fetal risk factors for stillbirth: population based study. BMJ. 2013;346:f108.
Cnattingius S, Stephansson O. The challenges of reducing risk factors for stillbirths. Lancet. 2011;377(9774):1294–5.
Draper ES, Manktelow B, Field DJ, James D. Prediction of survival for preterm births by weight and gestational age: retrospective population based study. BMJ. 1999;319(7217):1093–7.
Draper ES, Manktelow B, Field DJ, James D. Tables for predicting survival for preterm births are updated. BMJ. 2003;327(7419):872.
Schuit E, Hukkelhoven CW, Manktelow BN, Papatsonis DN, de Kleine MJ, Draper ES, Steyerberg EW, Vergouwe Y. Prognostic models for stillbirth and neonatal death in very preterm birth: a validation study. Pediatrics. 2012;129(1):e120–127.
Akolekar R, Bower S, Flack N, Bilardo CM, Nicolaides KH. Prediction of miscarriage and stillbirth at 11–13 weeks and the contribution of chorionic villus sampling. Prenat Diagn. 2011;31(1):38–45.
Agbola A. Textbook of Obstetrics and Gynaecology for Medical Students. 2nd ed. Ikeja: Heinemann Education Book (Nigeria) Plc. 2006.
Ballinger A, Patchett S. Clinical Medicine. 4th ed. London: Elsevier Limited. 1998.
Stillbirths. [http://www.who.int/reproductivehealth/topics/maternal_perinatal/stillbirth/en/]. Accessed 12 Apr 2015.
Mutihir JT, Eka PO. Stillbirths at the Jos University Teaching Hospital: incidence, risk, and etiological factors. Niger J Clin Pract. 2011;14(1):14–8.
Steyerberg EW. Clinical prediction models: a practical approach to development, validation and updating. New York: Springer; 2009.
de Goeij MC, van Diepen M, Jager KJ, Tripepi G, Zoccali C, Dekker FW. Multiple imputation: dealing with missing data. Nephrol Dial Transplant. 2013;28(10):2415–20.
Buuren S, Groothuis-Oudshoorn K. mice: Multivariate Imputation by Chained Equations in R. J Stat Softw. 2011;45(3):15–50.
Kenward MG, Carpenter J. Multiple imputation: current perspectives. Stat Methods Med Res. 2007;16(3):199–218.
Grobbee DE, Hoes AW. Clinical Epidemiology: Principles, Methods, and Applications for Clinical Research. New York: Jones and Bartlett Publishers; 2009.
Harrell Jr FE, Lee KL, Mark DB. Multivariable prognostic models: issues in developing models, evaluating assumptions and adequacy, and measuring and reducing errors. Stat Med. 1996;15(4):361–87.
R Development Core Team. R: A language and environment for statistical computing. Vienna: R Foundation for Statistical Computing; 2008. ISBN 3-900051-07-0, URL http://www.R-project.org.
Collins GS, Reitsma JB, Altman DG, Moons KG. Transparent reporting of a multivariable prediction model for individual prognosis or diagnosis (TRIPOD): the TRIPOD Statement. BMC Med. 2015;13:1.
Moons KG, Donders RA, Stijnen T, Harrell Jr FE. Using the outcome for imputation of missing predictor values was preferred. J Clin Epidemiol. 2006;59(10):1092–101.
Clark TG, Altman DG. Developing a prognostic model in the presence of missing data: an ovarian cancer case study. J Clin Epidemiol. 2003;56(1):28–37.
Knol MJ, Janssen KJ, Donders AR, Egberts AC, Heerdink ER, Grobbee DE, Moons KG, Geerlings MI. Unpredictable bias when using the missing indicator method or complete case analysis for missing confounder values: an empirical example. J Clin Epidemiol. 2010;63(7):728–36.
The authors appreciate Federal Medical Centre, Bida, Nigeria for permitting us to conduct this study. We express our gratitude to all the staff of the Department of Health Information for their support. We also gratefully acknowledge the financial support from the Netherlands Organization for Scientific Research / WOTRO Science for Development (Grant Number: 07.45.102.00) towards the completion of this study. Gbenga A Kayode is a recipient of a University Medical Center Utrecht Global Health Support Fellowship.
This study was funded by the Netherlands Organization for Scientific Research / WOTRO Science for Development (Grant Number: 07.45.102.00). The funder did not play any role in the design of the study and collection, analysis, and interpretation of data and in writing the manuscript.
Availability of data and materials
Based on the ethical approval obtained, the authors were not allowed to release the data to public domain. However, individuals can request for the data and it will be made available.
GAK, DEG, and KKG designed the study. GAK carried out data collection and literature review. JAHG and GAK performed data analysis; GAK drafted the first version of the manuscript. All authors (GAK, KKG, DEG, JAHG, ITA, EA, and MAC) reviewed and approved the final version of the manuscript.
The authors declare that they have no competing interests.
Consent for publication
Ethical approval and consent to participate
Ethical approval to conduct this research was obtained from the Ethical Review Committee of Federal Medical Centre Bida, Nigeria. Informed consent was obtained from the Head of Department of Obstetrics and Gynaecology before the study commenced.
About this article
Cite this article
Kayode, G.A., Grobbee, D.E., Amoakoh-Coleman, M. et al. Predicting stillbirth in a low resource setting. BMC Pregnancy Childbirth 16, 274 (2016). https://doi.org/10.1186/s12884-016-1061-2
- Low-resource setting