Skip to main content
  • Research article
  • Open access
  • Published:

Adaptation of the WHO maternal near miss tool for use in sub–Saharan Africa: an International Delphi study

Abstract

Background

Assessments of maternal near miss (MNM) are increasingly used in addition to those of maternal mortality measures. The World Health Organization (WHO) has introduced an MNM tool in 2009, but this tool was previously found to be of limited applicability in several low–resource settings. The aim of this study was to identify adaptations to enhance applicability of the WHO MNM tool in sub–Saharan Africa.

Methods

Using a Delphi consensus methodology, existing MNM tools were rated for applicability in sub-Saharan Africa over a series of three rounds. Maternal health experts from sub-Saharan Africa or with considerable knowledge of the context first rated importance of WHO MNM parameters using Likert scales, and were asked to suggest additional parameters. This was followed by two confirmation rounds. Parameters accepted by at least 70% of the panel members were accepted for use in the region.

Results

Of 58 experts who participated from study onset, 47 (81%) completed all three rounds. Out of the 25 WHO MNM parameters, all 11 clinical, four out of eight laboratory, and four out of six management–based parameters were accepted, while six parameters (PaO2/FiO2 < 200 mmHg, bilirubin >100 μmol/l or >6.0 mg/dl, pH <7.1, lactate >5 μmol/l, dialysis for acute renal failure and use of continuous vasoactive drugs) were deemed to not be applicable. An additional eight parameters (uterine rupture, sepsis/severe systemic infection, eclampsia, laparotomy other than caesarean section, pulmonary edema, severe malaria, severe complications of abortions and severe pre-eclampsia with ICU admission) were suggested for inclusion into an adapted sub-Saharan African MNM tool.

Conclusions

All WHO clinical criteria were accepted for use in the region. Only few of the laboratory- and management based were rated applicable. This study brought forward important suggestions for adaptations in the WHO MNM criteria to enhance its applicability in sub-Saharan Africa and possibly other low–resource settings.

Peer Review reports

Background

In light of the global reduction in maternal mortality, assessments of severe maternal morbidity or maternal near miss (MNM) have become more common [1,2,3]. MNM is defined as a woman who nearly died but survived a complication that occurred during pregnancy, childbirth, or within 42 days of termination of pregnancy [3]. Different identification criteria for severe maternal morbidity have been applied in different contexts [4,5,6]. Application of the World Health Organization (WHO) MNM tool has become a standardized method to identify women at the severe end of the morbidity spectrum. This tool comprises three groups of criteria with clinical, laboratory and management based parameters that focus on the presence of organ dysfunction [6].

Though the WHO MNM tool has been widely used since its introduction including in sub-Saharan Africa [7,8,9,10], it also received criticism since several laboratory-based and some management-based criteria reflecting organ dysfunction turned out to be of limited relevance in resource-limited settings in sub-Saharan Africa [11, 12]. The need for more practical MNM criteria for use in low–income settings was previously noted [13] and the WHO Technical Working Group on Maternal Mortality and Morbidity classifications has indicated that an integrative module applicable to the local context for use in resource limited settings is under development [14]. Researchers have suggested possible adaptations [11, 12, 15] at the expense of inter–study comparability.

Although there is evidence that several WHO MNM parameters are not applicable to low-income settings, there is a lack of well-founded alternative parameters formulated by experts with experience in such settings [11, 12, 15]. Lack of such uniform criteria prevents robust comparison studies of MNM. The aim of this study was to come to a consensus–based adaptation of the WHO MNM tool to enhance its applicability for use in low–income settings, particularly in sub–Saharan Africa.

Methods

We applied a three round Delphi study design. A Delphi is a structured group process in which a series of questionnaires is sent to a panel of experts who are asked to identify, rate or rank issues important to the subject under consideration [16]. It is a means of extracting opinion from a group of experts and is widely applied in medical, nursing and health services research [17,18,19,20,21,22,23,24]. We adopted a quasi–anonymous Delphi, in which each panel member was aware of the other participating members, but responses were kept anonymous and presented on a group level. In our opinion, it was important for members to be informed about the composition of the group in order to assign appropriate value to the panel. In every subsequent round, group responses were reported and instructions for completion of that round were provided. Questionnaire development, pre-testing, analysis and coordination were conducted by AKT and SJG. A Delphi steering committee consisting of all authors (AKT, SAS, JS, JZ, JvR, TvdA, and SJG) was established to coordinate the Delphi process, analyse comments and determine a priori criteria for consensus and termination of the study.

Selection and recruitment panel of experts

Expert panel members were selected if they authored an article on maternal near miss in sub-Saharan Africa [25] or if they were suggested by already selected authors. All experts were approached through email by introducing purpose of the study, its design, and a request to participate in the expert panel. We aimed to obtain wide coverage of experts with experience throughout sub-Saharan Africa and therefore no further selection was done after agreement for participation. After agreeing to participate, they were included in the first round and invited for subsequent rounds only if they completed the former round.

The Delphi procedure

Questionnaires were developed using LimeSurvey version 2.05+ (www.limesurvey.org) and sent with a unique, token secured link to participants using email. Three rounds of sequential online Delphi surveys were administered. Each round of Delphi was conducted over a three-week period with 2 to 3 months between rounds for analysis, questionnaire refinement and pilot testing. Email reminders were sent for non-respondents approximately after 10 days followed by an additional two reminders. Members of the steering committee (JS, JZ, TvdA and JvR) did take part as experts within the survey.

We used the 2009 MNM tool that consisted of 25 parameters, as well as an additional 12 parameters from the literature [4,5,6, 11, 26] in round 1 (Table 1). For each parameter, participants were asked to indicate their level of agreement on a 5-point Likert scale (ranging from 1 = least important to 5 = most important) as to whether that parameter would be important for identification of MNM in sub-Saharan Africa. A free-text field was also provided, inviting panel members to suggest additional parameters to be considered as criteria for MNM. Sociodemographic characteristics, professional background, country of work and experience of participants in sub-Saharan Africa were collected in round 1which was conducted in October 2015.

Table 1 List of parameters presented for evaluation and suggested in the study

In round 2, which was conducted in December 2015, we grouped parameters from round 1 in to accepted, maybe accepted and rejected based on their median score of 5, 4, and ≤3 respectively. A fourth group of suggested parameters was also constructed from parameters suggested for inclusion by participants in round 1. These were presented to the panel for verification of the groups using a yes-no question. Consensus for inclusion of an item for use in an adapted ‘sub-Saharan MNM tool’ was defined a priori as at least 70% agreement. Level of agreement of at least 70% was used in several Delphi studies as level consensus [17, 18]. A parameter that failed to receive at least 60% would be excluded. Parameters with rates of agreement between 60% and 70% were brought back for voting again in round 3. We asked the panel to indicate for every accepted parameter which definitions or cut off values should be considered by providing drafts of definitions and suggested cut-off points.

In round 3, conducted in May 2016, we included all parameters for which consensus was not reached for final voting. A list of parameters which reached consensus for inclusion or exclusion were also presented for their information only. The cut-off point for inclusion remained 70%. All responses were analysed using SPSS version 23.

Results

Participants

Of 102 experts invited for participation, 58 (56.9%) agreed to participate. Fifty two out of 58 (89.7%) completed round 1, 50/52 (96.2%) round 2, and 47/49 (95.9%) all three rounds. One participant opted out from participation after round 2 due to internet connection problems. Twenty–two countries were represented by the expert panel, the majority from sub–Sahara Africa: one each from Belgium, Benin, Ghana, Kenya, Malawi, Mozambique, Norway, Rwanda, Sudan, Switzerland and United States of America; two from Italy; three each from Burkina Faso, Sweden, Uganda and United Kingdom; four each from Brazil, Ethiopia, Nigeria, South Africa, and Tanzania; and seven from the Netherlands where the study was initiated.

Most experts were male (n = 40; 76.9%), obstetricians (n = 40; 76.9%), and had a PhD degree (n = 28; 53.8%). The majority (44; 84.6%) had more than 5 years of experience within their current position and 34 (65.4%) had five or more years of work experience in sub-Saharan African settings. Four were members of the WHO working group on Maternal Mortality and Morbidity classifications who developed the WHO 2009 MNM tool [3, 6].

First round

Of the 37 parameters presented for evaluation, 21(56.8%) were rated as ‘very important’ (16 of 25 WHO parameters and 5 of 12 literature-based parameters). Twelve (6 of 25 WHO and 6 of 12 literature-based parameters) were rated as ‘may be important’ while 4 parameters (3 of 25 WHO, 1 of 12 literature-based) were rated as ‘unimportant’. Cardiac arrest, shock, loss of consciousness lasting more than 12 h and haemorrhage or infection leading to hysterectomy achieved greatest consensus with >80% of experts rating these as ‘very important’. Contrastingly, PaO2/FiO2 < 200 mmHg, lactate >5 mEq/ml, pH <7.1 and uterine artery embolization received very low rates of agreement (<22%) for use in the region. Specific levels of agreement for each parameter in round 1 are shown in Fig. 1. Several additional parameters (n = 31) were suggested for consideration by 19 panel members. All suggested parameters were collected by two authors (AKT and SJG) and presented to the steering committee for discussion. Parameters were discussed for their importance and were combined in case of overlap. Following the discussion among the Delphi steering committee, 14 parameters were summarized and reported back to the experts as ‘suggested parameters’ in round 2.

Fig. 1
figure 1

Level of agreement for using selected MNM parameters in sub–Saharan Africa (round 1)

Second and third rounds

In round 2, consensus was reached to include 26 parameters (18 from WHO, 6 from the literature and two from suggested parameters. For accepted parameters, consensus ranged from 100% for shock and cardiac arrest to 71.7% for severe pre–eclampsia with ICU admission. In this round, 15 other parameters were voted to be excluded. This includes four parameters from WHO (PaO2/FiO2 < 200 mmHg, pH <7.1, bilirubin >100 μmol/l or >6.0 mg/dl, and lactate >5 mEq/ml), two from the literature based (obstructed labour and interventional radiology), and nine from the suggested parameters (Tables 2 and 3). Among rejected parameters consensus rates for inclusion of the MNM tool ranged from 6.5% for uterine artery embolization to 54.3% for obstructed labour. For 10 parameters, consensus was not reached for inclusion or exclusion. There was also no consensus on cut–off points for number of units of blood transfused to the mother as a proxy for major obstetric haemorrhage. The 10 parameters and suggested cut-off points for blood transfusion were therefore reported again in round 3 for rating.

Table 2 Rate of agreement on inclusion of selected MNM parameters for use in sub-Saharan Africa
Table 3 Suggested parameters and respective decisions in round 2 and round 3

In round 3, only one parameter (acute thrombocytopenia, platelets <50,000/ml) was accepted with a level of agreement of 72.3%. Nine parameters including dialysis for acute renal failure and use of continuous vasoactive drugs from the WHO parameters were excluded. Other literature based parameters: admission to the intensive care unit, diabetic ketoacidosis, severe anaemia and severe HIV related illness were also rejected. Detailed level of agreement, the Delphi rounds and corresponding decisions is shown in Tables 2 and 3.

Adapted sub-Saharan Africa MNM tool

At the end of this Delphi exercise, 27 MNM parameters were accepted for use in sub-Saharan Africa. This includes 19 parameters from WHO 2009 parameters (11 out of 11 clinical, four out of eight laboratory-based, and four out of six management-based criteria). Additionally, eight parameters were accepted for MNM criteria in the region (six out of 12 literature based criteria and two from suggested parameters). These include seven clinical (eclampsia, pulmonary edema, ruptured uterus, severe complications of abortion, severe malaria sepsis/severe systemic infection and severe pre-eclampsia with ICU admission) and one management-based (laparotomy other than caesarean section) parameters. Consensus was reached on working definitions and cut-off values for the majority of the newly added parameters while the existing WHO definition was taken up for original parameters. Consensus was not reached for the number of units of blood to constitute MNM due to haemorrhage. Eighteen (38.3%) experts suggested basing the need for blood transfusion, followed by 16(34%) and 14(29.8%) who opted using five and two units of blood transfusion respectively. The final set of ‘sub-Saharan Africa MNM Tool’ parameters with their respective definitions is shown in Table 4.

Table 4 Adapted sub-Saharan Africa MNM tool

Discussion

To the best of our knowledge, this is the first study bringing together the opinions of a large group of experts concerning the construction of a feasible set of MNM criteria for use in low resource sub–Saharan African settings. The majority of the WHO MNM tool parameters were rated feasible for use in sub-Saharan Africa. On the other hand, our Delphi experts rated several laboratory and management-based parameters not to be feasible. On several clinical criteria, initially not included in the WHO MNM tool, consensus was reached and these are suggested to be added. Hence, we provided a framework of an adapted MNM tool with 27 parameters for use in sub-Saharan Africa.

We followed the structure of the existing WHO MNM tool to suggest inclusion or exclusion of parameters [6]. The adapted MNM parameters have the potential to serve as uniform adaptations and enable inter-study comparisons in the future. We followed recommended Delphi practices: reproducible participant criteria, a priori defined level of consensus for inclusion and exclusion of parameters, and a planned number of rounds [27, 28].

A majority of the WHO 2009 MNM parameters in general and the clinical criteria in particular were found to be acceptable criteria for use in sub-Saharan Africa. These results are in line with adaptations suggested in Rwanda [15], Tanzania [11], and Malawi [12].

Our results also favour inclusion of several clinical criteria, which were not part of the 2009 WHO MNM parameters. Such parameters were previously part of the recommendations by researchers who tried application of the tool in low-income settings [11, 12, 15]. Out of these eclampsia, ruptured uterus, and sepsis/severe systemic infection are classified as ‘potentially life threatening complications’ of pregnancy by WHO [3, 6]. Inclusion of these potentially life threatening complications as additional parameters for MNM is supported by a recent study in maternity units in Latin America indicating that the likelihood of developing severe maternal outcomes (MNM & MD) was high among cases with many these potentially life threatening complications [29]. A study from Malawi and other African countries that reported that these ‘potentially life threatening complications’ have high case fatality rates [30, 31].

In this study, only few of the laboratory- and management-based parameters were accepted into the sub-African MNM Tool. The use of laboratory, and management-based parameters in low-income settings is more problematic due to lack of laboratory facilities and qualified health staffs in many settings [11, 12, 15].

Consensus was not reached regarding the number of units of blood for transfusion as a criterion for major obstetric haemorrhage. In our opinion it is slightly alarming that more than one in three (34%) panel members suggested that postpartum haemorrhage does not become life threatening in sub-Saharan Africa until five units of blood are administered, given the serious lack of blood for transfusion. In many district hospitals, it is very rare to have five units of blood available for transfusion. This renders a definition of MNM based on a number of transfusions highly problematic [32]. Although we tried to overcome this by providing an option based on the need for blood transfusion had it been available, no consensus was achieved. We strongly feel that a criterion of five units would underestimate the magnitude of MNM in the region. Hence, from a pragmatic point of view, we suggest the use of at least two units of blood as a cut–off, taking into account lack of blood for transfusion in the region. A cut-off of two units was found effective previously [11, 12].

This study involved participation of international maternal health experts, including experts involved in the development of the 2009 WHO MNM tool, from 22 countries with considerable expertise in sub-Saharan Africa. The views of included experts expressed here, however, may differ from those who declined or did not participate and outcomes do not necessarily represent the views of individual participants. Most of our expert panel members were male obstetricians, which is a reflection of the experts working in sub-Saharan Africa. We do not expect that another composition of the experts based on gender or professional background would influence the results. The use of the online system prevented bias towards strong voice [23, 28]. Participation was entirely voluntary, and all panel members were given the opportunity to withdraw from the survey at any stage.

Findings were limited by lack of arranging consultative meetings for parameters which were still undetermined in round 3. Consultative meetings were found to be effective in solving issues related to equivocal findings in other studies [17]. Arranging consultative meeting or video-conference was impossible due to financial and technological restrictions.

Conclusion

A majority of WHO MNM parameters were rated to be feasible for use in sub-Saharan Africa. Although the WHO MNM tool aims to enable comparisons between settings, and context-based adjustments of the tool may hamper inter–study comparability [6, 33], we feel that this aim becomes irrelevant unless the WHO tool is adjusted for use in low–resource settings where most MNM occurs [13]. In order to increase comparability of future studies, we recommend that researchers apply these adapted criteria for case selection. There is a need to assess specificity, sensitivity, and predictive value of the adapted tool compared to the WHO tool for use in sub-Saharan Africa or other low income settings [12, 34]. We hope that our results may be taken into account by WHO in their valued advocacy for studies into MNM, including comparisons. In addition, our results may feed into the Core Outcomes in Women’s and Newborn Health Initiative (CROWN) [35] and our adapted tool may promote standardized outcome reporting in low-resource settings.

Abbreviations

CS:

Caesarean section

ICU:

Intensive care unit

MNM:

Maternal near miss

PPH:

Postpartum hemorrhage

WHO:

World Health Organization

References

  1. World Health Organization. Beyond the numbers: reviewing maternal deaths and complications to make pregnancy safer. Geneva: World Health Organization; 2004.

    Google Scholar 

  2. Firoz T, Chou D, von Dadelszen P, Agrawal P, Vanderkruik R, Tuncalp O, et al. Measuring maternal health: focus on maternal morbidity. Bull World Health Organ. 2013;91(10):794–6.

    Article  PubMed  PubMed Central  Google Scholar 

  3. World Health Organization. Evaluating the quality of Care for Severe Pregnancy Complications: the who near-miss approach for maternal health. Geneva: World Health Organization; 2011.

    Google Scholar 

  4. Mantel GD, Buchmann E, Rees H, Pattinson RC. Severe acute maternal morbidity: a pilot study of a definition for a near-miss. Br J Obstet Gynaecol. 1998;105(9):985–90.

    Article  CAS  PubMed  Google Scholar 

  5. Waterstone M, Bewley S, Wolfe C. Incidence and predictors of severe obstetric morbidity: case-control study. BMJ. 2001;322(7294):1089–93. discussion 1093-4

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  6. Say L, Souza JP, Pattinson RC. WHO working group on maternal mortality and morbidity classifications. Maternal near miss--towards a standard tool for monitoring quality of maternal health care. Best Pract Res Clin Obstet Gynaecol. 2009;23(3):287–96.

    Article  PubMed  Google Scholar 

  7. Nelissen EJ, Mduma E, Ersdal HL, Evjen-Olsen B, van Roosmalen JJ, Stekelenburg J. Maternal near miss and mortality in a rural referral hospital in northern Tanzania: a cross-sectional study. BMC Pregnancy Childbirth. 2013;13:141.

    Article  PubMed  PubMed Central  Google Scholar 

  8. Litorp H, Kidanto HL, Roost M, Abeid M, Nystrom L, Essen B. Maternal near-miss and death and their association with caesarean section complications: a cross-sectional study at a university hospital and a regional hospital in Tanzania. BMC Pregnancy Childbirth. 2014;14:244-2393-14-244.

    Article  Google Scholar 

  9. Rulisa S, Umuziranenge I, Small M, van Roosmalen J. Maternal near miss and mortality in a tertiary care hospital in Rwanda. BMC Pregnancy Childbirth. 2015;15:203-015-0619-8.

    Article  Google Scholar 

  10. Oladapo O, Adetoro O, Ekele B, Chama C, Etuk S, Aboyeji A, et al. When getting there is not enough: a nationwide cross-sectional study of 998 maternal deaths and 1451 near-misses in public tertiary hospitals in a low-income country. BJOG Int J Obstet Gynaecol. 2016;123(6):928–38.

    Article  CAS  Google Scholar 

  11. Nelissen E, Mduma E, Broerse J, Ersdal H, Evjen-Olsen B, van Roosmalen J, et al. Applicability of the WHO maternal near miss criteria in a low-resource setting. PLoS One. 2013;8(4):e61248.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  12. van den Akker T, Beltman J, Leyten J, Mwagomba B, Meguid T, Stekelenburg J, et al. The WHO maternal near miss approach: consequences at Malawian District level. PLoS One. 2013;8(1):e54805.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  13. Spector J. Practical criteria for maternal near miss needed for low-income settings. Lancet 2013;382(9891):504-505.

  14. Souza JP, Say L, Gulmezoglu M. Practical criteria for maternal near miss needed for low-income settings - Authors' reply. Lancet. 2013;382(9891):505–6736(13)61711-0.

    Article  PubMed  Google Scholar 

  15. Kalisa R, Rulisa S, van den Akker T, van Roosmalen J. Maternal near miss and quality of care in a rural Rwandan hospital. BMC Pregnancy and Childbirth. 2016;16:324.

    Article  PubMed  PubMed Central  Google Scholar 

  16. Hsu C, Sandford BA. The Delphi technique: making sense of consensus. Practical assessment, research & evaluation. 2007;12(10):1–8.

    Google Scholar 

  17. Al Wattar B, Tamilselvan K, Khan R, Kelso A, Sinha A, Pirie A, et al. Development of a CORE outcome set for epilepsy in pregnancy (E-CORE): a national multi-stakeholder modified Delphi consensus study. BJOG Int J Obstet Gynaecol. 2017;124(4):661–7.

    Article  CAS  Google Scholar 

  18. Gordijn SJ, Beune IM, Thilaganathan B, Papageorghiou A, Baschat AA, Baker PN, et al. Consensus definition of fetal growth restriction: a Delphi procedure. Ultrasound Obstet Gynecol. 2016;48(3):333–9.

    Article  CAS  PubMed  Google Scholar 

  19. van ‘t Hooft J, Duffy JM, Daly M, Williamson PR, Meher S, Thom E, et al. A Core outcome set for evaluation of interventions to prevent preterm birth. Obstet Gynecol. 2016;127(1):49–58.

    Article  PubMed  Google Scholar 

  20. Rogozinska E, D'Amico MI, Khan KS, Cecatti JG, Teede H, Yeo S, et al. Development of composite outcomes for individual patient data (IPD) meta-analysis on the effects of diet and lifestyle in pregnancy: a Delphi survey. BJOG. 2016;123(2):190–8.

    Article  CAS  PubMed  Google Scholar 

  21. Keeney S, Hasson F, McKenna H. The Delphi technique in nursing and health research. John Wiley & Sons; 2010. doi:10.1002/9781444392029.

  22. Asselin M, Harper M. Revisiting the Delphi technique: implications for nursing professional development. J Nurses Prof Dev. 2014;30(1):11–5.

    Article  PubMed  Google Scholar 

  23. Kennedy HP. Enhancing Delphi research: methods and results. J Adv Nurs. 2004;45(5):504–11.

    Article  PubMed  Google Scholar 

  24. Wielenga JM, Tume LN, Latour JM, van den Hoogen A. European neonatal intensive care nursing research priorities: an e-Delphi study. Arch Dis Child Fetal Neonatal Ed. 2015;100(1):F66–71.

    Article  PubMed  Google Scholar 

  25. Tura, AK. Gebrehiwo,Y. Zwart,JJ. van Roosmalen, J. Stekelenburg,J. Scherjon,S. Systematic review of severe acute maternal morbidity (near miss) in sub-Saharan Africa: implications for the post-millennium development goals era. 2015; Available at: http://www.crd.york.ac.uk/PROSPERO/display_record.asp?ID=CRD42015023883.

  26. Filippi V, Ronsmans C, Gohou V, Goufodji S, Lardi M, Sahel A, et al. Maternity wards or emergency obstetric rooms? Incidence of near-miss events in African hospitals. Acta Obstet Gynecol Scand. 2005;84(1):11–6.

    Article  PubMed  Google Scholar 

  27. Diamond IR, Grant RC, Feldman BM, Pencharz PB, Ling SC, Moore AM, et al. Defining consensus: a systematic review recommends methodologic criteria for reporting of Delphi studies. J Clin Epidemiol. 2014;67(4):401–9.

    Article  PubMed  Google Scholar 

  28. Okoli C, Pawlowski SD. The Delphi method as a research tool: an example, design considerations and applications. Information & Management. 2004;42(1):15–29.

    Article  Google Scholar 

  29. De Mucio B, Abalos E, Cuesta C, Carroli G, Serruya S, Giordano D, et al. Maternal near miss and predictive ability of potentially life-threatening conditions at selected maternity hospitals in Latin America. Reprod Health. 2016;13(1):134.

    Article  PubMed  PubMed Central  Google Scholar 

  30. van den Akker T, van Rhenen J, Mwagomba B, Lommerse K, Vinkhumbo S, van Roosmalen J. Reduction of severe acute maternal morbidity and maternal mortality in Thyolo District, Malawi: the impact of obstetric audit. PLoS One. 2011;6(6):e20776.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  31. Strand RT, Tumba P, Niekowal J, Bergstrom S. Audit of cases with uterine rupture: a process indicator of quality of obstetric care in Angola. Afr J Reprod Health. 2010;14(2):55–62.

    CAS  PubMed  Google Scholar 

  32. Bates I, Chapotera GK, McKew S, van den Broek N. Maternal mortality in sub-Saharan Africa: the contribution of ineffective blood transfusion services. BJOG. 2008;115(11):1331–9.

    Article  CAS  PubMed  Google Scholar 

  33. Lobato G, Nakamura-Pereira M, Mendes-Silva W, Dias MA, Reichenheim ME. Comparing different diagnostic approaches to severe maternal morbidity and near-miss: a pilot study in a Brazilian tertiary hospital. Eur J Obstet Gynecol Reprod Biol. 2013;167(1):24–8.

    Article  PubMed  Google Scholar 

  34. Witteveen T, Bezstarosti H, de Koning I, Nelissen E, Bloemenkamp KW, van Roosmalen J, et al. Validating the WHO maternal near miss tool: comparing high- and low-resource settings. BMC Pregnancy Childbirth. 2017;17(1):194. -017-1370-0

    Article  PubMed  PubMed Central  Google Scholar 

  35. Khan K. Chief editors of journals participating in the CROWN initiative (appendix 1). The CROWN initiative: journal editors invite researchers to develop core outcomes in women's health. BJOG. 2016;123(Suppl 3):103–4.

    Article  PubMed  Google Scholar 

Download references

Acknowledgments

We thank the Netherlands Organization for International Cooperation in Higher Education (Nuffic) for funding this study in the form of a PhD grant. We would like to thank all experts who participated in this Delphi exercise (Adefris M, Gondar, Ethiopia; Adu-Bonsaffoh K, Accra, Ghana; Alnaes-Katjavivi P, Oslo, Norway; Ameh CA, Liverpool, UK; Berhane G, Korem, Ethiopia; Cavaliere E,Verona, Italy; Cecatti CJ, Campinas, Brazil; Chama C, Maiduguri, Nigeria; Compaore GD, Bobo-Dioulasso, Burkina Faso; De Brouwere V, Antwerp, Belgium; Essen B, Uppsala, Sweden; Etuk SJ, Calabar, Nigeria; Filippi V, London, UK; Ganaba R, Bobo-Dioulasso, Burkina Faso; Gessessew A, Mekele, Ethiopia; Getachew A, Malawi; Goufodji S, Cotonou, Benin; Gurgel RQ, Sergipe, Brazil; Haddad SM, Campinas, Brazil; Heitkamp A, Cape Town, South Africa; Kaye DK, Kampala, Uganda; Kidanto HL, Dar es Salaam, Tanzania; Knight M, Oxford, UK; Litorp H, Uppsala, Sweden; Lule J, Kampala, Uganda; Mantel G, Zwolle, the Netherlands; Meguid T, Zanzibar, Tanzania; Mohammadi S, Uppsala, Sweden; Nyamtema A, Ifakara, Tanzania; Okong P, Kampala, Uganda; Oladapo OT, Geneva, Switzerland; Osman N, Maputo, Mozambique; Pattinson RC, Pretoria, South Africa; Qureshi Z, Nairobi, Kenya; Rulisa S, Kigali, Rwanda; Soma-Pillay P, Pretoria, South Africa; Sombie I, Obo-Dioulasso, Burkina Faso; Souza JP, Geneva, Switzerland; Spector J, Boston, USA; Stekelenburg J, Leeuwarden, the Netherlands; Sule-odu AO, Sagamu, Nigeria; Theron G, Cape Town, South Africa; van den Akker T, Leiden, the Netherlands; van Raaij F, MST, the Netherlands; van Roosmalen J, Amsterdam, the Netherlands; Versluis M, Groningen, the Netherlands; Zwart JJ, Deventer, the Netherlands).

Funding

AKT received funding from the Netherlands Organisation for International Cooperation in Higher Education (NUFFIC) in the form of PhD grant in University of Groningen, University Medical Centre Groningen, the Netherlands. The funding organization has no role in the design, execution or decision to publish the manuscript.

Availability of data and materials

All data used for conclusion in this study are included in this article. Additional data are available from the corresponding author on reasonable request.

Authors’ contribution

AKT, SAS, and JS conceived the study. AKT and SJG developed the questionnaire, collected data and analysed the data with continuous input from JS, SAS, TvdA, JvR, and JZ. AKT drafted a manuscript, which was revised by JS, SAS, JZ, TvdA, JvR, and SJG. All authors approved the final version for submission.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Abera K. Tura.

Ethics declarations

Ethics approval and consent to participate

This study was conducted as part of a PhD study on maternal near miss and maternal mortality in Ethiopia which was approved by the institutional health research ethics review committee of Haramaya University in Ethiopia (Ref No: C/A/R/D/01/1681/16). This study does not include any patient-related or otherwise sensitive information. Informed consent was requested from all experts and completing online questionnaire was considered as consent to participation.

Consent for publication

Not applicable

Competing interests

JvR is section editor for BMC Pregnancy and Childbirth. The authors declare that they have no competing interests.

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Open Access This article is distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Tura, A.K., Stekelenburg, J., Scherjon, S.A. et al. Adaptation of the WHO maternal near miss tool for use in sub–Saharan Africa: an International Delphi study. BMC Pregnancy Childbirth 17, 445 (2017). https://doi.org/10.1186/s12884-017-1640-x

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/s12884-017-1640-x

Keywords