- Research article
- Open Access
- Open Peer Review
Systematic review of effect of community-level interventions to reduce maternal mortality
BMC Pregnancy and Childbirth volume 9, Article number: 2 (2009)
The objective was to provide a systematic review of the effectiveness of community-level interventions to reduce maternal mortality.
We searched published papers using Medline, Embase, Cochrane library, CINAHL, BNI, CAB ABSTRACTS, IBSS, Web of Science, LILACS and African Index Medicus from inception or at least 1982 to June 2006; searched unpublished works using National Research Register website, metaRegister and the WHO International Trial Registry portal. We hand searched major references.
Selection criteria were maternity or childbearing age women, comparative study designs with concurrent controls, community-level interventions and maternal death as an outcome. We carried out study selection, data abstraction and quality assessment independently in duplicate.
We found five cluster randomised controlled trials (RCT) and eight cohort studies of community-level interventions. We summarised results as odds ratios (OR) and confidence intervals (CI), combined using the Peto method for meta-analysis. Two high quality cluster RCTs, aimed at improving perinatal care practices, showed a reduction in maternal mortality reaching statistical significance (OR 0.62, 95% CI 0.39 to 0.98). Three equivalence RCTs of minimal goal-oriented versus usual antenatal care showed no difference in maternal mortality (1.09, 95% CI 0.53 to 2.25). The cohort studies were of low quality and did not contribute further evidence.
Community-level interventions of improved perinatal care practices can bring about a reduction in maternal mortality. This challenges the view that investment in such interventions is not worthwhile. Programmes to improve maternal mortality should be evaluated using randomised controlled techniques to generate further evidence.
There are 529,000 maternal deaths each year, 99.6% of these in developing countries  where health care provision is rudimentary. The lifetime risk of maternal death was estimated in 2000 as 1 woman in 16 in sub-Saharan Africa and 1 in 46 in south-central Asia, compared to 1 in 2800 in developed regions . Most maternal deaths are preventable. Despite numerous initiatives by governments, WHO, UNICEF, UNFPA, World Bank and others, and a Millennium Development Goal (MDG 5) to reduce maternal mortality by three-quarters by 2015, there has been little improvement . In some areas mortality has worsened . Whether intervention programmes have been simple or complex, few have robustly assessed their effect on maternal deaths. Indeed, some authors have advocated that due to the large population sizes needed and the difficulty in obtaining reliable data, maternal mortality is an unsuitable indicator for assessing safe motherhood initiatives .
Meeting MDG 5 is likely to need a combination of strategies, including those at community-level, utilizing best evidence on antenatal, intrapartum and postpartum care. Complete access to facility based obstetric care may be best practice  but is likely to be many years away and even then will not be acceptable or accessible to all [6, 7]. It is plausible that community-level interventions could improve outcomes by increasing the standard of out-of-facility care through training or education, or by improving care-seeking behaviour and access to facility level care. However, opinions diverge as to whether investment in community-level interventions is worthwhile [5, 8]. We undertook a systematic review to assess the effectiveness of community-level interventions to reduce maternal mortality.
We searched the following electronic databases: MEDLINE, EMBASE, CINAHL, BNI, CAB ABSTRACTS, IBSS, Cochrane (Central, DARE and NHS EED and Systematic Reviews), Web of Science (SCI-expanded and SSCI), LILACS and African Index Medicus from database inception or at least from 1982 to June 2006 for terms including maternal mortalit*, communi* intervention*, participat*intervention*, midwi* and birth* attend* (see Additional file 1), and used Reference Manager 11 software http://www.refman.com to keep track of citations identified. We followed up references in published papers, contacted leading authors, and hand searched major relevant journals up to July 2007. We searched for unpublished work using the National Research Register website http://www.nrr.nhs.uk, 2006 issue 2, searched 30 June 2006), metaRegister http://www.controlled-trials.com/mrct/, searched 30 June 2006) and the WHO International Trial Registry portal http://www.who.int/trialsearch, searched 24 May 2007). No language restrictions were applied.
We developed a protocol using recommended methods for collating data from randomised controlled trials and cohort studies with concurrent controls following QUOROM and MOOSE checklists [9–12]. Selection criteria were general maternity populations or women of childbearing age (15 to 49 years) taking part in a community-level intervention. We defined a "community-level" intervention as one which is either accessed locally at the woman's home, village, school or local clinic, or delivered by any person within the community, including health personnel or lay individual. Studies conducted in primary care settings designed to provide normal pregnancy and childbirth services and refer women with complications to higher levels of care were eligible for inclusion. All eligible studies had to report on maternal deaths and have controls of concurrent comparable populations experiencing either "usual care", including hospital based care, or other community interventions. We used the ICD10 definition of maternal mortality (death of a woman while pregnant or within 42 days of termination of pregnancy, irrespective of the duration and site of the pregnancy, from any cause related to or aggravated by the pregnancy or its management but not from accidental or incidental causes). We excluded studies of pharmacological and nutritional interventions since these have already been the subject of other systematic reviews. We also excluded studies on non-general maternity or childbearing age populations, such as women with a particular disease. No language restrictions were applied.
Two authors (EK and CMacA) independently assessed titles and abstracts of all potential references for eligibility and retrieval of full papers. In cases of uncertainty the original papers or raw data were obtained or authors contacted to reach a decision about eligibility after consideration of the published information. All retrieved papers were assessed in duplicate (by EK and HW), using checklists of inclusion and exclusion criteria.
Two authors (EK and either CM or KSK) independently quality assessed studies and extracted data using a piloted data extraction form. We defined study quality as the extent to which design, methods, execution and analysis minimised bias in assessment of effectiveness, focusing on internal validity . We classified studies as high, medium, low (or unclear) quality with respect to selection, performance, measurement and attrition biases as shown in Table 1. Individual studies were described by study type, intervention, location and date, numbers taking part, population denominator (eg pregnancy or live birth) and study quality (Table 2). Any discrepancies were resolved by discussion with additional authors (CMacA and HW).
We extracted data to generate maternal mortality rates for the intervention and comparator arms of the included studies. For cluster randomised trials we computed the design effect from data presented in the study reports (intra-class correlation coefficients, cluster adjusted estimates and confidence intervals) using STATA 9.2 http://www.stata.com and adapted sample sizes and numbers of events to make appropriate allowance for clustering . Where such data could not be found, we computed a design effect using the mean intra-class correlation coefficient from the trials in which they were computable. We summarised results of individual studies as odds ratios (OR) and confidence intervals adjusted for clustering, which we pooled using the Peto method validated for meta-analysis of rare events . We considered results of randomised trials and cohort studies separately. Meta-analysis were only considered for studies without a high risk of bias, which were then stratified according to the purpose of the intervention.
We identified 768 relevant references, of which 13 studies met our inclusion criteria (Figure 1). The quality of the studies was extremely variable (Table 2). Eleven of the studies involved 118,467 maternities (pregnant women, pregnancies, deliveries or live births). Two studies had no data on participant numbers. We found five cluster randomised controlled trials, of which the trials by Jokhio  and Munjanja  had large numbers of participants but few clusters. Of the eight non-randomised studies, only one scored "high" and two "medium " in any of the four quality assessments. The rest scored either "low" or unclear"
None of the trials was powered to assess maternal mortality, although one trial did show a significant reduction based on small numbers of deaths . Of the randomised controlled trials, two evaluated interventions to improve perinatal care practices [15, 17]. Both aimed to educate lay birth attendants in awareness of basic concepts of maternal and neonatal care, reduce unsafe delivery practices, and increase referral where there may be problems [15, 17, 18]. Both provided adequate information to estimate the impact of the cluster design on maternal mortality outcomes. No adjustment for the cluster design was required for maternal mortality, as the intra-class correlation coefficient (ICC) was estimated to be zero. Three trials with equivalence hypotheses assessed reduced frequency but goal-oriented antenatal care models [16, 19, 20]. None of these trials adjusted for cluster effect for maternal mortality (for the meta-analysis we presumed that they also would have an ICC of zero, and no adjustment for clustering was made).
The outcomes of all included studies are shown in Table 2. The non-randomised studies were of insufficient quality to draw conclusions about their effectiveness.
For the studies with low risk of bias, separate meta-analyses were undertaken for the two types of intervention (Figure 2). Interventions to improve perinatal care practices showed a statistically significant difference in maternal mortality favouring treatment (OR = 0.62; 95% CI 0.39 to 0.98, p = 0.042). The meta-analysis to examine whether minimal targeted antenatal care was non-inferior to standard care showed no difference in maternal mortality (OR = 1.09; 95% CI 0.53 to 2.25, p = 0.81), although the confidence interval was wide.
This systematic review found a paucity of comparative studies of community-level interventions measuring maternal mortality. Only the RCTs provided reliable evidence. Meta-analysis of the interventions aimed at improving perinatal care practices, already shown to be effective in reducing perinatal or neonatal mortality, showed a reduction in maternal mortality. This constitutes evidence that is too strong for the effect of community-level perinatal care practices on reducing maternal mortality to be dismissed.
From the outset, we employed a broad definition of "community-level" to include interventions which were accessed or delivered locally in the community. This meant that three studies of antenatal care practices met our inclusion criteria, as they were conducted in local clinics. These trials of minimal but goal-oriented antenatal care, designed to determine whether this model was as effective as standard, more frequent "westernised" care, showed no difference in maternal death. These results confirm and consolidate the findings of the Cochrane review on patterns of antenatal care for low risk pregnancy  and the WHO systematic review of routine antenatal care , incorporating a more recent trial by Majoko et al . The implications for antenatal care practice are fully discussed in these reviews and will not be repeated here.
This systematic review employed an exhaustive search strategy, with a wide range of databases and searches, enabling us to compile a comprehensive collection of potentially relevant studies reporting maternal deaths. We had considered that inclusion of non-randomised controlled studies could have provided the review with added breadth. Unfortunately, poor quality, in particular high chance of selection bias resulting from lack of randomisation, renders their results highly inconclusive. One of these studies, in Matlab, Bangladesh, represented a major initiative in the attempt to change maternity services to reduce maternal mortality. Community midwives worked with community health workers and traditional birth attendants to attend home-births, detect and manage obstetric complications and refer to higher level care as required. A decrease in mortality was observed (OR 0.35, 95% CI 0.14 to 0.88) which was taken as sufficient evidence to extend the intervention. However, an adjacent comparison area subsequently experienced a similar decrease in mortality, and the improvement in mortality rates in both areas was later largely ascribed to women's self-referral to accessible hospital emergency obstetric care. More recently, other factors have also been postulated, such as safe abortion and family planning to reduce abortion deaths . After 30 years, the Matlab studies have been unable to determine with certainty the effectiveness of interventions.
A limitation of this review was the paucity of eligible randomised trials and the necessity to undertake two meta-analyses because of the two distinct types of intervention. Meta-analysis is a powerful and valid tool for combining rare outcomes, provided that appropriate methods are used which avoid large sample approximations . There were however, inadequate data to test for heterogeneity, which should be considered a secondary issue when pooling rare outcomes . Visually, heterogeneity for the antenatal care models appeared to be low but it is difficult to assess with so few trials.
Another potential limitation arises from the outcome of interest being extremely rare. This review included only studies which stated whether deaths had occurred. This meant that two small studies which did not report maternal deaths [26, 27] (one with a death, one without) found in the reviews on antenatal care patterns were not included in the present review. We cannot exclude the possibility that other studies may have known of, but not reported, maternal deaths.
The interventions were so similar in the three reduced but goal-oriented antenatal care trials that, the decision to pool their data was obvious. Combining results of both trials of improved perinatal health care practices may initially seem counter-intuitive. The intervention in Nepal was focussed on facilitator-led women's groups [17, 18] and the intervention in Pakistan on linkage and training of traditional birth attendants . However, we believe a meta-analysis of these trials to be appropriate, since the interventions in both aimed to improve the standard of perinatal care, by increasing hygienic practices and integrating modestly improved primary health care services, as reflected in process outcomes for both trials. Both trials were in resource-poor rural settings.
The evidence from this review, albeit based on only two trials and both in rural Asia, suggests that community-level interventions to improve perinatal care practices can also reduce maternal mortality. Few would contest the importance of continuing to establish maternity services which allow women to deliver in a health facility and have timely access to comprehensive obstetric emergency care. These services must provide appropriate evidence-based care, be adequately resourced and acceptable to women. In many countries with high maternal mortality, the strategy of intra-partum care based in health centres "is simply not achievable with current resources and infrastructure, and without other evidence-based options, countries could be left without adequate guidance about how to proceed" . Alongside strengthening facility based care, therefore, there is a need to develop and properly evaluate community-level strategies to improve maternal health outcomes, including mortality, especially in rural areas. Such strategies are inevitably complex and multifaceted. Thus process outcomes that describe how the strategy is implemented (eg distribution and use of clean delivery kits, use of sterile blade to cut the cord, whether birth attendant washed her hands) and the participants' experience (eg referral to higher level care, type and place of delivery) are necessary to understand "how" the intervention works and will improve the generalisability of the results.
The studies in Nepal and Pakistan have clearly shown that it is possible to design, implement and evaluate large scale interventions using randomised controlled designs. These trials have already produced valid policy-relevant evidence to show that neonatal and perinatal mortality can be reduced by community-level interventions to improve perinatal care practices. Such interventions, directed at improving maternity services, are likely to influence both maternal and perinatal outcomes but many studies are primarily generated and evaluated from one perspective only. Debate as to whether perinatal mortality can serve as a proxy for maternal mortality  may be less appropriate than directing concerted efforts to reduce and measure both within maternity services programmes. Many countries and agencies do implement large-scale and expensive programmes which could generate effectiveness evidence by incorporating cluster trial techniques, such as rolling out the programme in a randomised manner ('randomised roll-out'). This type of approach will, in the medium to longer term, produce evidence on which to base policies on how to achieve significant reductions in maternal mortality.
In summary, this review found that only RCTs provided reliable evidence. This evidence suggests that community-level interventions that improve perinatal practices can reduce maternal mortality. This finding challenges the view that investment in community-level interventions is not worthwhile, although further studies in different settings and contexts are needed. Study designs now allow for robust evaluation of large-scale programmes. It is imperative that we use randomised techniques to obtain more conclusive evidence of how to achieve the 5th MDG of reducing maternal mortality.
AbouZahr C: Maternal mortality in 2000: Estimates developed by WHO, UNICEF and UNFPA. 2004, Geneva, World Health Organization
Starrs AM: Safe motherhood initiative: 20 years and counting. Lancet. 2006, 368: 1130-1132. 10.1016/S0140-6736(06)69385-9.
WHO: The World Health Report 2005 – make every mother and child count. 2005, Geneva, World Health Organization
Graham WJ, Filippi VA, Ronsmans C: Demonstrating programme impact on maternal mortality. Health Policy Plan. 1996, 11: 16-20. 10.1093/heapol/11.1.16.
Campbell OMR, Graham WJ, on behalf of The Lancet steering group: Strategies for reducing maternal mortality: getting on with what works. Lancet. 2006, 368: 1284-1299. 10.1016/S0140-6736(06)69381-1.
Barnes-Josiah D, Myntti C, Augustin A: The 'three delays' as a framework for examining maternal mortality in Haiti. Soc Sci Med. 1998, 46: 981-993. 10.1016/S0277-9536(97)10018-1.
Thaddeus S, Maine D: Too far to walk: maternal mortality in context. Soc Sci Med. 1994, 38: 1091-110. 10.1016/0277-9536(94)90226-7.
Costello A, Azad K, Barnett S: An alternative strategy to reduce maternal mortality. Lancet. 2006, 368: 1477-1479. 10.1016/S0140-6736(06)69388-4.
Khan KS, ter Riet G, Popay J, Nixon J, Kleijnen J: Undertaking Systematic Reviews of Research on Effectiveness, CRDs Guidance for those Carrying Out or Commissioning Reviews. Edited by: Khan KS, ter Riet G, Glanville J, Sowden AJ, Kleijnen J. 2001, York Publishing Services Ltd, 4, 2
Downs SH, Black N: The feasibility of creating a checklist for the assessment of the methodological quality both of randomised and non-randomised studies of health care interventions. J Epidemiol Community Health. 1998, 52: 377-384. 10.1136/jech.52.6.377.
Moher D, Cook D, Eastwood S, Olkin I, Rennie D, Stroup D: Improving the quality of reports of meta-analyses of randomised controlled trials: the QUOROM statement. Quality of Reporting of Meta-analyses. Lancet. 1999, 354: 1896-1900. 10.1016/S0140-6736(99)04149-5.
Stroup D, Berlin J, Morton S, Olkin I, Williamson G, Rennie D, et al: Meta-analysis of Observational Studies in Epidemiology: A Proposal for Reporting. JAMA. 2000, 283: 2008-2012. 10.1001/jama.283.15.2008.
Deeks J, Higgins J, Altman D: Analysing and presenting results. Cochrane Handbook for Systematic Reviews of Interventions 4.2.6 [updated September 2006]. Section 8. Edited by: Higgins J, Green S. 2006, Chichester, UK: John Wiley & Sons, Ltd
Bradburn M, Deeks J, Berlin J, Localio A: Much ado about nothing: a comparison of the performance of meta-analytical methods with rare events. Stat Med. 2007, 26: 53-77. 10.1002/sim.2528.
Jokhio A, Winter H, Cheng K: An Intervention Involving Traditional Birth Attendants and Perinatal and Maternal Mortality in Pakistan. New Engl J Med. 2005, 352: 2091-2099. 10.1056/NEJMsa042830.
Munjanja SP, Lindmark G, Nystrom L: Randomised controlled trial of a reduced-visits programme of antenatal care in Harare, Zimbabwe. Lancet. 1996, 348: 364-369. 10.1016/S0140-6736(96)01250-0.
Manandhar D, Osrin D, Shrestha B, Mesko N, Morrison J, Tumbahangphe K, et al: Effect of a participatory intervention with women's groups on birth outcomes in Nepal: cluster-randomised controlled trial. Lancet. 2004, 364: 970-979. 10.1016/S0140-6736(04)17021-9.
Morrison J, Tamang S, Mesko N, Osrin D, Shrestha B, Manandhar M, et al: Women's health groups to improve perinatal care in rural Nepal. BMC Pregnancy and Childbirth. 2005, 5: 6-10.1186/1471-2393-5-6.
Majoko F, Munjanja SP, Nyström L, Mason E, Lindmark G: Randomised controlled trial of two antenatal care models in rural Zimbabwe. BJOG. 2007, 114: 802-811. 10.1111/j.1471-0528.2007.01372.x.
Villar J, Ba'aqeel H, Piaggio G, Lumbiganon P, Miguel Belizan J, Farnot U, et al: WHO antenatal care randomised trial for the evaluation of a new model of routine antenatal care. Lancet. 2001, 357: 1551-1564. 10.1016/S0140-6736(00)04722-X.
Villar J, Carroli G, Khan-Neelofur D, Piaggio G, Gülmezoglu M: Patterns of routine antenatal care for low-risk pregnancy. The Cochrane Database of Systematic Reviews. 2001, Art. No.: CD000934-4
Carroli G, Villar J, Piaggio G, Khan-Neelofur D, Gulmezoglu M, Mugford M, et al: WHO systematic review of randomised controlled trials of routine antenatal care. Lancet. 2001, 357: 1565-1570. 10.1016/S0140-6736(00)04723-1.
Fauveau V, Stewart K, Khan SA, Chakraborty J: Effect on mortality of community-based maternity-care programme in rural Bangladesh. Lancet. 1991, 338: 1183-1186. 10.1016/0140-6736(91)92041-Y.
Ronsmans C, Vanneste AM, Chakraborty J, van Ginneken J: Decline in maternal mortality in Matlab, Bangladesh: a cautionary tale. Lancet. 1997, 350: 1810-14. 10.1016/S0140-6736(97)08012-4.
Chowdhury ME, Botlero R, Koblinsky M, Saha SK, Dieltiens G, Ronsmans C: Determinants of reduction in maternal mortality in Matlab, Bangladesh: a 30-year cohort study. Lancet. 2007, 370: 1320-28. 10.1016/S0140-6736(07)61573-6.
Sikorski J, Wilson J, Clement S, Das A, Smeeton N: A randomised controlled trial comparing two schedules of antenatal visits: the antenatal care project. BMJ. 1996, 312: 546-553.
McDuffie R, Beck A, Bischoff K, Cross J, Orleans M: Effect of frequency of prenatal care visits on perinatal outcome among low-risk women. A randomized controlled trial. JAMA. 1996, 275: 847-851. 10.1001/jama.275.11.847.
Ackermann-Liebrich U, Voegeli T, Gunter-Witt K, Kunz I, Zullig M, Schindler C, et al: Home versus hospital deliveries: follow up study of matched pairs for procedures and outcome. BMJ. 1996, 313: 1313-8.
de Bernis L, Dumont A, Bouillin D, Gueye A, Dompnier JP, Bouvier-Colle MH: Maternal morbidity and mortality in two different populations of Senegal: a prospective study (MOMA survey). BJOG. 2000, 107: 68-74. 10.1111/j.1471-0528.2000.tb11581.x.
Dumont A, de Bernis L, Bouillin D, Gueye A, Dompnier JP, Bouvier-Colle MH: Maternal morbidity and qualification of health-care workers: comparison between two different populations in Senegal. J Gynecol Obstet Biol Reprod (Paris). 2002, 31: 70-79.
Greenwood AM, Bradley AK, Byass P, Greenwood BM, Snow RW, Bennett S, et al: Evaluation of a primary health care programme in The Gambia. I. The impact of trained traditional birth attendants on the outcome of pregnancy. J Trop Med Hyg. 1990, 93 (1): 58-66.
Maine D, Akalin MZ, Chakraborty J, De FA, Strong M: Why did maternal mortality decline in Matlab?. Stud Fam Plann. 1996, 27: 179-87. 10.2307/2137952.
Foord F: Gambia: evaluation of the mobile health care service in West Kiang district. World Health Statistics Quarterly – Rapport Trimestriel de Statistiques Sanitaires Mondiales. 1995, 48: 18-22.
Fox-Rushby JA: The Gambia: Cost and effectiveness of a mobile maternal health care service, West Kiang. World Health Statistics Quarterly. 1995, 48: 23-27.
Fox-Rushby JA, Foord F: Costs, effects and cost-effectiveness analysis of a mobile maternal health care service in West Kiang, The Gambia. Health Policy. 1996, 35: 231-41. 10.1016/0168-8510(95)00774-1.
Xu Z: China: lowering maternal mortality in Miyun County, Beijing. World Health Statistics Quarterly – Rapport Trimestriel de Statistiques Sanitaires Mondiales. 1995, 48: 11-14.
Zhang T, Wu YQ, Zhang X, Xiong Q, Wang YP, Zhao GL, et al: An evaluation of effects of intervention on maternal and child health in the rural areas of China. Sichuan da Xue Xue Bao Yi Xue Ban/Journal of Sichuan University Medical Science Edition. 2004, 35: 539-42.
The pre-publication history for this paper can be accessed here:http://www.biomedcentral.com/1471-2393/9/2/prepub
We would like to thank Yen-Fu Chen, who is a systematic reviewer, for providing data extraction and discussion on one included Chinese paper, Iria Rodriguez-Cobo for providing translation of abstracts in Portuguese and Spanish and Anne Walker for her administrative support. We are grateful to Paul F A Van Look for his critical review of the paper.
The study was funded by the University of Birmingham. HRW was joint author of one of the studies under review. We declare that we have no conflict of interest.
HW, CMacA and KSK proposed the original idea for this paper. All authors contributed to the protocol. EK designed and carried out the searches. EK and CMacA screened initial references for retrieval. KSK, CM and EK designed the data extraction form and extracted the data, and CMacA and HW and EK completed the quality table. JD undertook the statistical analysis. EK, CMacA and HW wrote the paper and KSK, MG and JD contributed to it. All authors approved the writing of the text.