Skip to main content

Study protocol training for life: a stepped wedge cluster randomized trial about emergency obstetric simulation-based training in a low-income country

Abstract

Background

Globally perinatal and maternal mortality rates remain unacceptably high. There is increasing evidence that simulation-based training in obstetric emergencies is associated with improvement in clinical outcomes. However, the results are not entirely consistent. The need for continued research in a wide variety of clinical settings to establish what works, where and why was recommended. The aim of this study is to investigate the effectiveness of an emergency obstetric simulation-based training program with medical technical and teamwork skills on maternal and perinatal mortality in a low-income country.

Methods

A stepped wedge cluster randomized trial will be conducted at the medium to high-risk labour ward at Mulago Hospital, Kampala, Uganda, with an annual delivery rate of over 23,000. The training will be performed using a train-the-trainers model in which training is cascaded down from master trainers to local facilitators (gynaecologists) to learners (senior house officers). Local facilitators will be trained during a four-day train-the-trainers course with an annual repetition. The senior house officers will be naturally divided in seven clusters and randomized for the moment of training. The training consists of a one-day, monodisciplinary, simulation-based training followed by repetition training sessions. Scenarios are based on the main local causes of maternal and neonatal mortality and focus on both medical technical and crew resource management skills. Kirkpatrick’s classification will be used to evaluate the training program. Primary outcome will be the composite of maternal and neonatal mortality ratios. Secondary outcome will comprise course perception, evaluation of the instructional design of the training, knowledge, technical skills, team performance, percentage of ventouse deliveries, percentage of caesarean sections, and a Weighted Adverse Outcome Score.

Discussion

This stepped wedge cluster randomized trial will investigate the effect of a monodisciplinary simulation-based obstetric training in a low-income country, focusing on both medical technical skills and crew resource management skills, on patient outcome at one of the largest labour wards worldwide. We will use a robust study design which will allow us to better understand the training effects, and difficulties in evaluating training programs in low-income countries.

Trial registration

ISRCTN98617255, retrospectively registered July 23, 2018.

Peer Review reports

Background

Newborn and maternal healthcare is worldwide open to improvement. In 2000, two out of eight Millennium Development Goals (MDGs) were directed to reduce under-five child mortality and to improve maternal health [1]. Despite the fact that impressive improvements were made in most regions, this progress was not sufficient to meet the defined goals. Globally, 2.6 million babies still die every year in their first month of life and a similar number are stillborn [2]. Additionally, every day about 830 women die from preventable causes related to pregnancy and childbirth around the world [3]. In 2016 world leaders launched a new agenda, which includes a set of 17 Sustainable Development Goals (SDGs) for the next 15 years [4].

One of the targets of the old agenda was to reduce under-five mortality rate by two thirds between 1990 and 2015. The MDG report 2015 showed that this mortality rate has declined by more than half, dropping from 90 to 43 deaths per 1000 live births [5]. Despite these impressive improvements, current trends were not sufficient to meet the target. In addition, a report published in the Lancet in 2014 revealed that the progress in the reduction of neonatal deaths has been much slower than that of children over 4 weeks of age [6]. Approximately a fourth of the neonatal deaths is being attributed to intrapartum-related complications [1, 2, 5]. The highest neonatal mortality rate still occurs in sub-Saharan Africa [5].

The target of MDG five was to achieve universal access to reproductive health services, and to reduce maternal mortality ratio (MMR) by three quarters [5]. While globally MMR results showed a reduction of almost 50%, the risk of maternal death in sub-Saharan Africa remains unacceptably high [5]. It was estimated that in 2015, roughly 303,000 women died during and following pregnancy and childbirth [3]. Almost all of these deaths occurred in low-income countries with a defined maternal mortality ratio of 239 per 100,000 live births versus 12 per 100,000 live births in high income countries [3]. Most of these deaths could have been prevented [3, 5]. A key strategy for improving newborn and maternal care is to ensure that every birth occurs with the assistance of skilled health personnel, meaning a medical doctor, nurse or midwife. Globally, this proportion of deliveries attended by skilled health personnel increased to 71% around 2014 [5]. Yet, this leaves more than one in four deliveries without access to crucial medical care during childbirth.

In September 2015 a new sustainable development agenda was set with 17 goals, each with specific targets to be achieved over the next 15 years [4]. Specific targets are to reduce the global maternal mortality ratio to less than 70 per 100,000 live births, to end preventable deaths of newborns aiming to reduce neonatal mortality to at least as low as 12 per 1000 live births, and to increase health financing and the recruitment, development, training and retention of health workforce in developing countries [4]. We will focus on these targets during this study.

Uganda

Uganda is one of the low-income countries where newborn and maternal healthcare is open to improvement. The MDG Progress Report on Uganda, delivered in 2013, revealed that the observed trend in the reduction of under-five mortality matched the target trajectory [7]. The perinatal mortality rate in Uganda dropped from 39.3 in 1990 to 22.0 in 2013 [7]. The maternal mortality ratio per 100,000 live births was targeted to be reduced to 131 by 2015. Despite the marked improvements in births assisted by trained health workers and access to care after childbirth, at the end of 2015 the maternal mortality ratio was still 343 compared to 687 in 1990 [8].

Causes of perinatal and maternal mortality

The majority of perinatal deaths worldwide are caused by preterm birth complications (35%), complications during labour and delivery (24%), and sepsis (15%) [5]. The most important direct causes of maternal mortality in Uganda are postpartum haemorrhage (42%), obstructed or prolonged labour (22%), and complications from abortion (11%) [9]. This was disclosed by a survey of 553 health facilities across Uganda [9]. Another important reason is high blood pressure during pregnancy (pre-eclampsia and eclampsia) [8]. The most common underlying cause of death was inadequate staff numbers [4,5,6,7]. Moreover, a national assessment found that only 3% of health facilities expected to offer emergency obstetric care, were able to do so [10]. Nevertheless, the annual Health Sector Performance Report in 2011–2012 found that around half of Government healthcare facilities were providing basic obstetric care or had at least one staff member trained in managing complications in pregnancy and childbirth [7, 10]. Hence, it appears that the management of acute obstetric emergencies is open to improvement.

Simulation-based training

Simulation-based education (SBE) has increasingly been recognized as a useful and safe educational tool in healthcare over the past decades. To evaluate the effect of a simulation-based education program, Kirkpatrick’s (KP) classification is often used (Fig. 1) [11]. In this classification, four levels are described, starting with trainees’ reaction on the training (KP1), followed by learning (KP2), changes in behaviour (KP3), and finally outcome (patient outcome, reduced cost etc.) (KP4). A systematic review published in 2003 concluded that only a few training programs in acute obstetric emergencies had been described, and even fewer had been evaluated [12]. Since this review, there have been numerous evaluation studies on the effectiveness of simulation training for obstetric emergencies, with increasing evidence that it is associated with improvement in clinical outcomes, mostly related to neonatal outcomes [13,14,15,16,17,18,19,20,21,22,23,24,25,26,27,28,29,30,31,32]. However, the results are not entirely consistent. Training programmes based on local, unit-based and multi-professional training, with appropriate mannequins, and practice-based tools to support best care, were found to be associated with improved clinical outcomes [33]. Yet some training is associated with no improvements, or even deterioration in outcomes. Hence it was recognized that there is a need for continued research in a wide variety of clinical settings to identify which interventions are beneficial [14, 33]. In settings where emergency obstetric simulation-based training is not yet widely established, we propose to use a randomized controlled trial design as most previous studies were set-up as pre- vs. post-interventional design.

Fig. 1
figure 1

Kirkpatrick’s model for evaluation of training programs. KP: Kirkpatrick level

Methods and design

Aim

The aim of this study is to investigate the effectiveness of a simulation-based emergency obstetric training program on different levels of Kirkpatrick in a low-income country with a stepped wedge cluster randomized trial.

Design

A stepped wedge cluster randomized trial will be conducted at the medium to high-risk labour ward at Mulago Hospital, Kampala, Uganda, with an annual delivery rate of over 23,000. A stepped wedge trial is a cluster-randomized trial in which all study groups (clusters) receive the intervention by a computer-generated random sequential roll-out of the training sessions over time (Fig. 2).

Fig. 2
figure 2

Stepped wedge design with seven clusters and subsequently eight study periods of each 7 weeks

This design has several advantages; all clusters are trained, the effect can be estimated from both within- and between-cluster comparisons, it is possible to control for time effects, and the design is useful when it is preferable to implement the intervention in stages because of logistical, practical or financial constraints [34,35,36,37]. However, it may be tough to create fixed clusters of students without contamination during working hours, difficult to plan training sessions during holidays and exam periods, and a challenge to train a new cluster strictly every 7 weeks. Therefore, a prospective pre-post intervention analyses will also be done with 16 months prior to the start of the program and 16 months from the program onwards.

The training will be performed using a train-the-trainers model in which training is cascaded down from master trainer to local facilitators to learners. Local facilitators will be a selection of gynaecologists from Mulago Hospital based on their clinical and teaching experience. They will be selected by the head of department and will train and implement new medical technical skills and crew resource management skills in a hierarchical way (top-down). The gynaecologists will be trained during a 4 day train-the-trainers course including a test day with junior house officers (intern doctors) and annual repetition day. Afterwards, the local facilitators will train the senior house officers (SHOs) in their first-, second- or third-year of their gynaecology training program. The SHOs will be naturally divided in seven clusters of approximately six to nine persons and randomized for the moment of training. The local facilitators will be paid for the training sessions.

The training consists of a one-day, monodisciplinary, simulation-based training followed by repetition training sessions. Scenarios are based on the main local causes of maternal and neonatal mortality and include crew resource management. Primary outcome will be the composite of maternal and neonatal mortality ratios. Secondary outcome will comprise course perception, evaluation of the instructional design of the training, knowledge, technical skills, team performance, percentage of ventouse deliveries, percentage of caesarean sections, and four items of the Weighted Adverse Outcome Score [21].

Setting and participants

The training will be implemented at Mulago hospital, the national referral hospital in Kampala, Uganda and the teaching Hospital for Makerere University. This hospital serves the population living in Kampala and the surrounding districts. The maternity wards of Mulago Hospital include a low-risk ward and a medium to high-risk ward. Each year, over 31,000 women give birth in Mulago Hospital. Over 23,000 women deliver at the medium to high-risk ward. Only staff from the medium to high-risk ward will be included in this study. The staff consists of 45 gynaecologists, 60 SHOs, and 45 midwives. The SHOs differ in level of education towards their gynaecologist training (first-, second-, and third-year SHOs). During a 24-h shift one gynaecologist is on-call duty. During daytime, six SHOs, and eight midwives provide obstetric care while four SHOs and six midwives are available during night.

The study concerns a simulation-based training program focusing on medical technical skills and crew resource management in emergency obstetric scenarios in a low-income setting. Except for vacuum extraction and neonatal resuscitation training, no other simulation-based training was done before. The local facilitators will train all first-, second- and third-year SHOs since they have a central and coordinating role in providing emergency obstetric care on the labour ward in this hospital. With over 23,000 women giving birth at the ward in 1 year, and only gynaecologist on-call duty during a 24-h shift, midwives ask the SHOs to handle in case of an emergency obstetric situation. Before the SHOs start with their three-year training to become a gynaecologist, they have worked already in the hospital as an intern during their training to become a doctor. During the period as an intern, they are already responsible for triage of patients and learn how to perform a caesarean section. After their internship, students got selected to become a resident in obstetrics and gynaecology. During a shift, the SHOs are working together in teams of first-, second-, and third-year students. They need to call and help each other during emergency obstetric situations.

The training program consists of a full-day simulation-based training and half-day repetition training sessions. To be included, SHOs must work at the medium to high-risk maternity ward of the Mulago hospital. Written informed consent to participants in this study have to be obtained at the beginning of the first training day.

Trial interventions

Training equipment

Full body simulators (Noelle® and Pedi® Blue neonate, Gaumard) will be used for all training sessions. Communication with Noelle® will be done by an actor, usually a non-local doctor who is not involved in the training day. Other training materials (e.g. disposables, balloon ventilators) will be obtained from Mulago Hospital labour ward and reused as much as possible. Course content (e.g. syllabus, instructor manual, slides, observation forms) will be developed in cooperation with staff members of the obstetrics and gynaecology department in Mulago Hospital and Medsim, a medical simulation centre in Eindhoven, The Netherlands. All materials will be written in English. The instructional design features described by Issenberg et al. and Cook et al. will be used to design the training program [38, 39].

Train-the-trainers course

All training sessions will take place at the skills lab of the Makerere University College of Health Sciences, situated at Mulago hospital. The first step will be the train-the-trainers course for the local facilitators provided by a Dutch team, consisting of two obstetricians, a communication expert and a simulation technician. They are all certified simulation educators. The train-the-trainers course will take 4 days. During the first day, principles of simulation-based education (e.g. learning theories, crew resource management, debriefing techniques) and the training program for the SHOs will be discussed and registered. Additionally, local protocols for obstetric emergencies will be restructured during the first day and the local trainers will be introduced to the full body simulators. From the second day on, the local facilitators will start practicing during obstetric simulated scenarios on each other. This includes preparing, leading and debriefing a simulated scenario, including technical set-up (simulators, audio-video equipment, presentation equipment). On the last day the trainers will educate junior house officers (intern doctors) in simulation-based obstetric training as a final test. The Dutch team of master trainers will provide the local trainers feedback. Afterwards, the local trainers will facilitate simulation-based training sessions for all SHOs without supervision of the master trainers in the above mentioned training scheme. Each training session will be organised by two local trainers (main and repetition training). Finally, the master trainers will provide an annual one-day train-the-trainers repetition course.

Main training sessions

The main training of the SHOs will comprise a one-day (8-h), simulation-based, obstetric training, focusing on 50% medical technical skills and 50% crew resource management skills (i.e. teamwork skills) (Fig. 3).

Fig. 3
figure 3

Set up of the main training

There are seven groups with SHOs, each group consists of six to nine SHOs. The training scenarios will be postpartum haemorrhage, eclampsia, fetal distress with a vacuum-assisted vaginal delivery and resuscitation of the newborn, breech delivery, and a repetition scenario of postpartum haemorrhage. These scenarios relate to local leading causes of perinatal and maternal mortality and obstetric healthcare problems. Crew resource management skills such as speak up, leadership, situational awareness, and decision-making will be integrated in every scenario with increasing difficulty levels. Learning goals and learning objectives will be defined for the scenarios in collaboration with the local trainers.

The main training will start with a general introduction and a knowledge test. Afterwards, the concept of simulation-based training will be explained and the SHOs will set their individual learning goals. Subsequently, the five scenarios will be covered. Every scenario will start with a short introduction of the scenario, followed with performing the scenarios by two to three trainees. The trainers and remaining SHOs will observe the trainees via synchronised video broadcast. Every trainee will participate in at least two scenarios. After each scenario a debriefing by means of the video recordings will be provided by the trainers. The video will be used to show what was done/not done. After this, the students will reflect upon their learning experiences. The debriefing will contains three different phases; reaction, analysis and take home phase. The instructors will provide feedback on both medical technical skills and crew resource management skills. When all five scenarios are completed, the predefined learning goals will be evaluated. Finally, all SHOs will undergo the same knowledge test and they will be asked to fill in an evaluation questionnaire on course perception.

Repetition training sessions

After the main training, SHOs will be invited to take part in repetition training sessions. Each repetition training session will comprise half a day. During a repetition training, one clinical scenario will be executed (and repeated). New scenarios will be designed for these sessions based on the same emergency obstetric situations in the main training. However, expectations for the level of performance will be raised and some extra elements such as hand hygiene will be added to keep it challenging. Each repetition training will start with an introduction, in which learning goals will be defined. At the end of every training, learning goals will be evaluated and summarized.

Hypothesis

Simulation-based obstetric training in a low-income country will decrease the composite of maternal and perinatal mortality ratios. Questions to be answered:

  1. 1.

    To what extent is emergency obstetric simulation-based training acceptable and feasible for local facilitators and trainees in a low-income country? (KP 1)

  2. 2.

    Does emergency obstetric simulation-based training provided by local facilitators in a low-income country improve knowledge, skills, and team performance? (KP 2)

  3. 3.

    Does emergency obstetric simulation-based training provided by local facilitators in a low-income country increase the percentage of deliveries by vacuum extraction and decrease the percentage of caesarean sections? (KP 3)

  4. 4.

    Does emergency obstetric simulation-based training provided by local facilitators in a low- income country decrease four items of the Weighted Adverse Outcome Score? (maternal death, intrapartum or perinatal death, uterine rupture, Apgar score less than 7 at 5 min) (KP 4)

  5. 5.

    Does emergency obstetric simulation-based training provided by local facilitators in a low- income country decrease the composite of maternal and perinatal mortality ratios, the separate ratios, and the ratio of maternal and perinatal mortality per total number of deliveries? (KP 4)

Primary outcome

The primary outcome of this study will be the combined mortality proportion (CMP). This will concern a composite mortality rate, including maternal and perinatal mortality. Maternal mortality ratio (MMR) is defined as the number of maternal deaths per 100,000 live births [40]. Perinatal mortality ratio (PMR) is defined as the number of stillbirths and deaths in the first week of life per 1000 live births. In Mulago hospital only deliveries with a gestational age of 28 weeks or more or a birth weight of more than one kilogram are registered. These deliveries will be included in the analysis.

Expressed as proportions, the combined mortality proportion (CMP) holds: CMP = MMR/100,000 + PMR/1000. Maternal mortality and perinatal mortality will be prospectively registered using the patient registration books in Mulago Hospital. Data extraction from these registration books will be without identification of the subjects.

Secondary outcomes

To evaluate the perception of the trainees of the training program, we will use a 42-item questionnaire about ten instructional design features of the training program including feedback, repetition, curriculum integration, difficulty range, learning strategies, clinical variation, controlled environment, individualization, defined outcomes, and simulator validity (the ID-SIM) [41]. The data will be treated as ordinal data at the item level. Suggestions for improvement can be made in an open remark.

A 30-item multiple choice knowledge test about technical and non-technical skills was development and evaluated by gynaecologists from Mulago Hospital and the Netherlands. SHOs will be asked to fill in the questionnaire at the onset and end of the full-day main training. Mean values of the knowledge tests will be compared.

Clinical performance in the simulated postpartum haemorrhage scenarios will be assessed by three independent Dutch simulation instructors through reviewing the videotaped training sessions. The assessors will be blinded for the day of training and whether the scenario was the first or the last of the day. A skills checklist based on literature and clinical experience will be used [42]. The mean score of the clinical performance of the first and last scenario of the SHOs’ main training will be compared.

Team performance will also be assessed by three independent Dutch simulation instructors through reviewing the videotaped training sessions. The Clinical Teamwork Scale (CTS) will be used [43]. The CTS contains questions about communication, situational awareness, decision-making, role responsibility, and patient friendliness. The mean score of the clinical performance of the first and last scenario of the main training will be compared. The assessors will be blinded for the day of training and whether the scenario was the first or the last of the day.

The percentage of deliveries by vacuum extraction and caesarean sections will be prospectively collected from Mulago Hospital’s patient registration book.

The Weighted Adverse Outcome Score (WAOS) is defined as the total weighted score of each adverse outcome divided by the total number of deliveries (Fig. 4) [44]. Because of registration difficulties, only four out of 10 index measures (maternal death, intrapartum or perinatal death, uterine rupture, Apgar score less than 7 after 5 min) will be assessed.

Fig. 4
figure 4

Weighted Adverse Outcome Score (WAOS). ICU, intensive care unit; NICU, neonatal intensive care unit [21].

Maternal and perinatal mortality ratios will also separately be evaluated, because these ratios are not independent in the combined mortality proportion. Finally, the ratio of maternal and perinatal mortality per total number of deliveries will be analysed.

Sample size calculation

Power calculation was carried out as described in both Hussey et al. and Woertman et al. [35,36,37] First the sample size calculation for a standard randomized clinical trial (RCT) was calculated. To show a reduction in CMP of 20% with an alpha of 0.05 and a power of 80%, a total of 6398 deliveries will be needed for a simple RCT design. The design effect was calculated assuming an intracluster correlation (ICC) of 0.05, a cluster size of 3343 deliveries per year, and seven clusters. Considering the design effect, we will need 2367 deliveries per measurement period. To achieve this number at least 5 weeks for each period will be needed. However, to obtain logistical possibilities, the duration of each step will be 7 weeks with a total study duration of 56 weeks. Statistical significance will be accepted at a two-sided p-value < 0.05.

Statistical analysis

All data will be collected, secured and stored in Mulago hospital. Access to the final trial dataset will be limited to persons who have to perform statistical analyses and to interpret results. The statistical analysis of the stepped wedge design will be analysed in different steps. First of all, differences in patient characteristics (age, parity, gestational age, single/multiple pregnancy, neonatal gender, birth weight) across clusters will be investigated with Kruskal-Wallis for numerical data and with exact chi-square statistics for categorical data. The characteristics that seem to be different across clusters (p < 0.05) will enter into the generalized linear mixed effects model (GLMM) for estimation of treatment effect. Here the outcome is the event (i.e. composite mortality rate, including maternal and perinatal mortality) on the individual and we will use a logit link function to model the probability of the event. In the logit scale, the cluster indicator will serve as random effect on the intercept, the selected patient characteristics will enter this model as linear predictors, the period of the stepped wedge is treated as categorical effect, as well as the treatment effect.

In mathematical terms the model can be formulated as follows:

$$ \mathrm{logit}\left[P\left({Y}_{ij}=1|{Z}_i,{\boldsymbol{P}}_{ij},{\boldsymbol{X}}_{ij},{T}_{ij}\right)\right]=\mu +{Z}_i+\sum \limits_{r=1}^R{\alpha}_r{P}_{ij r}+\sum \limits_{s=1}^S{\beta}_s{X}_{ij s}+\gamma {T}_{ij} $$

with the logit function given by logit(x) = log x − log(1 − x) and

Yij: the binary outcome on patient j in cluster i,

Zi: the random effect of cluster i, assumed to be normally distributed \( {Z}_i\sim N\left(0,{\sigma}_C^2\right) \), and with \( {\sigma}_C^2 \) the between-cluster variance,

Pij: a vector of indicators Pij = (Pij1, Pij2, …, PijR)T for patient j in cluster i that indicate in which period the observation is taken, with \( {\sum}_{r=1}^R{P}_{ijr}=1 \) and R the number of periods,

Xij: a vector of confounders Xij = (Xij1, Xij2, …, XijS)T for patient j in cluster i, and S the number of covariates.

Tij: the treatment indicator for patient j in cluster i.

μ: the overall intercept,

αr: the effect of period r

βs: the effect of confounder Xijs

γ: the effect of treatment [45].

Ethical considerations

Ethical approval was obtained from both the Mulago Research and Ethics Committee (Protocol MREC: 674), and the Uganda National Council for Science and Technology (UNCST, SS 3927). Written informed consent to participants in this study was obtained at the beginning of the first training day.

Discussion

In the last decades numerous evaluation studies on the effectiveness of simulation training in obstetric emergencies have been published, with increasing evidence that it is associated with improvement in clinical outcomes [13,14,15,16,17,18,19,20,21,22,23,24,25,26,27,28,29,30,31,32]. However, the results are not entirely consistent. The need for continued research in a wide variety of clinical settings to establish what works, where and why was recommended [14, 33]. Therefore we propose to use a randomized controlled trial design in settings where emergency obstetric simulation-based training is not yet widely established.

This stepped wedge cluster randomized trial will investigate the effect of a monodisciplinary simulation-based obstetric training focusing on both medical technical skills and crew resource management skills in a low-income country, on patient outcome at one of the largest labour wards worldwide. In this study, also other non-patient outcome measures will be included. We hypothesize that simulation-based obstetric training in a low-income country is acceptable and feasible for trainers and trainees, improves knowledge, skills, team performance and professional practice, and improves maternal and neonatal morbidity/mortality rates. Different from previous studies, we will use a robust study design which will allow us to better understand the training effects.

A limitation of this most accurate study design in one hospital is the need of fixed teams without contamination during working hours. Due to organizational constraints, such as exam periods and cluster inconsistency, this design may be hard to implement in a low-income country. Therefore pre-post analyses will be performed as well. Additionally, it was logistical impossible to create multidisciplinary fixed teams including midwives, junior house officers, SHOs, gynaecologists, paediatricians, and anaesthesiologist. Team training was set up monodisciplinary, with only first-, second-, and third-year SHOs. This group was chosen as they have a central and coordinating role in providing emergency obstetric care in this hospital, and they have to work in teams during their shift. However, training all obstetric team member would possibly contribute more to reduce maternal and neonatal morbidity and mortality. Another limitation is the selection of only gynaecologists to become local facilitators. They were selected by the head op department based on their clinical and teaching experience. Future studies should include other obstetric team members as facilitators and should include evaluation of personal suitability.

The primary outcome will be a composite of the maternal mortality ratio (MMR) and the perinatal mortality ratio (PMR). While there is a clear definition of the perinatal mortality ratio, issues with routine antenatal care visits and administration difficulties will give uncertainties in gestational age and moment of death. This will maybe influence data collection and interpretation. Improvement of data administration seems to be an important worldwide issue.

The current project fits well within the formulated Sustainable Development Goals agenda to ensure healthy lives and to promote wellbeing for newborns and mothers by specifically increasing the development, training and retention of health workforce in developing countries [4]. If this training program appears to be effective, this training should be implemented in the curriculum of the gynaecology training program in comparable low-income settings.

Availability of data and materials

The datasets which will be used and analysed during the current study will be available from the corresponding author on reasonable request.

Abbreviations

MDG:

Millennium development goals

SHO:

Senior house officer

CRM:

Crew resource management

CTS:

Clinical teamwork scale

Medsim:

Medical education and simulation centre Eindhoven

CMP:

Combined mortality proportion

MMR:

Maternal mortality ratio

PMR:

Perinatal mortality ratio

WAOS:

Weighted adverse outcome score

RCT:

Randomized clinical trial

References

  1. United Nations. Millennium development goals and beyond 2015. http://www.un.org/millenniumgoals/childhealth.shtml Accessed 13 July 2016..

  2. World Health Organization. Children: reducing mortality http://www.who.int/mediacentre/factsheets/fs178/en/ Accessed 28 Nov 2017..

  3. World Health Organization. Maternal mortality http://www.who.int/mediacentre/factsheets/fs348/en/ Accessed 28 Nov 2017..

  4. United Nations. Sustainable development goals http://www.un.org/sustainabledevelopment/health/ Accessed 28 Nov 2017..

  5. United Nations. The Millennium Development Goals Report 2015 http://www.un.org/millenniumgoals/2015_MDG_Report/pdf/MDG 2015 rev %28July 1%29.pdf?utm_source=MHTF+Subscribers&utm_campaign=502b6a8c8a-MH_Buzz_July_14_2015&utm_medium=email&utm_term=0_8ac9c53ad4-502b6a8c8a-183789913 Accessed 28 Nov 2017..

  6. Lancet T. Every newborn, every mother, every adolescent girl. Lancet. 2014;383(9919):755..

    Article  Google Scholar 

  7. Ministry of Finance, Planning and Economic Development the republic of U. Millennium Development Goals Report for Uganda 2013 http://www.ug.undp.org/content/dam/uganda/docs/UNDPUg-2013MDGProgress Report-Oct 2013.pdf Accessed 28 Nov 2017..

  8. Website WHO. Maternal Health. http://www.who.int/gho/maternal_health/countries/uga.pdf Accessed 28 Nov 2017..

  9. Mbonye AK, Mutabazi MG, Asimwe JB, Sentumbwe O, Kabarangira J, Nanda G, et al. Declining maternal mortality ratio in Uganda: priority interventions to achieve the millennium development goal. Int J Gynaecol Obstet. 2007;98(3):285–90..

    Article  CAS  PubMed  Google Scholar 

  10. MOH. Annual Health Sector Performance Report 2011/12. http://health.go.ug/docs/AHSPR_11_12.pdf Accessed 28 nov 2017..

  11. Kirkpatrick DL, Kirkpatrick JD. Evaluating Training Programs: The Four Levels. Berrett-Koehlar; 1994..

    Google Scholar 

  12. Black RS, Brocklehurst P. A systematic review of training in acute obstetric emergencies. BJOG. 2003:837–41..

  13. Merién AER, van de Ven J, Mol BW, Houterman S, Oei SG. Multidisciplinary team training in a simulation setting for acute obstetric emergencies: a systematic review. Obstet Gynecol. 2010;115(5):1021–31..

    Article  PubMed  Google Scholar 

  14. Crofts JF, Winter C, Sowter MC. Practical simulation training for maternity care--where we are and where next. BJOG. 2011;118(Suppl):11–6..

    Article  PubMed  Google Scholar 

  15. van Lonkhuijzen L, Dijkman A, van Roosmalen J, Zeeman G, Scherpbier A. A systematic review of the effectiveness of training in emergency obstetric care in low-resource environments. BJOG. 2010;117(7):777–87..

    Article  PubMed  Google Scholar 

  16. Bergh A-M, Baloyi S, Pattinson RC. What is the impact of multi-professional emergency obstetric and neonatal care training? Best Pract Res Clin Obstet Gynaecol. 2015;29(8):1028–43..

    Article  PubMed  Google Scholar 

  17. Mduma ER, Ersdal H, Kvaloy JT, Svensen E, Mdoe P, Perlman J, et al. Using statistical process control methods to trace small changes in perinatal mortality after a training program in a low-resource setting. Int J Qual Heal care J Int Soc Qual Heal Care. 2018;30(4):271–5..

    Article  Google Scholar 

  18. Rule ARL, Maina E, Cheruiyot D, Mueri P, Simmons JM, Kamath-Rayne BD. Using quality improvement to decrease birth asphyxia rates after “helping babies breathe” training in Kenya. Acta Paediatr. 2017;106(10):1666–73..

    Article  PubMed  Google Scholar 

  19. Eblovi D, Kelly P, Afua G, Agyapong S, Dante S, Pellerite M. Retention and use of newborn resuscitation skills following a series of helping babies breathe trainings for midwives in rural Ghana. Glob Health Action. 2017;10(1):1387985..

    Article  PubMed  PubMed Central  Google Scholar 

  20. Msemo G, Massawe A, Mmbando D, Rusibamayila N, Manji K, Kidanto HL, et al. Newborn mortality and fresh stillbirth rates in Tanzania after helping babies breathe training. Pediatrics. 2013;131:e353–60..

    Article  PubMed  Google Scholar 

  21. Mduma E, Ersdal H, Svensen E, Kidanto H, Auestad B, Perlman J. Frequent brief on-site simulation training and reduction in 24-h neonatal mortality-an educational intervention study. Resuscitation. 2015;93:1–7..

    Article  PubMed  Google Scholar 

  22. Gomez PP, Nelson AR, Asiedu A, Addo E, Agbodza D, Allen C, et al. Accelerating newborn survival in Ghana through a low-dose, high-frequency health worker training approach: a cluster randomized trial. BMC Pregnancy Childbirth. 2018;18(1):72..

    Article  PubMed  PubMed Central  Google Scholar 

  23. Dumont A, Fournier P, Abrahamowicz M. Traor?? M, Haddad S, Fraser WD. Quality of care, risk management, and technology in obstetrics to reduce hospital-based maternal mortality in Senegal and Mali (QUARITE): a cluster-randomised trial. Lancet. 2013;382(9887):146–57..

    Article  PubMed  Google Scholar 

  24. Nelissen E, Ersdal H, Mduma E, Evjen-Olsen B, Twisk J, Broerse J, et al. Clinical performance and patient outcome after simulation-based training in prevention and management of postpartum haemorrhage: an educational intervention study in a low-resource setting. BMC Pregnancy Childbirth. 2017;17(1):7..

    Article  Google Scholar 

  25. Sorensen BL, Rasch V, Massawe S, Nyakina J, Elsass P, Nielsen BB. Advanced life support in obstetrics (ALSO) and post-partum hemorrhage: a prospective intervention study in Tanzania. Acta Obstet Gynecol Scand England. 2011;90(6):609–14..

    Article  Google Scholar 

  26. Andreatta P, Gans-Larty F, Debpuur D, Ofosu A, Perosky J. Evaluation of simulation-based training on the ability of birth attendants to correctly perform bimanual compression as obstetric first aid. Int J Nurs Stud England. 2011;48(10):1275–80..

    Article  Google Scholar 

  27. Walker DM, Cohen SR, Fritz J, Olvera-García M, Zelek ST, Fahey JO, et al. Impact evaluation of PRONTO Mexico. Simul Healthc J Soc Simul Healthc 2016;11(1):1–9..

  28. Egenberg S, Karlsen B, Massay D, Kimaro H, Bru LE. “No patient should die of PPH just for the lack of training!” Experiences from multi-professional simulation training on postpartum hemorrhage in northern Tanzania: a qualitative study. BMC Med Educ. 2017;17(1):119..

    Article  PubMed  PubMed Central  Google Scholar 

  29. Egenberg S, Øian P, Bru LE, Sautter M, Kristoffersen G, Eggebo TM. Can inter-professional simulation training influence the frequency of blood transfusions after birth? Acta Obstet Gynecol Scand. 2015;94(3):316–23..

    Article  PubMed  PubMed Central  Google Scholar 

  30. Egenberg S, Masenga G, Bru LE, Eggebø TM, Mushi C, Massay D, et al. Impact of multi-professional, scenario-based training on postpartum hemorrhage in Tanzania: A quasi-experimental, pre- vs. post-intervention study. BMC Pregnancy Childbirth. 2017;17:1..

    Article  Google Scholar 

  31. Boet S, Bould MD, Fung L, Qosa H, Perrier L, Tavares W, et al. Transfer of learning and patient outcome in simulated crisis resource management: a systematic review. Can J Anesth. 2014:571–82..

  32. Pattinson RC, Bergh AM, Makin J, Pillay Y, Moodley J, Madaj B, et al. Obstetrics knowledge and skills training as a catalyst for change. South Afr Med J. 2018;108(9):748–55..

    Article  CAS  Google Scholar 

  33. Draycott TJ, Collins KJ, Crofts JF, Siassakos D, Winter C, Weiner CP, et al. Myths and realities of training in obstetric emergencies. Best Pract Res Clin Obstet Gynaecol. 2015;29(8):1067–76..

    Article  PubMed  Google Scholar 

  34. Mdege ND, Man M-S, Taylor Nee Brown CA, Torgerson DJ. Systematic review of stepped wedge cluster randomized trials shows that design is particularly used to evaluate interventions during routine implementation. J Clin Epidemiol. 2011;64(9):936–48..

    Article  PubMed  Google Scholar 

  35. Hussey MA, Hughes JP. Design and analysis of stepped wedge cluster randomized trials. Contemp Clin Trials. 2007;28(2):182–91..

    Article  PubMed  Google Scholar 

  36. Woertman W, de Hoop E, Moerbeek M, Zuidema SU, Gerritsen DL, Teerenstra S. Stepped wedge designs could reduce the required sample size in cluster randomized trials. J Clin Epidemiol. 2013;66(7):752–8..

    Article  PubMed  Google Scholar 

  37. de Hoop E, Woertman W, Teerenstra S. The stepped wedge cluster randomized trial always requires fewer clusters but not always fewer measurements, that is, participants than a parallel cluster randomized trial in a cross-sectional design. J Clin Epidemiol. 2013;66(12):1428..

    Article  PubMed  Google Scholar 

  38. Cook DA, Hatala R, Brydges R, Zendejas B, Szostek JH, Wang AT, et al. Technology-enhanced simulation for health professions education: a systematic review and meta-analysis. JAMA. 2011;306(9):978–88..

    Article  CAS  PubMed  Google Scholar 

  39. Issenberg SB, McGaghie WC, Petrusa ER, Lee Gordon D, Scalese RJ. Features and uses of high-fidelity medical simulations that lead to effective learning: a BEME systematic review. Med Teach. 2005;27(1):10–28..

    Article  PubMed  Google Scholar 

  40. Website WHO. http://www.who.int/healthinfo/statistics/indmaternalmortality/en/ Accessed 28 Nov 2017..

  41. Fransen AF, van der Hout-van der Jagt MB, Gardner R, van Runnard Heimel PJ, Oei SP, Oei SG, Capelle M, et al. Assessment tool for the instructional design of simulation-based team training courses: the ID-SIM. BMJ Simul Technol Enhanc Learn. 2017;4(2):59–64..

    Article  Google Scholar 

  42. Nelissen E, Ersdal H, Ostergaard D, Mduma E, Broerse J, Evjen-Olsen B, et al. Helping mothers survive bleeding after birth: an evaluation of simulation-based training in a low-resource setting. Acta Obstet Gynecol Scand. 2014;93(3):287–95..

    Article  PubMed  Google Scholar 

  43. Guise J-M, Deering SH, Kanki BG, Osterweil P, Li H, Mori M, et al. Validation of a tool to measure and promote clinical teamwork. Simul Healthc. 2008;3(4):217–23..

    Article  PubMed  Google Scholar 

  44. Nielsen PE, Goldman MB, Mann S, Shapiro DE, Marcus RG, Pratt SD, et al. Effects of teamwork training on adverse outcomes and process of care in labor and delivery: a randomized controlled trial. Obstet Gynecol. 2007;109:48–55..

    Article  PubMed  Google Scholar 

  45. Molenberghs G, Verbeke G. Models for discrete longitudinal data. New York: Springer-Verlag; 2005..

    Google Scholar 

Download references

Acknowledgements

We thank E.R. van den Heuvel for help with the statistical analysis and D. Kienhorst for reviewing the manuscript.

Funding

This study was supported by Máxima Medical Center, Veldhoven, the Netherlands and Rotary Clubs in the Netherlands and Uganda. Both supported in training supplies such as medical materials for each scenario, paperwork needed for documentation, and the video recording system.

Author information

Authors and Affiliations

Authors

Contributions

AvT, AvM, PN, BvdH, LM, BN, IN, JB, and SGO were involved in conception and design of the study. AvT and AvM drafted the manuscript. AvT, AvM, PN, BvdH, LM, BN, IN, AN, JB, and SGO reviewed the manuscript critically and approved submission. AvT, PN, BvdH will do the data collection and analysis. All authors will have a contribution in the implementation of the intervention and interpretation of data.

Corresponding author

Correspondence to A. A. C. van Tetering.

Ethics declarations

Ethics approval and consent to participate

Ethical permission was obtained from both the Mulago Research and Ethics Committee (Protocol MREC: 674), and the Uganda National Council for Science and Technology (UNCST, SS 3927). Written informed consent to participants in this study was obtained at the beginning of the first training day.

Consent for publication

Written informed consent will be obtained for publication of included participants. Informed consent will not be obtained of patient recorded in the Mulago Hospital registration books, because the data from the registration books will be entirely unidentifiable and there will be no details on individuals reported.

Competing interests

The authors declare that they have no competing interests.

Additional information

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Supplementary information

Additional file 1.

Knowledge test. 30-item multiple choice knowledge test about technical and non-technical skills.

Additional file 2.

Skills checklist. Skills checklist of postpartum haemorrhage based on literature and clinical experience.

Rights and permissions

Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated in a credit line to the data.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

van Tetering, A.A.C., van Meurs, A., Ntuyo, P. et al. Study protocol training for life: a stepped wedge cluster randomized trial about emergency obstetric simulation-based training in a low-income country. BMC Pregnancy Childbirth 20, 429 (2020). https://doi.org/10.1186/s12884-020-03050-3

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/s12884-020-03050-3

Keywords