Skip to main content
Download PDF

The Tommy’s Clinical Decision Tool, a device for reducing the clinical impact of placental dysfunction and preterm birth: protocol for a mixed-methods early implementation evaluation study

BMC Pregnancy and Childbirth volume 22, Article number: 639 (2022) Cite this article

Abstract

Background

Disparities in stillbirth and preterm birth persist even after correction for ethnicity and social deprivation, demonstrating that there is wide geographical variation in the quality of care. To address this inequity, Tommy’s National Centre for Maternity Improvement developed the Tommy’s Clinical Decision Tool, which aims to support the provision of “the right care at the right time”, personalising risk assessment and care according to best evidence. This web-based clinical decision tool assesses the risk of preterm birth and placental dysfunction more accurately than current methods, and recommends best evidenced-based care pathways in a format accessible to both women and healthcare professionals. It also provides links to reliable sources of pregnancy information for women. The aim of this study is to evaluate implementation of Tommy’s Clinical Decision Tool in four early-adopter UK maternity services, to inform wider scale-up.

Methods

The Tommy’s Clinical Decision Tool has been developed involving maternity service users and healthcare professionals in partnership. This mixed-methods study will evaluate: maternity service user and provider acceptability and experience; barriers and facilitators to implementation; reach (whether particular groups are excluded and why), fidelity (degree to which the intervention is delivered as intended), and unintended consequences. Data will be gathered over 25 months through interviews, focus groups, questionnaires and through the Tommy’s Clinical Decision Tool itself. The NASSS framework (Non-adoption or Abandonment of technology by individuals and difficulties achieving Scale-up, Spread and Sustainability) will inform data analysis.

Discussion

This paper describes the intervention, Tommy’s Clinical Decision Tool, according to TiDIER guidelines, and the protocol for the early adopter implementation evaluation study. Findings will inform future scale up.

Trial registration

This study was prospectively registered on the ISRCTN registry no. 13498237, on 31st January 2022.

Peer Review reports

Background

Poor perinatal outcomes are more common in those from ethnic minority and socially deprived groups [1]. However, even after adjustment for socio-economic and demographic characteristics, wide variation between hospital stillbirth and preterm birth rates persists [2]. This suggests that inequity in maternity care, including risk assessment and targeting of effective interventions, is an important issue that needs to be addressed. The UK’s National Health Service (NHS) Long Term Plan [3] primarily aims to ensure national programmes are focused on reducing health inequalities and addressing unwarranted variation in care, whilst empowering people to have more control over their own health, and more personalised care when they need it.

Reducing stillbirth and preterm birth rates in the UK remains a priority. In 2016 the Saving Babies’ Lives Care Bundle (SBLCB) was published by NHS England [4]. This document sets out evidence-based guidance for maternity services to achieve a UK Government target to halve stillbirths by 2030. The bundle focused on four elements: reducing smoking in pregnancy; risk assessment and surveillance for fetal growth restriction; raising awareness of reduced fetal movement and effective fetal monitoring during labour. The second version of the care bundle, published in 2019, included a new element, which focused on preventing preterm birth [5], and followed a new UK Government target to reduce the preterm birth rate from 8 to 6% by 2025 [6].

All recent national reports have identified that staff struggle with a lack of information, support and resources to provide the best care. The Each Baby Counts project investigated care related to babies who died (stillbirth or neonatal death) or suffered brain injury during birth. They found that, in 76% of cases under consideration, inadequate risk assessment and recognition was a critical contributory factor to the outcome. They also reported that in half (50%) of the cases, failure to follow guidelines or locally agreed best practice was a critical contributory factor [7]. Reasons for not following guidelines included gaps in training, lack of recognition of problems, heavy workload, staffing levels and local guidelines not being based on best available evidence.

Effective interventions can improve outcomes: aspirin can prevent placental dysfunction and preterm preeclampsia [8]; progesterone and cervical cerclage can prevent preterm birth [9, 10]. However, these interventions need to be timely, and targeted appropriately, which relies on accurate identification of women with at-risk pregnancies and equity in care provision. At present, risk assessment in pregnancy is undertaken using a checklist approach that has been used ever since the introduction of formal antenatal care. The checklist does not weigh risk factors, assess interaction between risk factors, or include risk reduction for absence of any risks. Most notably, this form of risk assessment is devoid of a personalised or numerical risk score – thereby precluding effective risk communication and personalisation of care for the individual woman.

To address the need to improve risk assessment in pregnancy and reduce inequity in service provision, the Tommy’s National Centre for Maternity Improvement developed the Tommy’s Clinical Decision Tool. The Centre is a collaboration between Tommy’s charity (Registered charity no.1060508), the Royal College of Obstetricians and Gynaecologists (RCOG), the Royal College of Midwives (RCM) and the Women’s Voices Network, with several universities (Bristol, Sheffield, St George’s London, King’s College London) and charities (Mothers for Mothers, Prompt Maternity Foundation). The Tommy’s Clinical Decision Tool is a web-based CE marked medical device that processes information directly entered by women themselves as well as clinical test results. It uses this information to more accurately, and automatically, assess a woman’s risk of preterm birth and pregnancy complications such as preeclampsia and fetal compromise which can lead to stillbirth. It does this by utilising three validated algorithms for risk assessment and clinical decision support; one for placental disorders (preeclampsia, stillbirth) [11] and two for preterm birth, one at the beginning of pregnancy [12] and the other during pregnancy if women present with symptoms of threatened preterm labour [13]. The tool not only provides individualised risk assessment at the point of care, but also recommends care pathways which are based on best practice and current national guidance. This will lead to better targeting of interventions for preventing stillbirth and preterm birth, whilst providing reassurance and avoiding unnecessary intervention for women at low risk. The Tommy’s Clinical Decision Tool provides women with access to their assessments and care recommendations, along with links to good quality, reliable information.

This programme fits with the NHS England’s Maternity Transformation Programme, which seeks to implement the vision set out in “Better Births” [14], that all pregnant women should have access to individualised and safe care, with healthcare providers harnessing advancements in digital health data management. The Tommy’s Clinical Decision Tool utilises digital technology that will ensure access to high quality care for all women, including those who are most likely to suffer the poorest outcomes.

Many promising technological innovations in health and social care are characterised by non-adoption or abandonment by individuals or by failed attempts to scale up locally, spread distantly, or sustain the innovation long term at the organisation or system level. Digital clinical decision support tools require an expanded scope of health worker engagement across the health system in order to scale them up effectively [15]. In order to address this, our implementation strategy has taken account of current evidence regarding success factors which include: a strong evidence base, professional consensus, service user and provider involvement, adequate training for clinicians, decision support results available to healthcare service users as well as providers, automatic provision of decision support and provision of decision support where and when decisions are being made [16].

The Tommy’s National Centre for Maternity Improvement programme aims to see implementation of the Tommy’s Clinical Decision Tool in all NHS maternity services. This will be carried out over four phases (Fig. 1). In Phase I (2020) development and beta testing of the first iteration of the tool were carried out with the Tommy’s Centre dedicated women’s involvement group, and healthcare professionals (HCPs) based in two NHS hospitals through a series of “digital workshops”. This involved initial testing and familiarisation of the prototype tool, refinements to the application and development of training packages. In Phase II, the tool is being implemented as a service development project in four early adopter NHS Trusts. In Phase III, the tool will be rolled-out to another 13 maternity services as part of a 26 site cluster randomised controlled trial (RCT), when the efficacy of the tool in the targeting of appropriate care and improved outcomes will be investigated, along with an evaluation of healthcare costs. Phase IV will see implementation of the tool in all NHS maternity services.

Fig. 1
figure 1

Overview of Tommy's Clinical Decision Tool Implementation and Evaluation Programme

Full size image

In this paper we provide a detailed description of the intervention, the Tommy’s Clinical Decision Tool, and describe the protocol for a mixed-methods study evaluating the implementation of the Tool in four early adopter NHS Trusts (Phase II).

The intervention: Tommy’s Clinical Decision Tool

The Tommy’s National Centre for Maternity Improvement developed a Community of Practice (CoP) group to engage and involve relevant UK maternity care providers and users from a broad geographic and socio-demographic background in the design, development and testing of the device. The CoP formed a consensus on suitable algorithms for use as well as agreeing definitions for risk groups and corresponding personalised care pathways. They agreed that the included algorithms should ideally be taken from high quality RCTs carried out in settings relevant to the UK health care system and demonstrating consistent clinical benefit. Where such trials were unavailable, algorithms would be taken from high quality intervention studies incorporating an appropriate standard care comparison group and showing improvements in relevant clinical outcomes and/or health care resource use, establishing external validation. Two systematic reviews were conducted to identify internally and externally validated multiple marker algorithms suitable for use in risk assessment for placental dysfunction, preterm birth and threatened preterm labour [17, 18].

A systematic review of the literature identified four internally validated first trimester algorithms to predict preterm birth. All used maternal characteristics, medical and previous obstetric history. The only algorithm calculating risk of preterm birth before 34 weeks was selected [12]. The algorithm had also been externally validated in a Dutch cohort [18].

The best performing model for placental function assessment, of the 11 identified, had been developed over 15 years with data from more than 120,000 pregnancies. The regression model uses maternal characteristics (age, height, weight, ethnicity, family history of pre-eclampsia, medical and obstetric history), as well as current blood pressure, first trimester uterine artery Doppler and maternal serum PAPP-A or PlGF. The algorithm was validated in a large multi-centre NIHR trial involving over 16,000 pregnancies, and was shown to have good performance with both improved sensitivity and specificity compared to current NICE recommendations [19]. Efficacy in identifying women at high risk of pre-eclampsia, who were prescribed aspirin, with subsequent reduction of preterm pre-eclampsia, was demonstrated in a large multi-centre double-blind RCT [20]. Effectiveness in a ‘real world’ setting has also been demonstrated [11].

The algorithm used for assessment in threatened preterm labour utilises risk factors and clinical test results (fetal fibronectin and/or transvaginal ultrasound measurement of cervical length). It is recommended in the Saving Babies Lives Care Bundle v.2, and has been externally validated [13]. A prospective evaluation demonstrated that the algorithm could safely guide management and avoid hospitalisation in the vast majority (90%) of cases [21]. The current National Institute for Health and Care Excellence (NICE) guideline recommends a treat-all approach for women presenting with symptoms before 30 weeks’ gestation. If applied in this cohort, all women would have been admitted, exposing the vast majority of mothers and their babies to unnecessary hospitalisation, medical intervention and in-utero transfers.

The care pathways recommended by the Tool are taken from national guidelines, which include the Saving Babies Lives Care Bundle v.2 [4]. Table 1 column 4 summarises the care pathways that may be recommended, depending on result of the individualised risk assessment, at specific timepoints.

Table 1 Tommy's Clinical Decision Tool assessments, key input variables and care pathway recommendations
Full size table

In some circumstances, the individual risk assessment is over-ridden and the application defaults to recommend alternative pathways. These are shown in Table 2.

Table 2 Conditions or situations in which individual risk assessment using the Tool defaults to alternative pathways
Full size table

All women are encouraged to register and to use the Tommy’s Clinical Decision Tool’s Information Hub, however, in women with multiple pregnancy, the risk assessment functions are disabled. In women with pre-existing diabetes or pre-existing hypertension, only the initial preterm birth risk assessment is available. This is because comprehensive care pathways are already established, and these women are referred to local specialist teams. Trusts may also choose to use the Tommy’s Clinical Decision Tool alongside local guidance when delivering care for women with other conditions, such as Antiphospholipid Syndrome or Chronic Kidney Disease.

The Tommy’s Clinical Decision Tool has a dual interface: one for use by the maternity service user, with accessible terminology, through which they can also access the Information Hub, and one for healthcare professionals, through which data is verified and/or entered by the clinician. The interfaces were designed and developed by clinicians and women, who approved use of incorporated terminology. Figure 2 shows an example of the dual interface following a placental function assessment.

Fig. 2
figure 2

Tommy's Clinical Decision Tool dual interface: example of placental function assessment

Full size image

Maternity service users are encouraged to register on the Tool prior to their booking appointment (i.e. the first contact with a midwife who takes a full history and makes plans for her pregnancy care). Once registered, the woman enters information about herself and her medical and obstetric history. During the appointment, the midwife checks with the woman and verifies this information, runs the preterm risk assessment, explains the recommended care pathway and makes any necessary referrals. Before the woman is 16 weeks pregnant, a healthcare professional, usually her midwife, will enter results from her first trimester ultrasound scan, blood results and blood pressure measurement (column 3, Table 1), runs the placental function assessment and actions the recommended care pathway. If the woman later experiences changes in fetal movements, or symptoms of possible preterm labour, the Tommy’s Clinical Decision Tool is used to carry out further risk assessments and generate appropriate care recommendations. An overview of touchpoints is shown in Fig. 3, while more detail on these processes is provided in Table 3.

Fig. 3
figure 3

Tommy's Clinical Decision Tool touchpoints for risk assessment

Full size image
Table 3 Tommy's Clinical Decision Tool—intervention processes
Full size table

Tommy’s Clinical Decision Tool Information Hub

The Information Hub provides women with links to the latest evidence-based information and guidance from trusted resources such as the NHS, Tommy’s charity and the Royal College of Obstetricians and Gynaecologists. It displays relevant links at different stages in the woman’s pregnancy, based on her gestation at the time she accesses the hub. This resource, which will be regularly reviewed and updated, currently provides links to information on the conditions and issues listed in Table 4.

Table 4 Conditions and issues covered in the Tommy's Clinical Decision Tool Information Hub
Full size table

Data storage

Data collected through the Tool will initially be held by the Royal College of Obstetricians and Gynaecologists (RCOG), who will host the data in a secure, closed cloud storage in line with NHS Digital security standards. The data will then be securely migrated to NHS Digital and hosted in their Cloud Centre for Excellence (Cloud CfE).

Methods/Design

Study aim and objectives

Aim

The study is an implementation process evaluation, based on current guidance [22,23,24], which aims to provide evidence to support the planned ‘real world implementation’ of Tommy’s Clinical Decision Tool within the NHS.

Objectives

  • To understand the functioning of the Tommy’s Clinical Decision Tool by specifying intervention description and implementation strategies, and examining implementation outcomes, mechanisms of impact, and contextual factors in four early adopter NHS Trusts.

  • Assessment of acceptability and usability of the Tool, and acceptability of the personalised risk assessment and care recommendations it provides. This will be assessed from the perspectives of maternity service users, health professionals and organisations.

  • Assessment of barriers and facilitators to successful implementation.

  • Assessment of reach, i.e., whether the Tool is used by, and for risk assessment of, a representative sample of the population of maternity service users.

  • Assessment of fidelity, i.e., whether the Tool is used and implementation proceeds as expected.

  • Identification of unintended consequences.

Study design

This project is a mixed-methods implementation evaluation study, which will be carried out in four NHS Trusts (five hospital sites). It consists of three Work Packages: 1. Evaluation of healthcare professionals and providers views and experience of using the Tommy’s Clinical Decision Tool; 2. Evaluation of women’s views and experience of the tool and the maternity care it has influenced and 3. Evaluation of reach and fidelity.

Implementation outcome measures

  1. 1.

    Acceptability and usability will be measured using qualitative data from focus groups and interviews with women and healthcare professionals/providers and study specific online questionnaires developed for this study (Additional Files 1, 2 and 3), that include the mHealth App Usability Questionnaire (MAUQ) for Standalone mHealth Apps [25]. This will include evaluation of an implementation toolkit (i.e. a collection of resources to aid training and implementation).

  2. 2.

    Barriers and facilitators will be measured using qualitative data from focus groups and interviews and online questionnaires.

  3. 3.

    Reach will be measured using qualitative data from focus groups and interviews, online questionnaires and comparison of aggregate data collected through the Tool with Trust maternity data.

  4. 4.

    Fidelity will be measured using qualitative data from focus groups and interviews, online questionnaires, comparison of aggregate data collected through the Tool with Trust maternity data, and site records of training activity.

  5. 5.

    Unintended consequences will be measured using qualitative data from focus groups and interviews, online questionnaires and data collected through the Tommy’s Clinical Decision Tool and Trust maternity statistics. The relationship between the work packages and implementation outcomes is demonstrated in Fig. 4.

    Fig. 4
    figure 4

    The relationship between Study Work Packages and Implementation Outcomes

    Full size image

Participants

Work Package 1 – Health professionals’ and providers’ views and experience

HCPs will be invited to complete an online questionnaire through posters/flyers and by local Champions, Research Midwives and by Trust email. Those who are willing to consider further participation in interviews or focus groups will be selected through a process of purposive sampling. This method of sampling has been chosen to ensure that the experiences of a wide range of HCPs are investigated in more detail, e.g., clinicians with little or much experience, those in management of staff or IT systems. Five HCPs from each site will be interviewed, and 5–8 HCPs will be invited to one of two focus groups per site. In total, there will be 25 HCP interviews, and 10 focus groups of 5–8 HCPs.

Work Package 2 – Women’s views and experience

All pregnant women choosing to book their maternity care at participating Trusts and who register to use the tool at or before their booking appointment will be eligible. Potential participants will be invited through posters/flyers and direct contact. When the women first register to use the tool they will see a page of text explaining the study. They will be asked to consider agreeing to their contact details and expected and actual date of birth of their baby being passed to researchers. All women agreeing to contact by researchers will be texted and/or emailed an invitation to complete an online questionnaire during pregnancy, and after their baby is born. At the end of the online questionnaires, participants will be given the opportunity to enter their name and email address if they are willing to consider being interviewed or participating in a focus group. To ensure a wide range of experiences and views are captured during focus groups and interviews, purposive sampling will be used to identify women with different demographic characteristics, (e.g., age group, ethnic group, parity, Index of Multiple Deprivation (IMD) decile); risk status, as determined by the Tommy’s Clinical Decision Tool (i.e., low, moderate, high); pregnancy outcome (i.e., late miscarriage or stillbirth, neonatal death, preterm birth, live birth). Based on numbers of births in participating Trusts, with a 20% response rate over 9 months data collection period, we estimate that 3,330 women will complete at least one online questionnaire. Of these, 40 women will be invited for interview and 5–8 will be invited to one of two focus groups per site. Women whose preferred language is not English will be offered the opportunity to have the interview conducted through an interpreter.

Work Package 3 – Evaluation of reach and fidelity

The number of records included in the aggregate data will depend on final numbers of women booking for maternity care and giving birth to their babies at the early adopter Trusts. Estimated sample size (n = 16,663 births) was based on average number of births at participating Trusts recorded on NHS Digital’s National Maternity Dataset.

Data collection

Qualitative data

The semi-structured interviews will last around one hour and be organised at a time and place convenient to the participant. Focus groups will last around one and a half hours and be carried out either virtually (e.g. MSTeams or Zoom) or face-to-face. An interview schedule and topic guides will be used to direct the discussion on the participant’s views and experience of using the Tool, as well as their understanding of the rationale for risk assessment and recommendations for care. We will also explore how information provided through the tool was used by women to inform decisions about their care. Interviews and focus groups will be recorded on an encrypted digital recording device and/or the online platform, and uploaded to a secure server managed by a University approved transcription service. During the process of transcription, names and any information that may lead to identification of participants will be removed or changed to maintain anonymity. Transcripts will be produced and downloaded by the researchers who will store them on a secure University Microsoft Sharepoint site specific to this study.

Online questionnaires

Online questionnaires will be managed through Qualtrics, a University approved online survey management system. The first page of the questionnaire will have brief information about the study and a link to the full participant information sheet. Participants will be asked to confirm they have read this information sheet and consent to continue. If willing, they will be asked questions about their experience of using the Tool, risk assessment, recommended care pathways and their pregnancy outcomes. They will also be asked about their use of the Tool’s Information Hub and whether it influenced any decisions they made about seeking further advice or care. The computer device identification number (IP address) will be kept in order to minimise the chance of the same participant completing a duplicate questionnaire. Other than the IP address, no identifiers will be stored, unless entered by women who consent to be contacted about the interviews or focus groups.

Aggregate data

Aggregate data for Work Package 3, exploring reach and fidelity, will be obtained through the Tool developer or from NHS Digital. All women booked for maternity care will be advised that their clinical data is managed according to standards approved by NHS Digital and those who do not wish their data to be used for research purposes can opt-out. This information will be made available to them via their booking letter and when they register on the Tool. Aggregate data on characteristics and outcomes of all women receiving maternity care at participating Trusts will be obtained either from individual Trusts or through NHS Digital’s publicly available Maternity Services Data Set (MSDS). The data will be used to describe and explore factors as listed in Table 5.

Table 5 Work Package 3: Reach and Fidelity, factors to be investigated
Full size table

Data analysis

Qualitative data

Qualitative data collected through interviews and focus groups will be managed through NVivo qualitative data software and analysed using a thematic framework approach. The Framework approach [26] is a method of qualitative data analysis designed to generate findings that can inform practice and policy and the steps used within this approach lend themselves well to the data likely to be generated in this study. Data analysis will be informed by the NASSS (Non-adoption or Abandonment of technology by individuals and difficulties achieving Scale-up, Spread and Sustainability) framework [27], in addition to inductive analysis (where the researcher is open to new themes emerging from the data). This framework was chosen because it is an evidence-based, theory-informed and pragmatic framework to help predict and evaluate the success of a technology-supported health or social care program. A proportion of transcripts and identification of themes will be reviewed by a second experienced researcher to increase validity.

Online questionnaires

Statistical software will be used to explore and analyse the quantitative data gathered through the questionnaires. Participant demographic characteristics and risk profiles will be explored using descriptive statistics (i.e., frequencies and percentages) and groups will be compared using multivariate and multilevel logistic regression models. Regression models will be adjusted to account for maternal demographic and risk characteristics. Differences between groups will be considered statistically significant if the p value is ≤ 0.05. Qualitative data gathered through free text boxes, (e.g., answers to the question: “Is there anything else you would like to tell us about your experience of using the tool?”) will be analysed using qualitative thematic analysis.

Aggregate data

Participant characteristics, risk status, care pathways and outcomes will be explored using descriptive statistics (i.e., frequencies and percentages) and groups (i.e. those registered on the Tool and all maternity service users) will be compared using Pearson’s Chi-squared tests and multilevel logistic regression models. Regression models will be adjusted to account for maternal demographic and risk characteristics. Differences between groups will be considered statistically significant if the p value is ≤ 0.05. Apparent differences will be explored and described in detail.

Ethical issues

Potential distress to participants

It is possible that some women may find recounting their experience of pregnancy and birth distressing, particularly those experiencing poor outcomes. In order to minimise any potential distress, the email texts and online questionnaires were sensitively composed and were approved by our PPI group, some of whom have experienced poor pregnancy outcomes themselves. Participants will be reminded that their participation is voluntary and they can withdraw at any time. The research team will assess whether significant risks are emerging during data collection. If they are, participants will be directed to a resources document with contact details of organisations and charities who offer support. The researcher will also offer to provide help in obtaining support from other sources, such as her GP.

Incentives

Healthcare professionals will be offered vouchers worth £10 for participating in interviews and £20 for participating in focus groups. Women completing the online questionnaires will be offered the opportunity to be entered into a draw for a £100 shopping voucher. Interview and focus group participants in Work Package 2 will be offered a thank-you voucher worth £20.

Public and patient involvement

The study’s Public and Patient Involvement (PPI) Lead is a member of the Women’s Network and the Women’s Voices Involvement Panel. This group includes women with lived experience of preterm birth, stillbirth and neonatal death, women with a usual birth experience representing those not immediately considered high risk, and women with no maternity experience representing the views of first-time mothers. The group has been involved in the design and development of the Tommy’s Clinical Decision Tool and this implementation evaluation study from inception, attending workshops and Community of Practice events. They have informed the design, language, communication of risk, user experience, functionality, patient information, implementation plans as well as study participant documents and data collection instruments.

Discussion

This study will evaluate the implementation of Phase II of the Tommy’s National Centre for Maternity Improvements’ Tommy’s Clinical Decision Tool programme. The Tool is used for risk assessment and provides evidence-based care recommendations to reduce inequalities in service provision and, ultimately, stillbirth and preterm birth. Evaluating implementation in four early adopter maternity services gives us the opportunity to evaluate implementation processes and produce findings that will inform wider scale up as, all too often, the successful implementation of a healthcare intervention in one context is not necessarily replicated in others [28].

The Tommy’s Clinical Decision Tool will allow maternity services to effectively implement the best evidenced-based care, including those pathways recommended in SBLCB v.2, with its additional element for reducing preterm birth. It will also, importantly, allow more effective targeting of these pathways through more accurate risk assessment. Widdows and colleagues [29] reported findings from a pragmatic study comparing clinical and process outcomes before and after implementation of the first version of the Saving Babies Lives Care Bundle. Although the stillbirth rate had fallen from 4.2 to 3.4 per 1,000 over the study period (aRR 0.80, (95% CI 0.70 to 0.91, P < 0.001), they were not able to confirm this was a direct result of the implementation of the care bundle. They did, however, report an increase in caesarean sections, inductions of labour, ultrasound scans, neonatal unit admissions and the proportion of small for gestational age infants detected. They recommended further prospective studies that could more rigorously evaluate the clinical and cost consequences of implementing SBLCB. Our evaluation of the Phase II implementation will allow us to answer some of the questions that remain unanswered by Widdows and colleagues [29], in a more rigorous prospective study. The next phase of the programme is a cluster RCT which will investigate the Tool’s effect on clinical outcomes (including rates of stillbirth and preterm birth), service outcomes (e.g. number of ultrasound scans, rates of induction and caesarean sections) and cost consequences.

A major strength of this programme is that its driving force is truly multidisciplinary in nature: a collaboration between maternity services users themselves, the professional bodies of the two main clinical disciplines in maternity care, academic expertise provided by several universities and the support of interested charities. Another strength is that the aims of the programme are in line with national policy, including the Maternity Transformation Programme [30] and the NHS Digital’s Data and information strategy [31]. Trusts implementing the Tommy’s Tool will also be able to claim a rebate from the Maternity Incentive Scheme (CNST) as the Tool is compliant with SBLCB.

We recognise that in its first iteration the Tommy’s Clinical Decision Tool is limited by a number of factors. Firstly, it is only available in the English language. Secondly, the Tool is not yet fully interactive with Trust maternity information systems. While this remains the case, healthcare professionals need to record the risk assessments and care recommendations on the Trust maternity records. These are significant barriers to successful reach and scale up, however, these issues are being addressed and resolutions will be applied to future iterations of the Tool.

The findings of this study will be reported using the Standards for Reporting Implementation Studies (StaRI) guidelines [32]. We have provided detailed description of the Tommy’s Clinical Decision Tool in this paper, but will report adaptations to the Tool, along with the implementation processes, in the main findings paper, according to the TIDieR guidelines for describing interventions [33].

Availability of data and materials

Not applicable. This paper describes a study protocol, and therefore contains no data.

Abbreviations

cCTG:

Computerised cardiotocograph

CFM:

Changed fetal movements

CL:

Cervical length

CoP:

Community of Practice

CRL:

Crown rump length

fFN:

Fetal fibronectin

HCP:

Healthcare professional/provider

KCL:

King’s College London

MAUQ:

MHealth App Usability Questionnaire

MoM:

Multiple of the Median

NHS:

National Health Service

PAPP-A:

Pregnancy Associated Plasma Protein-A

PF:

Placental Function

PPTL:

Possible preterm labour

PTB:

Preterm birth

RCT:

Randomised controlled trial

SBLCB:

Saving Babies Lives Care Bundle

ToB:

Timing of birth

USS:

Ultrasound scan

WP:

Work package

References

  1. Jardine J, Walker K, Gurol-Urganci I, Webster K, Muller P, Hawdon J, et al. Adverse pregnancy outcomes attributable to socioeconomic and ethnic inequalities in England: a national cohort study. Lancet. 2021;398(10314):1905–12.

    Article  Google Scholar 

  2. Aughey H, Blotkamp A, Carroll F, Geary R, Gurol-Urganci I, Harris T, Hawdon J, Heighway E, Jardine J, Knight H, Mamza L. National Maternity and Perinatal Audit: Clinical report 2019. Based on births in NHS maternity services between 1 April 2016 and 31 March 2017.London: RCOG; 2019 Oct. Available from: https://maternityaudit.org.uk/pages/reports.

  3. Alderwick H, Dixon J. NHS The Long Term Plan. British Medical Journal Publishing Group; 2019. Available from: www.longtermplan.nhs.uk/publication/nhs-long-term-plan/.

  4. NHS England. Saving Babies Lives: a care bundle for reducing stillbirths. 2016. Available from: https://www.england.nhs.uk/wp-content/uploads/2016/03/saving-babies-lives-car-bundl.pdf.

  5. NHS England. Saving Babies’ Lives Version 2: a care bundle for reducing perinatal mortality. 2019. Available from: https://www.england.nhs.uk/wp-content/uploads/2019/07/saving-babies-lives-care-bundle-version-two-v5.pdf.

  6. Department of Health and Social Care. Safer Maternity Care: The National Maternity Safety Strategy—Progress and Next Steps. London: The Stationery Office; 2017. Available from: https://www.gov.uk/government/publications/safer-maternity-care-progress-and-next-steps.

  7. Royal College of Obstetricians and Gynaecologists. Each Baby Counts: 2020 Final Progress Report. London: RCOG; 2021. Available from: https://www.rcog.org.uk/globalassets/documents/guidelines/research--audit/each-baby-counts/ebc-2020-final-progress-report.pdf.

  8. Roberge S, Bujold E, Nicolaides KH. Aspirin for the prevention of preterm and term preeclampsia: systematic review and metaanalysis. Am J Obstet Gynecol. 2018;218(3):287–93.

    Article  CAS  Google Scholar 

  9. Stewart LA, Simmonds M, Duley L, Dietz KC, Harden M, Hodkinson A, Llewellyn A, Sharif S, Walker R, Wright K. Evaluating progestogens for prevention of preterm birth international collaborative (EPPPIC) individual participant data (IPD) meta-analysis: protocol. Syst Rev. 2017;6(1):1–7.

    Article  Google Scholar 

  10. Alfirevic Z, Stampalija T, Medley N, Alfirevic Z. Cervical stitch (cerclage) for preventing preterm birth in singleton pregnancy. Cochrane database of systematic reviews; 2017. Available from: https://www.cochranelibrary.com/cdsr/doi/https://doi.org/10.1002/14651858.CD008991.pub3.

  11. Guy GP, Leslie K, Diaz Gomez D, Forenc K, Buck E, Khalil A, Thilaganathan B. Implementation of routine first trimester combined screening for pre-eclampsia: a clinical effectiveness study. BJOG. 2021;128(2):149–56. Available from: https://onlinelibrary.wiley.com/doi/abs/10.1111/1471-0528.16361.

    Article  CAS  Google Scholar 

  12. Beta J, Akolekar R, Ventura W, Syngelaki A, Nicolaides KH. Prediction of spontaneous preterm delivery from maternal factors, obstetric history and placental perfusion and function at 11–13 weeks. Prenat Diagn. 2011;31(1):75–83. Available from: https://api.istex.fr/ark:/67375/WNG-TCBWG89G-X/fulltext.pdf.

    Article  Google Scholar 

  13. Carter J, Seed PT, Watson HA, David AL, Sandall J, Shennan AH, Tribe RM. Development and validation of predictive models for QUiPP App v. 2: tool for predicting preterm birth in women with symptoms of threatened preterm labor. Ultrasound Obstet Gynecol. 2020;55(3):357–67.

    Article  CAS  Google Scholar 

  14. NHS England. National Maternity Review. Better Births; Improving Outcomes of Maternity Services in England. 2016. London: National Health Service.

  15. Orton M, Agarwal S, Muhoza P, Vasudevan L, Vu A. Strengthening delivery of health services using digital devices. Glob Health Sci Pract. 2018;6(Supplement 1):S61-71. Available from: https://www.ncbi.nlm.nih.gov/pubmed/30305340.

    Article  Google Scholar 

  16. Lobach D, Sanders GD, Bright TJ, Wong A, Dhurjati R, Bristow E, Bastian L, Coeytaux R, Samsa G, Hasselblad V, Williams JW. Enabling health care decisionmaking through clinical decision support and knowledge management. Evid Rep Technol Assess. 2012;(203):1–784. Available from: https://www.ncbi.nlm.nih.gov/pubmed/23126650.

  17. Meertens LJ, van Montfort P, Scheepers HC, van Kuijk SM, Aardenburg R, Langenveld J, van Dooren IM, Zwaan IM, Spaanderman ME, Smits LJ. Prediction models for the risk of spontaneous preterm birth based on maternal characteristics: a systematic review and independent external validation. Acta Obstet Gynecol Scand. 2018;97(8):907–20. Available from: https://www.narcis.nl/publication/RecordID/oai:cris.maastrichtuniversity.nl:publications%2F4660bf66-cef8-4994-af53-a411fe39566a.

    Article  Google Scholar 

  18. Meertens LJ, Scheepers HC, van Kuijk SM, Aardenburg R, van Dooren IM, Langenveld J, van Wijck AM, Zwaan I, Spaanderman ME, Smits LJ. External validation and clinical usefulness of first trimester prediction models for the risk of preeclampsia: a prospective cohort study. Fetal Diagn Ther. 2019;45(6):381–93.

    Article  Google Scholar 

  19. Tan MY, Wright D, Syngelaki A, Akolekar R, Cicero S, Janga D, Singh M, Greco E, Wright A, Maclagan K, Poon LC. Comparison of diagnostic accuracy of early screening for pre-eclampsia by NICE guidelines and a method combining maternal factors and biomarkers: results of SPREE. Ultrasound Obstet Gynecol. 2018;51(6):743–50. Available from: https://onlinelibrary.wiley.com/doi/abs/10.1002/uog.19039.

    Article  CAS  Google Scholar 

  20. Rolnik DL, Wright D, Poon LC, O’Gorman N, Syngelaki A, de Paco Matallana C, Akolekar R, Cicero S, Janga D, Singh M, Molina FS. Aspirin versus placebo in pregnancies at high risk for preterm preeclampsia. N Engl J Med. 2017;377(7):613–22. https://doi.org/10.1056/NEJMoa1704559.

    Article  CAS  PubMed  Google Scholar 

  21. Watson HA, Carter J, Seed PT, Tribe RM, Shennan AH. The QUiPP App: a safe alternative to a treat-all strategy for threatened preterm labor. Ultrasound Obstet Gynecol. 2017;50(3):342–6 (2017;50:342–6).

    Article  CAS  Google Scholar 

  22. World Health Organization. Monitoring and evaluating digital health interventions: a practical guide to conducting research and assessment. Geneva: World Health Organization; 2016. Available here: https://apps.who.int/iris/handle/10665/252183. License: CC BY-NC-SA 3.0 IGO.

  23. Moore GF, Audrey S, Barker M, Bond L, Bonell C, Hardeman W, Moore L, O’Cathain A, Tinati T, Wight D, Baird J. Process evaluation of complex interventions: Medical Research Council guidance. BMJ. 2015;350. https://doi.org/10.1136/bmj.h1258.

  24. Skivington K, Matthews L, Simpson SA, Craig P, Baird J, Blazeby JM, Boyd KA, Craig N, French DP, McIntosh E, Petticrew M. A new framework for developing and evaluating complex interventions: update of Medical Research Council guidance. BMJ. 2021;30:374.

    Google Scholar 

  25. Zhou L, Bao J, Setiawan IM, Saptono A, Parmanto B. The mHealth App Usability Questionnaire (MAUQ): development and validation study. JMIR Mhealth Uhealth. 2019;7(4):e11500.

    Article  Google Scholar 

  26. Ritchie J, Spencer L. Qualitative data analysis for applied policy research. Thousands Oaks: Sage; 2002. p. 305–29.

    Google Scholar 

  27. Greenhalgh T, Wherton J, Papoutsi C, Lynch J, Hughes G, Hinder S, Fahy N, Procter R, Shaw S. Beyond adoption: a new framework for theorizing and evaluating nonadoption, abandonment, and challenges to the scale-up, spread, and sustainability of health and care technologies. J Med Internet Res. 2017;19(11):e8775. Available from: https://www.ncbi.nlm.nih.gov/pubmed/29092808.

    Article  Google Scholar 

  28. Damschroder LJ, Aron DC, Keith RE, Kirsh SR, Alexander JA, Lowery JC. Fostering implementation of health services research findings into practice: a consolidated framework for advancing implementation science. Implement Sci. 2009;4(1):1–5. Available from: https://www.ncbi.nlm.nih.gov/pubmed/19664226.

    Article  Google Scholar 

  29. Widdows K, Roberts SA, Camacho EM, Heazell AE. Stillbirth rates, service outcomes and costs of implementing NHS England’s Saving Babies’ Lives care bundle in maternity units in England: a cohort study. PLoS One. 2021;16(4):e0250150.

    Article  CAS  Google Scholar 

  30. NHS England. Maternity Transformation Programme. Available from: https://www.england.nhs.uk/mat-transformation/. [Cited 2022].

  31. NHS Digital. Data and information strategy v.1. Leeds: Health and Social Care Information Centre. Available from: https://digital.nhs.uk/data-and-information/nhs-digital-data-and-information-strategy.

  32. Pinnock H, Barwick M, Carpenter CR, Eldridge S, Grandes G, Griffiths CJ, Rycroft-Malone J, Meissner P, Murray E, Patel A, Sheikh A. Standards for reporting implementation studies (StaRI) statement. BMJ. 2017;356. Available from: https://doi.org/10.1136/bmj.i6795.

  33. Hoffmann TC, Glasziou PP, Boutron I, Milne R, Perera R, Moher D, Altman DG, Barbour V, Macdonald H, Johnston M, Lamb SE. Better reporting of interventions: template for intervention description and replication (TIDieR) checklist and guide. BMJ. 2014;7:348.

    Google Scholar 

  34. Royal College of Midwives Education & Research conference brochure: Oral and poster presentation . abstracts. 2022. RCM: London. Available from: https://www.rcm.org.uk/media/5942/midirs-rcm-conference-supplement.pdf

Download references

Acknowledgements

The authors would like to sincerely thank the wider members of the Tommy’s National Centre for Maternity Improvement Programme Delivery Team for their advice, input and administrative support (Namely: Alessandra D’Angelo, Carly Edwards, Emma Gilgunn-Jones, Suzanne Gowiely, Gbenga Kayode, Victoria Komolafe, Ruta Margalete, Jo Tanner, Gemma Thurston and Dan Wolstenholme) and the Women’s Voices Involvement Group, who contributed their views and recommendations on the participant documents, focus group topic guide, interview schedule and design of the online questionnaires. Jane Sandall, at King’s College London, is an NIHR Senior Investigator and is supported by the National Institute for Health Research (NIHR) Applied Research Collaboration South London (NIHR ARC South London) at King’s College Hospital NHS Foundation Trust. The views expressed are those of the authors and not necessarily those of the NIHR or the Department of Health and Social Care. Early findings from this study were presented at the 2022 RCM Education and Research Conference [34].

Funding

This project is funded by Tommy’s charity (Registered charity no.1060508) and conducted by the Tommy’s National Centre for Maternity Improvement: a joint initiative of the Royal College of Obstetricians & Gynaecologists and the Royal College of Midwives. Apart from funding, the funder has no role in this study.

Author information

Authors and Affiliations

  1. Department of Women and Children’s Health, School of Life Course and Population Sciences, King’s College London, 10th Floor, North Wing, St Thomas’ Hospital, Westminster Bridge Road, London, SE1 7EH, UK

    Jenny Carter, Hannah Wilson & Jane Sandall

  2. Tommy’s National Centre for Maternity Improvement, Royal College of Obstetricians and Gynaecologists/Royal College of Midwives, 10-18 Union Street, London, SE1 1SZ, UK

    Jenny Carter, Dilly Anumba, Lia Brigante, Christy Burden, Tim Draycott, Siobhán Gillespie, Birte Harlev-Lam, Andrew Judge, Erik Lenguerrand, Elaine Sheehan, Basky Thilaganathan, Hannah Wilson, Cathy Winter, Maria Viner & Jane Sandall

  3. Department of Oncology and Metabolism, University of Sheffield, The Jessop Wing, Tree Root Walk, Sheffield, S10 2SF, UK

    Dilly Anumba & Siobhán Gillespie

  4. Royal College of Midwives, 10-18 Union Street, London, SE1 1SZ, UK

    Lia Brigante & Birte Harlev-Lam

  5. Academic Women’s Health Unit, University of Bristol, Bristol Medical School, Southmead Hospital, Bristol, BS10 5NB, UK

    Christy Burden

  6. Royal College of Obstetricians and Gynaecologists, 10-18 Union Street, London, SE1 1SZ, UK

    Tim Draycott

  7. Translational Health Sciences, University of Bristol, Bristol Medical School, Southmead Hospital, Bristol, BS10 5NB, UK

    Andrew Judge & Erik Lenguerrand

  8. Maternal Medicine Department, St George’s University Hospitals NHS Foundation Trust, Blackshaw Road, London, SW17 0QT, UK

    Elaine Sheehan

  9. Vascular Biology Research Centre, Molecular and Clinical Sciences Research Institute, St George’s University of London, Cranmer Terrace, London, SW17 0QT, UK

    Elaine Sheehan & Basky Thilaganathan

  10. Fetal Medicine Unit, St George’s University Hospitals NHS Foundation Trust, Blackshaw Road, London, SW17 0QT, UK

    Basky Thilaganathan

  11. PROMPT Maternity Foundation, Department of Women’s Health, The Chilterns, Southmead Hospital, Bristol, BS10 5NB, UK

    Cathy Winter

  12. Mothers for Mothers, New Fulford Family Centre, Gatehouse Avenue, Bristol, BS13 9AQ, UK

    Maria Viner

Authors
  1. Jenny Carter
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Dilly Anumba
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Lia Brigante
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Christy Burden
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Tim Draycott
    View author publications

    You can also search for this author in PubMed Google Scholar

  6. Siobhán Gillespie
    View author publications

    You can also search for this author in PubMed Google Scholar

  7. Birte Harlev-Lam
    View author publications

    You can also search for this author in PubMed Google Scholar

  8. Andrew Judge
    View author publications

    You can also search for this author in PubMed Google Scholar

  9. Erik Lenguerrand
    View author publications

    You can also search for this author in PubMed Google Scholar

  10. Elaine Sheehan
    View author publications

    You can also search for this author in PubMed Google Scholar

  11. Basky Thilaganathan
    View author publications

    You can also search for this author in PubMed Google Scholar

  12. Hannah Wilson
    View author publications

    You can also search for this author in PubMed Google Scholar

  13. Cathy Winter
    View author publications

    You can also search for this author in PubMed Google Scholar

  14. Maria Viner
    View author publications

    You can also search for this author in PubMed Google Scholar

  15. Jane Sandall
    View author publications

    You can also search for this author in PubMed Google Scholar

Contributions

JC and JS designed the study, with contributions, oversight, review and approval from all authors. All listed authors (DA, LB, CB, TD, SG, BH-L, AJ, EL, ES, BT, HW, CW and MV) contributed to development of the programme, the writing of the paper and have read and approved the final manuscript.

Corresponding author

Correspondence to Jenny Carter.

Ethics declarations

Ethics approval and consent to participate

The London-Bromley Research Ethics Committee approved the study (REC reference 21/PR/1029). The study will be conducted in compliance with the Research Governance Framework for Health and Social Care and Good Clinical Practice (GCP). The Chief Investigator will be responsible for the ongoing management of the study. The Sponsor will monitor and conduct audits on a selection of studies in its clinical research portfolio. Monitoring and auditing will be conducted in accordance with the UK Policy Framework for Health and Social Care 2017 and in accordance with the Sponsor’s monitoring and audit procedures.

All participants (healthcare professionals/providers and women) participating in interviews or focus groups will be provided with participant information sheets and be required to give informed consent. This consent can be confirmed in writing or verbally, where the interview or focus group is being carried out virtually, and if women participants are unable to access the necessary technology (e.g. word processing or document scanning). Consent to completing the surveys will be confirmed by a consent statement and tick box on the online platform.

Consent for publication

Not applicable. This paper does not contain any individual person’s data in any form.

Competing interests

JS is Head of Maternity and Midwifery Research at NHS England and NHS Improvement. EL is a member of the University of Bristol (UoB) and part of his salary until 31/7/2021 was paid by the PROMPT Maternity Foundation (PMF) to UoB. He has no conflict of interest since then. All other authors declare that they have no competing interests.

Additional information

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Supplementary Information

Additional file 1:

HCP online questionnaire. Online questionnaire for completion by healthcare professionals.

Additional file 2:

Antenatal questionnaire. Online questionnaire for completion by women participants before the birth of their baby.

Additional file 3

: Postnatal questionnaire. Online questionnaire for completion by women participants after the birth of their baby.

Rights and permissions

Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated in a credit line to the data.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Carter, J., Anumba, D., Brigante, L. et al. The Tommy’s Clinical Decision Tool, a device for reducing the clinical impact of placental dysfunction and preterm birth: protocol for a mixed-methods early implementation evaluation study. BMC Pregnancy Childbirth 22, 639 (2022). https://doi.org/10.1186/s12884-022-04867-w

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/s12884-022-04867-w

Keywords

BMC Pregnancy and Childbirth

ISSN: 1471-2393

Contact us