- Study protocol
- Open Access
A protocol for developing, disseminating, and implementing a core outcome set (COS) for childbirth pelvic floor trauma research
BMC Pregnancy and Childbirth volume 20, Article number: 376 (2020)
More than 85% of women sustain different degrees of trauma during vaginal birth. Randomized controlled trials on childbirth pelvic floor trauma have reported a wide range of outcomes and used different outcome measures. This variation restricts effective data synthesis, impairing the ability of research to inform clinical practice. The development and use of a core outcome set (COS) for childbirth pelvic floor trauma aims to ensure consistent use of outcome measures and reporting of outcomes.
An international steering group, within CHORUS, an International Collaboration for Harmonising Outcomes, Research and Standards in Urogynaecology and Women’s Health, including academic community members, researchers, healthcare professionals, policy makers and women with childbirth pelvic floor trauma will lead the development of this COS. Relevant outcome parameters will be identified through comprehensive literature reviews. The selected outcomes will be entered into an international, multi-perspective online Delphi survey. Subsequently and based on the results of the Delphi surveys consensus will be sought on ‘core’ outcomes.
Dissemination and implementation of the resulting COS within an international context will be supported and promoted. Embedding the COS for childbirth pelvic floor trauma within future clinical trials, systematic reviews, and clinical practice guidelines is expected to enrich opportunities for comparison of future clinical trials and allow better synthesis of outcomes, and will enhance mother and child care. The infrastructure created by developing a COS for childbirth pelvic floor trauma could be leveraged in other settings, for example, advancing research priorities and clinical practice guideline development.
Childbirth pelvic floor trauma affects more than 85% of women during vaginal birth . The incidence of different degrees of perineal trauma vary from over 70% in multiparous to over 91% in nulliparous women . The physical consequences of vaginal childbirth may be mild, subclinical conditions or severe pathologies either immediately or in the long term.
Childbirth pelvic floor trauma commonly refers to perineal and vaginal trauma following delivery and the focus of research has been on the perineal body and the anal sphincter complex. However, it may affect different anatomical structures of the pelvic floor including muscles, nerves, connective tissue, as well as bone trauma. Such trauma can involve rupture, compression and stretching of different tissues and organs of the pelvis and pelvic floor resulting in nerve, muscle and connective tissue damage.
The incidence of urinary incontinence (UI) six months postpartum was 20.7% in a recent large cohort study . A clinical diagnosis of obstetric anal sphincter injury (OASIS) is made in between 1 and 11% of women having a vaginal delivery [3, 4]. The reported incidence of levator ani muscle (LAM) trauma varies widely and has been reported to range between 13 and 26% in women who have a vaginal delivery [5,6,7,8]. Short and long-term morbidity associated with childbirth pelvic floor trauma can have a significant effect on daily activities, psychological wellbeing, sexual function and overall quality of life. The development of therapeutic interventions to reduce this health burden is therefore urgently required to generate further evidence in order to inform clinical practice.
Childbirth pelvic floor trauma and associated outcomes have been defined using different clinical symptoms, diagnostic parameters and outcome measures and there is no international consensus regarding the assessment and management of different types of childbirth pelvic floor trauma. In the absence of a standardized approach, significant outcomes may not be properly collected and reported. Evidence synthesis can be further limited by the use of different outcome measures (including definitions and instruments).
For example, a Cochrane Review suggested that different pushing strategies showed no difference in perineal laceration and episiotomy, neither in resulting in caesarean and instrumental deliveries, nor in the neonatal outcomes. Interestingly, delayed pushing in labor led to a shortening of the actual time pushing and increased rates of spontaneous vaginal delivery whereas an overall longer second stage may be a risk factor for pelvic floor trauma. However, the studies included were admittedly of moderate to low quality and failed to show any clear difference in serious perineal trauma and episiotomy rates . Another Cochrane review concluded that the effectiveness of interventions for women in subsequent pregnancies following obstetric anal sphincter injury is unknown . Possible pre- and intrapartum interventions to consider are pelvic floor muscle training, perineal massage, balloon dilatation, warm compresses, birthing positions and pushing strategies that may impact pelvic floor trauma [11, 12]. The main issues that have been highlighted in previous systematic reviews including the one our group published recently  are inconsistent selection, measurement and reporting of outcomes.
Addressing the variation in outcome selection and reporting should be a priority, therefore the aim of this initiative is to develop, disseminate, and implement a core outcome set (COS) for childbirth pelvic floor trauma research. Specific projects led by CHORUS, an International Collaboration for Harmonising Outcomes, Research and Standards in Urogynaecology and Women’s Health aim to tackle such limitations in research evidence. A systematic review evaluating the variations in outcome measures and outcome reporting in childbirth pelvic floor trauma trials has been completed and published .
This project has been prospectively registered with the Core Outcome Measures in Effectiveness Trials [COMET] initiative, registration number 981 . The Core Outcomes in Women’s Health [CROWN] initiative [www.crown-initiative.org] will support the dissemination and implementation of a COS for childbirth pelvic floor trauma to increase the value of primary research by encouraging future childbirth pelvic floor trauma trials to report core outcomes and, therefore, contribute data to high quality meta-analyses .
The aim of the study is the development and future implementation of a core outcome set (COS) for childbirth pelvic floor trauma research. A multiperspective group of professionals, patients and researchers will contribute to the development of a COS following a standard process. Such a COS will strengthen the consistent reporting of outcomes and use of outcome measures.
Scope of the COS for childbirth pelvic floor trauma
This COS will apply to clinical studies evaluating interventions for the management of women with childbirth pelvic floor trauma. All therapeutic interventions for childbirth pelvic floor trauma will be considered regardless of type, setting, or mode of administration. In order to cover the entire spectrum of degrees of perineal trauma, we will not differentiate between specific types of trauma. Childbirth pelvic floor trauma will be defined as any trauma to the pelvic floor, perineum, anal sphincter complex, lower urogenital tract and lower gastrointestinal tract sustained at the time of vaginal childbirth. The scope of the COS goes beyond interventions for the management of pelvic floor trauma to the direction of prevention, prevention studies and mixed studies, too.
The development of this protocol was guided by the COMET Handbook  and was undertaken with consideration of the COS-STAndards for Reporting (COS-STAR) statement and checklist , albeit specific adaptations have been made to meet the aims of this project.
A steering committee co-ordinated by CHORUS will guide all steps involved in the development of this COS for childbirth pelvic floor trauma (Fig. 1).
Stage 1: systematic / scoping review (identifying potential outcomes)
Creating a comprehensive inventory of outcomes and outcome measures enables the identification of key concepts and the evaluation of the extent of existing variations in outcome reporting in childbirth pelvic floor trauma research. Based on our previous work [13, 14] the outcomes listed in Table 1 will be included into a modified Delphi survey. Any stakeholder can bring in terms on interventions for the prevention that might not be covered by the publications [13, 14]. Within the Delphi process and subsequent multi-perspective consensus meetings, any gaps in previously identified and evaluated potentially eligible outcomes will be reviewed and considered.
Outcome selection for use in clinical trials of childbirth pelvic floor trauma
Selection of appropriate outcomes is an essential for study design. Clinical trials that evaluate benefits and harms of interventions for childbirth pelvic floor trauma must select outcomes of relevance to key stakeholders and measure them using appropriate tools. The main issues that arise throughout this process are inconsistent selection, measurement and reporting of outcomes. Measuring outcomes of interventions for childbirth pelvic floor trauma in a variety of ways leads to outcome reporting bias. Therefore, the barrier to compare and highlight differences in research findings has an inevitable and negative impact on their interpretation and embedding into clinical practice.
The Standard Protocol Items: Recommendations for Interventional Trials (SPIRIT) statement, supported by funders of health research, recommends the use of COS where they exist . Mapping all outcomes reported in clinical trials on interventions for childbirth pelvic floor trauma will provide the basis for initializing the process of development of COS.
Outcomes will be listed in a database, categorized in domains and themes and coded according to the taxonomy proposed by the COMET Initiative . If there is uncertainty as to how to classify or present an outcome, consensus of the steering group will be sought. Following the steering group’s agreement, the outcome inventory will be entered into the Delphi method.
Stage 2. Determining core outcomes
Creating a group for the development of a COS for childbirth pelvic floor trauma
A multiperspective group of healthcare professionals, researchers and women who sustained childbirth pelvic floor trauma will contribute to the development of a COS that will be applicable to research evaluating outcomes and outcome measures for childbirth pelvic floor trauma.
This group will consider the urgent need for development of effective interventions to reduce the impact of childbirth pelvic floor trauma on women’s quality of life given the flaws and weaknesses of current evidence documented in Cochrane reviews   .
The project for developing a COS for childbirth pelvic floor trauma will be guided by a management team and a steering committee. The management team will include research partners who will meet regularly and organize daily tasks and overall work progress. The steering committee will meet at 6 monthly intervals. A coordinator and two other expert members will provide advice on methodology and childbirth pelvic floor trauma-related issues. There will also be representatives from the management team. The purpose of the steering committee will be to provide support and guidance on any arising issues. Two women with childbirth pelvic floor trauma will be invited to participate in the study management and oversight of the process.
A modified Delphi approach is a method where several surveys are delivered over a series of rounds . This sequential, robust method has a significant advantage over other less structured consensus methods. Web-based Delphi surveys facilitate stakeholders participation being feasible and efficient [23, 24]. Potential key stakeholders as listed in Table 2 will be identified through appropriate contact methods and invited to participate in the Delphi survey. Representation will be aimed for each stakeholder group.
A snowball sampling approach will be used to identify potential participants in different stakeholder groups who will be invited via electronic communication tools (email or social media). Researchers and healthcare professionals will be identified through relevant published papers and national and international professional organizations. Policy makers will be identified through published reports and policies. Public representatives will be identified and invited to participate through patient groups and social media. Relevant organizations will be approached and encouraged to distribute the invitation to their members. The research team will provide these organizations with information about the aims of the study, the importance of developing core outcome sets and the methodology and process.
The invitation email will also contain an electronic link to the CHORUS portal, which will allow stakeholders to register for the online Delphi survey. We aim to recruit similar numbers of participants to each stakeholder group. There are no clear recommendations for calculating the required sample . However, based upon previous studies, we aim to include 20 participants from each stakeholder group.
The number of responder participants in each stakeholder group will be reviewed following the end of round 1. Results will be presented as total number and / or percentage of:
respondents who have completed the survey
respondents who completed the round
respondents in each stakeholder group
respondents compared to potential respondents as identified from the information provided by the steering committee
new respondents who were not included in the original invitation to complete the survey
Participants will be asked to register online, provide demographic details, and commit to all rounds . They will be allocated a unique identifier, which will make their responses anonymous.
Participants will be asked to score individual outcomes using a 7-point Likert Scale anchored between 1 (not important) to 7 (critical). This scale was created by the Grading of Recommendations Assessment, Development and Evaluation (GRADE) working group and has been widely adopted by COS Developers . During the first round, participants will be invited to suggest additional outcomes. The round will close following a 4-week window. Additional outcomes listed by participants will be reviewed by the outcome committee and, if novel, listed in round two.
Participants will present their individual and stakeholder group responses and they will be invited to reflect on the observed results before proceeding to the next step and scoring individual outcomes again. The round will close following a 4-week window. The modified Delphi method promotes repeated reflection, rescoring of outcomes and facilitates stakeholder group agreement with regards to “core” outcomes . This round’s results will enable individual outcomes to be classified as shown in Table 3. Although subjective, these definitions and criteria have been proposed by previous COS developers  (21)  and help with collecting uniform data.
The round two results will be reviewed by the steering group to consider the need for a further Delphi survey round.
During this final phase, a meeting conducted by an independent coordinator will be organized with the purpose of deciding which outcomes will be validated and included in the COS. In addition, outcomes that do not meet core outcome criteria will be discussed. This meeting will purposefully include various points of view from participants who have completed all rounds of the Delphi survey. During the consensus meeting, the results from each round of the Delphi survey will be presented. To avoid biased consensus formation amongst a group of varied participants, the steering committee will consider all opinions [15, 29] in an interactive meeting. To facilitate dissemination and implementation, editors from key journals and funders of childbirth pelvic floor trauma research will be invited to participate.
The Delphi consensus is defined in a priori specification in Table 3. Each core outcome will be classified within a threshold value of > 70% of participants considering the core outcome parameter as critical, or not important, or lack of consensus what results in a non-classification as a core outcome parameter.
The analyses will be primarily descriptive, with frequency counts provided for the variables. A limited number of analyses for trends within categorical variables (chi-square or Fisher’s exact test) will be performed. These analyses examine the relationship between measures of consensus, the different stakeholders and diagnostic criteria.
Ethical and governance considerations
As with previous COS development projects, this project is considered as a service evaluation not influencing patient safety [30,31,32]. Moreover, the Medical Research Council decision tool  indicated that this study protocol does not require NHS Research Ethics Committee (REC) approval.
All participants involved will be asked for their consent before participating in either stakeholder interviews or the Delphi survey, and all procedures will be conducted according to the Declaration of Helsinki . A “no-response” option will be allowed both for the survey and interactive parts of the research to ensure responder’s right to withhold information. A specific timeframe of the Delphi process will be provided and information concerning the interval of data storage and handling will be made available to participants.
This protocol for the development of COS for childbirth pelvic floor trauma adheres to best practice guidance provided by the COMET Ηandbook being in line with CHORUS’s aims and with other protocols which have adopted COS methodologies for various health conditions.
The development of COS incorporates the perspectives of multiple stakeholders including academic community members, researchers, health care professionals, policy makers and patient communities. This approach will ensure that the views, priorities and interests of all groups are considered in the selection of outcomes and outcome measures in childbirth pelvic floor trauma trials in the future.
Due to the miscellany of terms and definitions, it will be of importance to capture a wide range of terms also apart RCT. Any term or definition brought up will be assessed in a multiperspective view by the different stakeholders. As many core areas of the impact of childbirth trauma on women’s well-being may have not been addressed in currently available evidence, the whole process will encourage the identification and consideration of any wider physical and psychosocial sequelae which in turn are interrelated and may influence each other in order to ensure key outcomes are include in a COS.
Based on this process, a better methodology in selecting collecting and reporting outcomes in childbirth pelvic floor trauma research could enhance the quality of published research and reduce bias and research waste.
The National Institute for Health and Care Excellence supports the use of COS when selecting outcomes during evidence scoping and synthesis . As this activity forms the basis of guideline development, the COS could have a direct impact in improving healthcare of women with childbirth pelvic floor trauma.
Strengths and limitations
This protocol represents the first international, multiprofessional and multidisciplinary initiative to develop a core outcome set (COS) for use in childbirth pelvic floor trauma clinical trials. With a documented wide variation in the reported outcomes and outcome measures impairing our ability to synthesize primary research, as well as various methodological flaws in currently available research evidence, the development of this COS is highly warranted. The process to develop the COS is well established and involves a rigorous methodology, with extensive literature reviews, wide stakeholder participation, Delphi survey and a consensus meeting to establish the COS. This approach will encourage inclusion of diverse perspectives internationally.
However, the selected COS may not be applicable to all types of research or methodologies and the development of additional COS or updated ones may be warranted following this process.
Part of stage 1 (systematic review on the variations of reported outcomes) has been completed and published . The investigators have had online consultations on the development and drafting of this protocol. The first round of the e-Delphi survey is currently being developed but has not yet been completed. Protocol modifications may be implemented following consensus among the investigators if logistic issues arise.
Availability of data and materials
Not applicable as it is a protocol article. Future data will be stored in an open-repository, university based.
International Collaboration for Harmonising Outcomes
Core Outcome Measures in Effectiveness Trials
Core Outcome Set
COS-STAndards for Reporting
Levator Ani Muscle
Obstetric Anal Sphincter Injury
Research Ethics Committee
Frohlich J, Kettle C. Perineal care. BMJ Clin Evid. 2015;2015.
Wesnes SL, Hannestad Y, Rortveit G. Delivery parameters, neonatal parameters and incidence of urinary incontinence six months postpartum: a cohort study. Acta Obstet Gynecol Scand. 2017;96(10):1214–22.
Dudding TC, Vaizey CJ, Kamm MA. Obstetric anal sphincter injury: incidence, risk factors, and management. Ann Surg. 2008;247(2):224–37.
Royal College of Obstetricians and Gynaecologists. Third- and Fourth-degree Perineal Tears, Management (Green-top Guideline No. 29) 2015 [Available from: https://www.rcog.org.uk/en/guidelines-research-services/guidelines/gtg29/.
Kearney R, Miller JM, Ashton-Miller JA, DeLancey JO. Obstetric factors associated with levator ani muscle injury after vaginal birth. Obstet Gynecol. 2006;107(1):144–9.
Dietz HP, Gillespie AV, Phadke P. Avulsion of the pubovisceral muscle associated with large vaginal tear after normal vaginal delivery at term. Aust N Z J Obstet Gynaecol. 2007;47(4):341–4.
Dietz HP, Lanzarone V. Levator trauma after vaginal delivery. Obstet Gynecol. 2005;106(4):707–12.
Schwertner-Tiepelmann N, Thakar R, Sultan AH, Tunn R. Obstetric levator ani muscle injuries: current status. Ultrasound Obstet Gynecol. 2012;39(4):372–83.
Lemos A, Amorim MM. Dornelas de Andrade A, de Souza AI, Cabral Filho JE. Correia JB Pushing/bearing down methods for the second stage of labour Cochrane Database Syst Rev. 2017;3:CD009124.
Farrar D, Tuffnell DJ, Ramage C. Interventions for women in subsequent pregnancies following obstetric anal sphincter injury to reduce the risk of recurrent injury and associated harms. The Cochrane database of systematic reviews. 2014(11):Cd010374.
Woodley SJ, Boyle R, Cody JD, Morkved S, Hay-Smith EJC. Pelvic floor muscle training for prevention and treatment of urinary and faecal incontinence in antenatal and postnatal women. Cochrane Database Syst Rev. 2017;12:CD007471.
Du Y, Xu L, Ding L, Wang Y, Wang Z. The effect of antenatal pelvic floor muscle training on labor and delivery outcomes: a systematic review with meta-analysis. Int Urogynecol J. 2015;26(10):1415–27.
Pergialiotis V, Durnea C, Elfituri A, Duffy J, Doumouchtsis SK. Do we need a core outcome set for childbirth perineal trauma research? A systematic review of outcome reporting in randomised trials evaluating the management of childbirth trauma. BJOG : an international journal of obstetrics and gynaecology. 2018;125(12):1522–31.
Doumouchtsis SK. Developing a core outcome set for female pelvic floor disorders (urinary incontinence, pelvic organ prolapse, childbirth perineal trauma and pelvic pain syndromes) 2017 [Available from: http://www.comet-initiative.org/studies/details/981.
Khan K, Bent A. The CROWN initiative: journal editors invite researchers to develop core outcomes in women's health: the core outcomes in Women's Health Initiative. Female pelvic medicine & reconstructive surgery. 2015;21(1):1–2.
Williamson PR, Altman DG, Bagley H, Barnes KL, Blazeby JM, Brookes ST, et al. The COMET Handbook: version 1.0. Trials. 2017;18(Suppl 3):280.
Kirkham JJ, Gorst S, Altman DG, Blazeby JM, Clarke M. Devane D, et al. Core Outcome Set-STAndards for Reporting: The COS-STAR Statement. 2016;13(10):e1002148.
Chan AW, Tetzlaff JM, Gotzsche PC, Altman DG, Mann H, Berlin JA, et al. SPIRIT 2013 explanation and elaboration: guidance for protocols of clinical trials. BMJ (Clinical research ed). 2013;346:e7586.
Lemos A, Amorim MM, Dornelas de Andrade A, de Souza AI, Cabral Filho JE, Correia JB. Pushing/bearing down methods for the second stage of labour. The Cochrane database of systematic reviews. 2015(10):Cd009124.
O'Kelly SM, Moore ZE. Antenatal maternal education for improving postnatal perineal healing for women who have birthed in a hospital setting. The Cochrane database of systematic reviews. 2017;12:Cd012258.
Middleton P, Shepherd E, Crowther CA. Induction of labour for improving birth outcomes for women at or beyond term. The Cochrane database of systematic reviews. 2018;5:Cd004945.
Crisp J, Pelletier D, Duffield C, Adams A, Nagy S. The Delphi method? Nurs Res. 1997;46(2):116–8.
Nelson RL. Systematic reviews and research waste. Lancet (London, England). 2016;387(10014):124.
Glasziou P, Altman DG, Bossuyt P, Boutron I, Clarke M, Julious S, et al. Reducing waste from incomplete or unusable reports of biomedical research. Lancet (London, England). 2014;383(9913):267–76.
Sinha IP, Smyth RL, Williamson PR. Using the Delphi technique to determine which outcomes to measure in clinical trials: recommendations for the future based on a systematic review of existing studies. PLoS Med. 2011;8(1):e1000393.
Guyatt GH, Oxman AD, Kunz R, Atkins D, Brozek J, Vist G, et al. GRADE guidelines: 2. Framing the question and deciding on important outcomes. J Clin Epidemiol. 2011;64(4):395–400.
Gopalakrishna G, Mustafa RA, Davenport C, Scholten RJ, Hyde C, Brozek J, et al. Applying grading of recommendations assessment, development and evaluation (GRADE) to diagnostic tests was challenging but doable. J Clin Epidemiol. 2014;67(7):760–8.
Sutton J, Austin Z. Qualitative research: data collection, analysis, and management. Can J Hosp Pharm. 2015;68(3):226–31.
Khan K. The CROWN initiative: journal editors invite researchers to develop core outcomes in women's health. BJOG : an international journal of obstetrics and gynaecology. 2014;121(10):1181–2.
Hirsch M, Duffy JM, Barker C, Hummelshoj L, Johnson NP, Mol B, et al. Protocol for developing, disseminating and implementing a core outcome set for endometriosis. BMJ Open. 2016;6(12):e013998.
Chiarotto A, Terwee CB, Deyo RA, Boers M, Lin CW, Buchbinder R, et al. A core outcome set for clinical trials on non-specific low back pain: study protocol for the development of a core domain set. Trials. 2014;15:511.
Ma C, Panaccione R, Fedorak RN, Parker CE, Khanna R, Levesque BG, et al. Development of a core outcome set for clinical trials in inflammatory bowel disease: study protocol for a systematic review of the literature and identification of a core outcome set using a Delphi survey. BMJ Open. 2017;7(6):e016146.
Council MR. Do I need NHS Ethics approval? [Available from: http://www.hra-decisiontools.org.uk/ethics/.
Glasziou P. The role of open access in reducing waste in medical research. PLoS Med. 2014;11(5):e1001651.
There is no external funding, also not from a commercial organization. The host organization has offered financial support for this project.
Ethics approval and consent to participate
As with former COS development projects of i-CHORUS, this project is considered a service evaluation not directly influencing patient care or safety, therefore ethics committee approval was not required. Medical Research Council’s decision tool was used to determine whether this research required approval from an NHS Research Ethics Committee.
As suggested by the Editorial office, we sent the ethics committee waiver separately to BMCSeriesEditorial@biomedcentral.com.
All participants involved will be asked for their consent and conflict of interest before participating in either stakeholder meetings or the Delphi survey.
Consent for publication
Not applicable as not patient’s data or images are going to be published in this article.
About this article
Cite this article
Doumouchtsis, S.K., Rada, M.P., Pergialiotis, V. et al. A protocol for developing, disseminating, and implementing a core outcome set (COS) for childbirth pelvic floor trauma research. BMC Pregnancy Childbirth 20, 376 (2020). https://doi.org/10.1186/s12884-020-03070-z
- Childbirth pelvic floor trauma
- Birth-related injuries
- Obstetric anal sphincter injury (OASIS)
- Urinary incontinence (UI)
- Levator Ani muscle (LAM)
- International collaboration for Harmonising outcomes (CHORUS)
- Core outcome measures in effectiveness trials (COMET)
- Core outcome set (COS)
- Recommendations for interventional trials (SPIRIT)