- Study protocol
- Open Access
- Open Peer Review
Tests for predicting complications of pre-eclampsia: A protocol for systematic reviews
© Thangaratinam et al; licensee BioMed Central Ltd. 2008
- Received: 27 March 2008
- Accepted: 11 August 2008
- Published: 11 August 2008
Pre-eclampsia is associated with several complications. Early prediction of complications and timely management is needed for clinical care of these patients to avert fetal and maternal mortality and morbidity. There is a need to identify best testing strategies in pre eclampsia to identify the women at increased risk of complications. We aim to determine the accuracy of various tests to predict complications of pre-eclampsia by systematic quantitative reviews.
We performed extensive search in MEDLINE (1951–2004), EMBASE (1974–2004) and also will also include manual searches of bibliographies of primary and review articles. An initial search has revealed 19500 citations. Two reviewers will independently select studies and extract data on study characteristics, quality and accuracy. Accuracy data will be used to construct 2 × 2 tables. Data synthesis will involve assessment for heterogeneity and appropriately pooling of results to produce summary Receiver Operating Characteristics (ROC) curve and summary likelihood ratios.
This review will generate predictive information and integrate that with therapeutic effectiveness to determine the absolute benefit and harm of available therapy in reducing complications in women with pre-eclampsia.
- Receiver Operating Characteristic
- Receiver Operating Characteristic
- Test Accuracy
- Diagnostic Odds Ratio
- Post Test Probability
Hypertension is a common medical complication of pregnancy, affecting about 6–8% of all pregnancies. Hypertensive disorders in pregnancy consist of a group of disorders that include pre-eclampsia, latent or chronic essential hypertension, a variety of renal diseases, and transient (gestational) hypertension. The definitions used to distinguish these disorders differ, leading to uncertainty about their prevalence, natural history and response to treatment. Pre eclampsia is associated with several complications and remains one of the largest single cause of maternal and fetal mortality and morbidity[3, 4]. They have been reported to account for 14% of direct maternal deaths and 18% of fetal or infant deaths[3, 4].
Once the diagnosis of pre-eclampsia is established, timely management is of the essence to avoid or minimise mortality and morbidity. Clinical prediction of disease complications using a combination of patients' characteristics, symptoms, physical signs and investigations all of which we consider tests, forms the basis of clinical care in these situations. Therefore, there is a need for guidance regarding the best testing strategies with which to predict the development of complications in pre-eclampsia. As well as allowing clinicians to avoid unnecessary interventions in low risk groups, this would allow high-risk groups to benefit from monitoring of disease severity, use of antihypertensive therapy, administration of anticonvulsants, and antenatal corticosteroids[6, 7].
A systematic quantitative overview of studies of complications of pre-eclampsia will be conducted to obtain summary estimates of accuracy of all available tests.
The proposed methodology is in line with the guidance of the NHS Centre for Reviews and Dissemination and that of the Cochrane Methods Working Group on Screening and Diagnostic tests. The investigation will be carried out in the following recommended steps: (i) Question formulation, (ii) Study selection and identification, (iii) Study quality assessment, (iv) Data extraction and (v) Data synthesis. Our strategy for each of these steps will be based on a prospective protocol, which is outlined below:
Structured questions for systematic review of test accuracy studies
Tests for predicting complications of pre eclampsia
Pregnant women with pre eclampsia
Parity; Race; Maternal age; Previous severe pre eclampsia/Eclampsia; Family history of pre eclampsia/eclampsia; Obesity; Weight gain; Pre existing hypertension, renal disease, diabetes, lupus, thrombophilia, other auto immune diseases; Multiple pregnancy; Symptoms-headache, epigastric pain, nausea, visual disturbance or combination of symptoms
Blood pressure; Peripheral oedema; Exaggerated tendon reflexes; Clonus; Papilloedema; Retinal changes; Oliguria; Symphysio fundal height; Oxygen saturation
Biochemical: Serum uric acid, urine dipstick (Bedside Urinalyses) 24 hour urine protein, urinary calcium excretion, hypoalbuminaemia, microalbuminuria, fibronectin, protinuria, renal and liver function tests; Ultrasound: Growth, liquor volume, Doppler (uterine, umbilical artery, Middle cerebral artery, venous, uteroplacental) Bio Physical Profile; Haematological: Anti thrombin III, platelet count, haemoglobin, fibrinogen, thrombophilia screen, Maternal serum Alpha feto protein(MSAFP), Serum Human Chorionic Gonadotropin (HCG); Computerised Tomography; Magnetic Resonance Imaging
Eclampsia; Pulmonary oedema; Cerebral Haemorrhage; Hepatic, renal, haematological complications; Cardiac arrest; Abruption; Thromboembolism; stroke; psychiatric problems; Complications of labour and delivery; Maternal death; Need for hospitalisation, Day care unit visits, Use of intensive care, ventilation and dialysis
Intra uterine growth restriction; Pre maturity; Abnormal p H at birth or antenatal; Abnormal Apgar; Hypoxic Ischemic Encephalopathy; Perinatal death; Long term effect, learning disabilities, Developmental and special needs after discharge; Need for neonatal intensive care admission, mechanical ventilation and duration of hospital stay
Systematic review of test accuracy studies
Search term combinations for identification of studies predicting complications of pre eclampsia
1. pre adj eclampsia
3. hypertens $
4. pregnan $
5. pre-eclampsia #.DE.
6. hypertension #.DE.
7. pregnancy #.DE.
8. 3 or 6 (hypertension)
9. 4 OR 7 (pregnancy)
10. 8 and 9 (pregnancy and hypertension)
14. multiparity or nulliparity
15. matern$ near age
16. (previous or prior) near eclampsia
17. (previous or prior) near preeclampsia
18. (previous or prior) near pre adj eclampsia
19. multiple near pregnan$*
20. twin$ or triplet$ or quadruplet$
23. epigastric near pain
24. naus$ or vomit$
36. weight gain#.DE.
43. blood adj pressure
44. oedema or edema
45. tendon$ near reflex$
48. papilledema or papilloedema
49. retina$ near change$
51. symphys$ near fundal
52. symphys$ near height
54. oxygen near saturat$
63. serum near uric adj acid
64. urin near analys $
66. maternal near (feto adj protein$ or fetoprotein$ or alphafetoprotein$)
67. urin$ near calcium
68. hypoalbuminemia or hypoalbuminaemia
72. renal adj function near test$
73. liver adj function near test$
74. liquor near volume
75. biophysical near profile
78. platelet adj count
79. anti adj thrombin$
81. antiphospholipid $
84. alpha-fetoproteins #.DE
85. calcium-ur. DE
86. hypoalbuminemi a#.DE.
87. fibronectins .DE.
88. proteinuria #.DE.
89. kidney-function-test s#.DE.
90. liver-function-tests #.DE.
91. ultrasonography #.DE.
92. haematologic-test s#.DE.
93. antithrombin-III. DE.
94. fibrinogen #.DE.
95. antibodies-antiphospholipid #.DE.
96. diagnostic-imaging #.DE.
100. (renal or kidney$) near (disease$ or complicat$)
101. (hepatic or liver$) near (disease$ or complicat$)
102. death or mortality
105. (pulmonary or lung) near (complicat$ or disease$)
107. pulmonary near(oedema or edema)
110. uter$5 near haemorrhage
112. (heart or cardiac) near arrest$
113. (psychiatric or mental) near (illness$ or complication$1 or disorder)
115. hypox$ near isch$
116. (development$ or learning) near (disorder$ or difficult$)
137. 11 and 98 and 136
(Captures Population and Test and Outcome)
138. animal = yes
139. human = yes
140. 138 not 139
141. 137 not 140
142. PT = comment or PT = letter
11. 1 OR 2 OR 5 OR 10
143. 141 not 142
Final citation set (animal only studies, comments and letters excluded)
98. 42 or 62 or 97 (Captures Test)
In the first stage the electronic searches will be scrutinised by two independent reviewers and full manuscripts of all citations that are likely to meet the predefined selection criteria will be obtained. All available reports, irrespective of language will be included to reduce bias. Subsequent final inclusion or exclusion decisions will be made on examination of these manuscripts. In cases of duplicate publication, the most recent and complete versions will be selected. Two reviewers will then independently select the studies, which meet predefined and explicit criteria regarding population, tests, outcomes and study design (Table 1). These criteria will be piloted using a sample of papers and agreement between reviewers will be measured. When disagreements occur, the two reviewers will meet and if necessary the issue will be resolved by consensus involving a third reviewer.
The extraction of study findings will be conducted in duplicate using a pre-designed and piloted data extraction form to avoid any errors. Two authors will independently extract information from each article in order to construct 2 × 2 tables of the diagnostic test result and outcomes. Any disagreement will be resolved by consensus. Given the extent of insufficient reporting in the medical literature, we propose to obtain missing information from investigators whenever possible. It is otherwise impossible to distinguish between what was done but not reported and what was not done. To avoid introducing bias, unpublished information will be obtained in writing, and will be coded in the same fashion as published information with equal regard for inter-coder agreement. In addition to using multiple coders to insure the reproducibility of the overview, sensitivity analyses around important or questionable judgements regarding the inclusion or exclusion of studies, the validity assessments and data extraction will be performed.
We will explore causes of variation in results from study to study (heterogeneity), synthesise results from individual studies (meta-analysis) if appropriate[8, 15] and assess for the risk of publication bias. Heterogeneity of results between studies will be graphically assessed looking at the distribution of rates, sensitivities and specificities in the ROC (Receiver Operating Characteristics) curve and likelihood ratios using Forest plots. To explore causes of heterogeneity we will conduct a sensitivity analysis by subgroups to see whether variations in population characteristics, tests, outcomes and study quality affect the estimate accuracy. Conclusions regarding the typical estimate accuracy will be interpreted cautiously if there is significant heterogeneity. Individual factors explaining heterogeneity will also be analysed using meta-regression to determine their unique contribution allowing for other factors. We will conduct meta-analyses to generate summary estimates of likelihood ratios (LRs), diagnostic odds ratios (ratio of LRs) and area under receiver operating characteristic (ROC) curves as appropriate[15, 20, 21]
The risk of publication bias is expected to be high in reviews of test accuracy. Analysis for assessing the risk of publication bias will be carried out by producing funnel plots of accuracy estimates against corresponding variances. In the absence of publication bias it is to be expected that the point estimates will fill a funnel shape in the plot. Large gaps in the funnel indicate a group of possible 'missing' publications. These omissions are due to small studies showing limited accuracy and are unlikely to be missing at random. This phenomenon will also be statistically evaluated using Egger's test .
In the same way as systematic reviews of effectiveness of treatments in Obstetrics have been pursued over the last decade, research on test accuracy also needs systematic reviewing[14, 24]. One of the questions remaining after establishing effectiveness evidence for magnesium sulphate, steroids and anti hypertensives is to identify those who will benefit most from these interventions[25, 26]. Relying on the inclusion and exclusion criteria of the trials alone is not sufficient for determining who should and shouldn't get these treatments. Women at high risk of complications of pre-eclampsia are likely to benefit most whilst in low risk women, therapy may cause more harm than good. Therefore, what is required is the prediction of risk of complications (such as eclampsia) of pre-eclampsia.
Information on women's risk stratification can be obtained from test accuracy reviews, which provide post test probabilities for a clinical outcome targeted by treatment. Integration of these with evidence for therapeutic effectiveness will enable generating estimates of Number Needed to Treat (NNT). The lower the risk, the higher the NNT and the lower are our and women's expectation of benefit from treatment. Conversely, the higher the baseline risk, the lower the NNT, the higher are our expectation of benefit and the more inclined we would be to recommend, and women to accept therapy[24, 27]. This will serve to rationalise clinical decision-making.
This project will collate and synthesise the available evidence regarding the value of the tests for predicting complications of pre-eclampsia. The systematic overviews will assess the quality of the available evidence and provide estimates of rate (or risk) of complications of pre-eclampsia given various patient characteristics and other findings. It will identify a set of tests that have maximal predictive value to aid in therapeutic decision-making. An estimate of the magnitude of the benefits will be gauged by integration of the knowledge about risk with evidence of therapeutic effectiveness for various interventions. This will help to formulate practice recommendations and specific recommendations for future research.
TIPPS review group
Shakila Thangaratinam (Clinical Lecturer), Khalid S Khan (Professor in Obstetrics and Gynaecology) affiliated to Education Resource Centre, Birmingham Women's Hospital, Birmingham, B15 2TG, UK.
Khaled M K Ismail (Senior Lecturer/Consultant), Fidelma O'Mahony (Senior Lecturer/Consultant), Shaughn O'Brien (Professor in Obstetrics and Gynaecology) affiliated to Academic Unit of Obstetrics and Gynaecology, Keele University School of Medicine, University Hospital of North Staffordshire, Stoke-on-Trent, ST4 6QG, UK.
Steve Sharp (Electronic Information Librarian) affiliated to NeLH Specialist Library for ENT and Audiology, Radcliffe Infirmary, Oxford, OX2 6HE, UK.
Arri Coomarasamy (Sub specialist in Reproductive Medicine & Surgery) affiliated to Assisted Conception Unit, Guy's Hospital, London, UK
- World Health Organization: The hypertensive disorders of pregnancy. 1987, Report of a WHO Study GroupGoogle Scholar
- Duvekot JJ, Peeters LLH: Maternal haemodynamic adaptation to pregnancy. Obstet Gynecol Surv. 1994, 49: S1-S14. 10.1097/00006254-199412011-00001.View ArticlePubMedGoogle Scholar
- HMSO: Report on Confidential Enquiries into Maternal Deaths in the United Kingdom 1997–99. 2001Google Scholar
- Montan SSNSN: Hypertension in Pregnancy – foetal and infant outcome. Hypertension in pregnancy. 1987, B6: 337-348. 10.3109/10641958709023484.Google Scholar
- Coomarasamy A, Papaiannou S, Gee , Khan KS: Aspirin to prevent pre-eclampsia in women with abnormal uterine artery doppler: a meta-analysis. Obstet Gynecol. 2001, 98: 861-866. 10.1016/S0029-7844(01)01569-1.PubMedGoogle Scholar
- Duley L, Henderson-Smart DJ, Knight M, King JF: Antiplatelet drugs for prevention of pre-eclampsia and its consequences: systematic review. BMJ. 2001, 322: 329-333. 10.1136/bmj.322.7282.329.View ArticlePubMedPubMed CentralGoogle Scholar
- Coomarasamy A, Gee H, Khan KS, Braunholtz D: Aspirin has clinically significant benefit in high risk groups – Summary NNT can mislead clinicians. eBMJ. 2001Google Scholar
- Khan KS, Ter Riet G, Glanville J, Sowden AJ, Kleijnen J: Undertaking Systematic Reviews of Research on Effectiveness. CRD's Guidance for Carrying Out or Commissioning Reviews. 4. 2001, Centre for Reviews and Dissemination (CRD), University of York. CRD ReportGoogle Scholar
- Cochrane Methods Working Group on Systematic Reviews of Screening and Diagnostic Tests: Recommended Methods. 6-6-1996.Google Scholar
- Thangaratinam S, Ismail K, Sharp S, Coomarasamy A, O'Mahony F, Khan KS, O'Brien S: Prioritisation of tests for the prediction of preeclampsia complications: a Delphi survey. Hypertension in Pregnancy. 2007, 26: 131-138. 10.1080/10641950601148000.View ArticlePubMedGoogle Scholar
- Alderson P, Green S, Higgins JPT: Cochrane Reviewer's Handbook 4.2.2. 2004Google Scholar
- Egger M, Zellweger-Zahner T, et al: Language bias in randomised controlled trials published in English and German. Lancet. 1997, 350: 326-329. 10.1016/S0140-6736(97)02419-7.View ArticlePubMedGoogle Scholar
- Whiting PJ, Rutjes AWS, Reitsma JB, Bossuyt PM, Glas Afina, Kleijnen J: Sources of Variation and Bias in Studies of Diagnostic Accuracy A Systematic Review. Annals of Internal Medicine. 2004, 40: 189-202.View ArticleGoogle Scholar
- Khan KS, Dinnes J, Kleijnen J: Systematic reviews to evaluate diagnostic tests. J Obstet Gynecol Reprod Biol. 2001, 95: 6-11. 10.1016/S0301-2115(00)00463-2.View ArticleGoogle Scholar
- Deeks JJ: Systematic reviews in health care: Systematic reviews of evaluations of diagnostic and screening tests. BMJ. 2001, 323: 157-162. 10.1136/bmj.323.7305.157.View ArticlePubMedPubMed CentralGoogle Scholar
- Jaeschke R, Guyatt GH, Sackett DL: Users' guide to the medical literature. II. How to use an article about a diagnostic test. A. Are the results of the study valid?. JAMA. 1994, 271: 389-391. 10.1001/jama.271.5.389.View ArticlePubMedGoogle Scholar
- Lijmer JG, Mol BW, Heisterkamp S, Bonsel GJ, Prins MH, Meulen van der JHP, et al: Empirical evidence of design-related bias in studies of diagnostic tests. JAMA. 1999, 282: 1061-1066. 10.1001/jama.282.11.1061.View ArticlePubMedGoogle Scholar
- Bossuyt PM, Reitsma JB, Bruns DE, Glasziou PP, Gatsonis CA, Irwig LM, et al: Towards complete and accurate reporting of studies on diagnostic accuracy:The STARD initiative. Family Practice. 2004, 21: 4-10. 10.1093/fampra/cmh103.View ArticlePubMedGoogle Scholar
- Chein PFW, Khan KS: Evaluation of a clinical test. II: Assessment of validity. Br J Obstet Gynecol. 2001, 108: 568-572. 10.1016/S0306-5456(00)00128-5.Google Scholar
- Jaeschke R, Guyatt GH, Sackett DL: Users' guide to the medical literature. III. How to use an article about a diagnostic test. B. What are the results and will they help me in caring for my patients?. JAMA. 1994, 271: 703-707. 10.1001/jama.271.9.703.View ArticlePubMedGoogle Scholar
- Honest H, Khan KS: Reporting of measures of accuracy in systematic reviews in diagnostic literature. BMC Health Serv Res. 2002, 2 (1): 4-10.1186/1472-6963-2-4.View ArticlePubMedPubMed CentralGoogle Scholar
- Song F, Khan KS, Dinnes J, Sutton A: Asymmetric Funnel Plots and the Problem of Publication Bias in Meta-analyses of Diagnostic Accuracy. Int J Epidemiol. 2002, 31: 88-95. 10.1093/ije/31.1.88.View ArticlePubMedGoogle Scholar
- Egger M, David SG, Schneider M, Minder C: Bias in meta analysis detected by a simple, graphical test. BMJ. 1997, 315: 629-34.View ArticlePubMedPubMed CentralGoogle Scholar
- Khan KS, Honest , Bachmann LM: A generic framework for making clinical decisions integrating diagnostic and therapeutic research evidence in preterm birth. Fetal and Maternal Medicine Review. Fetal and Maternal Medicine Review. 2003, 13: 239-249. 10.1017/S0965539503001104.View ArticleGoogle Scholar
- The Magpie Trial Collaborative Group: Do women with pre-eclampsia, and their babies, benefit from magnesium sulphate? The Magpie Trial: a randomised placebo-controlled trial. Lancet. 2002, 359 (9321): 1877-90. 10.1016/S0140-6736(02)08778-0.View ArticleGoogle Scholar
- Chein PFW, Khan KS, Arnott N: Magnesium sulphate in the treatment of eclampsia and pre-eclampsia: an overview of the evidence from randomised trials. Br J Obstet Gynaecol. 1996, 103 (11): 1085-91.View ArticleGoogle Scholar
- Coomarasamy A, Braunholtz D, Song F, Taylor R, Khan KS: Individualising use of aspirin to prevent pre eclampsia: A framework for clinical decision making. BJOG. 2003, 110 (10): 882-888. 10.1111/j.1471-0528.2003.03002.x.View ArticlePubMedGoogle Scholar
- The pre-publication history for this paper can be accessed here:http://www.biomedcentral.com/1471-2393/8/38/prepub
This article is published under license to BioMed Central Ltd. This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.