- Research article
- Open Access
- Open Peer Review
Measurement error of mean sac diameter and crown-rump length among pregnant women at Mulago hospital, Uganda
BMC Pregnancy and Childbirthvolume 18, Article number: 129 (2018)
Ultrasonography is essential in the prenatal diagnosis and care for the pregnant mothers. However, the measurements obtained often contain a small percentage of unavoidable error that may have serious clinical implications if substantial. We therefore evaluated the level of intra and inter-observer error in measuring mean sac diameter (MSD) and crown-rump length (CRL) in women between 6 and 10 weeks’ gestation at Mulago hospital.
This was a cross-sectional study conducted from January to March 2016. We enrolled 56 women with an intrauterine single viable embryo. The women were scanned using a transvaginal (TVS) technique by two observers who were blinded of each other’s measurements. Each observer measured the CRL twice and the MSD once for each woman. Intra-class correlation coefficients (ICCs), 95% limits of agreement (LOA) and technical error of measurement (TEM) were used for analysis.
Intra-observer ICCs for CRL measurements were 0.995 and 0.993 while inter-observer ICCs were 0.988 for CRL and 0.955 for MSD measurements. Intra-observer 95% LOA for CRL were ± 2.04 mm and ± 1.66 mm. Inter-observer LOA were ± 2.35 mm for CRL and ± 4.87 mm for MSD. The intra-observer relative TEM for CRL were 4.62% and 3.70% whereas inter-observer relative TEM were 5.88% and 5.93% for CRL and MSD respectively.
Intra- and inter-observer error of CRL and MSD measurements among pregnant women at Mulago hospital were acceptable. This implies that at Mulago hospital, the error in pregnancy dating is within acceptable margins of ±3 days in first trimester, and the CRL and MSD cut offs of ≥7 mm and ≥ 25 mm respectively are fit for diagnosis of miscarriage on TVS. These findings should be extrapolated to the whole country with caution. Sonographers can achieve acceptable and comparable diagnostic accuracy levels of MSD and CLR measurements with proper training and adherence to practice guidelines.
The advent of ultrasonography and its swift advances has in the recent years significantly improved prenatal diagnosis and care globally [1, 2]. In the early stages of a pregnancy, ultrasound is essential in predicting the risk of adverse pregnancy outcomes such as aneuploidy, stillbirth, pre-eclampsia and the possibility of abnormal cord insertion visualization [3, 4]. It is also used for fetal anatomic surveys during a second-trimester scan to detect fetal malformations, monitoring fetal growth in utero and in pregnancy dating [5,6,7]. Therefore, given the essential role of ultrasonography in clinical decision making, it is imperative that sonographic parameters obtained are accurate and precise . However, a small percentage of error in measurements or incompleteness of the information obtained is at times unavoidable. [9, 10]. In first trimester, measurement error of CRL and MSD has been reported to be ±18.78% limits of agreement in United Kingdom (UK) . If significant, this error has implications on the accuracy of estimates of the fetal gestation age obtained. And if not taken into account at MSD or CRL cut offs used for the diagnosis of miscarriage, some normal pregnancies may be erroneously deemed non-viable . Consequently, this could lead to inadvertent termination of viable embryos and immense physical and emotional harm to the patient [11,12,13].
The unavoidable measurement error or incompleteness in information obtained during an ultrasound examination is related to various factors including but not limited to the skill of the sonographer and their level of training; technical factors related to the patient such as body habitus; the quality of the machine; fetal position; and the duration of the examination . As in other low resourced settings, Uganda’s healthcare system faces severe shortage of imaging experts [15,16,17]. This results in high workload which affects the performance and efficiency of health workers. In addition, majority of the low-income countries lack adequate resources to acquire high-end ultrasound machines with very good spatial resolution [16, 18]. With low spatial resolution machines, images appear blurred or enlarged, and due to this effect, calipers are placed beyond or may not cover the true dimensions leading to errors in measurements . Errors arising from variation between machines have been found to be substantial . The Ministry of Health Standards on Diagnostic Imaging and Therapeutic Radiology in Uganda recommends the use of CRL cut off of 5 mm to diagnose a miscarriage yet this has changed following recommendation by recent studies. The use of the outdated CRL cut off of 5 mm increases the risk of misdiagnosing normal pregnancies. This practice guidelines does not also provide clear guidance for measurement of MSD . This may lead to significant variations in MSD measurements.
The reliability of CRL and MSD measurements in first trimester using modern ultrasound equipment has not been adequately explored in the low developed countries like in the developed nations [11, 19, 21]. This study sought to understand the level of intra- and inter-observer variability in measuring MSD and CRL in women between 6 and 10 weeks’ gestation at Mulago National Referral Hospital.
This was a cross-sectional study conducted on pregnant women at the Department of Obstetrics and Gynecology, Mulago National Referral Hospital, Uganda from January to March 2016. We consecutively enrolled women with a single viable intrauterine embryo from 6 to 10 weeks of gestation and not bleeding. The first observer examined a woman who had consented, to assess if they were eligible for inclusion in this study. The second observer then further examined the eligible participant. The two observers examined each woman at the same point in time. Both observers used a Phillips Envisor (PHILIPS, USA, 2009) with a 7.5 MHz transvaginal probe for B-imaging to do all examinations.
For each examined participant, the observers took CRL measurements twice and MSD measurements once, and in between the two CRL measurements, the observers examined the ovaries and uterus. These measurements were obtained as described in the WHO Manual of diagnostic ultrasound, Volume 2  (Fig. 1). To archive blinding, the measurements of the first observer were removed from the machine before the second observer was allowed to enter the examination room. The same two sonographers that examined all the women had good training in obstetric sonography and at least five years of experience in fetal ultrasound. A female nurse or professional was always brought into the examination room for all the transvaginal ultrasound scans done by the male sonographer to make the women feel comfortable and safe.
The sample size calculations were based on the formula below by considering 95% Limits of agreement (LOA) of ±18.78% as the cut off for clinical significance [11, 22, 23]. In the formula, n = desired sample size and s = standard deviation of the differences in CRL or MSD measurements .
Data was double entered and validated in Epidata version 3.1 to identify inconsistent entries before being exported to SPSS Version 19.0 for analysis. Scatterplots of paired sets of measurements created with the line of equality were visually assessed for potential systematic errors in the intra and inter-observer measurements. A paired t-test at 0.05 set level of significance was used to check if the paired sets of measurements were significantly different, to rule out any systematic errors in the measurements.
To assess the strength of the absolute agreement within and between observers, the intraclass correlation coefficient (ICC) was computed based on a two-way random effects model [24,25,26]. Normality, constant mean and variance assumptions for LOA were fulfilled. Therefore, the difference between paired sets of measurements were plotted against their mean in Bland–Altman plots to assess the level of clinical agreement within and between the observers. The lack of agreement between measurements or observers becomes relevant only when the LOAs are wider than what is clinically acceptable [27, 28]. Technical error of measurements (TEM) within and between observers were calculated by taking the square root of the sum of the squares of the differences of the paired sets of measurements divided by twice the total number of participants measured.
We screened 71 pregnant women suspected to be in first trimester and enrolled 56 in this study. Of the 15 women excluded from the study, one had a ruptured ectopic pregnancy; three had empty gestation sacs; six were more than 10 weeks of gestation pregnant; three were not pregnant and two declined to be examined after consenting. The mean (SD) maternal age was 25.8 (4.33) and mean (SD) gestation age was 7.5 (1.14) (Table 1).
Intra-observer ICCs were 0.993 and 0.995 for CRL measurements while inter-observer ICCs were 0.988 for CRL and 0.955 for MSD measurements (Table 2). Intra-observer 95% LOAs for CRL were ± 2.04 mm (Fig. 2) and ± 1.66 mm (Fig. 3). Inter-observer 95% LOAs were ± 2.35 mm (Fig. 4) for CRL and ± 4.87 mm for MSD (Fig. 5). Intra-observer relative TEM for CRL were 4.62% and 3.70%, while inter-observer relative TEM were 5.88% for CRL and 5.93% for MSD measurements respectively (Table 3).
This study found a strong observer agreement with intra- and inter-observer ICCs ≥0.955 and this is similar to findings from other studies [29, 30]. Inter-observer 95% limits of agreement for MSD and CRL measurements were also in tandem with findings from other studies . However, intra-observer 95% limits of agreements for CRL measurements were about 2% higher than findings reported in a study by Pexters and colleagues . They reported intra-observer limits of agreement of CRL of ±8.91 and ± 11.37% . The minor differences observed could be attributed to the differences in settings such as observers, patient overload and the finite consistency and read-out precision of the instrument used to measure the structures . The study by Pexters et al. used an ultrasound machine with a 6–12-MHz transvaginal transducer for B-mode imaging while our machine was equipped with a 7.5-MHz probe . Intra-observer inconsistencies highlight a lack of clear or uniform criteria of measurement and interpretation of embryonic landmarks . Detailed instructions in locating landmarks are necessary to minimize intra- and inter-observer technique difference . The majority of our study participants were between 6 to 7 weeks of gestation. At this stage, reproducibility of CRL measurements is better than it is later in the first trimester because of increased embryonic mobility at about 8 weeks’ gestation and above . This could also explain the optimal reliability observed in this study. The relative TEM observed were within clinically acceptable variability in the precision of anthropometric measurements of 5.0% and 7.5% for intra-observer and inter-observer variability respectively .
The strength in this study is that it utilized an ultrasound machine with a high spatial resolution. We used the best available ultrasound machine in our setting at the time this study was conducted. This allowed a clear delineation of the anatomical landmarks of the embryo and the gestational sac therefore minimizing measurement errors. In using the same machine, we also eliminated errors due to differences in the machines. The short time interval between intra-observer measurements was our major limitation.
The intra- and inter-observer differences in crown-rump length and mean sac diameter relates to the utility of these measurements in first trimester to accurately estimate gestation age and/or make a diagnosis of early pregnancy loss . If the error is substantial, it may have serious clinical consequences. Our study has shown that intra and inter-observer error of CRL and MSD measurements among pregnant women in our setting were within acceptable limits. Therefore, in relation to the accurate estimation of the gestation age, it is unlikely to result in large differences in days when dating a pregnancy. However, in relation to making a diagnosis of early miscarriage, even a difference of 1 mm can have an impact on the clinical decision . Since our findings are within acceptable limits reported by Pexters et al. and other studies, an MSD cutoff of 25 mm and CRL cutoff of 7 mm for the diagnosis of early miscarriage should be suitable for use in our setting. These cut offs take into account measurement error and were amended as new guidelines [22, 23]. A large multicenter prospective study has demonstrated that these cutoffs are appropriate, with mean gestational sac diameter ≥ 25 mm with an empty sac (364/364 specificity: 100%, 95% confidence interval 99.0% to 100%), embryo with crown-rump length ≥ 7 mm without visible embryo heart activity (110/110 specificity: 100%, 96.7% to 100%) .
Intra- and inter-observer error of CRL and MSD measurements among pregnant women at Mulago hospital were within acceptable limits. This provides assurance that the error in the estimates of gestational age obtained are within acceptable margins of ±3 days in first trimester. The CRL and MSD cut offs of ≥7 mm and ≥ 25 mm are therefore reliable for diagnosis of miscarriage on TVS in our setting. However, these results should be generalized to the rest of the country with caution. Such diagnostic accuracy levels are achievable in Mulago hospital because it is a national referral hospital with sophisticated equipment and highly trained personnel. We recommend further studies in the lower health facilities to establish their diagnostic accuracy levels. Sonographers can achieve acceptable and comparable diagnostic accuracy levels of MSD and CLR measurements with proper training, regular audits and adherence to practice guidelines.
Intra-class correlation coefficient
Limits of agreement
Mean sac diameter
Technical error of measurements
McNay MB, Fleming JE: Forty years of obstetric ultrasound 1957–1997: from A-scope to three dimensions. Ultrasound Med Bio 1999, 25(1):3–56.
Alan B, Goya C, Tunc S, Teke M, Hattapoglu S. Assessment of placental stiffness using acoustic radiation force impulse Elastography in pregnant women with fetal anomalies. Korean J Radiol. 2016;17(2):218–23.
Padula F, Laganà A, Vitale S, Mangiafico L, D’Emidio L, Cignini P, Giorlandino M, Gulino F, Capriglione S, Giorlandino C. Ultrasonographic evaluation of placental cord insertion at different gestational ages in low-risk singleton pregnancies: a predictive algorithm. Facts Views Vis ObGyn. 2016;8(1):3.
Andrietti S, Carlucci S, Wright A, Wright D, Nicolaides KH. Repeat measurements of uterine artery pulsatility index, mean arterial pressure and serum placental growth factor at 12, 22 and 32 weeks in prediction of pre-eclampsia. Ultrasound Obstet Gynecol. 2017;50(2):221–7.
WHO. WHO manual of diagnostic ultrasound, vol. 2. 2nd ed. Geneva: Switzerland World Health Organization: World Health Organization & World Federation for Ultrasound in Medicine and Biology; 2013.
Rumack CM: Diagnostic ultrasound, vol. Vol. 1: Elsevier/Mosby; 2011.
Chudleigh Trish, Thilaganathan B: obstetric ultrasound: how, why and when, third edn: Churchill Livingstone; 2004.
Padula F, Capriglione S, Magliarditi M, De Sole R, Nuara R, Santonocito VC, Teodoro MC, Giorlandino C. Goal-directed junior ultrasound training in quantitative measurement of crown-rump length and fetal nuchal translucency: evaluation of a specific training program in a specialized center for prenatal diagnosis. Eur J Obstet Gynecol Reprod Biol. 2015;186:112–3.
Harris EF, Smith RN. Accounting for measurement error: a critical but often overlooked process. Arch Oral Biol. 2009;54(Suppl 1):S107–17.
Perini TA, Oliveira GL, Ornellas JD, Oliveira FP. Technical error of measurement in anthropometry. Rev Bras Med Esporte. 2005;11(1):81–5.
Pexsters A, Luts J, Van Schoubroeck D, Bottomley C, Van Calster B, Van Huffel S, Abdallah Y, D'Hooghe T, Lees C, Timmerman D, et al. Clinical implications of intra- and interobserver reproducibility of transvaginal sonographic measurement of gestational sac and crown-rump length at 6-9 weeks' gestation. Ultrasound Obstet Gynecol. 2011;38(5):510–5.
Bickhaus J, Perry E, Schust DJ. Re-examining sonographic cut-off values for diagnosing early pregnancy loss. Gynecol Obstet (Sunnyvale, Calif). 2013;3(1):141.
Lubinga SJ, Levine GA, Jenny AM, Ngonzi J, Mukasa-Kivunike P, Stergachis A, Babigumira JB. Health-related quality of life and social support among women treated for abortion complications in western Uganda. Health Qual Life Outcomes. 2013;11:118.
Padula F, Gulino FA, Capriglione S, Giorlandino M, Cignini P, Mastrandrea ML, D'Emidio L, Giorlandino C. What is the rate of incomplete fetal anatomic surveys during a second-trimester scan? J Ultrasound Med. 2015;34(12):2187–91.
MoH: Health sector development plan 2015-16_2019–20. In. Ministry of Health, Uganda; 2015.
WHO: Medical devices: managing the mismatch: an outcome of the priority medical devices project: World Health Organization; 2010.
Kawooya MG. Training for rural radiology and imaging in sub-saharan Africa: addressing the mismatch between services and population. J Clin Imaging Sci. 2012;2:37.
Maru DS-R, Schwarz R, Andrews J, Basu S, Sharma A, Moore C. Turning a blind eye: the mobilization of radiology services in resource-poor regions. Glob Health. 2010;6(1):1.
Sarris I, Ioannou C, Chamberlain P, Ohuma E, Roseman F, Hoch L, Altman DG, Papageorghiou AT. Intra- and interobserver variability in fetal ultrasound measurements. Ultrasound Obstet Gynecol. 2012;39(3):266–73.
MoH: Standards on Diagnostic Imaging and Therapeutic Radiology in Uganda In.: Ministry of Health 2012: 146.
Souka AP, Pilalis A, Papastefanou I, Salamalekis G, Kassanos D. Reproducibility study of crown-rump length and biparietal diameter measurements in the first trimester. Prenat Diagn. 2012;32(12):1158–65.
Lane BF, Wong-You-Cheong JJ, Javitt MC, Glanc P, Brown DL, Dubinsky T, Harisinghani MG, Harris RD, Khati NJ, Mitchell DG, et al. ACR appropriateness criteria® first trimester bleeding. Ultrasound Quarterly. 2013;29(2):91–6.
RCOG: Clinical practice guideline; management of early pregnancy miscarriage. In: Royal College of Obstetricians and Gynaecologists. Edited by Farah Nadine, Nadine Andrea Nugent, Anglim M; 2014.
McAlinden C, Khadka J, Pesudovs K. Statistical methods for conducting agreement (comparison of clinical tests) and precision (repeatability or reproducibility) studies in optometry and ophthalmology. Ophthalmic Physiol Opt. 2011;31(4):330–8.
Weir JP: Quantifying test-retest reliability using the intraclass correlation coefficient and the SEM. J Strength Cond Res 2005, 19(1):231–240.
Shrout PE, Fleiss JL. Intraclass correlations: uses in assessing rater reliability. Psychol Bull. 1979;86(2):420.
Bland JM, Altman DG. Applying the right statistics: analyses of measurement studies. Ultrasound Obstet Gynecol. 2003;22(1):85–93.
Bland JM, Altman D. Statistical methods for assessing agreement between two methods of clinical measurement. Lancet. 1986;327(8476):307–10.
Verburg BO, Mulder PG, Hofman A, Jaddoe VW, Witteman JC, Steegers EA. Intra- and interobserver reproducibility study of early fetal growth parameters. Prenat Diagn. 2008;28(4):323–31.
Verwoerd-Dikkeboom CM, Koning AH, Hop WC, Rousian M, Van Der Spek PJ, Exalto N, Steegers EA. Reliability of three-dimensional sonographic measurements in early pregnancy using virtual reality. Ultrasound Obstet Gynecol. 2008;32(7):910–6.
Kouchi M, Mochimaru M, Tsuzuki K, Yokoi T. Interobserver errors in anthropometry. J Hum Ergol. 1999;28(1/2):15–24.
Preisler J, Kopeika J, Ismail L, Vathanan V, Farren J, Abdallah Y, Battacharjee P, Van Holsbeke C, Bottomley C, Gould D. Defining safe criteria to diagnose miscarriage: prospective observational multicentre study. BMJ. 2015;351:h4579.
The authors wish to thank the mothers and their spouses, Mulago hospital staff, and whoever contributed to the success of this study.
Availability of data and materials
The datasets used and/or analysed during the current study are available from the corresponding author on reasonable request.
Ethics approval and consent to participate
Ethical Approvals were obtained from the School of Medicine Research Ethics Committee (SOMREC). Only participants that provided written informed consent were enrolled.
The authors declare that they have no competing interests.
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.