- Open Access
Validation of Canadian mothers’ recall of events in labour and delivery with electronic health records
BMC Pregnancy and Childbirthvolume 13, Article number: S3 (2013)
Maternal report of events that occur during labour and delivery are used extensively in epidemiological research; however, the validity of these data are rarely confirmed. This study aimed to validate maternal self-report of events that occurred in labour and delivery with data found in electronic health records in a Canadian setting.
Data from the All Our Babies study, a prospective community-based cohort of women’s experiences during pregnancy, were linked to electronic health records to assess the validity of maternal recall at four months post-partum of events that occurred during labour and delivery. Sensitivity, specificity and kappa scores were calculated. Results were stratified by maternal age, gravidity and educational attainment.
Maternal recall at four months post-partum was excellent for infant characteristics (gender, birth weight, gestational age, multiple births) and variables related to labour and delivery (mode of delivery, epidural, labour induction) (sensitivity and specificity >85%). Women who had completed a university degree had significantly better recall of labour induction and use of an epidural.
Maternal recall of infant characteristics and events that occurred during labour and delivery is excellent at four months post-partum and is a valid source of information for research purposes.
Maternal report of events that occurred during labour and delivery are used extensively in epidemiological research. Self-report data are commonly collected as they can be obtained efficiently and at less cost than medical chart reviews; furthermore, self-report allows researchers to simultaneously collect other data that may not be available in medical charts or other source documents, such as lifestyle information [1–4]. Although maternally reported data about the events occurring during labour and delivery are widely used, the validity of this data is rarely confirmed. To our knowledge, maternal recall of birth events has not been validated in a Canadian population and few studies have involved electronic health records.
According to previous studies, the validity of maternal recall varies based on the type of information [2–6], the way questions were worded , mothers’ socio-economic status [1, 8, 9], and length of time since the event [9, 10]. Other studies, specifically those examining maternal recall of infant birth weight, suggest that age, parity, time since birth and ethnicity do not affect the validity of maternal recall [1, 11].
The majority of validation studies have focused on maternal recall of infant birth weight, gestational age and/or mode of delivery [1–6, 8–19]. Generally, they have found that maternal recall for these variables is excellent. A US study found that 89% of 46,637 women sampled could recall their infant’s birth weight within one ounce when compared to the weight recorded on the medical charts , while a British study found that 91% of 649 mothers were able to recall their infant’s birth weight within 200g compared to medical charts . Another study conducted in the UK, determined that 94.5% of 8037 women could recall their infants gestational age at birth within one week of the gestational age found in the medical charts . Other studies showed that maternal recall of gestational age is less accurate than their recall of birth weight, but concluded that maternal recall of both gestational age and birth weight are valid [1, 2, 6, 9, 15, 19]. Several studies examining vaginal vs. caesarean delivery also found high agreement (typically >90%) between medical charts and maternal report [5, 7, 10, 12, 15, 17]. In contrast, conflicting results [5, 7, 15] have been found for use of forceps during delivery. While one Australian study reported that maternal recall for the use of forceps was 99.7% , another Australian study found that only 63.6% of mothers could accurately recall if forceps were used .
The aim of this study was to validate maternal self-report at four months post-partum of events that occurred during labour and delivery with data from electronic health records (EHRs) in a Canadian setting. This validation is important because several large birth cohorts [20–22] have been recently developed in Canada, all of which obtained data through questionnaires. Additionally, national surveys conducted by Statistics Canada, such as the Canadian Community Health Survey [23, 24] and the Maternity Experience Survey [25, 26], also rely on maternal recall of events that occurred during labour and delivery and data from EHRs are not always accessible for research purposes due to cost and time restraints that may prohibit access.
Self-reported data on birth outcomes was obtained from the All Our Babies (AOB) study, a prospective community-based cohort of women’s experiences during pregnancy and the post-partum period. Pregnant women were recruited through physicians’ practices, laboratory services, and posters in the community, and were eligible to participate if they were at most 24 weeks and 6 days gestation at the time of recruitment, receiving prenatal care in Calgary, and able to complete the questionnaires in English (n=4,003) . Participants were asked to complete three written questionnaires: the first before 24 weeks of gestation, the second between 34 and 36 weeks, and the third at four months post-partum. Data for this study comes from the questionnaire that women completed at four months post-partum. In total, 3,388 women completed at least one questionnaire, with a retention rate of 85%. A more detailed description of the AOB methodology can be found in McDonald et al . Ethical approval for the AOB study was granted by the University of Calgary’s Conjoint Health Research Ethics Board.
Pregnancy and birth outcome data were obtained directly from electronic health records (EHR) for the hospital admission for labour and delivery. EHRs include data on antenatal risk factors and events that occurred during labour and delivery . Deterministic linkage based on maternal personal health number (PHN), name and other unique identification factors were used to link data from the AOB study with the EHRs. A total of 2,859 women were identified in both datasets. We were unable to link approximately 15% of participants due to missing or erroneous personal health numbers (primary reason), missing postpartum questionnaire data, or delivery outside of hospital without a registered midwife.
Data elements from the AOB questionnaires and the EHR were reviewed, and eight common variables (caesarean delivery, epidural usage, gestational age, infant birth weight, infant gender, labour induction, multiple gestation pregnancy, preterm birth) were identified. Gestational age and birth weight were examined as both continuous and categorical variables. Gestational age was categorized as preterm (<37 weeks), term (37-40 weeks) and post-term (≥41 weeks) . Low birth weight was defined as birth weight less than 2500g.
Validation of the maternal self-report with the EHR was measured by calculating the sensitivity and specificity for measuring bias, and kappa score for measuring precision . Kappa coefficients were considered to represent excellent agreement if the value was greater than 0.75, moderate agreement if the value was between 0.40 to 0.75 and poor agreement if the value was less than 0.40 . The validity of maternal recall for continuous data elements was determined by calculating the proportion of mothers who reported the gestational age and birth weight within one week and 50g increments.
To determine if socio-demographic factors influenced maternal recall, a series of stratified analyses were also conducted by highest level of education (university vs. high school), gravidity (primigravida vs. multigravida), and maternal age at delivery (<35 vs. ≥35). Data on gravidity and education were obtained from the AOB questionnaire and data on maternal age at delivery was obtained from the EHRs. Sensitivity and specificity were compared and values where the 95% confidence intervals did not overlap were considered to be significantly different at α=0.05 level. Chi square tests were used to examine differences in demographic variables between women whose questionnaire data could and could not be linked to EHRs. All analyses were conducted in Stata SE Version 11.
Characteristics of participants identified in both the AOB dataset and EHRs are described in Table 1. Most of the women reported completing a university education, being in a relationship, and having a household income of $40,000 Canadian or greater. Data from the Maternity Experience Survey indicated that 75.3% of the mothers nationally, compared to 88.6% of the women in this study, have an annual household income of at least $40,000 Canadian . Additionally, data from Statistics Canada indicate that nationally 61.5% of women have completed a university degree compared to 74.9% seen in this sample . Significant differences were observed among women whose questionnaires could and could not be linked to EHRs. Women whose questionnaire data could not be linked to EHRs were significantly less likely to be employed, married or in a common-law relationship, over age 35 at the time of delivery, to own their own homes, to have delivered their infant in a hospital. They also had lower educational attainment and household incomes. No differences were observed based on country of birth, ethnicity, language spoken at home, and gravidity (results not shown).
Table 2 shows the overall agreement between self-reported data from the AOB cohort and information from the EHR. Maternal recall at four months post-partum was found to be valid with high sensitivity, specificity and kappa scores for all variables. Sensitivity and specificity were greater than 90% for the majority of variables studied. The variables of epidural usage, labour induction, and post-term births had lower sensitivity and specificity than the other variables studied; however, sensitivity and specificity were all greater than 80%.
When examined as continuous variables, the majority of women could accurately recall their infant’s gestational age and birth weight within a margin of error, although exact recall was low. Out of 2,677 mothers, 71.5% of the mothers recalled the exact gestational age of their infant, while 98.3% of the mothers remembered the gestational age of their infant within two weeks (Table 3). At four months post-partum, the exact birth weight of the infant was recalled by 11.6% of 2,552 mothers, and 91.7% of the mothers remembered the birth weight of their infant within 200g (Table 4). The inability of mothers to recall exact gestational age and birth weight has implications when calculating rates of common perinatal outcomes. The prevalence of low birth weight and post-term birth was significantly higher in the AOB data than in the EHRs (Table 5).
Stratified analysis revealed that women who had completed a university degree had significantly greater recall of whether their labour was induced (sensitivity=90.1, 95% CI: 87.3-92.4) and epidural usage (sensitivity=92.3, 95% CI: 90.6-93.8) compared to women who had only completed high school or less (labour induction: sensitivity=79.3, 95% CI: 72.8-84.8; epidural: sensitivity=86.6, 95% CI: 82.8-89.7) (Table 6). However, no significant difference was found in any of the outcomes studied by maternal age or gravidity (results not shown).
By comparing the self-reported data from women who participated in the AOB study and electronic health records, it was found that maternal self-report of events occurring around the time of labour and delivery are highly valid when recalled four months after delivery. Educational attainment was the only socio-demographic factor that influenced the accuracy of maternal recall in this study. Although women who had completed university had more accurate recall of labour induction and epidural usage than the mothers who had completed high school, it is worth mentioning that both groups of mothers had high rates of recall. It is plausible that women with higher educational attainment asked more questions during labour and delivery and as such were more aware of events during labour and delivery. The literature is conflicting as to whether women with more education have more accurate recall with some studies showing that more educated women had more accurate recall [2, 5, 19], and other studies showing no effect of education on validity [9, 15–17].
A significant association between validity of recall and maternal age and/or gravidity was not observed in this study. Similarly, other studies have not found an association between maternal age and recall [9, 16, 17, 19]. While no studies could be found that assessed the relationship between gravidity and recall, several studies have examined the relationship between parity and maternal recall. Results are conflicting with some studies showing that parity is negatively associated with recall [1, 2] while others show that there is no association with parity .
In the present study, mothers were able to more accurately report events if they were presented with a list of options (i.e. How was your new baby delivered? A) Vaginally, B) You went into labour but had an emergency caesarean section, C) You did not go into labour and had an emergency caesarean section, D) You had a planned caesarean section) compared to an open or free-text field (i.e. What was your baby’s birth weight?). This difference could also be due to the nature of the question asked. Further work that asks participants the same questions with both categorical and open response options is warranted as this may have important implications for researchers as they strive to reduce participant burden and achieve accurate responses.
Despite the large population, this study is not without limitations. As the present analysis was limited to variables that were captured in both datasets, the validity of socio-demographic and lifestyle factors, mental health, and pregnancy complications could not be assessed. Future studies should assess the validity of these and other important perinatal variables. Some stratification factors (gravidity and education) were self-reported and we cannot exclude the possibility of inaccurate reporting. However, significant differences were not observed with gravidity, and due to social desirability, we presume that women would be more likely to report a higher level of educational attainment that would minimize the difference in reporting seen between groups. Finally, this study was limited to women who could complete a written questionnaire in English. This prohibited an analysis of the impact of English fluency on the validity of maternal recall.
In conclusion, maternal recall at four months post-partum of important events that occurred during labour and delivery is excellent. This study fills a gap in literature and shows that self-reported data from Canadian mothers are valid sources of information with comparison to EHR for research purposes.
All Our Babies
Electronic Health Record
Adegboye AR, Heitmann B: Accuracy and correlates of maternal recall of birthweight and gestational age. BJOG : an international journal of obstetrics and gynaecology. 2008, 115 (7): 886-893. 10.1111/j.1471-0528.2008.01717.x.
Buka SL, Goldstein JM, Spartos E, Tsuang MT: The retrospective measurement of prenatal and perinatal events: accuracy of maternal recall. Schizophrenia research. 2004, 71 (2-3): 417-426. 10.1016/j.schres.2004.04.004.
Elkadry E, Kenton K, White P, Creech S, Brubaker L: Do mothers remember key events during labor?. American journal of obstetrics and gynecology. 2003, 189 (1): 195-200. 10.1067/mob.2003.371.
Tomeo CA, Rich-Edwards JW, Michels KB, Berkey CS, Hunter DJ, Frazier AL, Willett WC, Buka SL: Reproducibility and validity of maternal recall of pregnancy-related events. Epidemiology. 1999, 10 (6): 774-777. 10.1097/00001648-199911000-00022.
Oates RK, Forrest D: Reliability of mothers' reports of birth data. Australian paediatric journal. 1984, 20 (3): 185-186.
Sou SC, Chen WJ, Hsieh WS, Jeng SF: Severe obstetric complications and birth characteristics in preterm or term delivery were accurately recalled by mothers. Journal of clinical epidemiology. 2006, 59 (4): 429-435. 10.1016/j.jclinepi.2005.08.010.
Hewson D, Bennett A: Childbirth research data: medical records or women's reports?. American journal of epidemiology. 1987, 125 (3): 484-491.
Poulsen G, Kurinczuk JJ, Wolke D, Boyle EM, Field D, Alfirevic Z, Quigley MA: Accurate reporting of expected delivery date by mothers 9 months after birth. Journal of clinical epidemiology. 2011, 64 (12): 1444-1450. 10.1016/j.jclinepi.2011.03.007.
Seidman DS, Slater PE, Ever-Hadani P, Gale R: Accuracy of mothers' recall of birthweight and gestational age. British journal of obstetrics and gynaecology. 1987, 94 (8): 731-735. 10.1111/j.1471-0528.1987.tb03717.x.
Githens PB, Glass CA, Sloan FA, Entman SS: Maternal recall and medical records: an examination of events during pregnancy, childbirth, and early infancy. Birth. 1993, 20 (3): 136-141. 10.1111/j.1523-536X.1993.tb00438.x.
Wilcox WD, Gold BD, Tuboku-Metzger AJ: Maternal recall of infant birth weight. Clinical pediatrics. 1991, 30 (8): 509-510. 10.1177/000992289103000811.
Casey R, Rieckhoff M, Beebe SA, Pinto-Martin J: Obstetric and perinatal events: the accuracy of maternal report. Clinical pediatrics. 1992, 31 (4): 200-204. 10.1177/000992289203100402.
Gayle HD, Yip R, Frank MJ, Nieburg P, Binkin NJ: Validation of maternally reported birth weights among 46,637 Tennessee WIC program participants. Public Health Rep. 1988, 103 (2): 143-147.
Hvidtjorn D, Grove J, Schendel D, Schieve LA, Ernst E, Olsen J, Thorsen P: Validation of self-reported data on assisted conception in The Danish National Birth Cohort. Hum Reprod. 2009, 24 (9): 2332-2340. 10.1093/humrep/dep179.
Olson JE, Shu XO, Ross JA, Pendergrass T, Robison LL: Medical record validation of maternally reported birth characteristics and pregnancy-related events: a report from the Children's Cancer Group. American journal of epidemiology. 1997, 145 (1): 58-67. 10.1093/oxfordjournals.aje.a009032.
O'Sullivan JJ, Pearce MS, Parker L: Parental recall of birth weight: how accurate is it?. Archives of disease in childhood. 2000, 82 (3): 202-203. 10.1136/adc.82.3.202.
Quigley MA, Hockley C, Davidson LL: Agreement between hospital records and maternal recall of mode of delivery: evidence from 12 391 deliveries in the UK Millennium Cohort Study. BJOG : an international journal of obstetrics and gynaecology. 2007, 114 (2): 195-200. 10.1111/j.1471-0528.2006.01203.x.
Sanderson M, Williams MA, White E, Daling JR, Holt VL, Malone KE, Self SG, Moore DE: Validity and reliability of subject and mother reporting of perinatal factors. American journal of epidemiology. 1998, 147 (2): 136-140. 10.1093/oxfordjournals.aje.a009425.
Troude P, L'Helias LF, Raison-Boulley AM, Castel C, Pichon C, Bouyer J, de La Rochebrochard E: Perinatal factors reported by mothers: do they agree with medical records?. European journal of epidemiology. 2008, 23 (8): 557-564. 10.1007/s10654-008-9268-9.
Gracie SK, Lyon AW, Kehler HL, Pennell CE, Dolan SM, McNeil DA, Siever JE, McDonald SW, Bocking AD, Lye SJ, et al: All Our Babies Cohort Study: recruitment of a cohort to predict women at risk of preterm birth through the examination of gene expression profiles and the environment. BMC pregnancy and childbirth. 2010, 10: 87-10.1186/1471-2393-10-87.
Walker MC, Finkelstein SA, Rennicks White R, Shachkina S, Smith GN, Wen SW, Rodger M: The Ottawa and Kingston (OaK) Birth Cohort: development and achievements. Journal of obstetrics and gynaecology Canada : JOGC = Journal d'obstetrique et gynecologie du Canada : JOGC. 2011, 33 (11): 1124-1133.
Ontario Health Study. [https://ontariohealthstudy.ca/]
Savard N, Levallois P, Rivest LP, Gingras S: A study of the association between characteristics of CLSCs and the risk of small for gestational age births among term and preterm births in Quebec, Canada. Canadian journal of public health Revue canadienne de sante publique. 2012, 103 (2): 152-157.
Lega I, Ross NA, Zhong L, Dasgupta K: Gestational diabetes history may signal deprivation in women with type 2 diabetes. J Womens Health (Larchmt). 2011, 20 (4): 625-629. 10.1089/jwh.2010.2273.
Chalmers B, Dzakpasu S, Heaman M, Kaczorowski J: The Canadian maternity experiences survey: an overview of findings. Journal of obstetrics and gynaecology Canada : JOGC = Journal d'obstetrique et gynecologie du Canada : JOGC. 2008, 30 (3): 217-228.
Dzakpasu S, Kaczorowski J, Chalmers B, Heaman M, Duggan J, Neusy E: The Canadian maternity experiences survey: design and methods. Journal of obstetrics and gynaecology Canada : JOGC = Journal d'obstetrique et gynecologie du Canada : JOGC. 2008, 30 (3): 207-216.
McDonald SW, Lyon AW, Benzies KM, McNeil DA, Lye SJ, Dolan SM, Penell CE, Bocking AD, Tough SC: The All Our Babies pregnacy cohort: design, methods, and participant characteristics. BMC Pregnancy Childbirth. 2013, 13 (Suppl 1): S2-10.1186/1471-2393-13-S1-S2.
Information management guidelines. [http://www.aphp.ca/pdf/APHP%20Data%20Management%20Guidelines_October%202007_.pdf]
Delaney MRA: Guidelines for the management of pregnancy at 41+0 to 42+0 weeks. Journal of obstetrics and gynaecology Canada : JOGC = Journal d'obstetrique et gynecologie du Canada : JOGC. 2008, 30 (9): 800-810.
Public Health Agency of Canada: Data Tables - The Maternity Experiences Survey (MES) 2006-2007. 2009, Ottawa: Public Health Agency of Canada
Chart 8: Percentage of women among university graduates, by program level, Canada, 1992 to 2008. [http://www.statcan.gc.ca/pub/89-503-x/2010001/article/11542/c-g/c-g008-eng.htm]
This study was funded by Alberta Innovates - Health Solutions, formerly the Alberta Heritage Foundation for Medical Research, as part of the Preterm Birth and Healthy Outcomes Team Interdisciplinary Team Grant (#200700595). U. Bat-Erdene received a summer scholarship from the Canadian Institutes of Health Research (CIHR) Strategic Training Program in Genetics, Child Development and Health; A. Metcalfe holds a studentship award from the CIHR Strategic Training Program in Genetics, Child Development and Health; S.W. McDonald holds a post-doctoral fellowship award from the Alberta Centre for Child, Family and Youth Health; S.C. Tough holds a senior scientist award from Alberta Innovates – Health Solutions.
This article has been published as part of BMC Pregnancy and Childbirth Volume 13 Supplement 1, 2013: Preterm Birth: Interdisciplinary Research from the Preterm Birth and Healthy Outcomes Team (PreHOT). The full contents of the supplement are available online athttp://www.biomedcentral.com/bmcpregnancychildbirth/supplements/13/S1.
All of the publication fees will be funded by the Preterm Birth and Healthy Outcomes Team Interdisciplinary Team Grant (#200700595) from Alberta Innovates - Health Solutions, formerly the Alberta Heritage Foundation for Medical Research.
None of the authors have any competing interests to declare
SCT designed and secured funding for the overall study. AM and SWM designed the sub-study. UBE and AM conducted the analysis. UBE drafted the manuscript. All authors critically reviewed the manuscript and approved the final version for submission.