- Research article
- Open Access
Agreement of antenatal care indicators from self-reported questionnaire and the antenatal care card of women in the 2015 Pelotas birth cohort, Rio Grande do Sul, Brazil
BMC Pregnancy and Childbirth volume 19, Article number: 410 (2019)
Studies of healthcare service use during the pregnancy-postpartum cycle often rely on self-reported data. The reliability of self-reported information is often questioned as administrative data or medical records, such as antenatal care cards, are usually preferred. In this study, we measured the agreement of antenatal care indicators from self-reported information and antenatal care cards of pregnant women in the 2015 Pelotas Birth Cohort, Brazil.
In a sample of 3923 mothers, indicator agreement strengths were estimated from Kappa and prevalence-and-bias-adjusted Kappa (PABAK) coefficients. Maternal characteristics associated with indicator agreements were assessed with heterogeneity chi-squared tests.
The self-reported questionnaire and the antenatal care card showed a moderate to high agreement in 10 of 21 (48%) antenatal care indicators that assessed care service use, clinical examination and diseases during pregnancy. Counseling indicators performed poorly. Self-reported information presented a higher frequency data and a higher sensitivity but slightly lower specificity when compared to the antenatal card. Factors associated with higher agreement between both data sources included lower maternal age, higher level of education, primiparous status, and being a recipient of health care in the public sector.
Self-reported questionnaire and antenatal care cards provided substantially different information on indicator performance. Reliance on only one source of data to assess antenatal care quality may be questionable for some indicators. From a public health perspective, it is recommended that antenatal care programs use multiple data sources to estimate quality and effectiveness of health promotion and disease prevention in pregnant women and their offspring.
Antenatal Care (ANC) comprises a number of activities and procedures aimed at preserving the health of pregnant women while ensuring delivery of preventive measures, early detection of complications and the adequate management of pre-existing maternal disease states . The reduction of maternal mortality remains a priority under “Goal 3: Ensure healthy lives and promote well-being for all at all ages” in the new Sustainable Development Goals (SDGs) agenda through 2030 . In this context, information on maternal and child health is fundamental to ensure antenatal care quality and reduction of maternal and perinatal mortality. In Brazil, a pregnancy card records health information and details of antenatal and postpartum care visits. The card is a tool included in the Prenatal and Birth Humanization Program, part of the Ministry of Health medical record systems, and its use is mandatory to ensure that healthcare for pregnant women meets the national minimum quality standards. The card includes information on ANC visits, diagnostic findings and patient behaviors and links the different stages of the health care process. The systematic collection of data during each consultation can therefore be used to provide optimal health services at any point of care.
An alternative method for collection of data on health care received during the pregnancy-postpartum cycle is the use of individual questionnaires. The in-person interview or questionnaire is frequently used in epidemiology research because it provides a comprehensive and standardized assessment of the topic of interest. It is a relatively inexpensive tool that enables collection of data from a large population sample.
Medical records are considered the gold standard and are generally the preferred data source over interviews/questionnaires. However, evidence indicates that reliability of any individual source of data is imperfect, possibly inaccurate, and thus the combination of sources may improve reliability and completeness of information [1, 3,4,5,6]. The objective of this study was to evaluate for the first time the agreement between self-reported questionnaire information and data recorded in the ANC cards from women in the 2015 city of Pelotas Birth Cohort study, Rio Grande do Sul, Brazil.
Materials and methods
The data is representative of births in the municipality of Pelotas in 2015. However, this birth cohort is not representative of the total number of births in Brazil for that period. In 2015, 5598 newborn babies were identified, of whom 4329 were children of mothers who were residents in the urban area of Pelotas (cohort study targeted population) and were invited to participate. The refusal rate was 1.3% in the perinatal period.
This was a cross-sectional study based on the mothers of children eligible for the 2015 Pelotas Birth Cohort who were interviewed during pregnancy and/or at birth. The total number of eligible pregnant mothers was 4329 (in the case of multiple pregnancies only one record was kept for each mother). Fifty-nine records corresponded to multiple births, totaling 4270 mothers in the birth cohort. Of these mothers 4172 had attended ANC but 249 did not have an antenatal card available at the time of interview, resulting in a final sample of 3923 mothers included in this study (Additional file 1: Figure S1).
The questionnaires used during prenatal and perinatal visits of the 2015 Pelotas Birth Cohort are available at http://epidemio-ufpel.org.br/site/content/coorte_2015/questionarios.php. More detailed information on the cohort methods and follow-up visits is provided elsewhere .
The information was collected through interviews during pregnancy and/or the perinatal period. During antenatal care, two antenatal visits were performed, one before gestational week 16 and the second between gestational weeks 16 and 24. The third follow-up was at delivery. One questionnaire was used at weeks 16, 24 and at delivery to collect sociodemographic characteristics including maternal age, education, marital status, skin color, family income, pre-pregnancy health, and if the mother was seen by the same health professional during ANC and type of ANC provider. The perinatal questionnaire asked for reproductive health history variables – delivery characteristics, number of pregnancies, and if the mother was seen by the same health professional during ANC and type of ANC provider. ANC data were also collected at delivery and documented service utilization, details of clinical examination, occurrence of disease during pregnancy, prophylactic interventions (vaccination and supplements), and educational interventions (counseling). Additional file 2: Table S1 shows the questionnaire contents and data collection tools.
At the end of the interview the ANC card was photographed and information on ANC routines extracted and double entered into a database (Epi Info 6.04, Centers for Disease Control and Prevention, Atlanta, USA) by two trained research assistants. A consistency analysis with a frequency verification was performed using Stata 12® (Statacorp, College Station, TX, USA).
If there was no record of a given procedure on the card, it was considered as not performed. The agreement analysis was carried out only when the card was available with at least one record present. The questionnaire items and antenatal card variables used in this study are described in Additional file 3: Table S2.
The agreement between the card and the questionnaire for each variable of interest was estimated using Kappa coefficient (κ) with corresponding 95% confidence intervals (95% CI). Kappa and Prevalence-Adjusted-and-Bias-Adjusted Kappa (PABAK)  values were interpreted using Landis and Koch categorization  into almost perfect (>0.80), substantial (0.61–0.80), moderate (0.41–0.60), fair (0.21–0.40), slight (0.00–0.20) and poor (<0.00). Sensitivity and specificity are reported with 95% CI and were calculated assuming the ANC card to be the gold standard or assuming the questionnaire to be the gold standard.
The association of maternal characteristics with an agreement between the card and the questionnaire was evaluated by building a score ranging from 1 to 10 using those ANC indicators with adjusted Kappa coefficients in the categories of almost perfect to moderate (ten indicators as shown in Table 3). A value of 1 was assigned to each indicator agreement (1 = yes/yes or no/no). The score was dichotomized into low (≤7 points as zero) and high agreement (≥ 8 points as one) to conduct bivariate analysis using the score as the dependent variable. Heterogeneity chi-squared tests were used to measure the difference between low and high agreement categories. The analyses were performed in Stata 15® (Statacorp, College Station, TX, USA).
Within the cohort of 3923 women 82.6% were between 20 and 39 years of age, 14.4% were under 20 years of age, 71.9% were white, 33.7% had up to 8 years of schooling and 86.4% were living with a partner at the time of interview. With regard to socioeconomic data, 59.7% were between the first and third quintiles of family income. In relation to obstetrical data, 50.4% of the women were primiparous, 64.8% had undergone c-section delivery, 52.8% were seen by the same health professional during ANC, and 45.0% received ANC in the public health sector. When comparing our sample with mothers who did not attend or receive ANC and lacked an antenatal card, a statistically significant difference for maternal education, marital status, family income, and parity was found (Table 1). Table 2 shows the distribution of data from ANC cards and from the self-reported questionnaire.
Agreement between ANC card indicators and questionnaire information
From the 21 indicators in the ANC card we observed that agreement strength with self-reported questionnaire information was poor in 1 indicator (K < 0.00), slight for 16 (K between 0.00–0.20), fair for 2 (K between 0.21–0.40), and moderate for 2 (K between 0.41–0.60) (Table 3). The agreement strength category obtained with the PABAK was higher than that obtained with the Kappa coefficient in 9 (43%) indicators – antenatal care number of visits ≥6, reported date of last menstrual period, weight, symphysis-fundal height, blood pressure, syphilis test, hypertension during pregnancy, diabetes during pregnancy, and sexually transmitted diseases (Table 3). Agreement strength categories for urinary tract infection during pregnancy, breast exam, hepatitis B vaccination, and counseling on physical activities such as walking were moderate, slight, fair, and poor respectively, and were equally categorized by PABAK and Kappa values. Agreement strength categories were lower with PABAK relative to those obtained with Kappa for gynecological exam, cervical cancer screening test, counseling on risks of alcohol use during pregnancy and counseling on risks of smoking during pregnancy (Table 3).
Sensitivity and specificity
Self-reported questionnaire with the ANC card as the gold standard
The sensitivity of the self-reported questionnaire was high (>90%) for 28.6% of the indicators evaluated, all of them in the components of service use and clinical examination. Good sensitivity (≥80 and < 90%) was present in 23.8% and low sensitivity (<80%) in 47.6% of the indicators. Specificity was low (<80%) for all indicators except for diabetes and sexually transmitted diseases that had >90% specificity (Table 4.).
Antenatal card with the self-reported questionnaire as the gold standard
The sensitivity of antenatal card was high (>90%) for 19.0% of the indicators evaluated, all of them in the clinical examination component. The number of visits showed good sensitivity (81.1%) and the rest presented low sensitivity. Specificity was high for 42.8% of the indicators, mainly those related to diseases during pregnancy and counselling. Good specificity (≥80 and < 90%) was present in 19.0% of the indicators (Table 4).
Maternal factors associated with an agreement between data sources
Table 5 presents the maternal characteristics associated with the concordance between the ANC card and self-report questionnaire. There was a significantly higher agreement among pregnant women with younger age, more years of maternal schooling, primiparous status and those using a public sector health care provider.
To our knowledge, this is one of the few studies evaluating the agreement between self-reported questionnaire from pregnant women and the antenatal card that recorded procedures and interventions during ANC [10, 11]. The assessment of agreement between sources of information on ANC assistance is an issue that has aroused the interest of the global scientific community. Our key findings indicate firstly, that assessment of ANC from self-reported questionnaire has moderate to high agreement to ANC card indicators of service utilization, clinical examination and diseases during pregnancy whereas indicators of counseling performed poorly. Secondly, self-reported information presented higher data frequency and higher sensitivity but slightly lower specificity when compared to the ANC card. Thirdly, factors associated with higher agreement between both data sources included young maternal age, more maternal schooling years, being a primiparous mother, and health care received in the public sector.
Moderate to high agreement on indicators of service utilization, clinical examination and diseases during pregnancy. Poor agreement on indicators of counseling
The moderate to high agreement in these indicators suggests that assessment of ANC through self-reported questionnaire or the antenatal card could be equivalent. However, caution is advised when interpreting these results, especially for indicators related to diseases during pregnancy. As has been shown in other studies , the performance of antenatal clinical exams such as measurements of weight, symphysis-fundal height, and blood pressure reached almost perfect agreement [10, 12]. These findings may be related to the ability of the patient to identify the reason for the ANC procedure/action recorded by the health professional during the ANC visit. For example, self-reporting weight may be more accurate than self-reporting a cervical cancer screening test. Patients are more likely to understand that weight is being measured when asked to step on a scale but less likely to discern whether a cervical cancer screening test is the reason for a gynecological examination [13,14,15]. Indeed we found a very low agreement on reporting of gynecological exam, cervical cancer screening test and breast exam (Table 3). Given that the frequency of these procedures was lower in the ANC cards relative to self-reports, the low agreements may also stem from poor record-keeping by health professionals or that these tests, that are mandatory at the national level, were not carried out, as reported in other studies [10,11,12,13,14, 16,17,18,19,20,21,22,23]. This would raise serious concerns regarding the quality of healthcare that women and their offspring receive.
Efforts to improve the quality of care for pregnant women in Brazil include a National Oral Health Policy  which mandates a dental consultation when initiating ANC. Our study found a fair agreement. However, the results should be analyzed with caution as 70.9% (1002/1412) of the pregnant women who reported having consulted with a dentist during pregnancy also participated in the oral health sub-study of this cohort , therefore in the general population agreement could be lower than reported.
For gestational diabetes, agreement was classified as almost perfect, a finding confirmed by other studies [25, 26] where agreement was often higher than those reported for other chronic diseases [27, 28]. Studies evaluating self-reported medical information have shown that patients can provide reasonably good reports on their illnesses [29, 30]. Recent publications on urinary tract infection have shown moderate agreement between self-reporting and medical records with a low sensitivity [31, 32], similar to the findings obtained by our study.
Some conditions such as diabetes, hypertension, anemia, and urinary tract infection may not have been recorded on the ANC cards, but women still refer to having experienced them. Similar findings have been reported in other studies [10, 33, 34]. One possible reason for over reporting of gestational diabetes is that the diagnosis requires a positive result on two different glucose tests. Thus, women with a positive first test but negative on the second may have reported gestational diabetes. Sexually transmitted diseases may have been under-reported possibly due to stigmatization.
Counselling indicators were more frequently self-reported than reported in the antenatal card. Reports of counselling pertaining to alcohol use and smoking during pregnancy had the lowest Kappa values and the highest difference between sources, perhaps due to a low probability of reporting of these habits to healthcare providers during antenatal care. Previous studies have shown that counseling and referrals (e.g., cervical cancer screening tests) are underreported in medical records compared to self-reported records, indicating that health professionals do not consistently register these interventions [35, 36].
. Self-reported information presented higher data frequency and higher sensitivity but slightly lower specificity when compared to the ANC card
The use of questionnaires in epidemiologic studies is considered a valid tool with many advantages for research. However, the quality of the information obtained by self-reporting is dependent on the type of disease [37, 38], the characteristics of the participants [30, 39], the design of the questionnaire, and the method used to administer it [40, 41]. In addition, information obtained by self-reporting or by review of medical records may not be consistent. Several studies have shown that the agreement between the two sources of information is dependent on the type of variable collected [42,43,44].
When self-report was compared to the card as gold standard, we found that specificity and sensitivity were > 80% for 9.5% (2/21) and 52% (11/51) of ANC indicators respectively. The high sensitivity in this comparison may be related to the use of self-administered questionnaires as sources of information on exposures and outcomes, which may be more complete and with fewer omissions in responses by participants.
When we compared the antenatal card with self-report as the gold standard, we found that the specificity and sensitivity were > 80% for 60% (13/21) and 25% (5/21) of ANC indicators respectively. This high specificity suggests that data recorded on the cards corresponded to the most relevant aspects identified during medical consultation. The low sensitivity suggests that registration of other ANC procedures/activities was incomplete. One reason may be that data recorded on antenatal cards do not accurately reflect all events occuring during a medical visit [45, 46]. Furthermore the content of antenatal cards is not standardized for data collection in a private versus public setting or designed for data collection by health professionals with responsibility for specific aspects of ANC.
Despite these limitations, data collected in the ANC card are preferable for making decisions on potentially significant clinical interventions during antenatal and perinatal stages .
. Maternal characteristics associated with the agreement between the ANC card and the self-reported questionnaire
Sociodemographic characteristics may contribute towards the strength of agreement between data sources and determine ANC quality . Our findings show that higher maternal age, lower educational status, pregnant women with ≥2 children and type of healthcare provider associate with a lower probability of high agreement between the antenatal card and the self-reported questionnaire. We were unable to find other studies on factors associated with ANC indicator agreements for the data sources used in our study. However, there is evidence that the demand for health services and ANC quality are typically related to the sociodemographic characteristics of pregnant women .
Limitations and implications
Due to the intrinsic limitations of the data sources analyzed herewith, judgements about their respective validity should be made with caution.
The quality of medical record documentation may be affected by omissions in reporting, for example tests may have been performed elsewhere and not transcribed onto the antenatal card or incomplete documentation due to time constraints for record-keeping by health professionals. In addition to problems with recording-keeping, accuracy of medical record extraction may be compromised by bias, fatigue or distraction of the systematic reviewer. These findings suggest that a purely quality-based assessment on medical records data could fail to find information on performed procedures and interventions that the pregnant woman might have supplied. This can result in the loss of important information on some ANC indicators.
The quality of an evaluation that depends solely on self-reported information can be influenced by recall bias, by subjectivity or misunderstanding of the questions pertaining to diagnoses, procedures and interventions received during ANC. In addition, the accuracy of a self-report may be affected by culturally influenced factors such as the importance of events, awareness and knowledge of health conditions .
Our study shows that data from questionnaires or the ANC cards provide substantially different information on indicator performance. From a public health perspective this raises questions with regard to reliance on indicators derived from a single data source. It may be more prudent to assess the quality of ANC programs using multiple data sources to determine quality and effectiveness of health promotion and disease prevention programs in pregnant women and their offspring. Researchers should explore alternative methods and data sources to obtain consistent estimates of ANC quality, various different indicators, be aware of factors that may influence the accuracy of data sources and conduct sub-studies to collect such data when not available. The implications of choosing a questionnaire or medical records should be carefully considered when evaluating health services for clinical practice, research, and public health. Deciding which data source to use will also depend on the outcome of interest and if the data is used for clinical decision-making, performance tracking, or public health.
Availability of data and materials
The dataset used in this study is available upon request.
Sustainable Development Goals
Goulet F, Jacques A, Gagnon R, Racette P, Sieber W. Assessment of family physicians’ performance using patient charts: interrater reliability and concordance with chart-stimulated recall interview. Eval Health Prof. 2007;30(4):376–92. https://doi.org/10.1177/0163278707307924.
United Nations. Transforming our world: the 2030 agenda for sustainable development; 2015. Available from: https://sustainabledevelopment.un.org/content/documents/21252030%20Agenda%20for%20Sustainable%20Development%20web.pdf
Corser W, Sikorskii A, Olomu A, Stommel M, Proden C, Holmes-Rovner M. Concordance between comorbidity data from patient self-report interviews and medical record documentation. BMC Health Serv Res. 2008;85(8):1–9. https://doi.org/10.1186/1472-6963-8-85.
Okura Y, Urban LH, Mahoney DW, Jacobsen SJ, Rodeheffer RJ. Agreement between self-report questionnaires and medical record data was substantial for diabetes, hypertension, myocardial infarction and stroke but not for heart failure. J Clin Epidemiol. 2004;57(10):1096–103. https://doi.org/10.1016/j.jclinepi.2004.04.005.
St Sauver JL, Hagen PT, Cha SS, Bagniewski SM, Mandrekar JN, Curoe AM, et al. Agreement between patient reports of cardiovascular disease and patient medical records. Mayo Clin Proc. 2005;80(2):203–10. https://doi.org/10.4065/80.2.203.
Tisnado DM, Adams JL, Liu H, Damberg CL, Chen WP, Hu FA, et al. What is the concordance between the medical record and patient self-report as data sources for ambulatory care? Med Care. 2006;44(2):132–40. https://doi.org/10.1097/01.mlr.0000196952.15921.bf.
Hallal PC, Bertoldi AD, Domingues MR, da Silveira MF, Demarco FF, da Silva IC, et al. Cohort profile: the 2015 Pelotas (Brazil) birth cohort study. Int J Epidemiol. 2017;47(4):1048. https://doi.org/10.1093/ije/dyx219.
Byrt T, Bishop J, Carlin JB. Bias, prevalence and kappa. J Clin Epidemiol. 1993;46(5):423–9. https://doi.org/10.1016/0895-4356(93)90018-v.
Landis JR, Koch GG. The measurement of observer agreement for categorical data. Biometrics. 1977;33(1):159–74. https://doi.org/10.2307/2529310.
Santos Neto ET, Leal M, Oliveira AE, Zandonade E, Gama S. Concordância entre informações do Cartão da Gestante e da memória materna sobre assistência pré-natal. Cad Saúde Pública. 2012; 28(2):256–266. DOI: https://doi.org/10.1590/S0102-311X2012000200005
Zanchi M, Gonçalves CV, Cesar Juraci A, Dumith S. Concordância entre informações do Cartão da Gestante e do recordatório materno entre puérperas de uma cidade. Cad Saúde Pública. 2013;29(5):1019–28. https://doi.org/10.1590/S0102-311X2013000500019.
Carvalho D, Novaes Hillegonda MD. Avaliação da implantação de programa de atenção pré-natal no Município de Curitiba, Paraná, Brasil: estudo em coorte de primigestas. Cad Saúde Pública. 2004;20(Supl 2):S220–30. https://doi.org/10.1590/S0102-311X2004000800017.
McGovern PG, Lurie N, Margolis KL, Slater JS. Accuracy of self-report of mammography and pap smear in a low-income urban population. Am J Prev Med. 1998;14(3):201–8. https://doi.org/10.1016/S0749-3797 (97)00076-7.
Pizarro J, Schneider TR, Salovey P. A source of error in self-reports of pap test utilization. J Community Health. 2002;27:351–7. https://doi.org/10.1023/A:1019888627113.
Heaman MI, Sword WA, Akhtar-Danesh N, Bradford A, Tough S, Janssen PA, et al. Quality of prenatal care questionnaire: instrument development and testing. BMC Pregnancy Childbirth. 2014;14:188. https://doi.org/10.1186/1471-2393-14-188.
Silveira DS, Santos IS, Dias-da-Costa JS. Atenção pré-natal na rede básica: uma avaliação da estrutura e do processo. Cad Saúde Pública. 2001;17(1):131–9. https://doi.org/10.1590/S0102-311X2001000100013.
Coutinho T, Monteiro MFG, Sayd JD, Teixeira MTB, Coutinho CM, Coutinho LM. Monitoring the prenatal care process among users of the unified health care system in a city of the Brazilian southeast. Rev Bras Ginecol Obstet. 2010;32(11):563–9. https://doi.org/10.1590/S0100-72032010001100008.
Neumann NA, Tanaka OU, Victora CG, Cesar JA. Qualidade e equidade da atenção ao pré-natal e ao parto em Criciúma, Santa Catarina, Sul do Brasil. Rev Bras Epidemiol. 2003;6(4):307–18. https://doi.org/10.1590/S1415-790X2003000400005.
Monteiro PB, Monteiro Filho MP, de Figueirêdo JT, Saintrain MVL, Bruno ZV, FHC C. Cytology-based screening during antenatal care as a method for preventing cervical cancer. Asian Pac J Cancer Prev. 2017;18(9):2513–8. https://doi.org/10.22034/APJCP.2017.18.9.2513.
Al Sairafi M, Mohamed FA. Knowledge, attitudes, and practice related to cervical cancer screening among Kuwaiti women. Med Princ Pract. 2009;18(1):35–42. https://doi.org/10.1159/000163044.
Abiodun OA, Fatungase OK, Olu-Abiodun OO, Idowu-Ajiboye BA, Awosile JO. An assessment of women’s awareness and knowledge about cervical cancer and screening and the barriers to cervical screening in Ogun state, Nigeria. IOSR-JDMS. 2013;10(3):52–8. https://doi.org/10.9790/0853-1035258.
Martins LFL, Thuler LCS, Valente JG. Cobertura do exame de Papanicolaou no Brasil e seus fatores determinantes: uma revisão sistemática da literatura. Rev Bras Ginecol Obstet. 2005;27(8):485–92. https://doi.org/10.1590/S0100-72032005000800009.
Leung SSK, Leung I. Cervical cancer screening: knowledge, health perception and attendance rate among Hong Kong Chinese women. Int J Women's Health. 2010;2:221–8. https://doi.org/10.2147/IJWH.S10724.
Brasil Ministério da Saúde (MS). Secretaria de Atenção à Saúde. Departamento de Atenção Básica. Coordenação Nacional de Saúde Bucal. Brasília: MS: Diretrizes da Política Nacional de Saúde Bucal; 2004. Available from: http://bvsms.saude.gov.br/bvs/publicacoes/politica_nacional_brasil_sorridente.htm
de Oliveira DMAS, Santos Iná S. Validade do auto-relato de diabete mellitus gestacional no pós-parto imediato. Cad Saúde Pública. 2009;25(2):251–8. https://doi.org/10.1590/S0102-311X2009000200003.
Solomon CG, Willett WC, Rich-Edwards J, Hunter DJ, Stampfer MJ, Colditz GA, et al. Variability in diagnostic evaluation and criteria for gestational diabetes. Diabetes Care. 1996;19:12–6. https://doi.org/10.2337/diacare.19.1.12.
Ngo DL, Marshall LM, Howard RN, Woodward JA, Southwick K, Hedberg K. Agreement between self-reported information and medical claims data on diagnosed diabetes in Oregon’s Medicaid population. J Public Health Manag Pract. 2003;9(6):542–4. https://doi.org/10.1097/00124784-200311000-00016.
El Fakiri F, Bruijnzeels MA, Hoes AW. No evidence for marked ethnic differences in accuracy of self-reported diabetes, hypertension, and hypercholesterolemia. J Clin Epidemiol. 2007;60(12):1271–12719. https://doi.org/10.1016/j.jclinepi.2007.02.014.
Bush TL, Miller SR, Golden AL, Hale WE. Self-report and medical record report agreement of selected medical conditions in the elderly. Am J Public Health. 1989;79(11):1554–6. https://doi.org/10.2105/ajph.79.11.1554.
Miller DR, Rogers WH, Kazis LE, Spiro A, Ren XS, Haffer SC. Patients’ self-report of diseases in the Medicare health outcomes survey based on comparisons with linked survey and medical data from the veterans health administration. J Ambul Care Manage. 2008;31(2):161–77. https://doi.org/10.1097/01.JAC.0000314707.88160.9c.
Mithoowani S, Celetti SJ, Irfan N, Brooks A, Mertz D. Inadequate documentation of urinary tract infection symptoms in the medical chart. Am J Infect Control. 2015;43(11):1252–4. https://doi.org/10.1016/j.ajic.2015.07.037.
Dietz P, Bombard J, Mulready-Ward C, Gauthier J, Sackoff J, Brozicevic P, et al. Validation of self-reported maternal and infant health indicators in the pregnancy risk assessment monitoring system. Matern Child Health J. 2014;18(10):2489–98. https://doi.org/10.1007/s10995-014-1487-y.
Liu J, Tuvblad C, Li L, Raine A, Baker LA. Medical record validation of maternal recall of pregnancy and birth events from a twin cohort. Twin Res Hum Genet. 2013;16(4):845–60. https://doi.org/10.1017/thg.2013.31.
Gresham E, Forder P, Chojenta CL, Byles JE, Loxton DJ, Hure AJ. Agreement between self-reported perinatal outcomes and administrative data in New South Wales, Australia. BMC Pregnancy Childbirth. 2015;15:161. https://doi.org/10.1186/s12884-015-0597-x.
Stange KC, Zyzanski SJ, Smith TF, Kelly R, Langa DM, Flocke SA, et al. How valid are medical records and patient questionnaires for physician profiling and health services research? A comparison with direct observation of patient visits. Med Care. 1998;36(6):851–67. https://doi.org/10.1097/00005650-199806000-00009.
Luck J, Peabody JW, Dresselhaus TR, Lee M, Glassman P. How well does chart abstraction measure quality? A prospective comparison of standardized patients with the medical record. Am J Med. 2000;108(8):642–9. https://doi.org/10.1016/s0002-9343(00)00363-6.
Molenaar EA, Van Ameijden EJ, Grobbee DE, Numans ME. Comparison of routine care self-reported and biometrical data on hypertension and diabetes: results of the Utrecht health project. Eur J Pub Health. 2007;17(2):199–205. https://doi.org/10.1093/eurpub/ckl113.
Bowlin SJ, Morrill BD, Nafziger AN, Lewis C, Pearson TA. Reliability and changes in validity of self-reported cardiovascular disease risk factors using dual response: the behavioral risk factor survey. J Clin Epidemiol. 1996;49(5):511–7. https://doi.org/10.1016/0895-4356(96)00010-8.
Goldman N, Lin IF, Weinstein M, Lin YH. Evaluating the quality of self-reports of hypertension and diabetes. J Clin Epidemiol. 2003;56(2):148–54. https://doi.org/10.1016/s0895-4356(02)00580-2.
Bergmann MM, Jacobs EJ, Hoffmann K, Boeing H. Agreement of self-reported medical history: comparison of an in-person interview with a self-administered questionnaire. Eur J Epidemiol. 2004;19(5):411–6. https://doi.org/10.1023/b:ejep.0000027350.85974.47.
Gama H, Correia S, Lunet N. Effect of questionnaire structure on recall of drug utilization in a population of university students. BMC Med Res Methodol. 2009;9:45. https://doi.org/10.1186/1471-2288-9-45.
Rice F, Lewis A, Harold G, van den Bree M, Boivin J, Hay DF, et al. Agreement between maternal report and antenatal records for a range of pre and peri-natal factors: the influence of maternal and child characteristics. Early Hum Dev. 2007;83(8):497–504. https://doi.org/10.1016/j.earlhumdev.2006.09.015.
Troude P, L’Hélias L, Raison-Boulley AM, Castel C, Pichon C, Bouyer J, et al. Perinatal factors reported by mothers: do they agree with medical records? Eur J Epidemiol. 2008;23(8):557–64. https://doi.org/10.1007/s10654-008-9268-9.
Hessol NA, Missett B, Fuentes-Afflick E. Lower agreement on behavioral factors than on medical conditions in self-reported data among pregnant Latina women. Arch Med Res. 2004;35(3):241–5. https://doi.org/10.1016/j.arcmed.2004.01.002.
Rohrbaugh M, Rogers JC. What did the doctor do? When physicians and patients disagree. Arch Fam Med. 1994;3(2):125–9.
Worster A, Haines T. Advanced statistics: understanding medical record review (MRR) studies. Acad Emerg Med. 2004;11(2):187–92. https://doi.org/10.1111/j.1553-2712.2004.tb01433.x.
Partin MR, Malone M, Winnett M, Slater J, Bar-Cohen A, Caplan L. The impact of survey nonresponse bias on conclusions drawn from a mammography intervention trial. J Clin Epidemiol. 2003;56(9):867–73. https://doi.org/10.1016/s0895-4356(03)00061-1.
Van Minh H, Oh J, Giang KB, Kien VD, Nam YS, Lee CO, et al. Multiple vulnerabilities and maternal healthcare in Vietnam: findings from the multiple indicator cluster surveys, 2000, 2006, and 2011. Glob Health Action. 2016;9(1):29386. https://doi.org/10.3402/gha.v9.29386.
Simkhada B, Van Teijlingen ER, Porter M, Simkhada P. Factors affecting the utilization of antenatal care in developing countries: systematic review of the literature. J Adv Nurs. 2008;61(3):244–60. https://doi.org/10.1111/j.1365-2648.2007.04532.x.
Olson JE, Shu XO, Ross JA, Pendergrass T, Robison LL. Medical record validation of maternally reported birth characteristics and pregnancy-related events: a report from the Children’s cancer group. J Epidemiol. 1997;145(1):58–67. https://doi.org/10.1093/oxfordjournals.aje.a009032.
This article is based on data from the study “Pelotas Birth Cohort, 2015” conducted by the Postgraduate Program in Epidemiology at Universidade Federal de Pelotas, in collaboration with the Brazilian Public Health Association (ABRASCO). The 2015 Pelotas (Brazil) Birth Cohort is funded by the Wellcome Trust (095582). Additional financial assistance was provided by the Coordenação de Aperfeiçoamento de Pessoal de Nível Superior – Brasil (CAPES) Finance Code 001. Funding agencies had no role in study design, collection, analysis, data interpretation or manuscript writing.
Ethics approval and consent to participate
The antenatal follow-up of the 2015 Pelotas (Brazil) Birth Cohort Study was approved by the Superior School of Physical Education Research Ethics Committee from the Federal University of Pelotas under the protocol 522.064. After agreeing to take part in the study, women signed a written informed consent.
Consent for publication
The authors declare that they have no competing interests.
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Additional file 1:
Figure S1. Flowchart sample.
Additional file 2:
Table S1. Questionnaire contents and data collection tools, Pelotas 2015.
Additional file 3:
Table S1. Questionnaire items and the antenatal care card variables.
Rights and permissions
Open Access This article is distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated.
About this article
Cite this article
Morón-Duarte, L.S., Ramirez Varela, A., Bassani, D.G. et al. Agreement of antenatal care indicators from self-reported questionnaire and the antenatal care card of women in the 2015 Pelotas birth cohort, Rio Grande do Sul, Brazil. BMC Pregnancy Childbirth 19, 410 (2019). https://doi.org/10.1186/s12884-019-2573-3
- Antenatal care
- Antenatal card
- Self-reported questionnaire