- Research article
- Open Access
Refinement of the Well-being in Pregnancy (WiP) questionnaire: cognitive interviews with women and healthcare professionals and a validation survey
BMC Pregnancy and Childbirth volume 22, Article number: 325 (2022)
Measuring positive and negative aspects of well-being during pregnancy and childbirth is important for both healthy women and women who are living with long-term health conditions (LTCs). This study aimed to further refine the Well-being in Pregnancy (WiP) questionnaire and to incorporate LTC specific items where appropriate.
A multi-method study. Cognitive interviews with pregnant or postpartum women (n = 11) and consultations with healthcare professionals (n = 11) and public representatives (n = 4) were conducted to explore the acceptability of existing WiP items and content. Items were refined and subsequently administered on an online survey (n = 768). Item reduction steps and exploratory factor analysis were performed on survey data. Convergent validity was examined using Pearson correlation coefficients to compare relationships with other included validated assessments.
Following amendments to three items, the addition of eight core WiP items and five LTC specific items, a total of 25 items were considered relevant and appropriate for use with pregnant women. Analysis of survey data reduced the questionnaire to 12 items measuring three core WiP scales; 1) Concerns over support after birth, 2) Positive pregnancy and, 3) Confidence about motherhood, and a five item standalone LTC specific scale. All scales demonstrated good validity and internal reliability. Scores for the three core scales moderately correlated with established well-being measures indicating that they were measuring similar, yet distinct concepts.
Analyses confirmed good psychometric properties of the refined WiP questionnaire. The use of pregnancy specific well-being measures, such as the WiP, provide a route into asking women in more detail about how their care may be tailored to support them and also facilitates positive conversations with women about how care and experience of pregnancy and childbirth may be enhanced further.
Subjective well-being is a multi-faceted concept that encompasses both positive and negative emotions, and an evaluation of satisfaction with life and psychological functioning . While research into subjective well-being has grown significantly in recent years, it remains poorly defined . The term well-being is often used interchangeably with happiness, flourishing and quality of life. There is also much debate about what constitutes subjective wellbeing. The Wellbeing in Pregnancy measure builds on Diener’s model  which recognises the multi-dimensionality of subjective wellbeing and highlights the inclusion of positive and negative affect and a cognitive components . The affective component (often referred to hedonic wellbeing) needs to include both positive affect and negative affect in a full assessment of well-being . The cognitive component may be viewed differently depending on philosophical perspective as Life Satisfaction (evaluative component) or eudemonia (meaning in life) . As the cognitive component reflects the conditions and circumstances of life as a whole, additional measurement of domain satisfaction represents a focused evaluation of some specific aspect of one’s life e.g. income or partner satisfaction .
A recent systematic review of the impact of pregnancy on subjective wellbeing found life satisfaction, happiness, and mental component of quality of life, were found to be high during pregnancy, but positive emotion and physical components of quality of life had decreased . A number of generic well-being measures are widely used, for example, the Satisfaction with Life Scale, WHO5 and Positive and Negative Affect Scale [8,9,10], and have more recently being used in perinatal research. Research to date suggests that pregnant women have higher levels of subjective well-being than mothers of young children (age 0–2 years). Both mothers and pregnant women were more likely to report that they were happy and felt like the things they do were more meaningful than other women . A small number of studies have found high subjective well-being during pregnancy to be associated with a number of positive outcomes including a reduction in the risk of preterm birth , better feeding practices  and possible protection against postnatal depression . In addition, a systematic review by Rasmussen et al. (2009) found women who were more optimistic during pregnancy were more likely to have had fewer miscarriages and babies with a healthy birthweight .
In the broader wellbeing field, the link between physical health and subjective wellbeing is increasingly recognised. For example, at the physiological level, positive emotions have been found to improve immune, cardiovascular, and endocrine functioning. In contrast, negative emotions are detrimental to these processes . This is also reflected in the perinatal period with women who rate their own health as poor or have a longstanding disability or illness have lower levels of well-being, and women who have experienced complications with their pregnancy or birth are less likely to feel good about themselves or to be satisfied with their lives [11, 17]. This highlights the need to be aware of and explore the impact of long term health conditions on wellbeing during pregnancy.
While generic well-being measures are increasingly being used, research suggests additional benefit in having domain specific measures. Domain satisfaction and life satisfaction are generally highly correlated but they can diverge therefore, measurement of domain satisfaction allows the examination of variations in well-being related to specific circumstances . As pregnancy is a major life event that could impact on other aspects of life including health and relationships, a domain-specific well-being measure would help identify the unique contribution of pregnancy specific subjective well-being and identify important areas of maternal need. This has been demonstrated in pregnancy specific measures of negative affect which have shown more predictive value than nonpregnancy specific measures [19, 20]. In addition, the majority of women using maternity services are healthy, therefore applying a well-being perspective during pregnancy, which focuses not just on negative but also on positive changes, may reduce the risk of over-pathologising emotional changes . Complementing this perspective on positive and negative aspects of well-being during pregnancy with a domain specific well-being measure that can evaluate the impact of LTCs on well-being during pregnancy will provide valuable data to inform policy and practice.
The Well-being in Pregnancy Scale (WiP) was developed to fill this measurement gap. This 12 item measure, which was previously developed following focus groups with women who were pregnant and women who had recently given birth, demonstrates good psychometric properties and has shown significant correlations with other general well-being measures . As part of the ongoing development of the WiP, we explored the value of using the WiP among pregnant and postpartum women and healthcare professionals working within maternity services within the UK. This study therefore aimed to assess and refine the modified core WiP items, add an additional WiP LTC module where necessary, and carry out a psychometric validation of the refined item content.
Design and ethics
A multi-method study consisting of two phases. Phase 1 aimed to confirm the suitability of existing WiP items and make modifications or add items where necessary. Phase 2 aimed to carry out a psychometric validation of the refined item content using appropriate quantitative methods. Study design was developed in line with internationally recognised standards for patient reported instrument development, such as that promoted by the US Food and Drug Administration (FDA) and the European Medical Agency (EMA) [22, 23]. Figure 1 shoes the sequence of iterative steps taken to refine and develop the WiP questionnaire.
Ethical approval was granted by the University of Oxford’s Medical Sciences Interdivisional Research Ethics Committee (Reference Number: R61498/RE001). For Phase 1, women and healthcare professionals taking part in qualitative interviews provided informed consent through signing an online consent form. For Phase 2, women were asked to confirm their eligibility to take part in the study through confirming they are aged 18 or over, that they are currently pregnant and that they agreed to take part. Consent was assumed upon anonymous survey submission.
Phase 1a: Cognitive interviews with women and healthcare professionals
Qualitative interviews took place with women (n = 11) and healthcare professionals (n = 11) who were taking part in a wider study exploring the acceptability and feasibility of using health and well-being measures among pregnant and recently pregnant women who were living with LTCs . Part 2 of the qualitative interviews took place in the form of a cognitive interview which aimed to assess the 12 items within the WiP questionnaire. During the cognitive interview, items were tested for relevance, understanding and possible gaps in content when measuring well-being in pregnancy. Participants were asked probing questions to confirm their understanding of the items and each item’s relevance to well-being in pregnancy [25, 26]. In cases where items appeared ambiguous or sensitive, items were amended. Postpartum women were asked to provide a retrospective view on well-being during their most recent pregnancy. See Additional file 1 for interview guide.
Study participants and procedure
Participants were women and healthcare professionals taking part in a wider study to explore the feasibility of using health and well-being measures in women living with LTCs . On agreeing to take part, women were given the opportunity to ask any questions about the research and asked to complete an online consent form. In addition to the information provided on the participant information sheet, LK gave a verbal explanation as to why the research was being conducted and an outline of her personal role in the research before the commencing interviews. Participants were given a GBP £30 voucher for their participation. Women were required to be living in the UK, be at least 18 years old and either currently pregnant or had given birth within the past year to take part. Healthcare professionals were required to have experience of caring for pregnant or postpartum women in connection to their LTC (such as, GPs, midwives, obstetricians and health visitors). See  for further details.
Interviews took place over the phone, were recorded and used the verbal probing method which allowed women to provide uninterrupted feedback followed by a focussed interview to gain a deeper understanding of responses [27, 28]. Interviews were conducted by a trained qualitative researcher, LK, who had no contact or relationship to participants prior to the research taking place. Interview transcription was outsourced, and accuracy checked by LK on their return. QSR NVIVO 11 software was used identify comments relating to specific items (for example, where a participant expanded on their interpretation of an item) and codes were generated to allow for the identification of any additional topics or concepts not already incorporated within the existing WiP items. Participant comments were summarized according to each questionnaire item and collated within an Excel document (Microsoft) by LK. This allowed within-case (how the item fits within the questionnaire as a whole) and between-case (interpretation of items across the sample) analysis . Interpretation difficulties or inconsistencies were discussed among authors and amended where appropriate. Analysis of the Excel document by the research team also ensured all that all questionnaire items had been adequately discussed and probed with each participant. The Excel document was completed concurrently with the interviews taking place allowing the research team to identify when no new comments were arising from both the women and healthcare professionals taking part.
Phase 1b: Consultation with patient and public representatives (PPI)
The modified WiP was pretested among PPI representatives for ease of completion and understanding. Women who had previously taken part in Phase 1a interviews, and had consented to be contacted again for the purposes of PPI engagement, were emailed and asked if they would like to provide feedback on the amended questionnaire and given a GBP £30 voucher for their time.
Consultations took place over the phone and women were given the opportunity to provide uninterrupted feedback regarding the questionnaire items followed by a focused discussion to gain a better understanding of responses. Probing questions were used to confirm understanding of the amended items and confirm their relevance to well-being in pregnancy.
Phase 2: Psychometric Validation
A web-based survey, formatted using Qualtrics survey software, was developed for administration to women who were currently pregnant. Initial screening questions were designed to determine whether a respondent had one or more LTC. Women who did not specify having a LTC were directed to Survey, Section 1 and women who indicated having one or more LTC were directed to Survey, Section 2. Section 1 included the following assessments: the modified WiP (core items only), the EQ-5D-5L, the Satisfaction With Life Scale (SWLS), the WHO-5 Well-being Questionnaire and, the Positive and Negative Affect Schedule (PANAS). Section 2 included the modified WiP core items with the LTC specific five item module, the EQ-5D-5L and the Long-term Conditions Questionnaire (LTCQ). To minimise responder burden, Section 2 for women living with LTCs did not include the three general well-being questionnaires included in Section 1. All assessments are outlined in further detail below. All women were asked demographic questions and questions relating to experiences of maternity care. The minimum sample size sought followed recommendations of ten responders per questionnaire item [29, 30]. Given the length of the revised questionnaire, 250 women were therefore required for the LTC population (25 items) and a minimum of 200 women were sought for the healthy population (20 items).
Study participants and procedure
All women were required to be living in the UK, be at least 18 years old and currently pregnant to take part in the online survey. Women who were not currently pregnant were excluded from taking part. Women were recruited through paid social media (Facebook and Instagram) advertisements. In addition, women living with a LTC were recruited through research advertisements posted on relevant mother and baby and condition specific organisations websites/ their associated social media. Examples of organisations include; Asthma UK, Guts UK, Epilepsy Action, Diabetes UK, Thyroid UK, National Maternity Voices, Mums Like Us and Netmums. Women were also contacted through the NPEU’s extensive public and public involvement and engagement group. Research advertisements were posted with a link to the information sheet and questionnaire link.
The Satisfaction With Life Scale (SWLS) contains five items, developed to assess satisfaction with the respondent’s life as a whole using a seven point scale from ‘strongly agree’ to ‘strongly disagree’ . Possible scores range from 5 to 35, with a score of 20 representing a neutral point on the scale. Scores 5–9 indicate the respondent is extremely dissatisfied with life, scores between 31 and 35 indicate the respondent is extremely satisfied with life.
The WHO-5 Well-being Questionnaire is a five item scale measuring positive psychological well-being within the past 2 weeks using a 6 point scale ranging from ‘all of the time’ to ‘at no time’ . Total raw scores range from 0 to 25. Scores are multiplied by 4 resulting in a final score where 0 represents the worst imaginable well-being and 100 represents the best imaginable well-being.
The Positive and Negative Affect Schedule (PANAS) is a 20-item scale used to assess positive and negative affect . All the items are rated on a scale ranging from ‘very slightly or not at all’ to ‘extremely’. The ten positive items are summed and the ten negative items are summed, resulting in a score range of 10–50 for each scale.
The EQ-5D-5L is a generic health status measure containing five questions, each on one domain (mobility, self-care, usual activities, pain and depression/anxiety), and a Visual Analogue Scale (VAS) . Each question has five response options, and the scores of the five domains can be transformed into a single index value. The score typically ranges from 0 (death) to 1 (best possible health), although a small number of scores can be obtained to indicate health states worse than death. The VAS ranges from 0 (worst imaginable health state) to 100 (best imaginable health state).
The Long-Term Conditions Questionnaire (LTCQ) measures the impacts of living with mental and/or physical long term conditions . It contains 20 items and is suitable for use in both health and social care settings. LTCQ item responses range from Never-Always and are scored on a scale from 0 (most negative response) to 4 (most positive response). All 20 items are scored as a single composite measure.
Permissions to use licenced measures were acquired where necessary (EQ-5D-5L and LTCQ).
All analysis took place with SPSS (version 27) statistical software package . Demographic data were presented using descriptive statistics. WiP items were recoded so that 0 = low levels of well-being and 3 = high level of well-being. Items then underwent a number of item reduction steps, including checks for the presence of high floor and/ or ceiling effects, the presence of items which demonstrated large numbers of weak correlations with other items and, the presence of items which reduced the internal reliability of the overall measure. Floor and ceiling effects were defined as < 5 and > 40% of respondents endorsing the most negative and positive response options, respectively . An item correlation matrix was used to identify items demonstrating poor correlations (< 0.2) with a large number of items. Poor correlations with a large number of items can indicate a particular item is measuring a similar construct to other items in the scale (i.e. they do not share variance). Low item-to-total correlations (< 0.3) and items which lowered the Cronbach alpha value were identified through reliability analysis.
To ensure suitability of exploratory factor analysis (EFA) on the data set, tests including Bartlett’s Test of Sphericity (p < 0.05)  and Kaiser-Meyer-Olkin (KMO) value (recommended value of 0.6)  were carried out. Following EFA, factors demonstrating an Eigenvalue of greater than 1 were extracted and rotated using an oblique (Direct Oblimin) rotation allowing correlation between factors [37, 38]. While both the Structure and Pattern matrices were used in interpreting output, and the Structure matrix offered primary guidance for interpretation .
On identification of sub-scales present, scales were transformed to a 0–100 score and examined for floor and ceiling effects (considered more than 20% of responses scoring 0 or 100). Population characteristics were examined to explore any potential covariate factors. Convergent validity was examined for the newly developed scales through assessing Pearson correlation coefficients (r) to compare relationships with the other validated assessments included. It was hypothesised that the satisfaction and well-being instruments (SWLS, the WHO-5 and the PANAS) would correlate moderately, the EQ-5D-5L would have weak to moderate correlations with the newly developed sub-scales. Finally, it was predicted that the LTC specific module would have moderate to strong correlations with LTCQ scores. Internal consistency of the newly developed scales was assessed with the Cronbach alpha statistic (> 0.7) .
Phase 1a: Cognitive interviews with women and healthcare professionals
Eleven women with pre-existing LTCs and 11 healthcare professionals took part in cognitive interviews. Women were a mean age of 32.9 years (SD 3.8, range 26–38 years). At the time of interviewing, five women were pregnant and six were postpartum. Healthcare professional’s taking part included a GP with a special interest in perinatal health and high-risk pregnancies, a specialist midwife for hypertension and renal disease, a diabetes specialist midwife, a midwife and infant feeding co-ordinator, three obstetricians, an obstetric physician, a consultant perinatal psychiatrist and two health visitors. See  for further details.
Following feedback on WiP items and content during the cognitive telephone interviews, modifications were made to three items and a further eight items were added to reflect further areas of well-being during pregnancy which were considered important by those interviewed (Table 1). The amendments to three existing items made subtle changes to wording so that women would be able to feel more comfortable in their responses. For example, ‘I feel I have bonded with my baby’ became ‘I feel I connected to my baby’ following feedback from both women and healthcare professionals advising that more subtle wording may allow women to communicate their worries more freely without raising anxiety that they should feel an instant bond with their baby. One woman said:
That’s [WiP bonding item] quite a hard one because if you're further on obviously you’ve got a bump, you can feel it moving, feel it kicking. Wereas, early on it’s still quite surreal and … without having that first scan you almost are a bit more reserved … You want to protect your emotions a little but more so you could … By answering that you could then feel, I don’t know, a bit of guilt by being like, ‘Oh God, I haven’t bonded with my baby yet, I feel bad for that,’ when actually that’s probably quite normal because you're so early on. W7, Asthma, Chronic rhinitis
Wording was also amended to address concerns regarding items relating to women’s satisfaction with care. Healthcare professionals in particular were concerned that a woman currently in their care would feel unable to express negative views on care received. Amendments were therefore made to make the item reflect overall care received and not care specific to any one healthcare professional. Two healthcare professionals explained:
… if you're a woman...and you're about to see the midwife, your question twelve, “I feel supported by the health professionals involved in my care during my pregnancy”. I mean are you going to talk... are you going to say, “Not at all?” SH2, General Practitioner
Because if you're a midwife that’s been caring for them for the whole way through pregnancy and then they want to say it is actually a negative experience … a little bit of a concern as to whether or not you might not get a truthful answer on that... SH11, Health visitor
Whilst these views were less common among women interviewed, one did express concern that responses may impact on care received:
I think I'm just a little bit cautious about questionnaires that you complete that are just fed back instantly, um and then alters your care … .it's not very anonymous to provide that information … how honest people can be on these questionnaires if then it’s fed back into their care? W6, Ulcerative colitis
During the interviews, women and healthcare professionals were asked to reflect on potential gaps within the content of the questionnaire. Although the measure was designed to focus on well-being during pregnancy, it was clear that many women were concerned during their pregnancy about life after birth and how they will adjust to motherhood. A number of women said:
… there’s nothing about … how you feel about your life afterwards, and I think during pregnancy you’re worried about that, or at least I was... especially with a first child … You can’t really understand how that’s going to impact your life until it happens, so there is a certain amount of anxiety about what your life’s going to be like afterwards that impacts you during pregnancy. W12, Endometriosis, underactive thyroid
… .[the WiP items are] talking about during the pregnancy, [what is missing is] … stuff to do with post-pregnancy...Like, “... do you have any concerns?” W2, Diabetes (Type 1), hypothyroidism
… maybe include something about, you know, like baby blues and things … it can get really bad. One of my friends has experienced it really bad, so like... Or postnatal depression … And the support available for it. W5, Asthma, Hypothyroidism
An additional eight items were therefore drafted to measure feelings relating to life after the birth of a baby and support that might be available to them. In addition to being anxious about how they would cope after the birth of their baby, women with a LTC also expressed concern over how their health can be affected during and after their pregnancy:
I needed quite a lot of overview from gastroenterology just to make sure that it wasn’t getting worse and what the plan would be if I escalated and I wasn’t going into remission … , it was quite worrying, because I was obviously dealing with all the symptoms of being pregnant which causes issues with your guts anyway, or causes pains everywhere else, and nausea and all that, but I was also dealing with symptoms of my ulcerative colitis which were getting worse. I couldn’t distinguish which one was which most of the time, if it was normal or if it was just my ulcerative colitis, but it was definitely worse, and I needed upping on my meds. W6, Ulcerative colitis
… the Well-being in Pregnancy scale, something along the lines of, ‘Are you anxious about how you’ll be able to cope after your pregnancy if you suffer from any kind of long term condition?’ … if somebody’s a parent and they’ve got a long term condition then it’s an absolute guarantee that they worry they’re not being the best parent they can be or they’re concerned about the way that they’re parenting simply because of their condition. W4, Spinal condition: Diastematomyelia
In light of the views expressed, five items specifically relating to pregnancy and living with a LTC were added to form a standalone WiP module. Finally, in line with participant feedback, response categories for the questionnaire were reduced from a six-point response scale to a four-point response scale which they viewed as a manageable number of response categories and suitable for the item stems.
Phase 1b: Consultation with patient and public representatives (PPI)
Four women provided feedback on the modified WiP items. The 20 WiP core items and five WiP LTC items were considered relevant and appropriate for use with pregnant women by all PPI participants. No items were deleted and the response categories were thought to be appropriate for the item stems. One item, ‘Overall, I feel supported by the health professionals involved in my care during my pregnancy‘, was thought to be potentially sensitive depending on where the questionnaire was completed. For example, women may feel inclined to provide a positive response if they thought it might affect their care.
Phase 2: Psychometric Validation
In total, 768 pregnant women completed the online survey with 502 (65.4%) women reporting that they did not have a LTC and 266 (34.6%) women reporting that they had one or more LTCs. The average age was 32.1 (SD 4.2) years old with most women remaining in full time education until after they were 19 years old. Most women described themselves as White British (84.9%). For women who reported having one or more LTC, having a mental health condition (46.2%), a joint, bone and connective tissue disorder (29.7%), a respiratory condition (28.6%) or a gastrointestinal condition (20.7%) was the most frequent condition reported. See Table 2 for further details. Regarding experiences of care during pregnancy, 63.1% of women said that they were satisfied with their care during their current pregnancy.
Item reduction and scale refinement
On examination of item floor and ceiling effects, one item regarding concerns ‘relationships with other people important to me’ changing was removed due to more than 40% of participants responding ‘At no time’. Five of the remaining 19 core WiP items were removed due to having poor correlations with a large number of items and their presence reducing the overall Cronbach’s alpha. Items were iteratively removed, with a new correlation matrix and reliability analysis rerun for each iteration. See Table 1 for further detail.
The KMO value for the remaining 14 items was 0.84, exceeding the recommended value of 0.6. The Bartlett Test of Sphericity reached statistical significance (P < 0.01), confirming correlation between the items. Fourteen items were entered into an EFA and four factors explaining 63.32% of the variance were initially extracted. Conceptually, two items regarding satisfaction with health services did not integrate well within the extracted factors and, on consideration of views expressed during interview and PPI feedback regarding such items eliciting socially desirable responses, they were removed from further analysis. Upon their removal, a further EFA determined three factors with an Eigenvalue of greater than one explaining 61.91% of the variance. The three factors were named: 1) Concerns over support after birth, Cronbach’s alpha, 0.76, 2) Positive pregnancy, Cronbach’s alpha, 0.79 and, 3) Confidence about motherhood, Cronbach’s alpha, 0.76. See Table 3 for the factor structure and loadings.
The five WIP-LTC module items were entered into a separate EFA which identified a single five item factor explaining 59.9% of the variance which supported its use as a single scale. Reliability, as assessed with Cronbach’s alpha, was 0.83. See Table 4 for the factor loadings.
Scale Distributions and Validation
Each scale was transformed to a 0–100 metric, where 0 indicated low levels of well-being and 100 indicated high levels of well-being. Scale scores were calculated by summing the response values, dividing the summed score by the maximum raw score and multiplying by 100. No scale exhibited floor or ceiling effects, which was considered to be > 20% of responses achieving the minimum or maximum score. Minimal respondents achieved scores of 0 on scales ‘Concerns over support after birth’, ‘Positive pregnancy’ and on the LTC module, while 8.9% of respondents achieved the maximum score on scale ‘Confidence about motherhood’. The WiP Total score displayed no floor or ceiling effects. Scale statistics are reported in Table 5.
Relationships between the WiP scales and potential covariate factors were examined. No significant differences between the healthy group and LTC group was found for scale ‘Concerns over support after birth’ and for scale ‘Confidence about motherhood’. Significant differences were found between the healthy group and LTC group for scale ‘Positive pregnancy’. Healthy women reported experiencing a more positive pregnancy compared to women with one or more LTC; mean (SD) = 52.5 (19.0) v 45.7 (21.7), t481.73 = − 4.251, p < 0.001. Differences between groups were also shown on the EQ-5D-5L where healthy women reported a higher QoL than those living with one or more LTC; mean (SD) = 0.73 (0.17) v 0.61 (0.23), t423.5 = − 7.47, p < 0.001. No significant differences were identified for any WiP scale when comparing women according to the number of reported LTCs (ANOVA, all comparisons p > 0.05).
While there was no significant difference for scale ‘Concerns over support after birth’, ‘Confidence about motherhood’ and the LTC module, those who reported having a planned pregnancy reported significantly higher levels of ‘Positive pregnancy’; means = 51.9 v 42.45, t766 = 5.13, p < 0.001.
As expected, for the healthy population group, relationships between WiP scales and the WHO-5, SWLS and the PANAS positive and negative affect scales were moderate (see Table 6). Relationships with the EQ-5D-5L were weak for ‘Concerns over support after birth’ (r = 0.25, p < 0.01) and ‘Confidence about motherhood’ (r = 0.26), but moderate for ‘Positive pregnancy’ (r = 0.38). For the LTC cohort, correlations were moderate to high with the EQ-5D-5L and LTCQ, r = 0.52, p < 0.01 and r = 0.70, p < 0.01 respectively, indicating the scales were measuring similar but different concepts. See Table 6 for correlations between well-being measures.
The WiP was initially developed based on existing literature and feedback from women who were pregnant or had recently given birth. This paper reports on steps taken to further refine, modify and validate WiP core items to assess well-being in pregnancy and to provide an additional bolt on LTC module to assess well-being among women living with one or more LTC. Phase 1 used cognitive interviews and PPI engagement to gain feedback from women and healthcare professionals regarding the understanding of the items. Phase 2 administered an online survey to help confirm the presence of three sub-scales and an additional stand-alone LTC module.
The content validity of the revised questionnaire is strengthened through further input by pregnant women and women who had recently given birth ensuring greater awareness of sensitive questions allowing women to communicate concerns more freely. Additional items regarding support following birth ensures a greater breath in the measurement of well-being. Revised scales demonstrated good validity and internal reliability. The first factor, ‘Concerns over support after birth’ contains four items asking women about worries or concerns they have regarding adequate support and social contact. The second factor, ‘Positive pregnancy’ contains five items measuring positive feelings during pregnancy. Positive feelings in pregnancy where shown to be significantly higher in the healthy women cohort compared to women with one or more LTC, and higher in women who had planned their pregnancy. The third factor, ‘Confidence about motherhood’ contains three items asking women how they feel about life and coping as a mother. Scores for the three scales identified moderately correlated with the included, established well-being measures indicating that they were measuring similar, yet distinct concepts. The LTC stand-alone module contained five items which all loaded highly on one factor and correlated moderate to highly with the EQ-5D-5L and the LTCQ. The items of the revised WiP and LTC bolt on were positively appraised by women and health professionals.
As noted earlier, well-being measures, such as the WiP, that can identify positive mental health rather than simply the absence of illness, should find a natural home in maternity care. The lack of uptake of these measures may be related, at least in part, to the need to raise awareness of maternal mental health difficulties. It is widely recognised that mental health problems during the perinatal period are more prevalent and can frequently go unrecognised and untreated, with some women not seeking help because of fear of stigma, or fear of intervention by social services . Guidance has been developed to improve the identification of women with mental health problems with short screening tools. A shift in focus to well-being measures may be seen to distract and detract from the needs of women who have mental health difficulties. However they should be complementary. Well-being measures and models in pregnancy may go some way to help reduce the stigma associated with the negative focus of existing measures.
A growing interest within general psychiatry to promote well-being models may also help facilitate the use of well-being measures in policy and practice more broadly. Fava and GUidi (2020) argue there is a role in psychiatry for promoting euthymia (a state of internal calm and contentment) and supporting positive emotions, meaning and purpose, competence, achievements, and quality relationships as many conditions are chronic and prone to relapse after treatment . Macleod (2020) identifies potential benefits in how we conceptualise mental illness and how we treat it, and that it is after treatment that more well-being focused approaches can come into their own, by both reducing residual symptoms and building well-being resource .
Psychometric research has demonstrated considerable overlap between well-being measures and measures of common mental disorders  and studies have demonstrated a strong negative correlation between measures of depression and subjective well-being around the time of birth . Much more methodological research is needed to help us understand the uniqueness and commonalities of the measures we use and to maximise their ability to identify women with mental health difficulties while highlighting the full spectrum of psychological well-being.
Paramount in considering the best measures to use in research, policy and practice is what women think about the measures we use. Reframing how we conceptualise mental health to include well-being measures should be inclusive and supportive of all women. Phase 1 of this study highlights the acceptability of the WiP with women and practitioners and consideration should be given to how such measures are used in practice. Pregnancy specific well-being measures provide a route into asking women in more detail about how their care may be tailored to support them were needed and also facilitates positive conversations with women about how care and experience of pregnancy and childbirth may be enhanced further.
Whilst this study benefited from a large sample size which spanned a considerable range of physical and mental LTCs, the majority of participants for the online survey were recruited via social media which may impact the generalisability of the findings. Social media advertisements however enabled women of child bearing age within the UK to be effectively targeted. In addition, social media is becoming an increasingly established method of recruitment for pregnancy and infant health research, particularly for studies requiring online survey completion . Although known to be less effective in recruiting pregnant women than social media advertisements , traditional recruitments approaches were also adopted through advertisements posted on relevant mother and baby and condition specific organisations websites allowing women who did not use social media the opportunity to take part.
It is noteworthy that just under half of the women living with a pre-existing LTC who completed the online survey reported living with a mental health condition. This is in contrast to those taking part in the cognitive interviews where only one of the 11 women reported a pre-existing LTC. Many of these women also reported living with a physical LTC, however, the modified WiP may benefit from further conceptual testing among women living with a mental health condition.
Finally, we acknowledge women who had recently given birth were included in Phase 1 cognitive interviews. Whilst the WiP is a measure intended for women who are currently pregnant, those who had recently given birth were able to give an important insight into the full pregnancy journey, ensuring all stages of pregnancy were considered.
Subjective well-being measures, which capture both positive and negative emotions, are important tools when assessing mental health for all women during pregnancy and childbirth. This study highlights the acceptability of the WiP with women and healthcare professionals. After a period of item refinement, analyses confirmed good psychometric properties of the WiP questionnaire. The use of pregnancy specific well-being measures provide a route into asking women in more detail about how their care may be tailored to support them and can facilitate positive conversations with women about how care and experience of pregnancy and childbirth may be enhanced further. Their use also has the potential to reduce fragmented care through promoting multidisciplinary discussions between healthcare professionals along the course of a woman’s pregnancy.
Availability of data and materials
The datasets generated and analysed during the current study are not publicly available due to ethical concerns regarding the possibility to fully anonymise data but are available from the corresponding author on reasonable request.
Exploratory factor analysis
Long-Term Conditions Questionnaire
National Health Service
Positive and Negative Affect Schedule
Patient and Public Involvement
Pearson correlation coefficient
Satisfaction With Life Scale
Visual Analogue Scale
WHO-5 Well-being Questionnaire
Well-being in Pregnancy Questionnaire
Alderdice F, McNeill J, Gargan P, Perra O. Preliminary evaluation of the Well-being in Pregnancy (WiP) questionnaire. J Psychosom Obstet Gynaecol. 2017;38:133–42.
Wadephul F, Glover L, Jomeen J. Conceptualising women's perinatal well-being: a systematic review of theoretical discussions. Midwifery. 2020;81:102598. https://doi.org/10.1016/j.midw.2019.102598.
Diener E. Subjective well-being. Psychol Bull. 1984;95:542–75.
Diener E, Suh EM, Lucas RE, Smith HL. Subjective well-being: three decades of progress. Psychol Bull. 1999;125:276–302.
Diener E, Emmons RA. The independence of positive and negative affect. J Pers Soc Psychol. 1984;47:1105–17.
Dolan P, Metcalfe R. Measuring subjective wellbeing for public policy: recommendations on measures; 2011.
Battulga B, Benjamin MR, Chen H, Bat-Enkh E. The impact of social support and pregnancy on subjective well-being: a systematic review. Front Psychol. 2021:12.
Diener E, Emmons RA, Larsem RJ, Griffin S. The satisfaction with life scale. J Pers Assess. 1985;49:71–5.
WHO Regional Office For Europe Wellbeing Measures In Primary Health Care/ The Depcare Project Report on a WHO Meeting Target 12 Reducing Mental Disorders and Suicide. Denmark; 1998.
Watson D, Clark LA, Tellegen A. Development and validation of brief measures of positive and negative affect: The PANAS scales. J Pers Soc Psychol. 1988;54:1063–70.
GfK NOP Social Research. Lifecourse Tracker: Wave 2 report final . 2012. https://www.gov.uk/government/publications/lifecourse-tracker-wave-2-report-final. Accessed 30 Aug 2021.
Voellmin A, Entringer S, Moog N, Wadhwa PDBC. Maternal positive affect over the course of pregnancy is associated with the length of gestation and reduced risk of preterm delivery. J Psychosom Res. 2013;75:336–40.
McManus MA, Khalessi AA, Lin J, Ashraf JRS. Positive feelings during pregnancy, early feeding practices, and infant health. Pediatr Int. 2017;59:593–9.
Bos SC, Macedo A, Marques M, Pereira AT, Maia BR, Soares MJ, et al. Is positive affect in pregnancy protective of postpartum depression? Brazilian J Psychiatry. 2013;35:5–12.
Rasmussen HN, Scheier MF, Greenhouse JB. Optimism and physical health: a meta-analytic review. Ann Behav Med. 2009;37:239–56.
De Neve J-E, Diener E, Louis Tay CX. The objective benefits of subjective well-being. In: Helliwell J, Layard R, Sachs J, editors. . New York: World Happiness Report; 2013.
Dalfrà MG, Nicolucci A, Bisson T, Bonsembiante B, Lapolla A. Quality of life in pregnancy and post-partum: a study in diabetic patients. Qual Life Res. 2012;21:291–8.
Headey B. Bottom-Up Versus Top-Down Theories of Life Satisfaction. In: Encyclopedia of Quality of Life and Well-Being Research. Dordrecht: Springer; 2014. p. 423–6.
Lobel M, Cannella DL, Graham JE, DeVincent C, Schneider JMB. Pregnancy-specific stress, prenatal health behaviors, and birth outcomes. Health Psychol. 2008;27:604–15.
Dunkel Schetter C, Glynn LM. Stress in pregnancy: Empirical evidence and theoretical issues to guide interdisciplinary research. - PsycNET. In: Contrada RJ, Baum A, editors. The handbook of stress science: Biology, psychology, and health. New York: Springer Publishing Company; 2011. p. 321–47.
Jomeen J, Martin CR. Wellbeing and quality of life in a maternal health context. In Ed Galvin K. Routledge Handbook of Wellbeing. Abingdon: Routledge; 2018.
FDA. US Department of Health and Human Services Food and Drug Administration. Guidance for industry: patient-reported outcome measures: use in medical product development to support labeling claims. 2009. https://www.fda.gov/regulatory-information/search-fda-guidance-documents/patient-reported-outcome-measures-use-medical-product-development-support-labeling-claims. Accessed 11 Feb 2020.
EMA. Reflection paper on the regulatory guidance for the use of health-related quality of life (HRQL) measures in the evaluation of medicinal products: EMEA/CHMP/; 2004. http://www.emea.eu.int. Accessed 11 Feb 2020
Kelly L, Kurinczuk JJ, Rivero-Arias O, Fitzpatrick R, Gibbons EAF. Exploring the use of health and wellbeing measures during pregnancy and the first year following birth in women living with pre-existing long-term conditions: qualitative interviews with women and healthcare professionals. BMC Health Serv Res. 2021;21.
Revicki DA, Erickson PA, Sloan JA, Dueck A, Guess H, Santanello NC. Interpreting and reporting results based on patient-reported outcomes. Value Heal. 2007;10:S116–24.
Willis GB. Cognitive interviewing: a tool for improving questionnaire design. London: Sage Publications; 2005.
Willis GB. Cognitive interviewing in practice: think-aloud, verbal probing, and other techniques. Thousand Oaks: Cognitive Interviewing, Sage Publications; 2005.
Willis G. Analysis of the cognitive interview in questionnaire design. Oxford: Oxford University Press; 2015.
Boateng GO, Neilands TB, Frongillo EA, Melgar-Quiñonez HR, Young SL. Best practices for developing and validating scales for health, social, and behavioral research: a primer. Front Public Heal. 2018;6.
Nunnally JC, Bernstein IH. Psychometric Theory. 3rd ed. New York: McGraw-Hill; 1994.
Herdman M, Gudex C, Lloyd A, Janssen M, Kind P, Parkin D, et al. Development and preliminary testing of the new five-level version of EQ-5D (EQ-5D-5L). Qual Life Res. 2011;20:1727–36.
Potter CM, Batchelder L, A’Court C, Geneen L, Kelly L, Fox D, et al. Long-Term Conditions Questionnaire (LTCQ): Initial validation survey among primary care patients and social care recipients in England. BMJ Open. 2017;7.
IBM. SPSS Statistics for Windows. Version 27.0. 2020.
Petrillo J, Cano SJ, McLeod LD, Coon CD. Using classical test theory, item response theory, and rasch measurement theory to evaluate patient-reported outcome measures: A comparison of worked examples. Value Heal. 2015;18:25–34.
Pett MA, Lackey NR, Sullivan JJ. Making sense of factor analysis: the use of factor analysis for instrument development in health care research: SAGE Publications; 2003.
Kaiser HF, Rice J, Jiffy L, Mark IV. Educ Psychol Meas. 1974;34:111–7.
Matsunaga M. How to factor-analyze your data right: Do’s, Don’ts, and how-To’s. Int J Psychol Res. 2010;3:97–110.
Laxer KD, Trinka E, Hirsch LJ, Cendes F, Langfitt J, Delanty N, et al. The consequences of refractory epilepsy and its treatment. Epilepsy Behav. 2014;37:59–70.
Cronbach LJ. Coefficient alpha and the internal structure of tests. Psychometrika. 1951;16:297–334.
NICE. Antenatal and postnatal mental health: clinical management and service guidance. Clinical guideline [CG192] 2020.
Fava GA, Guidi J. The pursuit of euthymia. World Psychiatry. 2020;19:40–50.
MacLeod A. Euthymia: why it really does matter. World Psychiatry. 2020;19:1–2.
Böhnke JR, Croudace TJ. Calibrating well-being, quality of life and common mental disorder items: psychometric epidemiology in public mental health research. Br J Psychiatry. 2016;209:162–8.
Corno G, Etchemendy E, Espinoza M, Herrero R, Molinari G, Carrillo A, et al. Effect of a web-based positive psychology intervention on prenatal well-being: A case series study. Women Birth. 2018;31:e1–8.
Shieh C, Khan I, Umoren R. Engagement design in studies on pregnancy and infant health using social media: Systematic review. Prev Med Rep. 2020;19:101113.
Adam LM, Manca DPBR. Can facebook be used for research? experiences using facebook to recruit pregnant women for a randomized controlled trial. J Med Internet Res. 2016;18.
The authors would like to thank Asthma UK, Guts UK, Epilepsy Action, Diabetes UK, Diabetes Support Forum UK, McPin Foundation, Thyroid UK, British Thyroid Foundation, Endometriosis UK, National Childbirth Trust, Netmums, Mums Like Us, AIMS, Mumsaid and National Maternity Voices who helped with recruitment by circulating the study recruitment link. The authors would also like to thank all participants who volunteered their time to take part in the study and to our patient and public representatives for their helpful and insightful contribution to this study.
This study was funded internally within the Nuffield Department of Population Health, University of Oxford. LK received funding from the National Institute for Health Research (NIHR) Collaboration for Leadership in Applied Health Research and Care Oxford at Oxford Health NHS Foundation Trust. The views expressed are those of the authors and not necessarily those of the NHS, the NIHR, or the Department of Health and Social Care.
Ethics approval and consent to participate
All methods were carried out in accordance with relevant guidelines and regulations. Ethical approval was granted by the University of Oxford’s Medical Sciences Interdivisional Research Ethics Committee (Reference Number: R61498/RE001). For Phase 1, women and healthcare professionals taking part in qualitative interviews provided informed consent through signing an online consent form. For Phase 2, women were asked to confirm their eligibility to take part in the study through confirming they are aged 18 or over, that they are currently pregnant and that they agreed to take part. Consent was assumed upon anonymous survey submission.
Consent for publication
The authors declare that they have no competing interests.
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
The original online version of this article was revised: the author reported that the 2nd author should be deleted from the author group. Research Officer was incorrectly added to the author list.
Refinement and development of the Well-being in Pregnancy (WiP) questionnaire interview topic guides. File included women living with LTCs and healthcare professional’s topic guides for Phase 1.
About this article
Cite this article
Kelly, L., Kurinczuk, J.J., Fitzpatrick, R. et al. Refinement of the Well-being in Pregnancy (WiP) questionnaire: cognitive interviews with women and healthcare professionals and a validation survey. BMC Pregnancy Childbirth 22, 325 (2022). https://doi.org/10.1186/s12884-022-04626-x
- maternity care
- patient-reported outcomes
- chronic conditions