{"id":15452,"date":"2021-08-02T08:38:46","date_gmt":"2021-08-02T12:38:46","guid":{"rendered":"https:\/\/www.bu.edu\/gdp\/?p=15452"},"modified":"2021-08-02T08:39:12","modified_gmt":"2021-08-02T12:39:12","slug":"devising-ways-to-measure-unmet-need-in-family-planning-a-thought-experiment","status":"publish","type":"post","link":"https:\/\/www.bu.edu\/gdp\/2021\/08\/02\/devising-ways-to-measure-unmet-need-in-family-planning-a-thought-experiment\/","title":{"rendered":"Devising Ways to Measure Unmet Need in Family Planning: A Thought Experiment"},"content":{"rendered":"<p><img loading=\"lazy\" src=\"\/gdp\/files\/2021\/07\/tam-wai-_vFmO_UJ5vk-unsplash-636x420.jpg\" alt=\"\" width=\"636\" height=\"420\" class=\"alignnone wp-image-15453 size-medium\" srcset=\"https:\/\/www.bu.edu\/gdp\/files\/2021\/07\/tam-wai-_vFmO_UJ5vk-unsplash-636x420.jpg 636w, https:\/\/www.bu.edu\/gdp\/files\/2021\/07\/tam-wai-_vFmO_UJ5vk-unsplash-1024x677.jpg 1024w, https:\/\/www.bu.edu\/gdp\/files\/2021\/07\/tam-wai-_vFmO_UJ5vk-unsplash-768x507.jpg 768w, https:\/\/www.bu.edu\/gdp\/files\/2021\/07\/tam-wai-_vFmO_UJ5vk-unsplash-1536x1015.jpg 1536w, https:\/\/www.bu.edu\/gdp\/files\/2021\/07\/tam-wai-_vFmO_UJ5vk-unsplash-2048x1353.jpg 2048w\" sizes=\"(max-width: 636px) 100vw, 636px\" \/><\/p>\n<p>By <a href=\"https:\/\/www.bu.edu\/gdp\/profile\/mahesh-karra\/\">Mahesh Karra<\/a><\/p>\n<p><span style=\"font-weight: 400;\">Unlike many domains in health, the provision of high-quality family planning services is not only measured by the achievement of good reproductive health outcomes, but also considers the objective of helping women and couples maximize a complex and evolving set of preferences around future fertility and well-being.\u00a0<\/span><\/p>\n<p><span style=\"font-weight: 400;\">For this reason, the demand for (and use of) contraception differs from most other interventions in health; while one can assume that individuals have a demand for health interventions that reduce their risk of morbidity and mortality, <\/span><a href=\"https:\/\/www.jstor.org\/stable\/24642137\"><span style=\"font-weight: 400;\">the same cannot be said<\/span><\/a> <span style=\"font-weight: 400;\">for the demand for contraception since women and couples may, in fact, want to become pregnant at different points over their lifetimes. As a result, it has become incumbent on family planning and reproductive health programs to:<\/span><\/p>\n<ol>\n<li style=\"font-weight: 400;\" aria-level=\"1\"><span style=\"font-weight: 400;\">Demonstrate that a demand for contraception and family planning exists; and<\/span><\/li>\n<li style=\"font-weight: 400;\" aria-level=\"1\"><span style=\"font-weight: 400;\">Measure the extent to which this demand for contraception is met through use.\u00a0<\/span><\/li>\n<\/ol>\n<p><span style=\"font-weight: 400;\">To this end, the concept of <\/span><a href=\"https:\/\/www.who.int\/data\/gho\/indicator-metadata-registry\/imr-details\/3414\"><span style=\"font-weight: 400;\">unmet need<\/span><\/a><span style=\"font-weight: 400;\">, which aims to estimate the proportion of women who want to delay or stop childbearing but are not using contraception, plays a fundamental role in family planning research, evaluation and advocacy and has received significant attention from academics in of reproductive health, human rights and reproductive justice, economics and demography.<\/span><\/p>\n<p><span style=\"font-weight: 400;\">In a <em><strong><a href=\"https:\/\/www.bu.edu\/gdp\/2022\/12\/12\/measurement-of-unmet-need-for-contraception-a-counterfactual-approach\/\">recent working paper<\/a><\/strong><\/em>, I review the concept of unmet need and propose a new approach to more effectively measure it with routine data.<\/span><\/p>\n<h5>Unmet need: current definition and measurement challenges<\/h5>\n<p><span style=\"font-weight: 400;\">Although the underlying concept of unmet need, the non-use of contraception among women stating a desire to avoid pregnancy, appears to be straightforward, its measurement is problematic and complex and <\/span><a href=\"https:\/\/www.ncbi.nlm.nih.gov\/pmc\/articles\/PMC4369378\/\"><span style=\"font-weight: 400;\">has undergone multiple revisions<\/span><\/a><span style=\"font-weight: 400;\"> in recent decades.\u00a0<\/span><\/p>\n<p><span style=\"font-weight: 400;\">In its latest iteration, unmet need is calculated as the proportion of sexually active women of reproductive age who want to <\/span><a href=\"https:\/\/dhsprogram.com\/pubs\/pdf\/AS25\/AS25%5b12June2012%5d.pdf\"><span style=\"font-weight: 400;\">either limit or space<\/span><\/a><span style=\"font-weight: 400;\"> their next birth for at least two years, but are not using any contraceptive method. While this revision is a significant simplification from previous versions, measuring unmet need still imposes a heavy data burden \u2013 up to 15 items from survey responses are needed to capture a range of indicators related to:<\/span><\/p>\n<ol>\n<li style=\"font-weight: 400;\" aria-level=\"1\"><span style=\"font-weight: 400;\">A woman\u2019s potential exposure to the risk of pregnancy;<\/span><\/li>\n<li style=\"font-weight: 400;\" aria-level=\"1\"><span style=\"font-weight: 400;\">Her sexual activity;<\/span><\/li>\n<li style=\"font-weight: 400;\" aria-level=\"1\"><span style=\"font-weight: 400;\">Her physiological capacity to become pregnant (fecundity); and<\/span><\/li>\n<li style=\"font-weight: 400;\" aria-level=\"1\"><span style=\"font-weight: 400;\">The reliability of a woman\u2019s retrospective reporting of her preferences to space and limit births.\u00a0<\/span><\/li>\n<\/ol>\n<p><span style=\"font-weight: 400;\">The categorization of women into whether they have a met need, unmet need, or no unmet need under this revised definition continues to be a challenge. Figure 1 below presents <\/span><a href=\"https:\/\/dhsprogram.com\/pubs\/pdf\/AS25\/AS25%5b12June2012%5d.pdf\"><span style=\"font-weight: 400;\">a flow diagram<\/span><\/a><span style=\"font-weight: 400;\"> of the classification algorithm that is currently used by the Demographic and Health Surveys (DHS).<\/span><\/p>\n<p style=\"text-align: center;\"><b>Figure 1: Current Methodology for Unmet Need Classification, DHS<\/b><\/p>\n<p><img loading=\"lazy\" src=\"\/gdp\/files\/2021\/07\/Mahesh-Working-Paper-Graphic.png\" alt=\"\" width=\"1177\" height=\"849\" class=\"aligncenter size-full wp-image-15849\" srcset=\"https:\/\/www.bu.edu\/gdp\/files\/2021\/07\/Mahesh-Working-Paper-Graphic.png 1177w, https:\/\/www.bu.edu\/gdp\/files\/2021\/07\/Mahesh-Working-Paper-Graphic-636x459.png 636w, https:\/\/www.bu.edu\/gdp\/files\/2021\/07\/Mahesh-Working-Paper-Graphic-1024x739.png 1024w, https:\/\/www.bu.edu\/gdp\/files\/2021\/07\/Mahesh-Working-Paper-Graphic-768x554.png 768w\" sizes=\"(max-width: 1177px) 100vw, 1177px\" \/><\/p>\n<p style=\"text-align: center;\"><span style=\"font-weight: 400;\">Source: <a href=\"https:\/\/dhsprogram.com\/pubs\/pdf\/AS25\/AS25[12June2012].pdf\"><em>United States Agency for International Development, 2012.<\/em><\/a><\/span><\/p>\n<p><span style=\"font-weight: 400;\">Over the years, a number of methodological limitations related to the measurement and estimation of unmet need have been highlighted by scholars and practitioners alike. Perhaps the most problematic feature of the current measure, however, is its reliance on women\u2019s reported fertility preferences, and particularly the measurement of women\u2019s wantedness of births through survey questions that ask them to recall their preferences when they became pregnant. This is ascertained by asking women \u201cAt the time you became pregnant with [name of the most recent birth], did you want to become pregnant then, did you want to wait until later, or did not want (more) children at all?\u201d By asking women to retrospectively reflect on past births, this approach suffers from ex-post rationalization bias, where women are more likely to express <\/span><a href=\"https:\/\/pubmed.ncbi.nlm.nih.gov\/18232208\/\"><span style=\"font-weight: 400;\">reluctance to declare<\/span><\/a><span style=\"font-weight: 400;\"> a past pregnancy or birth as unwanted, and particularly when the past birth of interest refers to a child who is alive.\u00a0<\/span><\/p>\n<p><span style=\"font-weight: 400;\">More generally, the reliance of unmet need on women\u2019s stated (reported) preferences as a proxy for their true (revealed) fertility preferences is itself problematic. This is because respondents are faced with hypothetical choice problems that attempt to elicit their preferences over alternatives that may not be applicable to them. As a result, respondents may not make the same choices in a hypothetical situation as they would in real life. In the case of fertility, this <\/span><a href=\"https:\/\/www.cairn.info\/revue-economique-2017-3-page-327.htm\"><span style=\"font-weight: 400;\">\u201chypothetical bias\u201d<\/span><\/a><span style=\"font-weight: 400;\"> implies that respondents may be willing to state a preference for more or fewer children when asked in a survey than they would actually prefer if the opportunity to realize this preference were to truly present itself.\u00a0<\/span><\/p>\n<p><span style=\"font-weight: 400;\">On the other hand, a more robust measure of a woman\u2019s revealed fertility preferences may be more informative about her true underlying fertility preferences and, in turn, may reveal her hidden demand for contraception.<\/span><\/p>\n<h5>Conceptualizing unmet need: a step back and a way forward<\/h5>\n<p><span style=\"font-weight: 400;\">The primary objective of unmet need is to estimate the proportion of women who are not using contraception, but who have a preference for limiting or spacing births.\u00a0<\/span><\/p>\n<p><span style=\"font-weight: 400;\">Taking a step back, unmet need can be understood by the following thought experiment. Say the <\/span><i><span style=\"font-weight: 400;\">current contraceptive prevalence <\/span><\/i><span style=\"font-weight: 400;\">refers to the proportion of women who currently use contraception. Now say that the <\/span><i><span style=\"font-weight: 400;\">ideal contraceptive prevalence <\/span><\/i><span style=\"font-weight: 400;\">refers to the proportion of women who <\/span><i><span style=\"font-weight: 400;\">would<\/span><\/i><span style=\"font-weight: 400;\"> use contraception in a world where their fertility preferences could be fully realized without cost. In this ideal environment, women would face no barriers, costs, or constraints of any kind to using contraception and to exercising their preferences for limiting and spacing births. In this environment:\u00a0<\/span><\/p>\n<ol>\n<li style=\"font-weight: 400;\" aria-level=\"1\"><span style=\"font-weight: 400;\">Women would be able to completely control their family planning and reproductive health decisions and would have full, free and informed choice over their contraceptive use, non-use and type of use (e.g. method type);<\/span><\/li>\n<li style=\"font-weight: 400;\" aria-level=\"1\"><span style=\"font-weight: 400;\">Women would be fully capable to realize any changes to their preferences that they make over fertility and childbearing (they can change their minds at any time without constraint); and\u00a0<\/span><\/li>\n<li style=\"font-weight: 400;\" aria-level=\"1\"><span style=\"font-weight: 400;\">There are no social, structural, emotional, or physical barriers that women face to making decisions over their contraceptive use and fertility. Women would have complete support from their partners, families and communities on all reproductive decisions over their lifetimes.\u00a0<\/span><\/li>\n<\/ol>\n<p><span style=\"font-weight: 400;\">Unmet need for contraception can be calculated as the difference between ideal contraceptive prevalence and current contraceptive prevalence.<\/span><\/p>\n<p><span style=\"font-weight: 400;\">When thinking about how to actually calculate this difference, it should be noted that while current contraceptive prevalence is straightforward to estimate with reported survey data, the identification of ideal contraceptive prevalence is, by construction, hypothetical.\u00a0<\/span><\/p>\n<p><span style=\"font-weight: 400;\">To estimate ideal contraceptive prevalence, previous estimators of unmet need have relied on\u00a0 women\u2019s stated fertility preferences through wantedness of births, and then inferred the extent to which their contraceptive use concords with these preferences.\u00a0<\/span><\/p>\n<p><span style=\"font-weight: 400;\">In the working paper, I propose the inverse: first, by inferring the ideal environment under which all fertility preferences can be realized and then by estimating the contraceptive prevalence in this environment. This approach hinges on the premise that the contraceptive prevalence under this ideal environment would reflect women\u2019s true (revealed) fertility preferences and, by extension, demand for contraception. If such an environment could be identified and estimated, then this approach would have a distinct advantage over traditional estimators in that it requires no direct and problematic measures of preferences.\u00a0<\/span><\/p>\n<p><span style=\"font-weight: 400;\">As an attempt to identify this \u201cideal\u201d environment, imagine that contraceptive prevalence under an \u201cideal\u201d environment would be the prevalence among the sub-population of women who are situated in \u201cideal\u201d conditions in which they have full, free, informed choice over their contraceptive use and are capable of acting on their preferences to the greatest possible extent.\u00a0<\/span><\/p>\n<p><span style=\"font-weight: 400;\">To identify this \u201cideal\u201d sub-population, narrow down the sample of women based on characteristics that are more likely to signal their level of contraceptive and reproductive empowerment. A key advantage of this approach is that women who live in these selective environments can be identified using routine survey data (e.g., DHS). Additionally, similar approaches have been utilized in <\/span><a href=\"https:\/\/academic.oup.com\/ajcn\/article\/105\/1\/121\/4633957\"><span style=\"font-weight: 400;\">child growth and development<\/span><\/a><span style=\"font-weight: 400;\">, where past studies constructed \u201cideal\u201d reference populations and have conducted comparative analyses to identify gaps in child growth and stunting relative to the reference group.<\/span><\/p>\n<h5>Testing a new unmeet need measure and main findings<\/h5>\n<p><span style=\"font-weight: 400;\">To undertake this new approach to estimating unmet need, data on 2,073,523 women from 80 DHS surveys covering 56 countries from 2010-2019 was analyzed and a subsample of women who meet the following five criteria was identified:<\/span><\/p>\n<ol>\n<li style=\"font-weight: 400;\" aria-level=\"1\"><span style=\"font-weight: 400;\">They belong to the highest wealth quintile, a proxy for their socioeconomic status.<\/span><\/li>\n<li style=\"font-weight: 400;\" aria-level=\"1\"><span style=\"font-weight: 400;\">They are either currently married or have been sexually active.<\/span><\/li>\n<li style=\"font-weight: 400;\" aria-level=\"1\"><span style=\"font-weight: 400;\">They have attained at least a tertiary level of schooling.<\/span><\/li>\n<li style=\"font-weight: 400;\" aria-level=\"1\"><span style=\"font-weight: 400;\">They know at least one contraceptive method, which also serves as a proxy for being informed about family planning and reproductive health services.<\/span><\/li>\n<li style=\"font-weight: 400;\" aria-level=\"1\"><span style=\"font-weight: 400;\">They do not report distance to a facility as being a significant problem in their access to health care.<\/span><\/li>\n<\/ol>\n<p><span style=\"font-weight: 400;\">When filtering the full sample of women by these five criteria, a final \u201cideal\u201d sample of 55,318 women from 52 countries across 73 DHS surveys (2.71 percent of the full sample of women) was identified.<\/span><\/p>\n<p><span style=\"font-weight: 400;\">There were significant differences between women from the full sample and women who were selected to be from ideal environments. In particular, women from ideal environments are:<\/span><\/p>\n<ol>\n<li style=\"font-weight: 400;\" aria-level=\"1\"><span style=\"font-weight: 400;\">More likely to reside in urban settings.<\/span><\/li>\n<li style=\"font-weight: 400;\" aria-level=\"1\"><span style=\"font-weight: 400;\">More likely to be older, on average.<\/span><\/li>\n<li style=\"font-weight: 400;\" aria-level=\"1\"><span style=\"font-weight: 400;\">Have fewer children, on average.<\/span><\/li>\n<li style=\"font-weight: 400;\" aria-level=\"1\"><span style=\"font-weight: 400;\">Are married to husbands\/partners who are significantly more likely to have a tertiary level of education.<\/span><\/li>\n<li style=\"font-weight: 400;\" aria-level=\"1\"><span style=\"font-weight: 400;\">Are more likely to earn as much or more than their husbands\/partners.<\/span><\/li>\n<\/ol>\n<p><span style=\"font-weight: 400;\">The newly calculated measure of unmet need was then compared against the two measures of unmet need that are currently used by the DHS. Unmet need using the new measure is, on average, five to six percentage points (30 percent) higher than the two standard measures of unmet need. Moreover, the distribution of unmet need measures using the new approach is wider, yielding more extreme estimates of unmet need on both the lower and higher end, as shown in Figure 2 below.<\/span><\/p>\n<p style=\"text-align: center;\"><b>Figure 2: Kernel Density Plots, Unmet Need Across Definitions<\/b><\/p>\n<p><img loading=\"lazy\" src=\"\/gdp\/files\/2021\/07\/figure-2-e1626289289242.png\" alt=\"\" width=\"613\" height=\"396\" class=\"wp-image-15466 size-full aligncenter\" \/><\/p>\n<p style=\"text-align: center;\"><span style=\"font-weight: 400;\">Source: <a href=\"\/gdp\/files\/2021\/07\/HCI_WP_015_FIN.pdf\">Karra, 2021<\/a>.<\/span><\/p>\n<p><span style=\"font-weight: 400;\">Wide variation was observable across the data; in some surveys, the new approach estimated a significantly higher (up to 30 percentage points) unmet need than what is currently estimated, while in other cases, our approach yielded significantly lower estimates (up to 20 percentage points) of unmet need, as shown in Figure 3 below.<\/span><\/p>\n<p style=\"text-align: center;\"><b>Figure 3: Kernel Density Plots, Difference between the New and Old Unmet Need Measure<\/b><\/p>\n<p><img loading=\"lazy\" src=\"\/gdp\/files\/2021\/07\/figure-3-e1626289360703.png\" alt=\"\" width=\"798\" height=\"404\" class=\"wp-image-15465 size-full aligncenter\" srcset=\"https:\/\/www.bu.edu\/gdp\/files\/2021\/07\/figure-3-e1626289360703.png 798w, https:\/\/www.bu.edu\/gdp\/files\/2021\/07\/figure-3-e1626289360703-636x322.png 636w, https:\/\/www.bu.edu\/gdp\/files\/2021\/07\/figure-3-e1626289360703-768x389.png 768w\" sizes=\"(max-width: 798px) 100vw, 798px\" \/><\/p>\n<p style=\"text-align: center;\"><span style=\"font-weight: 400;\">Source: <a href=\"\/gdp\/files\/2021\/07\/HCI_WP_015_FIN.pdf\">Karra, 2021<\/a>.<\/span><\/p>\n<h5>Final thoughts<\/h5>\n<p><span style=\"font-weight: 400;\">Unmet need has been a key indicator in family planning and reproductive health for more than four decades. It is an indicator that holds significant policy and programmatic weight and serves an important role in advocacy, resource allocation and agenda setting in family planning.<\/span><\/p>\n<p><span style=\"font-weight: 400;\">Previous reviews of unmet need have <\/span><a href=\"https:\/\/www.ncbi.nlm.nih.gov\/pmc\/articles\/PMC4369378\/#:~:text=Unmet%20need%20for%20family%20planning,Ross%2C%20and%20Bhushan%201996).\"><span style=\"font-weight: 400;\">raised a key question<\/span><\/a><span style=\"font-weight: 400;\">: \u201cWhat is desirable contraceptive coverage in the \u2018perfect contracepting\u2019 society, and what principles should guide the answer to this large question?\u201d. This analysis takes a first step in answering this question by estimating what contraceptive coverage would look like in an environment where women have the capability to \u201cperfectly contracept\u201d if they choose.\u00a0<\/span><\/p>\n<p><span style=\"font-weight: 400;\">Given that this approach questions the value of directly asking about women\u2019s fertility preferences through surveys, the findings call for a critical review of existing surveys and a reprioritization of survey content that is currently a part of <\/span><a href=\"https:\/\/dhsprogram.com\/Who-We-Are\/News-Room\/ICF-Wins-200-Million-Contract-to-Conduct-Demographic-and-Health-Surveys.cfm\"><span style=\"font-weight: 400;\">large-scale and costly<\/span><\/a><span style=\"font-weight: 400;\"> data collection efforts, like the DHS. The analysis also specifically calls for the substitution away from the use of problematic fertility preference questions that are known to be biased from the onset and towards a wider and more inclusive range of observable indicators that would effectively measure reproductive empowerment, family planning access and well-being.\u00a0<\/span><\/p>\n<p><span style=\"font-weight: 400;\">In the absence of any changes to the current data collection practices, future efforts should be encouraged to test a wider range of factors that capture women\u2019s ideal reproductive health environments to determine the extent to which ideal contraceptive use, and by extension unmet need, are sensitive to these choices.<\/span><\/p>\n<a href=\"https:\/\/www.bu.edu\/gdp\/2022\/12\/12\/measurement-of-unmet-need-for-contraception-a-counterfactual-approach\/\" class=\"button\">Read the Working Paper<\/a>\n","protected":false},"excerpt":{"rendered":"<p>By Mahesh Karra Unlike many domains in health, the provision of high-quality family planning services is not only measured by the achievement of good reproductive health outcomes, but also considers the objective of helping women and couples maximize a complex and evolving set of preferences around future fertility and well-being.\u00a0 For this reason, the demand [&hellip;]<\/p>\n","protected":false},"author":18806,"featured_media":15453,"comment_status":"closed","ping_status":"open","sticky":false,"template":"","format":"standard","meta":[],"categories":[398,156,126,1076,131,166,1],"tags":[147,725,1090,1089,1078,1026,773,392,523,784,664,963,1087,1091,1088],"_links":{"self":[{"href":"https:\/\/www.bu.edu\/gdp\/wp-json\/wp\/v2\/posts\/15452"}],"collection":[{"href":"https:\/\/www.bu.edu\/gdp\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.bu.edu\/gdp\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.bu.edu\/gdp\/wp-json\/wp\/v2\/users\/18806"}],"replies":[{"embeddable":true,"href":"https:\/\/www.bu.edu\/gdp\/wp-json\/wp\/v2\/comments?post=15452"}],"version-history":[{"count":16,"href":"https:\/\/www.bu.edu\/gdp\/wp-json\/wp\/v2\/posts\/15452\/revisions"}],"predecessor-version":[{"id":15858,"href":"https:\/\/www.bu.edu\/gdp\/wp-json\/wp\/v2\/posts\/15452\/revisions\/15858"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.bu.edu\/gdp\/wp-json\/wp\/v2\/media\/15453"}],"wp:attachment":[{"href":"https:\/\/www.bu.edu\/gdp\/wp-json\/wp\/v2\/media?parent=15452"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.bu.edu\/gdp\/wp-json\/wp\/v2\/categories?post=15452"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.bu.edu\/gdp\/wp-json\/wp\/v2\/tags?post=15452"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}