{"id":3083,"date":"2021-06-29T14:26:59","date_gmt":"2021-06-29T18:26:59","guid":{"rendered":"https:\/\/www.bu.edu\/riscs\/?p=3083"},"modified":"2021-06-29T15:15:27","modified_gmt":"2021-06-29T19:15:27","slug":"confidentiality-and-the-census-part-2","status":"publish","type":"post","link":"https:\/\/www.bu.edu\/riscs\/2021\/06\/29\/confidentiality-and-the-census-part-2\/","title":{"rendered":"Confidentiality and the Census (Part 2)"},"content":{"rendered":"

by Aloni Cohen<\/em><\/p>\n

Be sure to check out part 1 of this blog post here<\/a>.<\/em><\/p>\n

 <\/p>\n

Data Quality
\n<\/span><\/h3>\n

Confidentiality is critical for a useful, high quality Census. Perfect confidentiality is easy to achieve if we don’t care about <\/span>doing<\/span><\/i> anything with the Census responses. Just erase them. Or don’t collect them at all. But Census data is important, and data confidentiality must be balanced with data utility. The Census Bureau solicited public feedback on the quality of the demonstration data produced by the 2020 DAS. The demonstration data was produced by running preliminary versions of the 2020 DAS on 2010 data (as published, not the raw 2010 data).\u00a0<\/span><\/p>\n

Most of the analyses of the demonstration data have focused on a simple question: How much noise does the 2020 DAS add to the total population of various geo-political units (e.g., Congressional districts, state legislative districts, counties, cities, and towns). This amounts to comparing the total population in the demonstration data to the reported 2010 data\u2014the difference comes from the 2020 DAS.\u00a0<\/span><\/p>\n

Overall, the population noise from the 2020 DAS is small. For example, below are the results for the first ten cities\/towns alphabetically in Utah using the latest data (April 2021). The noise for most of the cities and towns in Utah is in the single digits or low tens, with only a small handful of deviations in the low hundreds. [7]<\/span><\/p>\n\n\n\n\n\n\n\n\n\n\n\n\n\n
City \/ Town<\/b><\/td>\n2010 Reported Population<\/b><\/td>\nNoise from 2020 DAS<\/b><\/td>\n<\/tr>\n
Alpine<\/span><\/td>\n\n

9,555<\/span><\/p>\n<\/td>\n

\n

0<\/span><\/p>\n<\/td>\n<\/tr>\n

Alta<\/span><\/td>\n\n

383<\/span><\/p>\n<\/td>\n

\n

2<\/span><\/p>\n<\/td>\n<\/tr>\n

Altamont<\/span><\/td>\n\n

225<\/span><\/p>\n<\/td>\n

\n

-4<\/span><\/p>\n<\/td>\n<\/tr>\n

Alton<\/span><\/td>\n\n

119<\/span><\/p>\n<\/td>\n

\n

-3<\/span><\/p>\n<\/td>\n<\/tr>\n

Amalga<\/span><\/td>\n\n

488<\/span><\/p>\n<\/td>\n

\n

-2<\/span><\/p>\n<\/td>\n<\/tr>\n

American Fork<\/span><\/td>\n\n

26,263<\/span><\/p>\n<\/td>\n

\n

-15<\/span><\/p>\n<\/td>\n<\/tr>\n

Annabella<\/span><\/td>\n\n

795<\/span><\/p>\n<\/td>\n

\n

1<\/span><\/p>\n<\/td>\n<\/tr>\n

Antimony<\/span><\/td>\n\n

122<\/span><\/p>\n<\/td>\n

\n

7<\/span><\/p>\n<\/td>\n<\/tr>\n

Apple Valley<\/span><\/td>\n\n

701<\/span><\/p>\n<\/td>\n

\n

4<\/span><\/p>\n<\/td>\n<\/tr>\n

Aurora<\/span><\/td>\n\n

1,016<\/span><\/p>\n<\/td>\n

\n

7<\/span><\/p>\n<\/td>\n<\/tr>\n<\/tbody>\n<\/table>\n

 <\/p>\n

Critics of the use of DP in the 2020 DAS point to large <\/span>relative<\/span><\/i> population deviations. For example, the reported population of Vineyard, Utah in the demonstration data is over 10% lower than in the published 2010 data. But this masks what’s really going on. The 2010 population of Vineyard was 139, and the noise from the 2020 DAS was 15. The noise isn’t large\u2014the reference population is tiny. Even looking at relative error, the vast majority of cities and towns see less than 1% deviation.<\/span><\/p>\n

The story is the same whether you look at Congressional districts, state legislative districts, and counties. Absolute errors are small; relative errors are small except in the smallest places.\u00a0<\/span><\/p>\n

Perhaps more important than the overall distribution of noise is how the distribution varies. The 2020 DAS tends to inflate small counts and deflate large counts. For example, the Census records people’s race using six categories. It seems that the 2020 DAS tends to make racially homogenous areas appear less so by deflating the (large) count of a single racial group and inflating the (small) counts of the other five racial groups. Though the effect isn’t huge, it is too soon to know whether it will have political consequences when looking at the country as a whole. It’s worth noting that the 2010 DAS likely also affected apparent racial homogeneity, but the effect is impossible to measure because details of the 2010 DAS are closely guarded secrets.<\/span><\/p>\n

Detecting polarization\u00a0<\/span><\/h3>\n

In joint work with Moon Duchin, JN Matthews, and Bhushan Suwal [9], we approach the data quality question through the lens of anti-gerrymandering litigation.\u00a0<\/span><\/p>\n

The most effective tool to fight racial and ethnic gerrymandering is the Voting Rights Act of 1965 (VRA). Section 2 of the VRA allows civil rights groups to challenge gerrymandered district plans in court. To prevail, the plaintiffs must pass the three-part test from the Supreme Court’s decision in <\/span>Thornburg v Gingles<\/span><\/i>.\u00a0<\/span><\/p>\n

Gingles<\/span><\/i> requires demonstrating <\/span>racially-polarized voting (RPV)<\/span><\/i>: the racial or ethnic minority group in question tends to prefer different candidates than the majority population. Measuring RPV directly is impossible, because we don’t have the right data. Election returns tell us how many votes in a given precinct were cast for candidate X and candidate Y. Census data tell us the fraction of the voting-age population in the precinct from each racial and ethnic group. But the votes aren’t reported by race and ethnicity, making RPV analysis imperfect at best.\u00a0<\/span><\/p>\n

One of the common techniques used to measure RPV is called <\/span>ecological regression<\/span><\/i>. It amounts to a linear regression over precinct-level data, where the independent variable (x-axis) is the fraction of the precinct’s population from the minority group, and the dependent variable (y-axis) is the fraction of votes for candidate X. A line of best fit with significant non-zero slope is used as evidence for RPV.<\/span><\/p>\n

Civil rights groups\u2014including MALDEF and Asian Americans Advancing Justice\u2014worry that the 2020 DAS will bury the RPV signal in noise [8]. It’s a reasonable worry, because noise usually attenuates the signal, making the line of best fit flatter.<\/span><\/p>\n

In our experiments, we found that the noise from the 2020 DAS does not affect the ability to detect RPV using ecological regression so long as the effect of very small precincts is handled appropriately. By filtering out very small\u00a0 precincts (fewer than 10 votes) or weighting precincts by the number of cast votes, any distortions in the detection of racially polarized voting due to the 2020 DAS vanishes.\u00a0<\/span><\/p>\n

We expect the final redistricting data to perform even better than our experiments show. The version of the 2020 DAS will introduce much less noise than the 2018 version we tested. Detection of RPV may actually be improved compared to current techniques where small precincts can have an outsized effect. RPV is only one part of a VRA lawsuit, albeit an important part. It could still be that the 2020 DAS makes it harder for civil rights groups to prevail\u2014that will depend a lot on what happens in the next few months. But our analysis leaves me optimistic.<\/span><\/p>\n

—<\/p>\n

Aloni Cohen is a Postdoctoral Associate at the Hariri Institute for Computing at Boston University and the Boston University School of Law. He will be joining the University of Chicago as an Assistant Professor of Computer Science starting January 2022.\u00a0 Aloni Cohen’s research explores the interplay between theoretical cryptography, privacy, law, and policy.\u00a0 Visit his person website at https:\/\/aloni.net\/<\/a><\/p>\n

“Contiguous United States, Census 2010”\u00a0<\/span>by\u00a0Eric Fischer<\/span>\u00a0is licensed under\u00a0<\/span>CC BY 2.0<\/p>\n

—<\/p>\n

Citations<\/span><\/h3>\n

[7] Utah’s Analysis of the April 2021 Demonstration Data (<\/span>PDF<\/span><\/a>)<\/span><\/p>\n

[8] MALDEF and AAJC’s <\/span>Preliminary Report on the Impacts of DP & the 2020 Census on Latinos, Asian Americans and Redistricting<\/span><\/a><\/p>\n

[9] A research paper of mine\u2014with Moon Duchin, JN Matthews, and Bhushan Suwal\u2014analyzing the core algorithm and its effects on redistricting: <\/span>Census TopDown: The Impacts of Differential 2 Privacy on Redistricting<\/span><\/a><\/p>\n

Additional Resources<\/b><\/p>\n

– An amicus brief that I filed along with an esteemed group of privacy experts\u2014computer scientists and legal scholars\u2014in the Alabama case: <\/span>Amicus Brief of Data Privacy Experts<\/span><\/a>\u00a0<\/span><\/p>\n

– Here’s a very accessible animated introduction to disclosure avoidance and differential privacy at the Census produced by Minute Physics: <\/span>Protecting Privacy with MATH (Collab with the Census)<\/span><\/a>\u00a0<\/span><\/p>\n

– A wonderful essay on “The technopolitics of the US Census”: <\/span>Democracy’s Data Infrastructure | Knight First Amendment Institute<\/span><\/a>, by Dan Bouk and danah boyd<\/span><\/p>\n

– The Census Bureau’s page of resources on the 2020 Disclosure Avoidance System: <\/span>2020 Census Data Products: Disclosure Avoidance Modernization<\/span><\/a>\u00a0<\/span><\/p>\n

– The Brennan Center’s collection of information about the lawsuit, including Alabama’s complaints and all amicus briefs: <\/span>Alabama v. US Dep’t of Commerce<\/span><\/a><\/p>\n

– The National Conference of State Legislatures’s collection of analyses of demonstration data products put out by the Census Bureau (under Additional Resources): <\/span>Differential Privacy for Census Data Explained<\/span><\/a><\/p>\n","protected":false},"excerpt":{"rendered":"

by Aloni Cohen Be sure to check out part 1 of this blog post here.   Data Quality Confidentiality is critical for a useful, high quality Census. Perfect confidentiality is easy to achieve if we don’t care about doing anything with the Census responses. Just erase them. Or don’t collect them at all. But Census […]<\/p>\n","protected":false},"author":19115,"featured_media":0,"comment_status":"closed","ping_status":"open","sticky":false,"template":"","format":"standard","meta":[],"categories":[1],"tags":[],"_links":{"self":[{"href":"https:\/\/www.bu.edu\/riscs\/wp-json\/wp\/v2\/posts\/3083"}],"collection":[{"href":"https:\/\/www.bu.edu\/riscs\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.bu.edu\/riscs\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.bu.edu\/riscs\/wp-json\/wp\/v2\/users\/19115"}],"replies":[{"embeddable":true,"href":"https:\/\/www.bu.edu\/riscs\/wp-json\/wp\/v2\/comments?post=3083"}],"version-history":[{"count":5,"href":"https:\/\/www.bu.edu\/riscs\/wp-json\/wp\/v2\/posts\/3083\/revisions"}],"predecessor-version":[{"id":3090,"href":"https:\/\/www.bu.edu\/riscs\/wp-json\/wp\/v2\/posts\/3083\/revisions\/3090"}],"wp:attachment":[{"href":"https:\/\/www.bu.edu\/riscs\/wp-json\/wp\/v2\/media?parent=3083"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.bu.edu\/riscs\/wp-json\/wp\/v2\/categories?post=3083"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.bu.edu\/riscs\/wp-json\/wp\/v2\/tags?post=3083"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}