
{"id":58819,"date":"2019-05-13T08:00:59","date_gmt":"2019-05-13T12:00:59","guid":{"rendered":"http:\/\/www.bu.edu\/law\/?p=58819"},"modified":"2025-07-14T12:10:48","modified_gmt":"2025-07-14T16:10:48","slug":"bu-law-faculty-and-students-take-on-algorithmic-bias","status":"publish","type":"bu-article","link":"https:\/\/www.bu.edu\/law\/record\/articles\/2019\/bu-law-faculty-and-students-take-on-algorithmic-bias\/","title":{"rendered":"BU Law Faculty and Students Take on Algorithmic Bias"},"content":{"rendered":"<h2>Combating such bias is at the heart of the Technology Law Clinic\u2019s work and a central aspect of several other courses and initiatives at BU Law.<\/h2>\n<figure id=\"attachment_58825\" aria-describedby=\"caption-attachment-58825\" style=\"width: 470px\" class=\"wp-caption alignright\"><img loading=\"lazy\" src=\"\/law\/files\/2019\/04\/joy-buolamwini-gender-shades.jpg\" alt=\"Technology Law Clinic client Joy Buolamwini used a white mask to demonstrate the shortcomings of artificial intelligence-powered gender classification products.\" width=\"460\" height=\"650\" class=\"wp-image-58825 size-full\" srcset=\"https:\/\/www.bu.edu\/law\/files\/2019\/04\/joy-buolamwini-gender-shades.jpg 460w, https:\/\/www.bu.edu\/law\/files\/2019\/04\/joy-buolamwini-gender-shades-450x636.jpg 450w, https:\/\/www.bu.edu\/law\/files\/2019\/04\/joy-buolamwini-gender-shades-243x344.jpg 243w, https:\/\/www.bu.edu\/law\/files\/2019\/04\/joy-buolamwini-gender-shades-374x529.jpg 374w\" sizes=\"(max-width: 460px) 100vw, 460px\" \/><figcaption id=\"caption-attachment-58825\" class=\"wp-caption-text\">Technology Law Clinic client Joy Buolamwini used a white mask to demonstrate the shortcomings of artificial intelligence-powered gender classification products.<\/figcaption><\/figure>\n<p>The <a href=\"https:\/\/www.ted.com\/talks\/joy_buolamwini_how_i_m_fighting_bias_in_algorithms?language=en\" target=\"_blank\" rel=\"noopener noreferrer\">white mask<\/a> that <a href=\"https:\/\/sites.bu.edu\/techlaw\/\" target=\"_blank\" rel=\"noopener noreferrer\">Technology Law Clinic<\/a> client Joy Buolamwini wore as part of her inquiry into artificial intelligence-powered gender classification products will soon be on display at the <a href=\"https:\/\/www.barbican.org.uk\/sites\/default\/files\/documents\/2019-04\/FINAL%20AI%20More%20than%20Human%20exhibition%20release%20280219_1.pdf\" target=\"_blank\" rel=\"noopener noreferrer\">Barbican Centre<\/a> in London, but Boston University School of Law students got an up-close-and-personal look last fall.<\/p>\n<p>That\u2019s because clinic students, under the guidance of Director <strong>Andrew Sellars<\/strong>, represented Buolamwini in her study of the facial analysis technology, called <a href=\"http:\/\/gendershades.org\/index.html\" target=\"_blank\" rel=\"noopener noreferrer\">Gender Shades<\/a>. They helped her make sure her research didn\u2019t run afoul of the Computer Fraud and Abuse Act, and they helped notify the relevant companies of the results in advance to give them a chance to address the products\u2019 shortcomings, including poor recognition of people of color and those with traditionally feminine facial features.<\/p>\n<p>The study is a stark example of the algorithmic bias that has taken root in so much of the technology that runs through our daily lives, directing the online ads we see for products or jobs or housing, determining the care we receive from government agencies, and even shaping how law enforcement agencies allocate crime-prevention resources.<\/p>\n<p>Combating such bias is at the heart of the Technology Law Clinic\u2019s work with Buolamwini and other clients and a central aspect of several other courses and initiatives at BU Law. The law school has a longstanding collaboration with the Hariri Institute for Computing and Computational Science and Engineering\u2014the <a href=\"https:\/\/www.bu.edu\/law\/2017\/11\/09\/cyber-alliance-offers-cross-disciplinary-perspectives-on-cybersecurity\/\">BU Cyber Security, Law and Society Alliance<\/a>\u2014in which law professors, computer science researchers, and social scientists engage on critical questions involving technology and ethics. Last fall, two BU Law professors\u2014<a href=\"https:\/\/www.bu.edu\/law\/profile\/stacey-dogan\/\">Stacey Dogan<\/a> and <a href=\"https:\/\/www.bu.edu\/law\/profile\/daniela-caruso\/\">Daniela Caruso<\/a>\u2014teamed up with computer science Professor <a href=\"https:\/\/www.bu.edu\/cs\/ran-canetti\/\">Ran Canetti<\/a> and faculty from Harvard, Columbia, and the University of California at Berkeley to launch a new online course called <a href=\"https:\/\/wiki.harvard.edu\/confluence\/display\/LFA\/Syllabus\" target=\"_blank\" rel=\"noopener noreferrer\">Law for Algorithms<\/a>. And this summer, <a href=\"https:\/\/www.bu.edu\/law\/profile\/danielle-citron\/\">Danielle Keats Citron<\/a>, an internationally recognized information privacy expert and a leading scholar on algorithmic bias, is joining the BU Law faculty.<\/p>\n<p>Algorithmic bias is a product of machine learning, which \u201cat its simplest,\u201d Sellars says, involves developing an algorithm \u201cthat is adaptive to data you feed it.\u201d<\/p>\n<p>\u201cIf you feed it large quantities of data over time, it can, for lack of a better word, learn,\u201d he says.<\/p>\n<p>The problem, of course, is that these algorithms are learning from humans who come with all kinds of implicit and explicit biases. Discrimination is hard enough to prove when a human is to blame; now civil rights advocates and regulators are grappling with how to prove discrimination by ever-changing algorithms. In March, the US Department of Housing and Urban Development <a href=\"https:\/\/www.nytimes.com\/2019\/03\/28\/us\/politics\/facebook-housing-discrimination.html\" target=\"_blank\" rel=\"noopener noreferrer\">sued Facebook<\/a>, claiming its algorithms allow advertisers to discriminate by only allowing certain types of people to see ads. In 2018, an Arkansas judge <a href=\"https:\/\/arktimes.com\/arkansas-blog\/2018\/05\/15\/judge-orders-dhs-to-stop-using-algorithm-for-home-care-hours-dhs-says-services-wont-be-disrupted\" target=\"_blank\" rel=\"noopener noreferrer\">ordered<\/a> that state\u2019s Department of Human Services to stop using an algorithm to determine the number of at-home care hours people with disabilities receive because so many patients\u2019 hours had decreased dramatically. And the ACLU and other organizations <a href=\"https:\/\/www.aclu.org\/other\/statement-concern-about-predictive-policing-aclu-and-16-civil-rights-privacy-racial-justice\" target=\"_blank\" rel=\"noopener noreferrer\">have raised<\/a> questions about the use of algorithms by law enforcement agencies trying to predict where crimes will occur.<\/p>\n<p>More than a decade ago, Citron raised the idea of \u201c<a href=\"https:\/\/openscholarship.wustl.edu\/cgi\/viewcontent.cgi?article=1166&amp;context=law_lawreview\" target=\"_blank\" rel=\"noopener noreferrer\">technological due process<\/a>\u201d\u2014the ability to have notice of and challenge decisions made by non-human arbiters. She <a href=\"https:\/\/www.nytimes.com\/roomfordebate\/2014\/08\/06\/is-big-data-spreading-inequality\/big-data-should-be-regulated-by-technological-due-process\" target=\"_blank\" rel=\"noopener noreferrer\">has argued<\/a> that one way to ensure such due process would be to have routine algorithmic auditing by the US Federal Trade Commission, which protects consumers against unfair business practices. More recently, Citron <a href=\"https:\/\/ai.shorensteincenter.org\/ideas\/2019\/4\/3\/the-automated-administrative-state\" target=\"_blank\" rel=\"noopener noreferrer\">has made the case<\/a> for abandoning punitive algorithmic decision-making in favor of more \u201cpro-social\u201d uses of the technology, such as offering translation for non-English speakers interacting with government agencies.<\/p>\n<p>\u201cWe are in a moment of deep uncertainty, and, often when it comes to tech, we adopt first, ask questions later,\u201d Citron says. \u201cWe are doing that in ways that are having great consequences on people\u2019s lives and opportunities.\u201d<\/p>\n<p>Dogan agrees.<\/p>\n<p>\u201cThe question of how the law should handle this bias is extremely difficult,\u201d she says. \u201cPart of the problem is the lack of appreciation among legal scholars and policy makers of just how complex machine learning is. Technologists, on the other hand, don&#8217;t always appreciate the complexity of the legal and regulatory framework in which they work. We are at a stage in which we really need to learn from one another and develop a sophisticated understanding from the legal perspective of what is happening with the technology, and vice versa. That\u2019s why we started this course and what we are trying to achieve in our collaboration with the Hariri Institute.\u201d<\/p>\n<p>The approach seems to be working. <a href=\"https:\/\/sites.bu.edu\/techlaw\/people\/\" target=\"_blank\" rel=\"noopener noreferrer\">Julia Schur<\/a> (\u201920), who wants to work in technology law, took the Law for Algorithms class last fall.<\/p>\n<p>\u201cI didn\u2019t go into that class looking for answers, but looking for which questions to ask,\u201d she explains. Schur also spent her second year helping clients in the Technology Law Clinic, including on issues of algorithmic bias, and will be a research assistant for Citron next year.<\/p>\n<p>\u201cTo best advise computer scientists, you need to understand their language, and they need to understand yours,\u201d she says. \u201cI think that\u2019s what we\u2019re doing very successfully by having these classes: We\u2019re teaching future generations of lawyers to not fear novelty but to tackle it head on.\u201d<\/p>\n<h6>Reported by Rebecca Beyer<\/h6>\n<h4>Related News<\/h4>\n<ul>\n<li><a href=\"https:\/\/www.bu.edu\/law\/2019\/04\/17\/paul-gugliuzza-jurisdictional-ping-pong-in-patent-cases\/\">\u201cJurisdictional Ping-Pong\u201d in Patent Cases<\/a><\/li>\n<li><a href=\"https:\/\/www.bu.edu\/law\/2018\/09\/21\/bu-law-professors-plan-to-study-impact-of-biopharmaceutical-funder-carb-x\/\">BU Law Professors Plan to Study Impact of Biopharmaceutical Funder CARB-X<\/a><\/li>\n<li><a href=\"https:\/\/www.bu.edu\/law\/2018\/06\/27\/who-approves-the-cias-jokes\/\">Who Approves the CIA\u2019s Jokes?<\/a><\/li>\n<\/ul>\n","protected":false},"excerpt":{"rendered":"<p>Combating such bias is at the heart of the Technology Law Clinic\u2019s work and a central aspect of several other courses and initiatives at BU Law.<\/p>\n","protected":false},"author":11260,"featured_media":70509,"comment_status":"closed","ping_status":"open","template":"","meta":{"bu_prepress_billboard":"","_bu_prepress_primary_term":"","_bu_prepress_primary_term_manual":"Technology Law"},"tags":[2676,4256,3267],"bu-publication":[3742],"record-article-category":[3749,3776,3775],"record-topic":[],"bu_edition":[],"media_type":[],"_links":{"self":[{"href":"https:\/\/www.bu.edu\/law\/wp-json\/wp\/v2\/bu-article\/58819"}],"collection":[{"href":"https:\/\/www.bu.edu\/law\/wp-json\/wp\/v2\/bu-article"}],"about":[{"href":"https:\/\/www.bu.edu\/law\/wp-json\/wp\/v2\/types\/bu-article"}],"author":[{"embeddable":true,"href":"https:\/\/www.bu.edu\/law\/wp-json\/wp\/v2\/users\/11260"}],"replies":[{"embeddable":true,"href":"https:\/\/www.bu.edu\/law\/wp-json\/wp\/v2\/comments?post=58819"}],"version-history":[{"count":12,"href":"https:\/\/www.bu.edu\/law\/wp-json\/wp\/v2\/bu-article\/58819\/revisions"}],"predecessor-version":[{"id":119063,"href":"https:\/\/www.bu.edu\/law\/wp-json\/wp\/v2\/bu-article\/58819\/revisions\/119063"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.bu.edu\/law\/wp-json\/wp\/v2\/media\/70509"}],"wp:attachment":[{"href":"https:\/\/www.bu.edu\/law\/wp-json\/wp\/v2\/media?parent=58819"}],"wp:term":[{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.bu.edu\/law\/wp-json\/wp\/v2\/tags?post=58819"},{"taxonomy":"bu-publication","embeddable":true,"href":"https:\/\/www.bu.edu\/law\/wp-json\/wp\/v2\/bu-publication?post=58819"},{"taxonomy":"record-article-category","embeddable":true,"href":"https:\/\/www.bu.edu\/law\/wp-json\/wp\/v2\/record-article-category?post=58819"},{"taxonomy":"record-topic","embeddable":true,"href":"https:\/\/www.bu.edu\/law\/wp-json\/wp\/v2\/record-topic?post=58819"},{"taxonomy":"bu_edition","embeddable":true,"href":"https:\/\/www.bu.edu\/law\/wp-json\/wp\/v2\/bu_edition?post=58819"},{"taxonomy":"media_type","embeddable":true,"href":"https:\/\/www.bu.edu\/law\/wp-json\/wp\/v2\/media_type?post=58819"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}