Penn Undergraduate Law Journal
  • Home
  • About
    • Mission
    • Masthead
    • Faculty Advisory Board
    • Partner Journals
    • Sponsors
  • Submissions
  • Full Issues
  • The Roundtable
    • Pre-Law Corner
  • Events
  • Contact
    • Contact
    • Apply
    • FAQs
  • Home
  • About
    • Mission
    • Masthead
    • Faculty Advisory Board
    • Partner Journals
    • Sponsors
  • Submissions
  • Full Issues
  • The Roundtable
    • Pre-Law Corner
  • Events
  • Contact
    • Contact
    • Apply
    • FAQs

The Roundtable


Welcome to the Roundtable, a forum for incisive commentary and analysis
on cases and developments in law and the legal system.


Algorithmic Discrimination in Technology

4/17/2018

0 Comments

 
Picture
By Luis Bravo
Luis Bravo is a sophomore at the University of Pennsylvania studying Sociology.

Spotify playlists, Google advertisements, and Amazon product search results are all tailored to individuals utilizing the power of algorithms. While algorithms are quickly becoming a consequential component of our everyday lives, we are only starting to learn about their limitations and potentially detrimental impacts. Incidents like Facebook’s trending topic controversy which centered around the company’s suppression of conservative media indicate that algorithms might be anything but neutral [1]. While the legal system can be a powerful deterrent against algorithmic discrimination, it has yet to adapt to the digital age.


Oftentimes referred to as artificial intelligence, algorithms are mathematical formulas performed by computers that can be used to describe data, predict trends, and prescribe courses of action [2]. Algorithms work by analyzing input data with mathematical formulas which results in an output, usually in the form of a recommendation. While many presume algorithms cannot be biased, algorithms can face constraints at every step of the algorithmic process. Perhaps the most concerning biases are those that replicate and reinforce societal disadvantages. This is the  case with Northpointe’s COMPASS sentencing system, an application that is designed to help judges decide parole sentences by predicting an individual’s chance of recidivism [3].
While the company claims it omits race as a variable in predicting an individual’s chance of reoffending, African-Americans are disproportionately categorized as dangerous in comparison to white criminal offenders. This effect is a result of Northpointe’s integration of historical crime data in its algorithm. America’s legacy of discrimination against blacks in the criminal justice system portrays African-Americans as more dangerous than their white counterparts. Though the algorithm itself does not discriminate against minorities, the incorporation of biased source data results in a feedback loop that ultimately skews results. As more and more cities across the country adopt similar programs to determine other aspects of life, such as policing and mortgage loans, algorithms could disadvantage protected classes behind the guise of mathematical fairness.

Unfortunately, the legal system has not evolved to the 21st century, rendering it largely unable to combat algorithmic discrimination. Existing discrimination laws clearly outline protected classes and distinguish between different types of discrimination [4]. While Title VII lays out some broad provisions regarding discrimination, the United States has mostly adopted a sectoral approach, banning discrimination in specific areas of law like housing and employment [5]. As a result, algorithmic discrimination has been left largely unchecked. Though private litigation and public pressure could serve as a mechanism to curtail the inappropriate usage of algorithms by companies, regulation is necessary to ensure all people are treated fairly. The Consumer Financial Protection Bureau, Federal Trade Commission, and Federal Communications Commission are all governmental agencies that could aid in combating different types of algorithmic discrimination if given expanded authority. Prior to the passage of any legislation, however, Congress must address an array of questions, like how can discrimination be measured and what constitutes fairness

Though algorithms may one day prove to be a positive tool in correcting past injustices, they can  also perpetuate institutionalized discrimination. Nevertheless, not all hope is lost. Steps can and should be taken to mitigate the detrimental impacts of algorithms. Technology companies can adopt voluntary ethical standards guiding the utilization of algorithms and rigorously test the implications of their applications prior to their release. In turn, the government can take an active approach in investigating the potential ramifications of algorithms and adopt regulations to curtail their detrimental impacts. Above all, society should continue to critically evaluate the implications of new technology and work to ensure a fair digital experience for all.            

Works Cited
[1] Thompson, Nicholas, and Fred Vogelstein. “Inside Facebook’s Two Years of Hell.” WIRED. Accessed March 22, 2018. https://www.wired.com/story/inside-facebook-mark-zuckerberg-2-years-of-hell/
[2] The Economist. “What Are Algorithms?” Accessed March 22, 2018. https://www.economist.com/blogs/economist-explains/2017/08/economist-explains-24
[3] Angwin, Julia, Jeff Larson, and Surya Mattu. “Machine Bias.” Text/html. ProPublica, May 23, 2016. https://www.propublica.org/article/machine-bias-risk-assessments-in-criminal-sentencing
[4] The U.S. National Archives and Records Administration. “EEO Terminology.” National Archives, August 15, 2016. https://www.archives.gov/eeo/terminology.html
[5] U.S. Equal Employment, and Opportunity Commission. “Laws Enforced by EEOC.” Accessed March 22, 2018. https://www.eeoc.gov/laws/statutes/index.cfm
Photo Credit: Pixabay User geralt

The opinions and views expressed through this publication are the opinions of the designated authors and do not reflect the opinions or views of the Penn Undergraduate Law Journal, our staff, or our clients.

0 Comments

Your comment will be posted after it is approved.


Leave a Reply.


    Categories

    All
    Aaron Tsui
    Akshita Tiwary
    Alana Bess
    Alana Mattei
    Albert Manfredi
    Alexander Saeedy
    Alexandra Aaron
    Alexandra Kanan
    Alexandra Kerrigan
    Alice Giannini
    Alicia Augustin
    Alicia Kysar
    Ally Kalishman
    Ally Margolis
    Alya Abbassian
    Amanda Damayanti
    Anika Prakash
    Anna Schwartz
    Arshiya Pant
    Ashley Kim
    Astha Pandey
    Audrey Pan
    Benjamin Ng'aru
    Brónach Rafferty
    Bryce Klehm
    Cary Holley
    Catherine Tang
    Christina Gunzenhauser
    Christine Mitchell
    Christopher Brown
    Clarissa Alvarez
    Cole Borlee
    Connor Gallagher
    Dan Spinelli
    Dan Zhang
    David Katz
    Davis Berlind
    Derek Willie
    Dhilan Lavu
    Edgar Palomino
    Edna Simbi
    Ella Jewell
    Ella Sohn
    Emma Davies
    Esther Lee
    Evelyn Bond
    Filzah Belal
    Frank Geng
    Gabrielle Cohen
    Gabriel Maliha
    Georgia Ray
    Graham Reynolds
    Habib Olapade
    Hailie Goldsmith
    Haley Son
    Hannah Steinberg
    Harshit Rai
    Hennessis Umacta
    Henry Lininger
    Hetal Doshi
    Ingrid Holmquist
    Iris Zhang
    Irtaza Ali
    Isabela Baghdady
    Ishita Chakrabarty
    Jack Burgess
    Jessica "Lulu" Lipman
    Joe Anderson
    Jonathan Lahdo
    Jonathan Stahl
    Joseph Squillaro
    Justin Yang
    Kaitlyn Rentala
    Kanishka Bhukya
    Katie Kaufman
    Kelly Liang
    Keshav Sharma
    Ketaki Gujar
    Khlood Awan
    Lauren Pak
    Lavi Ben Dor
    Libby Rozbruch
    Lindsey Li
    Luis Bravo
    Lyan Casamalhuapa
    Lyndsey Reeve
    Madeline Decker
    Maja Cvjetanovic
    Maliha Farrooz
    Marco DiLeonardo
    Margaret Lu
    Matthew Caulfield
    Michael Keshmiri
    Michael Merolla
    Mina Nur Basmaci
    Muskan Mumtaz
    Natalie Peelish
    Natasha Darlington
    Natasha Kang
    Nathan Liu
    Nayeon Kim
    Nicholas Parsons
    Nicholas Williams
    Nicole Greenstein
    Nicole Patel
    Nihal Sahu
    Omar Khoury
    Owen Voutsinas Klose
    Owen Voutsinas-Klose
    Paula Vekker
    Pheby Liu
    Pragat Patel
    Rachel Bina
    Rachel Gu
    Rachel Pomerantz
    Rebecca Heilweil
    Regina Salmons
    Sajan Srivastava
    Samantha Graines
    Sandeep Suresh
    Sanjay Dureseti
    Sarah Simon
    Saranya Das Sharma
    Saranya Sharma
    Sasha Bryski
    Saxon Bryant
    Sean Foley
    Sebastian Bates
    Serena Camici
    Shahana Banerjee
    Shannon Alvino
    Shiven Sharma
    Siddarth Sethi
    Sneha Parthasarathy
    Sneha Sharma
    Sophie Lovering
    Steven Jacobson
    Suaida Firoze
    Suprateek Neogi
    Takane Shoji
    Tanner Bowen
    Taryn MacKinney
    Thomas Cribbins
    Todd Costa
    Tyler Larkworthy
    Tyler Ringhofer
    Vatsal Patel
    Vikram Balasubramanian
    Vishwajeet Deshmukh
    Wajeeha Ahmad
    Yeonhwa Lee

    Archives

    April 2025
    March 2025
    February 2025
    January 2025
    December 2024
    November 2024
    September 2024
    May 2024
    April 2024
    January 2024
    December 2023
    November 2023
    May 2023
    March 2023
    January 2023
    December 2022
    November 2022
    September 2022
    June 2022
    March 2022
    February 2022
    January 2022
    December 2021
    November 2021
    May 2021
    April 2021
    March 2021
    February 2021
    January 2021
    December 2020
    November 2020
    October 2020
    July 2020
    June 2020
    May 2020
    April 2020
    March 2020
    February 2020
    December 2019
    November 2019
    October 2019
    September 2019
    August 2019
    July 2019
    May 2019
    April 2019
    March 2019
    January 2019
    December 2018
    November 2018
    October 2018
    September 2018
    August 2018
    July 2018
    June 2018
    May 2018
    April 2018
    March 2018
    February 2018
    December 2017
    November 2017
    October 2017
    August 2017
    July 2017
    May 2017
    April 2017
    March 2017
    February 2017
    January 2017
    December 2016
    November 2016
    October 2016
    September 2016
    August 2016
    July 2016
    June 2016
    April 2016
    March 2016
    February 2016
    December 2015
    November 2015
    October 2015
    September 2015
    August 2015
    July 2015
    June 2015
    May 2015
    April 2015
    March 2015
    February 2015
    November 2014
    October 2014
    August 2014
    July 2014
    June 2014
    May 2014
    April 2014
    March 2014
    December 2013
    November 2013
    October 2013
    September 2013

Powered by Create your own unique website with customizable templates.