丁香园AV

Sxwpilema谩t Siy谩m (Chief Leanne Joe) from the Squamish Nation opened the event with a welcome to the territories of the S岣祑x瘫w煤7mesh 脷xwumixw (Squamish), s蓹l虛ilw虛蓹ta蕯涩 (Tsleil-Waututh) and x史m蓹胃k史蓹y虛蓹m (Musqueam) Nations. She invited us to open our hearts and minds and emphasized the importance of creating spaces of curiosity and transformation with the knowledge being shared at this event. 丁香园AV President Dr. Joy Johnson noted that this talk was taking place the day before our first ever National Day for Truth and Reconciliation, during this collective reckoning with Indian Residential Schools and a time to stand in solidarity.

Dr. Chun opened with the premise that the equity and justice challenges we face today feel overwhelming to the point that they 鈥渢hreaten the vision of ourselves and a multi-cultural society.鈥� Dr. Chun鈥檚 forthcoming book, Discriminating Data, offers a timely exploration of these monumental questions in the context of social media and predictive algorithms. She reminded us that for this problem we blamed the internet, social media, polarization, misinformation, and the hate it espoused. Like in the view presented in the well-known Netflix documentary The Social Dilemma, 鈥渢he challenges social media present are new and unprecedented because recommender systems have hacked the human psyche.鈥� And, 鈥渨e have been manipulated like marionettes by evil tech dudes... and it鈥檚 game over for humanity," remarked Dr. Chun. On the other hand, she contrasted, others point out this is not new, and blaming tech for everything keeps us from taking on fundamental issues. For Dr. Chun, it is not either/or, but 鈥渢hey are part of the same chorus,鈥� and through social media networks, 鈥渨e continue to relive this history.鈥�

What Dr. Chun means by this provocative statement is that in their current form, our predictive programs embed within them past mistakes: segregation, internment and eugenics that 鈥渕ake it really difficult to imagine and live a different future.鈥� For example, images of mostly white U.S. celebrities make up the training data for facial recognition systems, not civil rights activists or interned Japanese children. She asked us to 鈥渋magine a world where nothing could change from this deepfake past鈥� premised on the white ideal because 鈥渓earning and truth equaled repeating this past.鈥� For Dr. Chun, this is the nightmare of predictive machine learning. Applying the concept of Ariella Azoulay, we need to instead 鈥渦nlearn, not by ignoring history but engaging it differently.鈥� 

Overall, Dr. Chun sees Discriminating Data in dialogue with scholars such as Cathy O鈥橬eil, Safiya Umoja Noble, Ruha Benjamin, Meredith Broussard, Kate Crawford, Virginia Eubanks, and others. In conversation with their work, Dr. Chun gave us a sample of the five main things that Discriminating Data does:

1. Expose and investigate how ignoring difference amplifies discrimination both currently and historically. Dr. Chun explained how ignoring race promotes racism using a classic example of Compass, an algorithm used by some U.S. courts to predict the risk of recidivism. She critiqued the idea that 鈥減retending visual markers do not exist solves the problem of racism.鈥� This program has been shown by researchers to discriminate against racial minorities 鈥渂ecause [if] a program can鈥檛 see race, it can鈥檛 see racism.鈥�
2. Interrogate default assumptions that ground algorithms and data structures. Her book explains how overblown promises about correlation tie 21st-century data analytics to 20th-century eugenics. She also shows how homophily, the notion that similarity breeds connection, 鈥渢ies social networks to U.S. segregation鈥� due to its emergence from studies on residential segregation. Thus, for Dr. Chun, echo chambers aren鈥檛 an accident, but the goal. 鈥淪egregation is the default.鈥�
3. Grasp the future machine learning algorithms put in place, focusing on when, why and how their predictions work. Dr. Chun explained that 鈥渇or machine learning, truth equals consistency, therefore the future equals the past.鈥� Programs like Compass are tested on their ability to predict the past, which reinforces inequalities. Therefore, according to Dr. Chun they 鈥渄o not offer new and unforeseen futures, they close the future [and] they automate past mistakes so we can no longer learn from them.鈥�
4. Use existing AI systems to diagnose current inequalities. Dr. Chun suggests that we can read AI systems against the grain to understand discrimination, to use them as evidence. She returned to Compass, where the program 鈥渟howed that racial bias is institutional.鈥� For Dr. Chun, Compass shows us how racism works.
5. Devise different algorithms and ways to verify machine learning programs that displace the eugenic and segregationist network structures of the present. As they currently are, our networks rely on two studies with serious ethical and methodological issues that Dr. Chun pointed out. First, homophily, where there is an overselection of white illiberal responses that led to the conclusion that similarly breeds connection. The second is sentiment analysis, a method developed in Japanese internment camps to manage people in occupied lands. She pointed out, powerfully, that these people were meant to disappear.

She ended with an earnest question as she showed us photos of Japanese internees: 鈥漌e live in their spaces when we reside in social media; how might we reside together with them?鈥�

In the question and answer period, Dr. Johnson and Dr. Chun conversed over some fundamental yet controversial questions of the contemporary networked world. From that, Dr. Chun鈥檚 message to the audience was to not accept what is given to you as a default, but rather, constantly question, as there will always be biases in what is presented. The most salient question of the night came from an audience member that was relayed by Dr. Johnson鈥斺�淚s it possible to have a better internet?鈥濃�攖o which Dr. Chun replied, 鈥淲e can have a better world, and then a better internet!鈥� This answer lies at the heart of Discriminating Data, that undoing the legacies of eugenics and segregation all around us will build a better world, first offline, to build them online.