DEIA

Submitted by Shelby Hallman on June 9th, 2022
Short Description: 

Algorithms are not neutral but this does not mean they are not useful tools for research. In this workshop on algorithmic bias, student learn how algorithms can perpetuate bias and discrimination and how to critically evaluate their search results.

Learning Outcomes: 

•Students will be introduced to the machine bias inherent in algorithmic decision making, with a focus on information systems.

•Students will discuss the effects of algorithm bias in order to articulate how some individuals or groups of individuals may be misrepresented or systematically marginalized in search engine results.

•Students will develop an attitude of informed skepticism in order to critically evaluate search results. 

Individual or Group:

Course Context (e.g. how it was implemented or integrated): 

Stand-alone workshop; co-curricular workshop. 

Assessment or Criteria for Success
Assessment Short Description: 
Formative assessment was conducted via the in-session activities. Summative assessment was conducted via an end of session survey form.
Suggested Citation: 
Hallman, Shelby. "Rise Against the Machines: Understanding Algorithmic Bias." CORA (Community of Online Research Assignments), 2022. https://projectcora.org/assignment/rise-against-machines-understanding-algorithmic-bias.
Submitted by Liz Bellamy on June 11th, 2020
Short Description: 

When writing a research paper, it can be easy to overlook the human side of scholarship – how being cited in a study (or not) can have real, material consequences, and how social structures can systematically exclude certain people from scholarship. This activity and lesson explores these ideas and gives students strategies for making their literature reviews more inclusive.

All told, this lesson takes about 50 minutes to an hour -- 20-30 minutes for the readings and pre-workshop activity, and 30 minutes of discussion. 

AttachmentSize
Inclusive citations outline and lesson plan.docxdisplayed 1534 times20.47 KB
Learning Outcomes: 
  • Students will be able to articular some of the material consequences of citation practices in scholarly and research fields.
  • Students will be able to identify baseline strategies for practicing inclusive citation in their fields of study.
  • Students will be able to consider alternative sources of authority in their fields of study.

Individual or Group:

Course Context (e.g. how it was implemented or integrated): 

This flipped-classroom workshop was first implemented in an extracurricular summer undergraduate workshop series. It was one of many topics offered in the series, and meant to complement topics such as "Finding Full-Text Articles" and "Writing a Literature Review." The workshop has been held virtually over Blackboard and Zoom, though it can certainly be adapted to an in-person setting. 

Additional Instructor Resources (e.g. in-class activities, worksheets, scaffolding applications, supplemental modules, further readings, etc.): 

Readings:

1: Maha Bali, Inclusive Citation: How Diverse Are Your References?

2: Rachel Pells, Understanding the Extent of Gender Gap in Citation 

Activity:

1. After finishing the readings, complete the following activity analyzing the citation practices of a research paper of your  choice. Choose either:

  1. your own literature review up to this point, or
  2. a scholarly article you’re considering for your literature review.

Your task is to briefly analyze the gender dynamics of your chosen research paper's works cited page (up to 20 sources, max). Based on what you can infer of the genders of the authors cited, what do you notice? Is there a balance or imbalance of gender among the authors cited? 

2. Respond to this discussion board post with what you noticed during your analysis and what any gender gap or lack thereof says to you about whose voices are valued in your field. 

Instructor's note: In order to remain manageable, this activity asked students to make assumptions about gender based on superficial characteristics and sort those genders largely into a binary. Some brief classroom time was spent unpacking how, in reality, gender is a complex spectrum. 

Suggested Citation: 
Bellamy, Liz . "Whose Shoulders Are You Standing On? Inclusive Citation Practices in Literature Reviews." CORA (Community of Online Research Assignments), 2020. https://projectcora.org/assignment/whose-shoulders-are-you-standing-inclusive-citation-practices-literature-reviews.
Submitted by Elisa Acosta on October 28th, 2018
Short Description: 

This 30-minute activity was a quick introduction to algorithmic bias and the importance of critically evaluating search engine results. Algorithms increasingly shape modern life and can perpetuate bias and discrimination. In pairs, students analyzed the results from Google Image searches and Google Autocomplete suggestions. This activity was based on “Algorithms of Oppression: How Search Engines Reinforce Racism,” by Safiya Umoja Noble. This lesson plan was Part 1 of an hour-long workshop that also included a 30 minute Google Scholar activity. Please see Jennifer Masanaga's Google Scholar activity for Part 2: https://www.projectcora.org/assignment/exploring-google-scholar-summer-b...

Attachments: 
AttachmentSize
Lesson Plandisplayed 5244 times154.64 KB
Presentation slidesdisplayed 2634 times3.37 MB
Worksheetdisplayed 2054 times326.34 KB
Suggested Readingsdisplayed 1431 times65.96 KB
Learning Outcomes: 

1. Students will discuss the effects of algorithm bias in order to articulate how some individuals or groups of individuals may be misrepresented or systematically marginalized in search engine results. 2. Students will develop an attitude of informed skepticism in order to critically evaluate Google search results.

Individual or Group:

Course Context (e.g. how it was implemented or integrated): 

The Computer Science Summer Institute Extension Program, or CCSIX, is a 3-week on-campus summer experience for first-year students studying computer science and related STEM fields. This program is designed for groups underrepresented in computing (i.e., women, underrepresented minorities in STEM, and first-generation or low-income college students). See Google's Computer Science Summer Institute (CSSI) https://blog.google/inside-google/life-at-google/googles-computer-scienc...

Potential Pitfalls and Teaching Tips: 

Incoming first-year students were shy and quiet. I revised the lesson plan to include more Think-Pair-Share and less all-class discussion. The instructor should model the Google Images activity first (Professor Style), then let students do the second activity (Computer Scientist) together in pairs. The students liked “partner time.” This was a summer bridge program, so we decided to keep the worksheets short and the activities social (students talking to each other).

Collaborators: 
Suggested Citation: 
Acosta, Elisa. "Exploring Algorithmic Bias with a Summer Bridge Program." CORA (Community of Online Research Assignments), 2018. https://projectcora.org/assignment/exploring-algorithmic-bias-summer-bridge-program.
Submitted by Elisa Acosta on March 20th, 2017
Short Description: 

Students in an introductory Women's and Gender Studies course are required to critically analyze and edit an article in Wikipedia. Through class discussion and an active learning exercise, students begin to understand how and why women and many racial groups and individuals are underrepresented or systematically marginalized in Wikipedia. Students learn how to use the "Talk" tab to evaluate Wikipedia articles and learn about authority and power structures within that community.

Attachments: 
AttachmentSize
Lesson Plandisplayed 1095 times28.96 KB
Worksheet #1 displayed 1036 times14.86 KB
Worksheet #2 displayed 918 times14.79 KB
Worksheet #3 displayed 942 times15.01 KB
Worksheet #1 (short version)displayed 980 times14.48 KB
Worksheet #2 (short version)displayed 1002 times14.42 KB
Worksheet #3 (short version)displayed 895 times14.67 KB
Learning Outcomes: 

Identify voices missing or marginalized in Wikipedia Define "notability" Define "reliable sources" Explain how Wikipedia's policies and guidelines contribute to its gender gap in knowledge

Individual or Group:

Course Context (e.g. how it was implemented or integrated): 

One-shot library instruction. This exercise is a "warm up" for the Wikipedia edit-a-thon co-sponsored by the Women's and Gender Studies Department. http://librarynews.lmu.edu/2017/03/wikipedia-edit-thon-gender-race-sexua...

Additional Instructor Resources (e.g. in-class activities, worksheets, scaffolding applications, supplemental modules, further readings, etc.): 

Jackson, J. (2016, July 28). Building on Millions of Tiny Shoulders: Tips for Hosting a Wikipedia Edit-a-thon. [Blog article]. Retrieved from http://programminglibrarian.org/blog/building-millions-tiny-shoulders-ti...

Potential Pitfalls and Teaching Tips: 

If taught Fall Semester, most first year students don't know what peer-review is yet.

Suggested Citation: 
Acosta, Elisa. "The Gender Gap in Wikipedia." CORA (Community of Online Research Assignments), 2017. https://projectcora.org/assignment/gender-gap-wikipedia.