evaluation

Submitted by Sarah Ralston on November 15th, 2017
Short Description: 

This activity/assignment was designed for a first year composition course in collaboration with an English/Writing instructor. It could be used in an information literacy credit course, First Year Experience course, or in another discipline-specific context. The purpose of the lesson is to lay the foundation for students to be able to read scholarly work more effectively and critically. Students are given instruction on reading a scholarly article and directed to look for key pieces of information such as research question or hypothesis, methods, participants or data sources, key findings, and limitations of the study. The instructor then shows an infographic (prepared in advance) showing those key pieces of information in a concise, visual format. Students are introduced to an online infographic maker such as easel.ly or piktochart, and directed to create their own infographic on the article as practice. The graded assignment is for students to create an infographic on a scholarly article of their choosing, relevant to a larger research assignment in the composition (or other) course (e.g. an annotated bibliography).

Attachments: 
AttachmentSize
Lesson plan, background prep, and assignment instructionsdisplayed 2164 times18.43 KB
"Parts of a Scholarly Article" Handout and Sample Infographicdisplayed 3221 times703.54 KB
Handout&Sample.pptxdisplayed 2158 times703.54 KB
Learning Outcomes: 

1. Students will be able to identify the components of a scholarly journal article in order to become familiar with common structures of research articles. 2. Students will be able to locate the key pieces of information (hypothesis or research question, methodology, participants or data sources, findings, and limitations) in a scholarly journal article in order to read for understanding. 3. Students will be able to present the key pieces of information from a scholarly article in a visual format using infographic or other online creation tools.

Individual or Group:

Course Context (e.g. how it was implemented or integrated): 

This assignment was created for a first year composition course in collaboration with the instructor. She wanted to use infographics as a method for teaching multimodal writing, and I wanted a strategy for showing how to read scholarly articles. This activity was conducted on my second visit to class, so students already had instruction on source types and characteristics of scholarly articles. We'd also had a discussion about the concept Scholarship as a Conversation. I spent the class time following the lesson plan as written, and the following class day the students had time in the computer lab with their instructor to create their own infographics. The final essay for the class is an argumentative essay, requiring 5 sources, 2 of which must be scholarly. An infographic summarizing one of the scholarly articles is required as an attachment to the essay.

Suggested Citation: 
Ralston, Sarah. "Scholarly Articles: Reading for Understanding." CORA (Community of Online Research Assignments), 2017. https://projectcora.org/assignment/scholarly-articles-reading-understanding.
Submitted by Andrea Brooks on June 20th, 2017
Short Description: 

This resource and accompanying assignment focuses on evaluating news sources/claims and were used in an online information literacy class.

Learning Outcomes: 

Students will be able to critically evaluate information sources using a number of factors, including the creator’s authority and perspective, the intended audience, the accuracy of the content, the context of the information need, and one's own perspective in interpreting the information

Individual or Group:

Course Context (e.g. how it was implemented or integrated): 

Setting: Online, 8-week information literacy course. This three-credit course is typically taught as a 16-week semester offering, but was altered for a summer 2017 session. Context: As part of a larger module on evaluating information, students are presented with multiple resources/readings related to news sources, perspective of news sources, fake news/misinformation, and tips for evaluating claims. This particular assignment had students view a Prezi presentation titled Fact Checking Pro and then complete a LibWizard that presented multiple claims related to coffee/caffeine consumption. For each claim, students ranked the quality of the headline’s claim on a sclae of 1 (poor) to 5 (excellent), and provided an explanation for their choice. Students also had to describe the steps they took to fact check the claim.

Additional Instructor Resources (e.g. in-class activities, worksheets, scaffolding applications, supplemental modules, further readings, etc.): 

See provided links

Potential Pitfalls and Teaching Tips: 

It may be beneficial to provide more prompts in the LibWizard to gauge student fact-checking efforts. Some students were very detailed; others were not. Additionally, it would be interesting and maybe more interactive for the students if they could somehow see how their peers had rated the source. I’m not sure how to do this in the LibWizard, but there may be some other way to make this happen. In a face-to-face setting, this would be easier to accomplish

Suggested Citation: 
Brooks, Andrea. "Fact Checking Pro." CORA (Community of Online Research Assignments), 2017. https://projectcora.org/assignment/fact-checking-pro-0.
Submitted by Sara Davidson Squibb on May 9th, 2017
Short Description: 

As part of a larger news evaluation campaign, Sara Davidson Squibb and colleagues (Lindsay Davis, Elizabeth McMunn-Tetangco and Elizabeth Salmon) created a jigsaw lesson to use with introductory writing courses. Students were asked to evaluate an article’s content, tone, and purpose in a large group before they discussed the article in the context of two other articles on the same topic in a smaller group. After these group discussions, the library instructor revealed the source of each news article and highlighted resources and strategies for learning more about news sources. Through the lesson, students were able to focus more on content, corroboration, and source knowledge (rather than a mere checklist) to make decisions about an article’s bias and level of accuracy. All four instruction librarians taught this lesson to multiple sections of introductory writing courses. Though the librarians started with an original set of three articles on the topic of health care enrollment, we also identified two other sets of materials that were targeted to the course content of specific introductory writing sections.

Attachments: 
AttachmentSize
Lesson Plan Outlinedisplayed 1913 times137.09 KB
Student Worksheetdisplayed 1283 times80.77 KB
Presentation Slidesdisplayed 1636 times1.27 MB
Article A redacted - HealthCare Enrollmentdisplayed 946 times134.71 KB
Article A - HealthCare Enrollmentdisplayed 910 times144.05 KB
Article B redacted - HealthCare Enrollmentdisplayed 867 times138.14 KB
Article B - HealthCare Enrollmentdisplayed 976 times140.93 KB
Article C redacted - HealthCare Enrollmentdisplayed 974 times166.21 KB
Article C - HealthCare Enrollmentdisplayed 863 times170.04 KB
Learning Outcomes: 

Students will be able to … • make an initial determination of an article’s accuracy and bias based on an evaluation of content, purpose, and tone. • discover the importance of corroborating information. • identify resources that can reveal more information about a new source’s perspective. • recognize that many factors may be considered when evaluating a news source.

Individual or Group:

Course Context (e.g. how it was implemented or integrated): 

Librarians contacted instructors of introductory writing classes and offered this one-shot lesson on news evaluation. Instructors provided class lists, and librarians made three student groups (A, B, C), matching each student with one article (Article A, etc.). Librarians provided redacted news articles, which instructors assigned to students to read prior to the library session.

Suggested Citation: 
Davidson Squibb, Sara . "News Evaluation – Beyond the Checklist." CORA (Community of Online Research Assignments), 2017. https://projectcora.org/assignment/news-evaluation-%E2%80%93-beyond-checklist.

Teaching Resource

Interactive lesson planning tool for identifying the skills and competencies necessary for reading, writing and participating on the web.

Submitted by Kim Pittman on April 4th, 2017
Short Description: 

In this workshop, students learn about the driving forces behind fake news, reflect on how our opinions impact the way we evaluate information, and discuss and practice using criteria for evaluating news. The workshop includes a brief presentation on fake news and cognitive biases, reflection prompts for students to respond to, and an activity in which students work in groups to evaluate different news articles on a common topic.

Learning Outcomes: 

Students will be able to evaluate sources based on information need and the context in which the information will be used. Students will be able to recognize cognitive biases in order to reflect on how those biases influence their thinking about source credibility.

Individual or Group:

Course Context (e.g. how it was implemented or integrated): 

We offered this as a standalone workshop, and invited instructors in our writing program to offer extra credit to students who attended. We’ve also adapted the workshop for public library and community settings. The workshop generally takes about an hour and could easily be used in one-shot library instruction.

Potential Pitfalls and Teaching Tips: 

The closing activity works best with a topic that students find relatable and interesting, but one that they may not already have especially strong opinions about. We’ve used the topic of affordable housing in our region. We choose articles that represent a variety of news source types (in-depth articles, editorials, short blog posts or overview articles) that illustrate different viewpoints and levels of depth and analysis. If working with a smaller group or a longer time period, we recommend assigning each group two articles in order to allow them to compare the two. If offering this workshop as a standalone workshop (rather than course-integrated), we recommend including an opportunity for students to introduce themselves to each other in the opening think/pair/share. After they’ve had a chance to talk to each other, ask each pair to share their response to one of the reflection questions with the larger group. This serves as an icebreaker and increases student participation throughout the workshop.

Collaborators: 
Suggested Citation: 
Pittman, Kim. "What's Happening? Evaluating News in a Time of Information Overload." CORA (Community of Online Research Assignments), 2017. https://projectcora.org/assignment/whats-happening-evaluating-news-time-information-overload.
Submitted by Candice Benjes-Small on November 17th, 2016
Short Description: 

As people rely more and more on social media to get their news, the filter bubble becomes increasingly problematic. In this workshop, students learn how to evaluate whether a news site is reliable. This group activity takes about 30 minutes and can be used for many different audiences by adjusting the examples used.

Attachments: 
AttachmentSize
Evaluating news worksheet.docxdisplayed 13493 times16.96 KB
Learning Outcomes: 

• Students will be able to identify characteristics of credible news sources. • Students will critically examine news sources to determine credibility.

Information Literacy concepts:

Individual or Group:

Course Context (e.g. how it was implemented or integrated): 

The workshop opened with an ice breaker, having students brainstorm three things they look for when deciding whether a news Website is believable. They did a quick pair-and-share, and then I recorded what they said on the white board. Next, I broke them into teams of two and asked each to look at two Websites and complete a worksheet. In our lesson, Source A was a Reuters news article and Source B was a Bipartisan Report article. Both are on the same story, although Source A correctly identifies it as happening in January 2016 while B plays it as if it just happened (October 2016). The worksheet included questions which showed similarities as well as differences. It took about 15-20 minutes for the students to complete the worksheets; then we discussed the answers. Talking points: Source A is a Reuters news report, while Source B is from a muckraking site. Both are on the same story, although Source A correctly identifies it as happening in January 2016 while B plays it as if it just happened (published Oct 2016). Discuss which criteria made a difference in judging the credibility- and which weren’t important- notably, the domain name, the advertising presence,a nd the date were not significant. Note that it’s best when the reporter has done the reporting themselves, not just repeating other media outlets’ reports. Would people on the left be more willing to believe the bipartisan report because it fits into their worldview? We need to be careful to avoid confirmation bias: believing a source is legit because we want to believe what it says. Opinion journalism is a good and valuable resource but it’s different from NEWS. With opinion journalism, you need to verify the facts in the story. In opinion pieces, they are making an argument and you need to analyze it. After the discussion, I had students brainstorm three criteria they would now use to evaluate a news source. They shared out, and then I collected them for a quick assessment later.

Potential Pitfalls and Teaching Tips: 

Teaching Tips: After pairing up the students, have one look at Source A, while the other looks at Source B, and then compare the two to answer the worksheet questions. To find other sample articles, check out http://mediabiasfactcheck.com and Melissa Zimdars's list of unreliable news sites: http://tinyurl.com/j9tldck Potential Pitfalls: When selecting an article, choose one that is controversial but not inflammatory to your audience

Collaborators: 
Suggested Citation: 
Benjes-Small, Candice. "Evaluating news sites: Credible or Clickbait?." CORA (Community of Online Research Assignments), 2016. https://projectcora.org/assignment/evaluating-news-sites-credible-or-clickbait.
Submitted by Deborah Novak on July 12th, 2016
Short Description: 

This assignment was created for an introductory nutrition course for health related science majors and nonmajors to meet the Information Literacy Flag criteria for the core standards at Loyola Marymount University. The assignment focuses on the evaluation of a primary and secondary source on a specific topic to assess the similarities and differences between the sources of information. The primary goal of the assignment is for a pair of students to select a current popular press article that references a recent scientific journal article. The students then procure a copy of the scientific journal article. Using a formatted questionnaire, the students evaluate characteristics and information from the popular press article and then characteristics and information from the journal article, then compare and contrast the two information sources.

Learning Outcomes: 

Locate, evaluate and effectively utilize information obtained from a variety of information sources. Find and use scholarly and discipline-specific professional information and understand how it differs from popular information. Evaluate resources for reliability, validity, accuracy, authority, and bias.

Discipline: 
BiologyHealth

Individual or Group:

Course Context (e.g. how it was implemented or integrated): 

This assignment is incorporated into an introductory nutrition course for health-related science majors and nonmajors. Most nutrition courses include a discussion on scientific research methods and sources of reliable nutrition information. This project has been integrated into the course as the follow-up assignment to the Scientific Method and Reliable Sources of Nutrition Information Unit. The assignment is designed to be completed by students partnered together in groups of two (three when there is an odd number of students in the class).

Assessment or Criteria for Success
(e.g. rubric, guidelines, exemplary sample paper, etc.): 
AttachmentSize
The Partner Evaluation Form: allows each student to evaluate their project partner's contributions to the assignment.displayed 790 times15.92 KB
Sample Popular Press Articledisplayed 690 times16.93 KB
Sample Scientific Journal Articles referenced in popular press articledisplayed 1123 times189.18 KB
Sample completed ILP Questionnaire (exemplary sample)displayed 2736 times253.47 KB
Potential Pitfalls and Teaching Tips: 

This assignment does not work well if the popular press article is a "list" i.e. top 5 sources of fiber, or the journal article is a opinion or summary piece. The journal article should be a standard analytical, descriptive or experimental study. Instructor needs to carefully review the popular press article and scientific article to make sure the students have selected proper articles. About 10-15% of the class need 2-3 tries before identifying an appropriate set of articles. The due date for Part 2 is usually determined after all of the groups have successfully identified their sources. The project can be done individually but it can be time consuming to grade which is why it has become a partner project. The partner evaluation rubric provides accountability for level of participation of each partner.

Suggested Citation: 
Novak, Deborah. "Information Literacy Project." CORA (Community of Online Research Assignments), 2016. https://projectcora.org/assignment/information-literacy-project.
Submitted by Dennis Isbell on April 1st, 2016
Short Description: 

A brief two page handout on how to read abstracts for scholarly journals for lower division undergraduates in particular. Examples include one from social sciences and one from humanities.

Attachments: 
AttachmentSize
Scholarly Journal Abs Handout1-16Rev.docxdisplayed 1618 times56.9 KB
Learning Outcomes: 

Evaluating Sources

Individual or Group:

Course Context (e.g. how it was implemented or integrated): 

First-year composition classes. Introduced when students were searching then selecting scholarly journal articles for their research paper assignments.

Suggested Citation: 
Isbell, Dennis. "Making Sense of Scholarly Journal Abstracts." CORA (Community of Online Research Assignments), 2016. https://projectcora.org/assignment/making-sense-scholarly-journal-abstracts.
Submitted by Cristy Moran on March 3rd, 2016
Short Description: 

This activity asks students to work in groups to evaluate Internet sources to meet a research need. Students will use their available wireless devices, smartphones, tablets, computers, or laptops to retrieve the URLs provided to them. Working together, students will ask evaluation questions, guided by a CRAAP handout (attached) or instructor. Then, groups will share their findings with the class. o Students are grouped (3-4 students per group, number of groups in total is irrelevant what it important is the size of the group remains very small). o Each group is handed a scenario card – a 3x5 index card with a URL, beneath the URL is a topic/ question for research. Each student should also receive an Internet evaluation handout with the CRAAP criteria for evaluation on it. (These cards will be created by the instructor. They are recommended to be realistic, likely research questions/ topics for their course and the URLs should be likely search results. Results should vary between acceptable, recommended sources and not recommended sources.) o Students should be given a short time to review - 3-5 mins. Instructor should stress how quickly students can move through a website to capture information such as publication dates and check source links. o At the end of the review period, each group will have a spokesperson make their case to which the class can engage with questions as to the criteria. This activity can be repeated multiple times. It is highly adaptable and reusable.

Attachments: 
AttachmentSize
CRAAP Evaluation of Web Sources Infographic Handoutdisplayed 2397 times668.5 KB
Example for Scenario Cards - Search on Juvenile Justice Topicsdisplayed 2400 times251.42 KB
Learning Outcomes: 

o Students will analyze sources for currency, relevance, accuracy, authority, and purpose. o Students will determine whether a source meets their information need.

Individual or Group:

Course Context (e.g. how it was implemented or integrated): 

This activity is a 5-10 minute activity delivered after a tour of library resources, when students are taught about evaluating Internet sources and given tips on how to effectively manage Internet research. This activity has also been implemented with professional faculty acting as students when modeled for faculty professional development workshops.

Additional Instructor Resources (e.g. in-class activities, worksheets, scaffolding applications, supplemental modules, further readings, etc.): 

The attached handout is an infographic for the CRAAP evaluation strategies and can be printed out and used in tandem with Internet evaluation skills instruction or provided to students to guide them through this activity.

Suggested Citation: 
Moran, Cristy. "Evaluating the Interwebz with Think/ Square/ Share." CORA (Community of Online Research Assignments), 2016. https://projectcora.org/assignment/evaluating-interwebz-think-square-share.
Submitted by Cristy Moran on March 3rd, 2016
Short Description: 

This is a short, engaging activity suitable for learners of all levels. In it, students evaluate web sources that are provided by an instructor using the acronym CRAAP (currency, relevance, accuracy, authority, and purpose). Students work together in groups and explore evaluation processes aloud, with guidance from the CRAAP cards and the instructor. This is an adaptation of various evaluating sources activities available in LIS literature and professional resources. This activity is ideally implemented as a kind of collaborative game moderated by the instructor. It is highly adaptable. o Students are grouped into 5 groups - one for each criterion of CRAAP. Each group will receive a CRAAP card or 3x5 index card with evaluation questions pertaining to Currency, Relevance, Accuracy, Authority, and Purpose – different for each table. o A source will be shared with the class on the projector. These sources will include scholarly articles, websites (blogs and orgs), and reference entries. It is essential that the instructor select sources that are relevant to their students (either by course, subject, or level) and that would be likely results on a student Internet search for a research topic/ question. o Each group will evaluate the source aloud on the single criterion they’ve been assigned. If it “passes,” then the source gets asked the next question. If it “fails,” the source is dismissed. o This activity can be repeated with various websites or web sources.

AttachmentSize
CRAAP Cards 2 sideddisplayed 1320 times3.97 MB
Learning Outcomes: 

o Students will examine sources for currency, relevance, accuracy, authority, and purpose. o Students will explain how different elements of a source (author, date, scope, slant, reading level, etc.) effect how the source meets or doesn’t meet their information gathering needs.

Individual or Group:

Course Context (e.g. how it was implemented or integrated): 

This is implemented in one-shot library instruction sessions at a state college. It has also been implemented as a way to model the activity in professional faculty workshops.

Additional Instructor Resources (e.g. in-class activities, worksheets, scaffolding applications, supplemental modules, further readings, etc.): 

CRAAP Cards print 2 sided for criterion (ex: Currency) on one side and questions (ex: What date...?) on back.

Potential Pitfalls and Teaching Tips: 

This activity is engaging, student-centered, and metacognitive. It is recommended that instructors curate a list of acceptable or recommended Internet resources for their various subject areas and use those among not recommended web sources for this exercise.

Suggested Citation: 
Moran, Cristy. "Evaluating the Interwebz with Designated Skeptics." CORA (Community of Online Research Assignments), 2016. https://projectcora.org/assignment/evaluating-interwebz-designated-skeptics.

Pages