evaluation

Teaching Resource

Interactive lesson planning tool for identifying the skills and competencies necessary for reading, writing and participating on the web.

Submitted by Kim Pittman on April 4th, 2017
Short Description: 

In this workshop, students learn about the driving forces behind fake news, reflect on how our opinions impact the way we evaluate information, and discuss and practice using criteria for evaluating news. The workshop includes a brief presentation on fake news and cognitive biases, reflection prompts for students to respond to, and an activity in which students work in groups to evaluate different news articles on a common topic.

Learning Outcomes: 

Students will be able to evaluate sources based on information need and the context in which the information will be used. Students will be able to recognize cognitive biases in order to reflect on how those biases influence their thinking about source credibility.

Individual or Group:

Course Context (e.g. how it was implemented or integrated): 

We offered this as a standalone workshop, and invited instructors in our writing program to offer extra credit to students who attended. We’ve also adapted the workshop for public library and community settings. The workshop generally takes about an hour and could easily be used in one-shot library instruction.

Potential Pitfalls and Teaching Tips: 

The closing activity works best with a topic that students find relatable and interesting, but one that they may not already have especially strong opinions about. We’ve used the topic of affordable housing in our region. We choose articles that represent a variety of news source types (in-depth articles, editorials, short blog posts or overview articles) that illustrate different viewpoints and levels of depth and analysis. If working with a smaller group or a longer time period, we recommend assigning each group two articles in order to allow them to compare the two. If offering this workshop as a standalone workshop (rather than course-integrated), we recommend including an opportunity for students to introduce themselves to each other in the opening think/pair/share. After they’ve had a chance to talk to each other, ask each pair to share their response to one of the reflection questions with the larger group. This serves as an icebreaker and increases student participation throughout the workshop.

Collaborators: 
Suggested Citation: 
Pittman, Kim. "What's Happening? Evaluating News in a Time of Information Overload." CORA (Community of Online Research Assignments), 2017. https://projectcora.org/assignment/whats-happening-evaluating-news-time-information-overload.
Submitted by Candice Benjes-Small on November 17th, 2016
Short Description: 

As people rely more and more on social media to get their news, the filter bubble becomes increasingly problematic. In this workshop, students learn how to evaluate whether a news site is reliable. This group activity takes about 30 minutes and can be used for many different audiences by adjusting the examples used.

Attachments: 
AttachmentSize
Evaluating news worksheet.docxdisplayed 13339 times16.96 KB
Learning Outcomes: 

• Students will be able to identify characteristics of credible news sources. • Students will critically examine news sources to determine credibility.

Information Literacy concepts:

Individual or Group:

Course Context (e.g. how it was implemented or integrated): 

The workshop opened with an ice breaker, having students brainstorm three things they look for when deciding whether a news Website is believable. They did a quick pair-and-share, and then I recorded what they said on the white board. Next, I broke them into teams of two and asked each to look at two Websites and complete a worksheet. In our lesson, Source A was a Reuters news article and Source B was a Bipartisan Report article. Both are on the same story, although Source A correctly identifies it as happening in January 2016 while B plays it as if it just happened (October 2016). The worksheet included questions which showed similarities as well as differences. It took about 15-20 minutes for the students to complete the worksheets; then we discussed the answers. Talking points: Source A is a Reuters news report, while Source B is from a muckraking site. Both are on the same story, although Source A correctly identifies it as happening in January 2016 while B plays it as if it just happened (published Oct 2016). Discuss which criteria made a difference in judging the credibility- and which weren’t important- notably, the domain name, the advertising presence,a nd the date were not significant. Note that it’s best when the reporter has done the reporting themselves, not just repeating other media outlets’ reports. Would people on the left be more willing to believe the bipartisan report because it fits into their worldview? We need to be careful to avoid confirmation bias: believing a source is legit because we want to believe what it says. Opinion journalism is a good and valuable resource but it’s different from NEWS. With opinion journalism, you need to verify the facts in the story. In opinion pieces, they are making an argument and you need to analyze it. After the discussion, I had students brainstorm three criteria they would now use to evaluate a news source. They shared out, and then I collected them for a quick assessment later.

Potential Pitfalls and Teaching Tips: 

Teaching Tips: After pairing up the students, have one look at Source A, while the other looks at Source B, and then compare the two to answer the worksheet questions. To find other sample articles, check out http://mediabiasfactcheck.com and Melissa Zimdars's list of unreliable news sites: http://tinyurl.com/j9tldck Potential Pitfalls: When selecting an article, choose one that is controversial but not inflammatory to your audience

Collaborators: 
Suggested Citation: 
Benjes-Small, Candice. "Evaluating news sites: Credible or Clickbait?." CORA (Community of Online Research Assignments), 2016. https://projectcora.org/assignment/evaluating-news-sites-credible-or-clickbait.
Submitted by Deborah Novak on July 12th, 2016
Short Description: 

This assignment was created for an introductory nutrition course for health related science majors and nonmajors to meet the Information Literacy Flag criteria for the core standards at Loyola Marymount University. The assignment focuses on the evaluation of a primary and secondary source on a specific topic to assess the similarities and differences between the sources of information. The primary goal of the assignment is for a pair of students to select a current popular press article that references a recent scientific journal article. The students then procure a copy of the scientific journal article. Using a formatted questionnaire, the students evaluate characteristics and information from the popular press article and then characteristics and information from the journal article, then compare and contrast the two information sources.

Learning Outcomes: 

Locate, evaluate and effectively utilize information obtained from a variety of information sources. Find and use scholarly and discipline-specific professional information and understand how it differs from popular information. Evaluate resources for reliability, validity, accuracy, authority, and bias.

Discipline: 
BiologyHealth

Individual or Group:

Course Context (e.g. how it was implemented or integrated): 

This assignment is incorporated into an introductory nutrition course for health-related science majors and nonmajors. Most nutrition courses include a discussion on scientific research methods and sources of reliable nutrition information. This project has been integrated into the course as the follow-up assignment to the Scientific Method and Reliable Sources of Nutrition Information Unit. The assignment is designed to be completed by students partnered together in groups of two (three when there is an odd number of students in the class).

Assessment or Criteria for Success
(e.g. rubric, guidelines, exemplary sample paper, etc.): 
AttachmentSize
The Partner Evaluation Form: allows each student to evaluate their project partner's contributions to the assignment.displayed 750 times15.92 KB
Sample Popular Press Articledisplayed 657 times16.93 KB
Sample Scientific Journal Articles referenced in popular press articledisplayed 986 times189.18 KB
Sample completed ILP Questionnaire (exemplary sample)displayed 2592 times253.47 KB
Potential Pitfalls and Teaching Tips: 

This assignment does not work well if the popular press article is a "list" i.e. top 5 sources of fiber, or the journal article is a opinion or summary piece. The journal article should be a standard analytical, descriptive or experimental study. Instructor needs to carefully review the popular press article and scientific article to make sure the students have selected proper articles. About 10-15% of the class need 2-3 tries before identifying an appropriate set of articles. The due date for Part 2 is usually determined after all of the groups have successfully identified their sources. The project can be done individually but it can be time consuming to grade which is why it has become a partner project. The partner evaluation rubric provides accountability for level of participation of each partner.

Suggested Citation: 
Novak, Deborah. "Information Literacy Project." CORA (Community of Online Research Assignments), 2016. https://projectcora.org/assignment/information-literacy-project.
Submitted by Dennis Isbell on April 1st, 2016
Short Description: 

A brief two page handout on how to read abstracts for scholarly journals for lower division undergraduates in particular. Examples include one from social sciences and one from humanities.

Attachments: 
AttachmentSize
Scholarly Journal Abs Handout1-16Rev.docxdisplayed 1576 times56.9 KB
Learning Outcomes: 

Evaluating Sources

Individual or Group:

Course Context (e.g. how it was implemented or integrated): 

First-year composition classes. Introduced when students were searching then selecting scholarly journal articles for their research paper assignments.

Suggested Citation: 
Isbell, Dennis. "Making Sense of Scholarly Journal Abstracts." CORA (Community of Online Research Assignments), 2016. https://projectcora.org/assignment/making-sense-scholarly-journal-abstracts.
Submitted by Cristy Moran on March 3rd, 2016
Short Description: 

This activity asks students to work in groups to evaluate Internet sources to meet a research need. Students will use their available wireless devices, smartphones, tablets, computers, or laptops to retrieve the URLs provided to them. Working together, students will ask evaluation questions, guided by a CRAAP handout (attached) or instructor. Then, groups will share their findings with the class. o Students are grouped (3-4 students per group, number of groups in total is irrelevant what it important is the size of the group remains very small). o Each group is handed a scenario card – a 3x5 index card with a URL, beneath the URL is a topic/ question for research. Each student should also receive an Internet evaluation handout with the CRAAP criteria for evaluation on it. (These cards will be created by the instructor. They are recommended to be realistic, likely research questions/ topics for their course and the URLs should be likely search results. Results should vary between acceptable, recommended sources and not recommended sources.) o Students should be given a short time to review - 3-5 mins. Instructor should stress how quickly students can move through a website to capture information such as publication dates and check source links. o At the end of the review period, each group will have a spokesperson make their case to which the class can engage with questions as to the criteria. This activity can be repeated multiple times. It is highly adaptable and reusable.

Attachments: 
AttachmentSize
CRAAP Evaluation of Web Sources Infographic Handoutdisplayed 2308 times668.5 KB
Example for Scenario Cards - Search on Juvenile Justice Topicsdisplayed 2312 times251.42 KB
Learning Outcomes: 

o Students will analyze sources for currency, relevance, accuracy, authority, and purpose. o Students will determine whether a source meets their information need.

Individual or Group:

Course Context (e.g. how it was implemented or integrated): 

This activity is a 5-10 minute activity delivered after a tour of library resources, when students are taught about evaluating Internet sources and given tips on how to effectively manage Internet research. This activity has also been implemented with professional faculty acting as students when modeled for faculty professional development workshops.

Additional Instructor Resources (e.g. in-class activities, worksheets, scaffolding applications, supplemental modules, further readings, etc.): 

The attached handout is an infographic for the CRAAP evaluation strategies and can be printed out and used in tandem with Internet evaluation skills instruction or provided to students to guide them through this activity.

Suggested Citation: 
Moran, Cristy. "Evaluating the Interwebz with Think/ Square/ Share." CORA (Community of Online Research Assignments), 2016. https://projectcora.org/assignment/evaluating-interwebz-think-square-share.
Submitted by Cristy Moran on March 3rd, 2016
Short Description: 

This is a short, engaging activity suitable for learners of all levels. In it, students evaluate web sources that are provided by an instructor using the acronym CRAAP (currency, relevance, accuracy, authority, and purpose). Students work together in groups and explore evaluation processes aloud, with guidance from the CRAAP cards and the instructor. This is an adaptation of various evaluating sources activities available in LIS literature and professional resources. This activity is ideally implemented as a kind of collaborative game moderated by the instructor. It is highly adaptable. o Students are grouped into 5 groups - one for each criterion of CRAAP. Each group will receive a CRAAP card or 3x5 index card with evaluation questions pertaining to Currency, Relevance, Accuracy, Authority, and Purpose – different for each table. o A source will be shared with the class on the projector. These sources will include scholarly articles, websites (blogs and orgs), and reference entries. It is essential that the instructor select sources that are relevant to their students (either by course, subject, or level) and that would be likely results on a student Internet search for a research topic/ question. o Each group will evaluate the source aloud on the single criterion they’ve been assigned. If it “passes,” then the source gets asked the next question. If it “fails,” the source is dismissed. o This activity can be repeated with various websites or web sources.

AttachmentSize
CRAAP Cards 2 sideddisplayed 1164 times3.97 MB
Learning Outcomes: 

o Students will examine sources for currency, relevance, accuracy, authority, and purpose. o Students will explain how different elements of a source (author, date, scope, slant, reading level, etc.) effect how the source meets or doesn’t meet their information gathering needs.

Individual or Group:

Course Context (e.g. how it was implemented or integrated): 

This is implemented in one-shot library instruction sessions at a state college. It has also been implemented as a way to model the activity in professional faculty workshops.

Additional Instructor Resources (e.g. in-class activities, worksheets, scaffolding applications, supplemental modules, further readings, etc.): 

CRAAP Cards print 2 sided for criterion (ex: Currency) on one side and questions (ex: What date...?) on back.

Potential Pitfalls and Teaching Tips: 

This activity is engaging, student-centered, and metacognitive. It is recommended that instructors curate a list of acceptable or recommended Internet resources for their various subject areas and use those among not recommended web sources for this exercise.

Suggested Citation: 
Moran, Cristy. "Evaluating the Interwebz with Designated Skeptics." CORA (Community of Online Research Assignments), 2016. https://projectcora.org/assignment/evaluating-interwebz-designated-skeptics.
Submitted by Ryer Banta on March 3rd, 2016
Short Description: 

For this activity students are asked to imagine that they are organizing a party, specifically a scholarly party. Groups are given a starting article that they evaluate and use as a jumping off point for choosing a theme for their party and finding more sources. Their theme acts as an early version of a research question. Following citations backwards and forwards groups invite other scholars who would have relevant things to say about their theme. Students also assess gaps in their invite list and identify other scholars from different perspectives or discipline who should also be invited.

Learning Outcomes: 

By the end of the session, students will be able to: - evaluate the benefits of thinking of scholarship as a conversation - use appropriate criteria in order evaluate individual sources and search results in their own research projects - use effective techniques to narrow a topic and select appropriate databases and publications in order to conduct effective and efficient searches in their own research projects - evaluate the utility of source evaluation criteria and search techniques from this activity

Information Literacy concepts:

Individual or Group:

Course Context (e.g. how it was implemented or integrated): 

This activity was originally designed for a first year University Studies seminar class.

Additional Instructor Resources (e.g. in-class activities, worksheets, scaffolding applications, supplemental modules, further readings, etc.): 

The lesson plan, activity worksheet and assessment questions are included as Google Doc links that can be copied or downloaded in your preferred file format. These works by Ryer Banta are licensed under a Creative Commons Attribution 4.0 International License.

Potential Pitfalls and Teaching Tips: 

Tips on adapting the activity: There are a few sections that you will need to add some relevant local information and directions to. I have comments on each of these that require these additions. Tips for choosing starting articles: Since I designed this activity for first year students and with them I've had most success giving all groups the same starting article. I choose an open access source that is well cited, but not too old. I also tried to find one that was broadly interesting to them and the subject of the course. It is also possible to choose several different sources that explore narrow aspects of a broad topic. For example, the broad topic could be 'wind energy', and sources could range from public perception, to engineering, to wildlife management, and more. Tips for facilitating the activity and timing: This activity as written will typically take groups about 20 minutes, though it can seem tight, especially if they are not used to doing much group work. So make sure to keep the groups moving along. Make sure you have enough time to debrief. Cut or streamline some sections of the activity if you need to save time, or focus students on some parts more than others. Some groups try to divide up the steps of the activity, but each step is really meant to build on the previous.

Suggested Citation: 
Banta, Ryer. "Scholarly Party ." CORA (Community of Online Research Assignments), 2016. https://projectcora.org/assignment/scholarly-party.
Submitted by William (Bill) Badke on January 6th, 2016
Short Description: 

Syllabus and five assignments within a two-credit live course at undergraduate level. See "Relevant Links" section for access to all assignments. Assignments include a rubric.

Learning Outcomes: 

The student will: 1. Gain an understanding of the characteristics of information and its dissemination in the information age. 2. Develop an appreciation for topic analysis and research focused around a question or hypothesis. 3. Learn to strategize research procedures using a wide variety of tools and information sources, based on an understanding of information systems and their manner of operation. 4. Acquire a deeper ability to use critical thinking to interact with diverse concepts, evaluate truth claims, synthesize data and make conclusions. 5. Show an appreciation for the ethical requirements of research and writing.

Individual or Group:

Course Context (e.g. how it was implemented or integrated): 

The course was taught over five evenings. The course material worked through the research process from topic identification to preparation for final writing. Course assignments provided opportunity for students to integrate instructional content with practice built around topics of their choice.

Additional Instructor Resources (e.g. in-class activities, worksheets, scaffolding applications, supplemental modules, further readings, etc.): 

Textbook: William Badke, Research Strategies: Finding Your Way through the Information Fog, 6th ed. (Bloomington, IN: iUniverse.com, 2017). Links to further resources: http://libguides.twu.ca/UNIV110/Presentations Rubrics provided in each assignment.

Suggested Citation: 
Badke, William (Bill). "UNIV 110 - Scholarly Inquiry and Research Methods." CORA (Community of Online Research Assignments), 2016. https://projectcora.org/assignment/univ-110-scholarly-inquiry-and-research-methods.
Submitted by Lane Wilkinson on January 6th, 2016
Short Description: 

This activity proceeds via Socratic questioning. The goal is to have students explain the common stumbling blocks they encounter as they look for information and as they write papers (if they have). The role of the librarian is to facilitate the discussion by providing a contextual framework for student experiences. By showing students that their research process follows a common pattern, they can make better choices about how, when, and where to look for information (e.g., not jumping straight to peer-reviewed articles when they can barely define their topic)

Attachments: 
AttachmentSize
1-11 Information Needs, Types, Qualities.docxdisplayed 4180 times53.49 KB
AttachmentSize
Optional worksheet displayed 4732 times250.83 KB
Learning Outcomes: 

Students will be able to articulate the type of information they need to complete a given task. Students will be able to identify the appropriate uses for various information formats. Students will be able to explain the criteria by which we identify the credibility of an information source. Students will be able to identify which attributes of a given information source should be included in an annotated bibliography.

Individual or Group:

Course Context (e.g. how it was implemented or integrated): 

This is a frequent activity I developed for our second-semester composition program. The common assignment is an annotated bibliography of 8-12 sources. Analyzing student bibliographies showed that they were having a tough time understanding how format can affect the usefulness of an information source, within context. The most frequent problem involved students jumping straight to peer-reviewed scholarship when they could barely articulate their research question. Likewise, students often do not approach research strategically and with an eye towards collecting a range of sources that will help address many common research needs. Since this activity is coupled to an annotated bibliography, a secondary pay-off is in helping students write their annotations. Once able to articulate the information need a source satisfies, they can better conceptualize how to incorporate the information into their paper.

Potential Pitfalls and Teaching Tips: 

This is a Socratic activity, so the librarian has to take the traditional "sage on the stage" approach and has to be comfortable keeping the conversation on track, no matter where it might go. The attached instructions are only a loose framework to help guide discussion.

Suggested Citation: 
Wilkinson, Lane. "Information Needs, Types, and Qualities." CORA (Community of Online Research Assignments), 2016. https://projectcora.org/assignment/information-needs-types-and-qualities.

Pages