Skip to Main Content
Our Guides

Artificial Intelligence (AI) Tools and Resources

Guide to generative AI concepts & tools, considerations for use, and more.

Information Literacy & AI

Information literacy helps students locate, evaluate, and utilize information to further their learning. The American Library Association's Framework for Information Literacy in Higher Education provides us a way to evaluate information generated via AI tools (2023). In higher education, the influence of artificial intelligence (AI) on information literacy has become increasingly significant. AI algorithms have the potential to enhance information access, streamline research processes, and improve data analysis. AI can assist students determine authority and evaluate sources, view information creation as an iterative process, and view researching as strategic exploration and inquiry as the Framework states (American Library Association, 2023).

However, the integration of AI & information literacy also raises concerns regarding algorithmic bias, data privacy, and the need for critical thinking. It is crucial for individuals to develop a balanced understanding of AI capabilities and limitations, enabling them to effectively utilize AI tools while exercising discernment and critical evaluation of the information AI systems provide. Ultimately, combining the power of AI with information literacy skills empowers individuals to make informed decisions, engage in critical analysis, and contribute meaningfully to the global academic conversation.

Defining Information Literacy and AI Literacy

AI Literacy

The most basic definition of information literacy is the ability to locate, evaluate, and use information -this includes using information ethically.

AI Literacy is related to this concept -it’s the ability to understand and interpret AI systems and their outputs.

Note: Being AI Literate does not mean you need to understand the advanced mechanics of AI. It means that you are actively learning about the technologies involved and that you critically approach any texts you read that concern AI.

Critical AI Information Literacy

Critical information literacy involves critically examining the systems and contexts in which the information is produced and shared, or the sociopolitical factors that influence and shape the production, dissemination, and consumption of information.

Looking at AI through a critical literacy lens then considers how these technologies are being developed and used, prompt acknowledgement, exploration, and action against the real harm that AI technologies can promote, as well as the opportunities they afford.

Reliability, Validity, & AI

In the context of research in higher education, validity and reliability of information play a crucial role in ensuring the integrity and credibility of scholarly work. Validity refers to the extent to which the information or data collected accurately measures or reflects the intended research objectives or constructs. It involves ensuring that the methods used to gather information are appropriate and that the conclusions drawn from the data are valid within the research context. On the other hand, reliability relates to the consistency and repeatability of the results obtained. It involves assessing whether the research findings can be consistently reproduced or replicated by others using similar methods and data.

Critical thinking, skepticism, and a willingness to question and verify information are essential when evaluating AI reliability.

Quick Tips for Evaluating Reliability

Who is the Author? 

Ai tools offer information with no human author, but generate answers based on models that are trained by human created material. In evaluating the reliability of an Ai tool, look for AI systems that offer interpretability tools or methods to understand how they arrived at their conclusions. Consider the reputation and track record of the developers or organizations behind the AI system, as well as any reported issues or concerns.

What is the Purpose?

Information generated by Ai tools can be used for any purpose the user determines, based upon the prompt used. Sometimes this information can be misleading or incorrect.

Are Citations Provided for the Information Generated?

Typically, tools such as ChatGPT do not provide citations, and if they do, they can be false. Cross-reference the AI-generated results or predictions with trusted sources or expert knowledge to validate their accuracy. Scholarly article citations can be easily verified by contacting your academic librarian. 

Date and Located of Publication

This information can be difficult to ascertain when using Ai tools, so be sure to follow the guidelines above regarding cross referencing the information contained in the results. Some Ai tool do not have up to the current date information in their training models.

Lateral Reading

Lateral reading is a strategy for fact-checking and evaluating sources, including generative AI responses. Lateral reading involves leaving the Ai tool to consult other online sources. Instead of relying on an Ai tool as your only source for information, try opening up new tabs to verify facts, identify gaps, and find alternative perspectives. Below are steps you can follow to fact-check information from AI tools.

  1. Break down the information in the AI's response. Identify specific facts or claims made by the AI that you can search online and compare with other sources.
  2. Open a new tab (or multiple!) to search for more information to support the AI's response.
    • Use Google and sites like Wikipedia or Encyclopedia Britannica to search for specific pieces of information included in the AI's response.
    • Use OneSearch and Google Scholar to verify if sources cited by the AI are real and relevant to the AI's response.
  3. Reflect on the assumptions made.
    • What did your prompt assume?
    • What did the AI assume?
    • Who would know things about this topic? Would they have a different perspective than what the AI offers? Where could you check to find out?
  4. Make a judgment call.
    • Decide what is true, what is misleading, and what is false.
    • Can you re-prompt the AI to try and fix some of its errors?
    • Can you dive deeper into some of the sources you found while fact-checking?

Lateral reading suggestions adapted from "AI and Information Literacy: Assessing Content" by the University of Maryland Libraries and licensed under a Creative Commons Attribution Non-Commercial (CC BY-NC 4.0) license.

The ROBOT test

The ROBOT test can help you critically evaluate AI tools without needing an advanced understanding of how they work. You can use the questions below to build a better understanding of an AI technology and decided if it is the best tool for your needs. Image of robot with text spelling out

 


Reliability

  • How reliable is the information available about the AI technology?
  • If it’s not produced by the party responsible for the AI, what are the author’s credentials? Bias?
  • If it is produced by the party responsible for the AI, how much information are they making available? 
    • Is information only partially available due to trade secrets?
    • How biased is they information that they produce?

Objective

  • What is the goal or objective of the use of AI?
  • What is the goal of sharing information about it?
    • To inform?
    • To convince?
    • To find financial support?

Bias

  • What could create bias in the AI technology?
  • Are there ethical issues associated with this?
  • Are bias or ethical issues acknowledged?
    • By the source of information?
    • By the party responsible for the AI?
    • By its users?

Owner

  • Who is the owner or developer of the AI technology?
  • Who is responsible for it?
    • Is it a private company?
    • The government?
    • A think tank or research group?
  • Who has access to it?
  • Who can use it?

Type

  • Which subtype of AI is it?
  • Is the technology theoretical or applied?
  • What kind of information system does it rely on?
  • Does it rely on human intervention? 

 

Creative Commons License
This work is licensed under a Creative Commons Attribution-NonCommercial-ShareAlike 4.0 International License.

Hervieux, S. & Wheatley, A. (2020). The ROBOT test [Evaluation tool]. The LibrAIry. https://thelibrairy.wordpress.com/2020/03/11/the-robot-test