• Skip to main content
  • Skip to after header navigation
  • Skip to site footer
Knowledge Base

Knowledge Base

Practical help for digital teaching

Resources

  • Knowledge Base
  • Kick Start
  • Free Resources
  • AI in Education
  • Log In

3 May 2024

Artificial Intelligence Knowledge Articles Teaching Technology

*Screenshots may differ to what you see, depending on whether you have a PC or Mac.

The limitations of ChatGPT 

There are things AI can’t do yet, however, ‘yet’ is important because AI’s improvement is exponential. 

10 ways ChatGPT may not be as helpful as you may have thought 

  1. ChatGPT is limited to information before mid-2021 because it has been trained on pre 2021 data. If you require information after mid-2021 ChatGPT will find it more difficult. 
  2. It doesn’t ask the user for clarification of their prompts. Users need to be skilled at prompt writing (prompt engineering) and critiquing its response. 
  3. It’s sensitive to the phrasing of the prompts – it can claim not to be able to answer, but with a slight rephrasing of the prompt, it can answer. Users need to be aware of this and learn how to rephrase prompts. 
  4. It can’t do logical reasoning. Activities which require logical reasoning will be more difficult to do with ChatGPT. 
  5. It can misinterpret data it is using when writing a response e.g., metaphor. Students would need to be aware, and fact check. Activities written to leverage this limitation will be harder for ChatGPT to do. 
  6. Its responses can lack insight and depth. It doesn’t understand the meaning behind the words it uses. It is a large-language model trained to generate words in a sentence based on the next most logical word. Activities which require insight and depth will be harder for ChatGPT to do. 
  7. Responses can be factually wrong, but still sound plausible and be coherent (hallucinations). Users need to be skilled at evaluating responses and fact checking. 
  8. It invents references that look correct but don’t exist (hallucinations). Students need to check and provide live links to references where applicable. 
  9. It will sometimes respond to harmful instructions or show bias. Users need to be aware of this and develop their critical thinking skills, so they can evaluate responses generated and rewrite responses where needed. 
  10. Indigenous knowledge and culture that is held orally is not in the model. 

    Sidebar

    Knowledge Articles

    Resource Categories

    Signup to Mildly Interesting

    Stay updated on the latest developments from our Academic Partners team, as well as insights from our Quality Team on updates and policies shaping the educational landscape. Don't miss out—sign up today to stay informed!

    * indicates required
    /* real people should not fill this in and expect good things - do not remove this or risk form bot signups */


    Need More Help?

    Copyright © 2026 · Manukau Institute of Technology · Crafted by Responsive

    Your cart (items: 0)

    Products in cart

    Product Details Total
    Subtotal $0
    View my cart
    Go to checkout

    Your cart is currently empty!

    Start shopping

    Notifications