Tech

How to get ChatGPT to provide sources and citations


ChatGPT on the phone

Jonathan Raa/NurPhoto via Getty Images

One of the biggest complaints about ChatGPT is that it provides information, but the accuracy of that information is uncertain. Those complaints exist because ChatGPT does not provide sources, footnotes, or links to where it gets the information used in its answers.

While that is true for GPT-3.5, GPT-4, and GPT-4o Models provides additional citations. While GPT-4 is only available to paid subscribers, GPT-4o is available to both free and paid subscribers, although free users get fewer and less detailed citations than paid users. Sign up for ChatGPT Plus.

Also: 4 things Claude AI can do that ChatGPT cannot

Here’s how ChatGPT describes its approach: “GPT-4o in its free mode provides basic and essential citations, focusing on quick and concise references to ensure information is retrievable. In contrast, GPT-4o in its paid mode provides advanced, detailed, and frequent citations, including multiple sources and contextual annotations to provide comprehensive verification and understanding of information. This ensures a robust and trustworthy experience, especially beneficial for users who require in-depth information and thorough source verification.”

Even with the citations provided in GPT-4o, there are still ways to improve the approach. Let’s take a look.

How to get ChatGPT to provide sources and citations

If you know how to prompt ChatGPT, it will give you the source. Here’s how.

To start, you need to ask ChatGPT something that requires a source or citation. I find it better to ask a question that has a longer answer, so ChatGPT has more “meat” to chew on.

Also: The Best AI Chatbots: ChatGPT and Other Fun Alternatives to Try

Please remember that ChatGPT cannot provide any information after January 2022 for GPT-3.5, April 2023 for GPT-4, and October 2023 for GPT-4o as well as information requests before they are available. The internet (for example, for an article about president Ronald Reagan) will have fewer sources available.

Here’s an example of a prompt I wrote about a topic I did a lot of research on in graduate school:

Describe the learning theories of cognitivism, behaviorism, and constructionism

This is where a little fast technique will appear. A good starting point is with this query:

Please provide source for previous answer

I find that this prompt often offers offline sources, books, articles, etc. The problem with offline sources is that you can’t verify their authenticity. But that’s a starting point. A better query is:

Please provide source URL

This prompt specifically tells ChatGPT that you want clickable links to sources. You can also tweak this prompt by requesting a specific number of sources, though your mileage may vary depending on how many you get back:

Please provide 10 URL sources

In the next step, we will see what we can do with these resources.

ChatGPT and most major language model AIs Responds well to detail and specificity. So if you are asking for sources, you can ask for higher quality sources. You will need to determine that you need reliable and accurate sources. While this approach isn’t necessarily effective, it can prompt the AI ​​to give you more useful feedback. For example:

Please provide me with reliable sources to support my arguments about… (regardless of the topic you are looking at)

You can also tell ChatGPT what type of source you want. If you are looking for scholarly articles, journals, peer-reviewed books, or authoritative websites, explicitly mention these preferences. For example:

Please recommend peer-reviewed journals that discuss… (and here, repeat what you discussed earlier in your conversation)

When dealing with abstract concepts or theories, ask ChatGPT to provide a conceptual framework and practical examples. Here is an example:

Can you describe the principles in Vygotsky’s Theory of Social Development and provide real-world examples where these principles apply, including sources for these examples?

This approach provides you with theoretical explanations and practical cases for tracing or case studies.

Also: Two ways you can build a custom AI assistant with GPT-4o

Another idea is to use sources that have no rotten links (i.e. they are no longer online at the URL that ChatGPT knows about). Be careful with this idea, though, as ChatGPT doesn’t know about things after January 2022 for GPT-3.5, April 2023 for GPT-4, and October 2023 for GPT-4o. So while you might be tempted to use a prompt like this:

Please provide me with sources published within the last five years.

Instead, consider using a reminder like this:

Please provide sources published between 2019 and April 2023.

And, as always, don’t assume any results ChatGPT gives you are accurate. It’s still possible that the AI ​​will completely fabricate answers, even to the extent of making up the names of what appear to be academic journals. It’s a lie. It is sometimes a useful tool but also a misleading one.

Keep in mind this golden rule about resources provided by ChatGPT: ChatGPT is often wrong more often than right.

In the many times I’ve asked ChatGPT to provide a source URL, nearly half are just bad links. The other 25% or so links lead to threads that are completely or completely unrelated to the topic you’re trying to source. GPT-4 and GPT-4o are a little more reliable, but not by much.

Also: How to use ChatGPT: Everything you need to know

For example, I asked sources on the platform for the phrase “trust but verify”, generally popular by US President Ronald Reagan. I got a lot of sources back, but most are non-existent. I received some information that correctly took me to active pages on the Reagan Presidential Library site, but the page topic had nothing to do with that term.

I had better luck with my learning theory question from step 1. There I got offline messages from people I knew in my studies who had worked on those theories. I also got the URL. But again only about two out of 10 worked or were correct.

Also: What does GPT stand for? Learn about GPT-3.5, GPT-4, GPT-4o and more

But don’t despair. The idea is not to expect ChatGPT to provide resources that you can use immediately. Instead, if you think of ChatGPT as a research assistant, it will give you some great starting points. Use the names of the articles (which may be completely fake or inaccessible) and drop them into Google. That process will give you some interesting search queries that could lead to interesting material that could legitimately be included in your research.

Also, remember that you are not limited to using ChatGPT. Just because ChatGPT exists doesn’t mean you should forget about all the tools available to researchers and students. Do your own web searches. Check with primary sources and subject matter experts if they are available. If you’re in school, you can even ask your friendly neighborhood librarian for help.

Also: How to use ChatGPT to create an app

Don’t forget that there are many wonderful traditional sources. For example, Google Scholar And NEWS provides access to a variety of academically acceptable resources that you can cite with reasonable reliability.

One final point: if you just cut and paste ChatGPT sources into your research, you might be fooled. Using AI to find clues, is not a way to avoid the real work of research.

Frequently Asked Questions

How do you put sources in APA format?

APA style is the citation style commonly required in academic programs. APA stands for the American Psychological Association. I often think they invented these style rules to get more clients. But seriously, the definitive starting point for APA style is Purdue OWLwhere there are many style guides.

Also: GPT-3.5 vs GPT-4: Is ChatGPT Plus Worth the Subscription Fee?

Be careful: online formatters may not get the job done, and your professor may return your work. It’s more beneficial to do your homework yourself — and be careful when doing it.

How can I make ChatGPT provide more reliable sources for my feedback?

This is a good question. I find that sometimes — Sometimes — if you ask ChatGPT to give you more sources or request sources again, it will give you a new list. If you tell ChatGPT that the sources it provides are wrong, it will sometimes give you better sources. The bot can also apologize and offer excuses. Another approach is to ask your original question again with a different focus or direction, then ask the source for the new answer.

Also: How to access, install and use AI ChatGPT-4 plugin

Again, my best advice is to avoid treating ChatGPT as a tool that writes for you and more as a writing assistant. Asking sources to cut and paste ChatGPT responses is almost plagiarism. But using ChatGPT responses and any sources you find as clues for further research and writing is a legitimate way to use this fascinating new tool.

Why is ChatGPT source so often wrong?

For some links, it’s just a broken link. Some links may have changed as many sources are at least three years old. Other sources have unknown ages. Since we don’t have a complete list of ChatGPT’s sources, it’s impossible to know how valuable they are.

Also: How does ChatGPT actually work?

But since ChatGPT is trained almost without human supervisionWe know that most of its sources are unverified and may be false, fabricated, or completely non-existent.

Trust, but verify.


You can follow my daily project updates on social media. Be sure to subscribe. My weekly newsletter updateand follow me on Twitter/X at @DavidGewirtzon Facebook at Facebook.com/DavidGewirtzon Instagram at Instagram.com/DavidGewirtzand on YouTube at YouTube.com/DavidGewirtzTV.

Related Articles

Leave a Reply

Your email address will not be published. Required fields are marked *