Skip to content
Vouch

Is GPTBot blocked on your site?

Enter your site and see whether your robots.txt blocks GPTBot, OpenAI's crawler, and 13 other AI and search crawlers, with the rule that decides each. Free, no sign-up.

What GPTBot is

GPTBot is OpenAI's web crawler for pages that may be used to train its models. It identifies itself as GPTBot and, by OpenAI's documentation, obeys robots.txt. A site that blocks it opts out of that training use; a site that allows it opts in. Neither choice alone decides whether ChatGPT can cite you, because search and user-triggered visits use other agents.

Block GPTBot but stay in ChatGPT search

This robots.txt blocks the training crawler and keeps OpenAI's search crawler allowed:

User-agent: GPTBot
Disallow: /

User-agent: OAI-SearchBot
Allow: /

To block GPTBot alone, the group is two lines:

User-agent: GPTBot
Disallow: /

Other AI crawlers to check

The results table covers ClaudeBot, PerplexityBot, Google-Extended, Applebot-Extended, CCBot and the rest. For the whole picture, including llms.txt and whether your page works without JavaScript, use the AI crawler checker, then decide each one in the robots.txt builder. The guide to blocking GPTBot sets out when each choice makes sense.

After the check

Letting a crawler in is only the first step. What assistants then say about your brand, question by question, is what Vouch measures; see the plans or the other free GEO tools.

Common questions

How do I check if GPTBot is blocked on my site?

Type your site's address above and press Check my site. The checker reads your robots.txt the way GPTBot would, applies the rules that match it and tells you whether GPTBot may read your home page, with the line of robots.txt that decides it. It reports the other AI crawlers in the same table.

What is the difference between GPTBot, OAI-SearchBot and ChatGPT-User?

OpenAI uses three agents. GPTBot collects pages that may train its models. OAI-SearchBot surfaces sites in ChatGPT search. ChatGPT-User visits a page when a person asks ChatGPT something that needs it. Blocking GPTBot does not block the other two, so a site can stay in ChatGPT search while opting out of training.

Should you block GPTBot?

Does blocking GPTBot remove my site from ChatGPT?

Not by itself. GPTBot is the training crawler. Whether ChatGPT can find and cite your pages in search depends on OAI-SearchBot, and a page a person asks about is fetched by ChatGPT-User. OpenAI says robots.txt rules may not apply to ChatGPT-User, because a person started the request.

How do I block or allow GPTBot in robots.txt?

To block it, add a group that names it and disallows everything: User-agent: GPTBot, then Disallow: /. To allow it, remove that group, or write User-agent: GPTBot with Allow: /. A crawler with its own group ignores the User-agent: * rules, so repeat any private paths inside the group. The free robots.txt builder writes this for each crawler.

AI robots.txt builder

Why does the checker say my site is allowed when I blocked it?

Usually the rule is in the wrong place or does not match. robots.txt must be served at the root of the exact host (www and non-www are separate files), a more specific Allow can override a broad Disallow, and a CDN or firewall can refuse GPTBot's requests without robots.txt saying so. The checker reads the live file, so it shows what a crawler would see today.

What does the checker store?

A result is kept in memory for an hour, so repeat checks and shared result links do not hit your site again. Nothing about the site is saved to a database. The address of the person checking is only counted, hashed, for the rate limit.