LeaderboardDeep reportAbout

AI crawlers

ChatGPT-User in robots.txt

ChatGPT-User is run by OpenAI. Purpose: user fetch. Source: OpenAI documentation.

What blocking ChatGPT-User changes

This agent fetches a page when a person asks the assistant about it. Blocking it stops those live reads.

Block ChatGPT-User

User-agent: ChatGPT-User
Disallow: /

Block ChatGPT-User from one folder

User-agent: ChatGPT-User
Disallow: /private/

Allow ChatGPT-User

If no group names ChatGPT-User, it follows your "User-agent: *" rules. To allow it while other bots are blocked:

User-agent: ChatGPT-User
Allow: /

How many sites block ChatGPT-User?

Of the 49 SaaS sites in our State of AI readiness check on 2026-10-17, 0 block ChatGPT-User from their homepage.

More: the guide AI crawlers in robots.txt and the AI crawler checker.

Questions

What is ChatGPT-User?

ChatGPT-User is the user agent token for an agent run by OpenAI. Its purpose: user fetch. See the OpenAI documentation linked on this page.

How do I block ChatGPT-User?

Add a group to robots.txt with "User-agent: ChatGPT-User" and "Disallow: /". The rule applies to agents that follow robots.txt.

How do I check if my site blocks ChatGPT-User?

Run the free check on this site. It tests your robots.txt against 8 AI agents on your homepage. The $19 deep report tests 18 agents per path.

AI crawler and llms.txt updates

Get an email when AI crawlers, robots.txt rules, or llms.txt practice change. At most twice a month.

We send a confirmation link first. See the privacy policy.