LeaderboardDeep reportAbout

AI crawlers

Perplexity-User in robots.txt

Perplexity-User is run by Perplexity. Purpose: user fetch. Source: Perplexity documentation.

What blocking Perplexity-User changes

This agent fetches a page when a person asks the assistant about it. Blocking it stops those live reads.

Block Perplexity-User

User-agent: Perplexity-User
Disallow: /

Block Perplexity-User from one folder

User-agent: Perplexity-User
Disallow: /private/

Allow Perplexity-User

If no group names Perplexity-User, it follows your "User-agent: *" rules. To allow it while other bots are blocked:

User-agent: Perplexity-User
Allow: /

More: the guide AI crawlers in robots.txt and the AI crawler checker.

Questions

What is Perplexity-User?

Perplexity-User is the user agent token for an agent run by Perplexity. Its purpose: user fetch. See the Perplexity documentation linked on this page.

How do I block Perplexity-User?

Add a group to robots.txt with "User-agent: Perplexity-User" and "Disallow: /". The rule applies to agents that follow robots.txt.

How do I check if my site blocks Perplexity-User?

Run the free check on this site. It tests your robots.txt against 8 AI agents on your homepage. The $19 deep report tests 18 agents per path.

AI crawler and llms.txt updates

Get an email when AI crawlers, robots.txt rules, or llms.txt practice change. At most twice a month.

We send a confirmation link first. See the privacy policy.