Amazonbot in robots.txt
Amazonbot is run by Amazon. Purpose: search and AI. Source: Amazon documentation.
What blocking Amazonbot changes
The operator uses this crawler for its search and AI features.
Block Amazonbot
User-agent: Amazonbot Disallow: /
Block Amazonbot from one folder
User-agent: Amazonbot Disallow: /private/
Allow Amazonbot
If no group names Amazonbot, it follows your "User-agent: *" rules. To allow it while other bots are blocked:
User-agent: Amazonbot Allow: /
More: the guide AI crawlers in robots.txt and the AI crawler checker.
Questions
What is Amazonbot?
Amazonbot is the user agent token for an agent run by Amazon. Its purpose: search and AI. See the Amazon documentation linked on this page.
How do I block Amazonbot?
Add a group to robots.txt with "User-agent: Amazonbot" and "Disallow: /". The rule applies to agents that follow robots.txt.
How do I check if my site blocks Amazonbot?
Run the free check on this site. It tests your robots.txt against 8 AI agents on your homepage. The $19 deep report tests 18 agents per path.
Get an email when AI crawlers, robots.txt rules, or llms.txt practice change. At most twice a month.
We send a confirmation link first. See the privacy policy.