visibian.HQ
visibian.com

AmazonChecked 29 Oct 2026

Amazonbot

Collects pages to improve Amazon's products and services, and may be used to train Amazon's AI models.

Run by
Amazon
Used for
Training AI
Follows robots.txt
Yes
Shut out by
10% of top websites

What blocking it changes

Amazon stops collecting the site's pages. Amazon also honours the noarchive meta tag, which keeps a page out of model training, and caches robots.txt for up to 30 days.

"...may be used to train Amazon AI models."

Amazon, read 29 Oct 2026
Figure 1How many shut out Amazonbot while letting Googlebot in
Most visited websites10%68 of 669
S&P 500 companies2%10 of 410
From our two studies of 29 October 2026: the 669 most visited websites and the 410 S&P 500 companies whose robots.txt we could read. 76 of the websites and 16 of the companies name Amazonbot in the file. The website study, the S&P 500 study.

The lines to copy

To shut it out
User-agent: Amazonbot
Disallow: /
To let it in
User-agent: Amazonbot
Allow: /

A crawler follows only the lines under the User-agent line that names it, and the lines under User-agent: * only when no line names it. So lines for one crawler do not change the rules for the others.

Amazon publishes the addresses it crawls from, so a request can be checked against them: the list.

More from Amazon

  • Amzn-SearchBot Reads pages for search in Amazon's products, such as Alexa. Amazon says it is not used for training.
  • Amzn-User Opens a page when a customer asks Alexa something that needs up-to-date information.