visibian.HQ
visibian.com

AppleChecked 29 Oct 2026

Applebot-Extended

A setting that tells Apple whether it may use the pages Applebot collects to train its foundation models.

Run by
Apple
Used for
Setting for training
Follows robots.txt
It is a setting, not a crawler
Shut out by
11% of top websites

What blocking it changes

Apple stops using the pages for training. The site stays in Siri, Spotlight and Safari results, and the setting does not affect ranking.

"Webpages that disallow Applebot-Extended can still be included in search results."

Apple, read 29 Oct 2026
Figure 1How many shut out Applebot-Extended while letting Googlebot in
Most visited websites11%75 of 669
S&P 500 companies2%10 of 410
From our two studies of 29 October 2026: the 669 most visited websites and the 410 S&P 500 companies whose robots.txt we could read. 85 of the websites and 19 of the companies name Applebot-Extended in the file. The website study, the S&P 500 study.

The lines to copy

It has no crawler of its own: Applebot reads the lines that name Applebot-Extended.

To shut it out
User-agent: Applebot-Extended
Disallow: /
To let it in
User-agent: Applebot-Extended
Allow: /

A crawler follows only the lines under the User-agent line that names it, and the lines under User-agent: * only when no line names it. So lines for one crawler do not change the rules for the others.

More from Apple

  • Applebot Crawls for Siri, Spotlight and Safari, including answers that may link to the sources.