visibian.HQ
visibian.com

PerplexityChecked 29 Oct 2026

PerplexityBot

Finds and links pages for Perplexity's search results. Perplexity says it is not used to train AI models.

Run by
Perplexity
Used for
Search and AI answers
Follows robots.txt
Yes
Shut out by
10% of top websites

What blocking it changes

Perplexity asks sites to allow it so that they appear in its search results. Changes can take up to 24 hours.

"It is not used to crawl content for AI foundation models."

Perplexity, read 29 Oct 2026
Figure 1How many shut out PerplexityBot while letting Googlebot in
Most visited websites10%70 of 669
S&P 500 companies1%4 of 410
From our two studies of 29 October 2026: the 669 most visited websites and the 410 S&P 500 companies whose robots.txt we could read. 119 of the websites and 32 of the companies name PerplexityBot in the file. The website study, the S&P 500 study.

The lines to copy

To shut it out
User-agent: PerplexityBot
Disallow: /
To let it in
User-agent: PerplexityBot
Allow: /

A crawler follows only the lines under the User-agent line that names it, and the lines under User-agent: * only when no line names it. So lines for one crawler do not change the rules for the others.

Perplexity publishes the addresses it crawls from, so a request can be checked against them: the list.

More from Perplexity

  • Perplexity-User Opens a page when a Perplexity user asks a question that needs it.