visibian.HQ
visibian.com

MicrosoftChecked 29 Oct 2026

Bingbot

Crawls the web for Bing, whose index Microsoft Copilot answers from.

Run by
Microsoft
Used for
Search and AI answers
Follows robots.txt
Yes
Shut out by
3% of top websites

What blocking it changes

The site drops out of Bing. To stay in Bing but out of its AI answers, Bing offers the NOARCHIVE meta tag; NOCACHE lets only the link, title and snippet be used.

"Content tagged NOARCHIVE will not be included in Bing Chat answers."

Microsoft, read 29 Oct 2026
Figure 1How many shut out Bingbot
Most visited websites3%22 of 669
S&P 500 companies0%1 of 410
From our two studies of 29 October 2026: the 669 most visited websites and the 410 S&P 500 companies whose robots.txt we could read. 65 of the websites and 21 of the companies name Bingbot in the file. The website study, the S&P 500 study.

The lines to copy

To shut it out
User-agent: Bingbot
Disallow: /
To let it in
User-agent: Bingbot
Allow: /

A crawler follows only the lines under the User-agent line that names it, and the lines under User-agent: * only when no line names it. So lines for one crawler do not change the rules for the others.