visibian.HQ
visibian.com

MistralChecked 29 Oct 2026

MistralAI-Index

Crawls the web to build Mistral's index, for search in its products.

Run by
Mistral
Used for
Search and AI answers
Follows robots.txt
Yes
Shut out by
4% of top websites

What blocking it changes

Mistral stops indexing the site. Its page does not say more.

"MistralAI-Index is for automated crawling of the web for indexing purposes only."

Mistral, read 29 Oct 2026
Figure 1How many shut out MistralAI-Index while letting Googlebot in
Most visited websites4%26 of 669
S&P 500 companies0%2 of 410
From our two studies of 29 October 2026: the 669 most visited websites and the 410 S&P 500 companies whose robots.txt we could read. 2 of the websites and 0 of the companies name MistralAI-Index in the file. The website study, the S&P 500 study.

The lines to copy

To shut it out
User-agent: MistralAI-Index
Disallow: /
To let it in
User-agent: MistralAI-Index
Allow: /

A crawler follows only the lines under the User-agent line that names it, and the lines under User-agent: * only when no line names it. So lines for one crawler do not change the rules for the others.

Mistral publishes the addresses it crawls from, so a request can be checked against them: the list.

More from Mistral

  • MistralAI-Training Collects pages to build datasets for training Mistral's AI models.
  • MistralAI-User Opens pages for actions a user asks for in Mistral's products.