visibian.HQ

MistralChecked 29 Oct 2026

MistralAI-Training

Collects pages to build datasets for training Mistral's AI models.

Run by
Mistral
Used for
Training AI
Follows robots.txt
Yes
Shut out by
4% of top websites

What blocking it changes

Mistral stops collecting the site's pages for training.

"Webmasters can disallow this user agent in their robots.txt file."

Mistral, read 29 Oct 2026
Figure 1How many shut out MistralAI-Training while letting Googlebot in
Most visited websites4%28 of 669
S&P 500 companies2%8 of 410
From our two studies of 29 October 2026: the 669 most visited websites and the 410 S&P 500 companies whose robots.txt we could read. 4 of the websites and 6 of the companies name MistralAI-Training in the file. The website study, the S&P 500 study.

The lines to copy

To shut it out
User-agent: MistralAI-Training
Disallow: /
To let it in
User-agent: MistralAI-Training
Allow: /

A crawler follows only the lines under the User-agent line that names it, and the lines under User-agent: * only when no line names it. So lines for one crawler do not change the rules for the others.

More from Mistral

  • MistralAI-Index Crawls the web to build Mistral's index, for search in its products.
  • MistralAI-User Opens pages for actions a user asks for in Mistral's products.