visibian.docs
visibian.com

What competitors let AI read

Most websites publish a small file, robots.txt, that says who may read them. This screen shows that choice for the competitors cited on your questions: which AI readers (the programs AI companies send to fetch pages) they allow and which they block. A site that blocks the reader behind an assistant is choosing not to be its source, and that is an opening.

Only the ones beating you

Not every domain in your market. The competitors checked are the ones already cited on your own tracked questions, because those are the sites whose choices matter to your results. The panel sits on Competitive Intelligence.

Read from what they publish

The stance comes from each competitor’s own robots.txt. Blocked means their file turns that reader away; a site with no file allows everything by default. A site we could not reach is reported as unreachable, not as open. Stances change over days, so the check runs daily and not more often.

We ask firstA competitor’s robots.txt is fetched before any of their pages. If it turns our reader away, we stop there and record that we did. A tool about respecting robots.txt respects robots.txt.

Updated . Something unclear? Write to [email protected]. A person reads it.