AI opt-out (noai): what it means and how to fix it

What we look for

These pages carry a noai or noimageai rule (a robots meta tag or X-Robots-Tag header asking AI systems not to use the page's text or images).

These rules do not affect search results, and only some AI companies honour them. Where you added them on purpose, they need no change.

Remove noai and noimageai from the robots meta tag or X-Robots-Tag header of pages that AI tools may use. Keep them where the opt-out is deliberate.

The id is stable, and every surface uses it, so it’s the thing to search for or hand to an agent.

Terminal: When it is one of the five findings under Fix first, raptor crawl prints the id under it.
Check: directives.noai_directive
crawl.json and the CSV: The crawl JSON names the finding by this id, and so do the CSV and raptor_query.
"check_id": "directives.noai_directive"
The HTML report: This link opens the finding in the report, and each finding shows its id.
crawl.html#finding=directives.noai_directive
MCP: raptor_findings with this check_id returns the finding in full, with a fix brief ready to paste into a task. If it didn’t fire, it says why.
raptor_findings { "job_id": "...", "check_id": "directives.noai_directive" }