Search opt-out (noindex)

Seen in a real crawl

From a crawl of Fernhollow Outdoor, a test site built for this site’s demo.

Where you’ll see it

The id is stable, and every surface uses it, so it’s the thing to search for or hand to an agent.

Terminal

When it is one of the five findings under Fix first, raptor crawl prints the id under it.

Check: directives.noindex

crawl.json and the CSV

The crawl JSON names the finding by this id, and so do the CSV and raptor_query.

"check_id": "directives.noindex"

The HTML report

This link opens the finding in the report, and each finding shows its id.

crawl.html#finding=directives.noindex

MCP

raptor_findings with this check_id returns the finding in full, with a fix brief ready to paste into a task. If it didn’t fire, it says why.

raptor_findings {
  "job_id": "...",
  "check_id": "directives.noindex"
}