What we look for
These pages carry the none rule (a robots meta tag or X-Robots-Tag header that means noindex and nofollow together: do not list this page or follow its links).
Why it matters
Search engines will leave these pages out of their results and ignore their links. That is right for private or temporary pages, and there it needs no change.
How to fix
Remove the none rule from the robots meta tag or X-Robots-Tag header of any page you want in search results. Leave it on pages that should stay hidden.
Where you’ll see it
The id is stable, and every surface uses it, so it’s the thing to search for or hand to an agent.
- Terminal
- When it is one of the five findings under Fix first,
raptor crawlprints the id under it.Check: directives.
none - crawl.json and the CSV
- The crawl JSON names the finding by this id, and so do the CSV and
raptor_query."check_
id": "directives. none" - The HTML report
- This link opens the finding in the report, and each finding shows its id.
crawl.
html# finding= directives. none - MCP
raptor_findingswith thischeck_idreturns the finding in full, with a fix brief ready to paste into a task. If it didn’t fire, it says why.raptor_
findings { "job_ id": ". . . ", "check_ id": "directives. none" }