Crawl Surface Audit

Review robots.txt and sitemap exposure quickly.

Crawl assets can unintentionally reveal sensitive paths. This scanner evaluates robots directives, sitemap discoverability, and potential indexing-risk patterns.