User-agent: * Allow: / # Block GSC noise from dotfile/admin probe paths (intentional 403s) Disallow: /.env Disallow: /.git/ Disallow: /admin/ Disallow: /wp-admin/ Disallow: /wp-login.php Sitemap: https://www.tvreviewer.com/sitemap.xml # === mythos-build managed AI bot policy === # Updated 2026-05-08 — Mythos-ready User-agent: ClaudeBot Allow: / User-agent: Claude-Web Allow: / User-agent: anthropic-ai Allow: / User-agent: GPTBot Allow: / User-agent: OAI-SearchBot Allow: / User-agent: PerplexityBot Allow: / User-agent: Google-Extended Allow: / User-agent: Applebot-Extended Allow: / User-agent: CCBot Disallow: / User-agent: Bytespider Disallow: / User-agent: omgili Disallow: / User-agent: AwarioBot Disallow: / User-agent: Diffbot Disallow: / User-agent: Amazonbot Disallow: / User-agent: cohere-ai Disallow: / User-agent: meta-externalagent Disallow: / User-agent: FacebookBot Disallow: / User-agent: ImagesiftBot Disallow: / Sitemap: https://tvreviewer.com/sitemap.xml # === end mythos-build managed block ===