# tannerd.net crawler policy — V5.5 maximum discovery mode # Search indexing, AI-agent access, AI input, and model training are allowed. # This file expresses permission; Cloudflare dashboard crawler rules can still # override access before a request reaches the Worker. User-agent: * Content-Signal: search=yes, ai-input=yes, ai-train=yes, use=full Allow: / Disallow: /admin/ Disallow: /api/admin/ Sitemap: https://tannerd.net/sitemap.xml