User-agent: * Allow: / Disallow: /dashboard Disallow: /dashboard/ Disallow: /settings Disallow: /settings/ Disallow: /admin Disallow: /admin/ Disallow: /report/ Disallow: /r/ Disallow: /webhooks/ # AI search, answer & training crawlers - conscious decision: the public # marketing/content surface is explicitly welcome, but private user data # (dashboards, reports, share links, settings, admin) stays off-limits for # every named bot. Each group below repeats the Disallow set because a # matching User-agent group fully overrides the wildcard "*" group. User-agent: GPTBot Allow: / Disallow: /dashboard/ Disallow: /settings/ Disallow: /admin/ Disallow: /report/ Disallow: /r/ Disallow: /webhooks/ User-agent: OAI-SearchBot Allow: / Disallow: /dashboard/ Disallow: /settings/ Disallow: /admin/ Disallow: /report/ Disallow: /r/ Disallow: /webhooks/ User-agent: ChatGPT-User Allow: / Disallow: /dashboard/ Disallow: /settings/ Disallow: /admin/ Disallow: /report/ Disallow: /r/ Disallow: /webhooks/ User-agent: PerplexityBot Allow: / Disallow: /dashboard/ Disallow: /settings/ Disallow: /admin/ Disallow: /report/ Disallow: /r/ Disallow: /webhooks/ User-agent: ClaudeBot Allow: / Disallow: /dashboard/ Disallow: /settings/ Disallow: /admin/ Disallow: /report/ Disallow: /r/ Disallow: /webhooks/ User-agent: Claude-Web Allow: / Disallow: /dashboard/ Disallow: /settings/ Disallow: /admin/ Disallow: /report/ Disallow: /r/ Disallow: /webhooks/ User-agent: Google-Extended Allow: / Disallow: /dashboard/ Disallow: /settings/ Disallow: /admin/ Disallow: /report/ Disallow: /r/ Disallow: /webhooks/ User-agent: Applebot-Extended Allow: / Disallow: /dashboard/ Disallow: /settings/ Disallow: /admin/ Disallow: /report/ Disallow: /r/ Disallow: /webhooks/ Sitemap: https://scampilot.de/sitemap.xml