# Search engines: welcome. User-agent: * Allow: / # AI-training crawlers: content is proprietary; not licensed for model training. User-agent: GPTBot Disallow: / User-agent: CCBot Disallow: / User-agent: Google-Extended Disallow: / User-agent: anthropic-ai Disallow: / User-agent: ClaudeBot Disallow: / User-agent: PerplexityBot Disallow: / User-agent: Bytespider Disallow: / User-agent: meta-externalagent Disallow: / Sitemap: https://gateframe.io/sitemap.xml