User-agent: * Allow: / # OpenAI User-agent: GPTBot Allow: / User-agent: ChatGPT-User Allow: / User-agent: OAI-SearchBot Allow: / # Anthropic User-agent: ClaudeBot Allow: / User-agent: anthropic-ai Allow: / User-agent: Claude-Web Allow: / # Perplexity User-agent: PerplexityBot Allow: / # Google (Gemini, Vertex, AI Overviews) User-agent: Google-Extended Allow: / # Apple Intelligence / Siri / Spotlight User-agent: Applebot Allow: / User-agent: Applebot-Extended Allow: / # Meta AI User-agent: Meta-ExternalAgent Allow: / # DuckDuckGo Assist User-agent: DuckAssistBot Allow: / # Amazon (Rufus, Alexa) User-agent: Amazonbot Allow: / # ByteDance / Doubao User-agent: Bytespider Allow: / # Cohere User-agent: cohere-ai Allow: / # Other AI / search agents User-agent: Diffbot Allow: / User-agent: Timpibot Allow: / User-agent: YouBot Allow: / Sitemap: https://superdupr.com/sitemap.xml # AI Content Discovery: llms.txt is served at the well-known path # https://superdupr.com/llms.txt (no robots.txt directive required)