# PaddlePalace.com Robots.txt # Optimized for Google, Bing, OpenAI, Perplexity, Anthropic, and other LLM search agents User-agent: * Allow: / Crawl-delay: 5 # OpenAI ChatGPT Bots User-agent: GPTBot Allow: / User-agent: OAI-SearchBot Allow: / # Anthropic's Claude User-agent: anthropic-ai Allow: / # Microsoft Copilot (via Bing) User-agent: bingbot Allow: / # Googlebot (used by Gemini) User-agent: Googlebot Allow: / # Perplexity AI User-agent: PerplexityBot Allow: / # Manus / Magpie Crawler User-agent: magpie-crawler Allow: / # DuckDuckGo User-agent: DuckDuckBot Allow: / # You.com AI Search User-agent: YouBot Allow: / # NeevaBot (legacy, now Snowflake) User-agent: Neevabot Allow: / # Disallow sensitive or non-indexable paths Disallow: /admin/ Disallow: /checkout/ Disallow: /cart/ Disallow: /account/ Disallow: /login/ Disallow: /register/ # Declare full and mobile sitemaps Sitemap: https://www.paddlepalace.com/sitemap.xml Sitemap: https://www.paddlepalace.com/mobile/sitemap.xml