# Block AI bots User-agent: GPTBot Disallow: / User-agent: ClaudeBot Disallow: / User-agent: ChatGPT Disallow: / User-agent: CCBot Disallow: / User-agent: SemrushBot Disallow: / User-agent: AhrefsBot Disallow: / User-agent: DotBot Disallow: / User-agent: BLEXBot Disallow: / User-agent: DataForSeoBot Disallow: / User-agent: MJ12bot Disallow: / # Allow search engines User-agent: Googlebot Allow: / Crawl-delay: 1 User-agent: Bingbot Allow: / Crawl-delay: 1 # Default rules User-agent: * Allow: / Crawl-delay: 2 # Sitemap (update if you have one) # Sitemap: https://www.example.com/sitemap.xml