Complete database of AI search engine crawler user-agents (GPTBot, PerplexityBot, ClaudeBot) with robots.txt configuration examples
-
Updated
Mar 9, 2026 - HTML
Complete database of AI search engine crawler user-agents (GPTBot, PerplexityBot, ClaudeBot) with robots.txt configuration examples
📊 Open methodology for scoring website readiness for AI search engines — 11 technical checks for GEO optimization
🔍 A curated list of Generative Engine Optimization (GEO) resources, tools, and guides for AI search engines (ChatGPT, Perplexity, Gemini)
🤖 Generate optimized robots.txt files for AI search engine crawlers (GPTBot, PerplexityBot, ClaudeBot, and more)
Interactive checklist to assess your website's readiness for AI search engines (ChatGPT, Perplexity, Gemini)
Generate badges showing your website's AI search readiness score from GEOScore
Add a description, image, and links to the geoscore topic page so that developers can more easily learn about it.
To associate your repository with the geoscore topic, visit your repo's landing page and select "manage topics."