> tools/llm-robots-guidance
LLM robots.txt guidance
Generate robots.txt and crawler guidance notes for AI bots without blocking useful discovery by mistake.
> robots.txt
User-agent: * Allow: / User-agent: GPTBot Allow: / User-agent: ClaudeBot Allow: / User-agent: PerplexityBot Allow: / Sitemap: https://acme.com/sitemap.xml # Also publish /llms.txt for clearer AI guidance
> want the complete audit?
Drop your domain and category. Get an instant score across four AI engines, then see the 30-day path to 6/10.
Check your AI visibility score