LLM Bot Logs
Which AI bots read your site, and why?
Upload your Nginx or Apache access log and Perquery picks out 15 AI bots by user agent: which pages they fetch, how often, and what your server answered. Each visit is sorted by why the bot came: citation, indexing or training.
Bot visits by bot
GPTBot53%
ClaudeBot35%
PerplexityBot12%
/platform3,240 hits · 200
/pricing2,870 hits · 200
/features/ai-visibility890 hits · 200
/pricing/enterprise0 hits · never fetched
92.4%200 OK rate
GPTBotBusiest bot
7,000Total bot visits
No AI bot fetched /pricing/enterprise, while /platform got 3,240 hits.
Why it matters
Your server logs show which AI bots visit and what they fetch
- 15 AI bots, from GPTBot and ClaudeBot to PerplexityBot and CCBot.
- Why the bot came: citation, indexing or training.
- HTTP status distribution to spot blocked or failed requests.
- Most-fetched pages, and the crawled pages no bot ever fetched.
Get started