AI Workflows
See If ChatGPT, Claude and Perplexity Crawl Your Site (Log Filter)
One User-Agent filter for your server or CDN logs that shows which pages ChatGPT, Claude and Perplexity bots visit, plus what to fix.
GrokREACHAI Films & TrailersRejects Bad AI Video1.3Kviews
GrokREACHAI WorkflowsBot Checks Its Usage11.1Kviews139likes
GrokREACHAI WorkflowsRoles and Handoffs19.3Kviews
GrokREACHAI WorkflowsBot Tutorial2.7KviewsPlatform rules change often. Always confirm on the linked source before applying.
See which pages ChatGPT, Claude and Perplexity actually visit, straight from your logs.
sh
OAI-SearchBot|ChatGPT-User|Claude-SearchBot|Claude-User|PerplexityBot|Perplexity-User
OAI-SearchBotChatGPTChatGPT-UserChatGPTClaude-SearchBotClaudeClaude-UserClaudePerplexityBotPerplexityPerplexity-UserPerplexity
1Open logs
Your server or CDN access logs.
Your server or CDN access logs.
2Filter User-Agent
Paste the filter below.
Paste the filter below.
3Sort
By URL, then request count.
By URL, then request count.
4Fix gaps
Key page at 0 visits? Check access before writing more.
Key page at 0 visits? Check access before writing more.
What to look for
- Which pages AI engines crawl, and which they barely touch.
- Whether product and comparison pages get reached.
- Old pages getting unexpected AI attention.
- An important page with 0 visits while weaker pages get crawled a lot: check robots.txt, internal links, rendering and accessibility first, before writing more articles.
These six User-Agent tokens match Cloudflare's AI Crawl Control bot reference.
Source: tip by @wespreadjam (Jam, spreadjam.com, an AEO tool for founders).





