How does Scrunch detect AI bot traffic visiting my site?
- Also asked as:
- How does Scrunch track AI bots on my website?
- Can Scrunch see which AI platforms visit my site?
Scrunch detects AI bot traffic visiting users’ websites through direct CDN and hosting integrations that capture real-time bot visits. These integrations identify which AI platforms are accessing site content, what they're requesting, how frequently they visit, and more.
Additional context: Scrunch distinguishes between training bots (collecting data to train AI models), indexer bots (building search indexes), and retrieval bots (fetching content for live user queries).
Example
For example, if a Scrunch user connects their CDN or hosting provider, they can see the following in the Agent Traffic tab:
Bot traffic trends
Volume of AI bot visits over time, broken down by specific AI models like ChatGPT, Perplexity, and more.
Request type classification
Whether bots are training on content, indexing it for future retrieval, or actively retrieving it for user queries.
Top performers
Which AI agents visit most frequently and which webpages receive the most bot attention.
Traffic comparison
Side-by-side view of human visitors versus AI bot traffic to understand relative volume.
Real-time monitoring
Bot requests sorted by recency to track current AI platform activity.
This visibility helps users understand which AI platforms actively engage with their content and which bots and pages drive the most AI search visibility.
Follow-up question: Which CDN and hosting providers does Scrunch integrate with?
Scrunch offers native integrations with major CDN and hosting providers: Akamai, AWS CloudFront, Cloudflare, Fastly, Vercel, and WordPress.
If using a CMS that doesn’t provide direct access to raw CDN logs: HubSpot CMS, BigCommerce, Shopify, Squarespace, Uberflip, Webflow, and Wix users can still integrate with Scrunch via proxy through Cloudflare.
Related FAQs
What methods does Scrunch use to collect data from AI platforms?
Scrunch uses multiple methodologies to collect prompt data from AI platforms like ChatGPT, Perplexity, Google AI Overviews, and others, including browser automation and official platform APIs.
How do I create and use customer personas in Scrunch?
Scrunch allows users to create customer personas based on unique characteristics and geographies and either auto-generate prompts based on those personas or assign personas to existing prompts for targeted tracking and filtering.
Which AI platforms and LLMs can Scrunch track and monitor?
Scrunch currently supports eight major AI platforms: ChatGPT, Claude, Gemini, Perplexity, Google AI Mode, Google AI Overviews, Meta AI, and Microsoft Copilot. Support for Grok is coming soon.