Scrunch detects AI bot traffic through direct integrations with your CDN or hosting provider. These connections capture real-time bot requests that never show up in traditional analytics, then classify them by bot type and platform so you can see which AI agents are accessing your content, what they’re requesting, and how often.
Scrunch distinguishes between: - Training bots that collect data to improve model performance - Indexer bots that crawl content to build searchable indexes - Retrieval bots that fetch content in real time to answer user prompts
Once your CDN or host is connected, the Agent Traffic tab shows: - Bot traffic trends over time, broken down by specific AI models (e.g., ChatGPT, Perplexity) - Request type classification (training, indexing, retrieval) - Top bot agents and the webpages they access most - Human vs. AI bot traffic comparisons - Real-time monitoring of the most recent bot requests
This visibility helps you understand which AI platforms actively engage with your content and which bots and pages drive the most AI search visibility.
GA4 and standard pageview-based analytics rarely capture AI bot activity because bots typically don’t execute page scripts. Raw server logs can help, but they’re often noisy, incomplete, and don’t classify requests by AI model or intent.
Scrunch goes beyond both by: - Connecting directly to your CDN/host to monitor AI crawlers in real time, capturing “invisible” bot traffic that powers AI answers but doesn’t trigger pageviews - Classifying requests by bot type (retrieval, indexer, training) and by platform/model - Complementing crawler insights with AI Referrals (via GA4) to show the human visits, conversions, and revenue that arrive from AI platforms
Scrunch separates bot activity from human visits influenced by AI: - Agent Traffic monitors AI crawlers hitting your site in real time through CDN/hosting integrations - AI Referrals connects to your Google Analytics 4 property to track human sessions, views, conversions, revenue, sources, and landing pages attributed to AI platforms
Together, these views show both supply (how often AI systems pull from your content) and demand (how often users arrive from AI).
Scrunch currently supports traffic tracking across eight major AI platforms: - ChatGPT - Claude - Gemini - Perplexity - Google AI Mode - Google AI Overviews - Microsoft Copilot - Meta AI
Support for Grok is coming soon.
Scrunch helps you verify that AI agents can read and use your content—and improve how they do it: - Access and delivery checks with Site Audit to identify issues that may limit AI visibility (access, delivery, or content problems) - Robots.txt and bot accessibility guidance to ensure legitimate AI crawlers aren’t unintentionally blocked - AXP (Agent Experience Platform) to automatically convert your site into an AI-optimized format and deliver it directly to AI agents for clearer understanding and better citations
Tip: Unless your content is paywalled/monetized, allow legitimate AI bots to access your site. The more LLMs can accurately read your content, the better they can represent your brand in AI answers.
Scrunch offers native integrations with major CDN and hosting providers: - Akamai - AWS CloudFront - Cloudflare - Fastly - Vercel - WordPress
If your CMS doesn’t expose raw CDN logs (e.g., HubSpot CMS, BigCommerce, Shopify, Squarespace, Uberflip, Webflow, Wix), you can still integrate via a Cloudflare proxy.