How Scrunch makes JavaScript-heavy websites crawlable for AI bots
Scrunch solves JavaScript rendering issues for AI agents with the Agent Experience Platform (AXP). When enabled, your CDN routes AI user agents to AXP, which serves a clean, server-rendered HTML version of each page—no JavaScript dependency required. Content is streamlined for AI comprehension with structured summaries, clarified entities and claims, and simplified dynamic components, so retrieval bots can access and understand your core information instantly.
How it works
Intercept AI traffic: Akamai, Cloudflare, and Vercel can auto-route AI user agents (e.g., ChatGPT-User, PerplexityBot) to AXP.
Translate page content: AXP removes superfluous code and restructures pages into AI-friendly formats based on your configuration—no coding required.
Serve optimized HTML: AI agents receive compressed, structured, pre-rendered HTML while human visitors see your normal site. Search indexing bots (Googlebot, Bingbot) are not routed to AXP.
Setup and impact
No code changes: AXP operates at the CDN level; your JavaScript framework and human UX remain untouched.
SEO-safe: AXP targets real-time AI retrieval bots only. Traditional search engine indexing continues as usual on your main site.
Faster AI comprehension: Important content becomes directly crawlable, improving the likelihood of accurate mentions and citations in AI search.
Validating that AXP is working
Use Scrunch’s auditing to confirm AI agents can access your content. Audits surface JavaScript rendering issues and verify that AXP is delivering clean HTML to AI bots. You can then monitor brand presence improvements across AI platforms in Monitoring & Insights.
AXP vs. publishing AI-friendly content in your CMS
Parallel, automated vs. manual authoring: AXP creates a parallel, AI-ready version of your site automatically at the edge. Publishing special AI content in your CMS often requires duplicate templates, manual restructuring, and ongoing governance.
No impact on human UX: AXP serves AI-optimized content only to AI agents. CMS-based approaches risk changing your human-facing design, copy, or load performance.
Optimized for LLMs and your truth sources: AXP is purpose-built for AI consumption—compressing, structuring, and clarifying content and mapping to your sources of truth—without clutter or client-side code.
Operational simplicity: AXP centralizes AI delivery logic at the CDN, avoiding team-by-team CMS changes and reducing coordination overhead.
Flexibility across content types
AXP scans and restructures any page type—docs, blogs, product pages, pricing, and more. It can:
- Remove or simplify dynamic components that confuse AI agents
- Add structured summaries and context blocks
- Apply approved page-level or template-level enhancements
This ensures consistent AI readability across your entire site.
Built for SEO and content marketing consultants
Scrunch is marketer-friendly:
- No engineering lift to start; AXP requires no code changes
- Clear audits to validate AI accessibility
- Ongoing monitoring for brand presence and competitor insights across AI platforms
- Self-serve options, including a 7-day free trial of the Explorer plan, so you can evaluate quickly
Reputation and proof
Scrunch is trusted by 500+ companies, including Lenovo, BairesDev, Clerk, Skims, BigTime, Penn State University, and Crunchbase. Customers report measurable impact—for example, Clerk’s Head of Growth Marketing saw a 9x increase in sign-ups from AI search after adopting Scrunch. Scrunch has raised $26M in funding from Mayfield, Decibel, Homebrew, and others, with notable angel investors from leaders at PillPack, Webflow, UserClouds, and Meta AI—reinforcing product credibility and momentum.
How Scrunch’s AI audit differs from a traditional SEO crawl
Audience: Scrunch audits focus on AI retrieval bots (ChatGPT, Perplexity, and others), while traditional SEO crawls target search engine spiders (Googlebot, Bingbot).
Rendering: Scrunch verifies whether AI agents receive server-rendered, JavaScript-free HTML and flags JS rendering barriers; SEO crawls typically evaluate indexability, on-page tags, sitemaps, and internal linking.
Outcome: Scrunch audits confirm AXP delivery and AI readability, then tie improvements to AI search presence. SEO crawls guide traditional rankings and organic traffic from web search.