Crawlytics vs Scrunch AI: Scrunch (now a Sitecore product) does share-of-voice and edge serving; Crawlytics adds llms.txt and WebMCP commerce from $29.99/mo.
Quick answer
Scrunch AI is the closest competitor Crawlytics has. As of June 2026, Scrunch does prompt-sampling share-of-voice across AI engines, Agent Traffic (reads your bot logs), AXP edge middleware that serves stripped-down clean HTML to agents, and page-level readiness audits — and it was just acquired by Sitecore (reported ~$225M, around June 3 2026), rebranding scrunchai.com to scrunch.com and moving enterprise. Crawlytics covers the two things Scrunch does not do: it generates and serves llms.txt + llms-full.txt + per-page /md/ versions, and it runs WebMCP agent commerce with conversion attribution across Stripe, Paddle, Lemon Squeezy, PayPal, and Square — all self-serve at $29.99-$49.99/mo. They overlap on bot tracking and clean-HTML-to-agents. Pick Scrunch for enterprise share-of-voice inside Sitecore. Pick Crawlytics for self-serve llms.txt, WebMCP commerce, and log-grounded bot analytics at a flat sub-$50 price. Run both if you want share-of-voice and the publish/transact layer.
Of all the comparisons I write, this is the one with the most genuine overlap. Scrunch AI (scrunch.com) and Crawlytics both read your AI-bot traffic and both serve a cleaned-up version of your site to agents. That puts Scrunch closer to Crawlytics than any of the pure share-of-voice monitors. But two things separate them, and a third thing — the Sitecore acquisition — just changed the math for anyone weighing the two.
Below: what Scrunch actually does (including what the acquisition means), what Crawlytics does, where the two truly overlap, where Scrunch wins, where Crawlytics wins, the pricing reality, and a decision by buyer type. Full disclosure up front — Crawlytics published this post, so I'll be specific about where Scrunch is the better tool.
Scrunch is a broad AI-visibility platform, and as of June 2026 it does four distinct jobs:
What Scrunch does not do, as of June 2026: it does not generate or serve an llms.txt file, and it does not offer a WebMCP or agent-commerce layer. Those are the two surfaces where Crawlytics has no overlap with it.
The Sitecore acquisition changes the buyer. Sitecore acquired Scrunch AI in a deal reported at roughly $225M around June 3 2026 (as of June 2026). Scrunch is rebranding scrunchai.com to scrunch.com and folding into Sitecore's enterprise digital-experience platform. That is a strong outcome for Scrunch and a signal the category is real — but it also points the product upmarket. Enterprise DXP suites are sold to large brands with implementation budgets, not to a solo operator who wants to flip on llms.txt this afternoon. The affordable, self-serve lane Scrunch used to court is the lane it is now vacating, and that is exactly where Crawlytics sits.
Crawlytics is an AI-agent-readiness stack with a different center of gravity: detect, serve, sell.
Detect. It tracks AI bots and agents from your server logs — 25-plus signatures across 19 providers, sorted into intent tiers, classified in sub-millisecond regex. Because it both reads your logs and generates your llms.txt, it can show you an llms.txt Coverage Gap: pages you declared that no bot has actually fetched. A monitor that only reads logs, or only publishes files, structurally can't close that loop.
Serve. This is the biggest single difference from Scrunch. Crawlytics generates and serves llms.txt and llms-full.txt, plus a per-page /md/ markdown version of every page, and it serves AI-optimized clean HTML to AI user-agents (Googlebot excluded). Scrunch's AXP serves clean HTML at the edge but does not publish the llms.txt protocol files. If you want the standard discovery files agents look for, Crawlytics is the tool that emits them.
Sell. Crawlytics' Commerce tier adds a WebMCP snippet that exposes your site's actions to in-browser agents and attributes conversions back across five payment providers — Stripe, Paddle, Lemon Squeezy, PayPal, and Square — using client-observed events plus signed webhooks, with a lead-gen path for non-commerce sites. WebMCP is still a draft, emerging spec: no browser ships it on by default today, and the real invokers as of June 2026 are Perplexity's Comet browser, some extensions, and custom agents. You can see it running live on staystrat.com, a real store on the Commerce stack. Scrunch has no equivalent.
And there's a free front door: the Agent-Ready Grader runs a live scan and scores five categories — Discoverability, Content Accessibility, Bot Access Control, Protocol Discovery, and Attribution — with no signup for the public score.
Three areas, and they're real:
/md/ serving both exist to hand agents a readable, lightweight version of your pages instead of your full marketing DOM. Different delivery mechanisms, same goal.If those three jobs are your whole list, the two tools are genuinely substitutable on that slice — and the decision comes down to share-of-voice (Scrunch's strength) versus llms.txt plus WebMCP plus price (Crawlytics' strength).
Three places Scrunch is straightforwardly the better choice, and I wouldn't pretend otherwise:
This is the big one. Scrunch samples AI engines with buyer prompts and charts your brand's mention rate against named competitors over time. Crawlytics does not do this — it has no prompt-sampling layer and measures your logs and crawl set instead. If your core question is "what share of AI answers mention us versus our rivals," Scrunch answers it and Crawlytics does not. Treat any vendor's share-of-voice numbers as directional rather than exact, but the capability itself is real and it's Scrunch's, not Crawlytics'.
Scrunch's AXP serves agents a stripped-down version of your pages at the edge, with large reported payload reductions. Crawlytics serves clean HTML and per-page markdown too, but Scrunch built theirs as edge middleware, which is an architecture some teams will prefer for latency and for sites already fronted by a CDN. It's newer and more limited as of June 2026, but it's a credible approach to the same problem.
Post-acquisition, Scrunch plugs into Sitecore's digital-experience platform, professional services, and enterprise procurement. If you're a large brand already on Sitecore — or you need SSO, a security review, and an MSA before you can buy anything — that ecosystem is a genuine advantage Crawlytics, a self-serve product, doesn't try to match.
Four places Crawlytics is the better choice, and where Scrunch either doesn't compete or has gone the other direction:
Crawlytics generates llms.txt and llms-full.txt from your sitemap, re-crawls to keep them fresh, and serves them at the stable URLs agents check — plus a per-page /md/ markdown version of every page. Scrunch does not publish the llms.txt protocol files as of June 2026. If you want the discovery files that agents look for by name, this is a clean win for Crawlytics. (For the case for the format itself, see what llms.txt is and why it matters.)
Crawlytics' Commerce tier exposes your site's actions to in-browser agents via a WebMCP snippet and attributes conversions back across Stripe, Paddle, Lemon Squeezy, PayPal, and Square. Scrunch has no agent-commerce layer. If your model includes agents being able to buy on your site — not just read it — Crawlytics is the only one of the two that touches it. Keep expectations honest: WebMCP is a draft spec with a limited real-invoker set today (Comet, some extensions, custom agents), so this is forward-looking infrastructure, not a switch that turns on ChatGPT checkout tomorrow. The WebMCP explainer walks through what actually invokes it.
Crawlytics is $29.99/mo for Visibility and $49.99/mo for Commerce (less on annual), with a 7-day free trial on Commerce, no per-event fees, and a card-not-required public grader. Scrunch was around $250/mo at entry before the acquisition (as of June 2026), and moving into an enterprise suite tends to push pricing up and toward sales-led contracts, not down. For a sub-$50M business, that gap is decisive — and you can start self-serve in minutes instead of routing through procurement.
Crawlytics stores no IP addresses, sets no cookies, and reports aggregate-only — so there's no cookie banner to add for the analytics it provides. That's a deliberate design choice that matters more as privacy regulation tightens, and it's worth confirming against whatever data-handling terms a Sitecore-owned Scrunch publishes for your region.
The price gap is the most concrete difference between these two.
Crawlytics publishes two flat tiers: Visibility at $29.99/mo ($23.99/mo on annual) and Commerce at $49.99/mo ($39.99/mo on annual), with a 7-day free trial on Commerce. Multi-site scales by a simple multiplier — Growth covers 5 sites, Scale covers 25, and Custom is unlimited and contact-priced for agencies. No usage caps, no per-event fees, cancel anytime. The free grader and the live demos are the entry points; there's no free product tier.
Scrunch, as of June 2026, started around $250/mo for its Core plan with higher tiers above it and a 7-day trial. The Sitecore acquisition is likely to move pricing toward enterprise contracting over time rather than self-serve checkout. Confirm current numbers on scrunch.com — they were mid-transition when this was written.
So the realistic comparison is roughly $30-$50/mo self-serve versus $250+/mo and climbing toward enterprise. That difference tracks the buyer each tool is built for.
The honest matrix:
Crawlytics. You want llms.txt published, bots tracked, and a readiness score, without a procurement cycle. The $29.99/mo Visibility tier covers it, and if you sell online the $49.99/mo Commerce tier adds WebMCP. Share-of-voice against competitors is a nice-to-have you can approximate by hand at this size; the publish-and-track layer is the part you actually need.
Scrunch (or another monitor), with Crawlytics for the rest. If the quarterly conversation is "what share of AI answers mention us versus Competitor X," that's Scrunch's job and Crawlytics doesn't do it. Buy Scrunch for that. If you also need llms.txt and WebMCP, add Crawlytics — the overlap is small enough that running both is reasonable.
Scrunch, naturally. The Sitecore integration, enterprise support, and procurement fit make Scrunch the path of least resistance. Crawlytics can still earn a place for the llms.txt protocol files and WebMCP commerce if those are on your roadmap and Sitecore doesn't ship them, but the center of gravity is Scrunch.
Crawlytics. WebMCP agent commerce with conversion attribution is the deciding feature, and Scrunch has no equivalent. Pair it with the free grader and a live look at staystrat.com to see the Commerce stack running, then check the tiers on the pricing page.
Written by Crawlytics Team. Crawlytics tracks AI bots, generates llms.txt, and powers WebMCP commerce, all from one snippet on any stack. See how it works →
Scrunch AI is a share-of-voice monitor with agent-traffic logs and edge middleware that serves clean HTML to agents, now owned by Sitecore and moving enterprise; Crawlytics is a self-serve AI-readiness stack that generates and serves llms.txt, runs WebMCP agent commerce, and tracks bots from your logs at $29.99-$49.99/mo.
For an enterprise team that needs prompt-sampling share-of-voice and already lives in the Sitecore ecosystem, yes — Scrunch is one of the more complete platforms in the category as of June 2026. For a smaller team that mainly needs llms.txt, bot analytics, and a flat price, it is likely more tool and more cost than the job requires.
No. Crawlytics does not sample AI engines or chart your brand mention rate against competitors. It measures your own server logs and your own published pages instead of a vendor-chosen prompt list. If share-of-voice is your core need, Scrunch or another monitor is the better fit, and you can run Crawlytics alongside it for the parts Scrunch does not cover.
Sitecore acquired Scrunch AI in a deal reported at roughly $225M around June 3 2026, as of June 2026. Scrunch is rebranding scrunchai.com to scrunch.com and folding into Sitecore's enterprise digital-experience suite, which points the product upmarket and away from the affordable self-serve buyer.
Yes, and the overlap is small enough that some teams do. Scrunch covers share-of-voice and its AXP edge layer; Crawlytics covers llms.txt generation and serving, WebMCP agent commerce, and log-grounded bot analytics. The honest split is monitor on Scrunch, publish and transact on Crawlytics.
This page is part of Crawlytics.app. View all pages: llms.txt · llms-full.txt