Platform features

Built for the age of AI search

Everything you need to understand how AI models interact with your content.

Core

LLM Bot Tracking

Identify 20+ AI crawlers in real-time — GPTBot, ClaudeBot, PerplexityBot, Google-Extended, and more. Know exactly which AI company is consuming your content.

Learn more
Core

Automatic Content Generation

Crawl any website via sitemap, convert pages to clean markdown, and generate llms.txt index files. Smart scoring prioritizes your most important content.

Learn more
Analytics

Analytics Dashboard

Real-time traffic charts, bot breakdowns by company, top pages report, and provider market share. Beautiful dashboard with advanced filtering.

Learn more
Scale

Multi-Site Monitoring

Connect unlimited websites to a single dashboard. Each site runs its own service — the dashboard aggregates stats across all of them.

Learn more
Analytics

Date Range Comparison

Compare any two time periods side by side. Track growth with percentage changes across total hits, LLM hits, providers, and individual pages.

Learn more
Security

Enterprise Security

AES-256-GCM encrypted API keys, SSRF protection, rate limiting, timing-safe auth, GDPR-compliant IP hashing, and localhost-only binding.

Learn more

Compatibility

Works everywhere

Deploy on any platform. Crawlytics integrates with your existing infrastructure in minutes.

V
Vercel
C
Cloudflare
N
Netlify
W
WordPress
N
Next.js
E
Express
A
Apache
n
nginx

FAQ

Frequently asked questions

No. Crawlytics runs as a separate service alongside your site. You only add a few nginx proxy rules to route .md and llms.txt requests. Your CMS, code, and existing pages are completely untouched.

You can configure automatic crawling on any schedule (e.g., nightly). Incremental mode only re-processes pages that changed based on sitemap lastmod dates, keeping updates fast even for large sites.

Three options: SQLite (zero setup, works immediately), Google BigQuery (for Looker Studio dashboards), and Google Sheets (simple, shareable). You can switch backends at any time.

Yes. Connect via the JSON API endpoint, CSV export, or directly through BigQuery/Google Sheets as native Looker Studio data sources.