Date Range Comparison
Measure growth and spot trends
Select any two time periods and compare them side by side. Crawlytics calculates percentage changes across every metric — total requests, LLM bot hits, individual providers, and page-level traffic. Spot which AI companies are increasing their crawling, which pages are gaining traction, and whether your llms.txt strategy is working.
Custom date ranges
Pick any start and end date, or use presets: Today, 7d, 30d, 90d, This month, Last month, This quarter.
Automatic previous period
Toggle comparison mode and the system automatically calculates the equivalent previous period.
Percentage change on everything
Every stat card, table row, and metric shows the delta with green (up) or red (down) indicators.
Provider-level comparison
See which AI companies increased or decreased their crawling between periods.
Page-level comparison
Identify which pages gained or lost AI attention. Spot new pages being discovered.
Single API call
The /api/compare endpoint fetches both periods in one request — efficient for dashboards.
How comparison works
When you select a date range (e.g., March 1-15), comparison mode automatically sets the previous period to the same duration immediately before (Feb 13-28). Both ranges are fetched in parallel from the service API. The dashboard then calculates deltas and percentage changes for every metric and renders them inline next to the current values.
Use cases
Date comparison helps answer questions like: "Is OpenAI crawling us more this month than last?" "Did our new blog posts get picked up by AI?" "Has our overall AI visibility improved since we added llms.txt?" "Which provider showed the biggest growth this quarter?" These insights help you understand the ROI of your AI-readiness strategy.
API support
The comparison feature is fully supported at the API level. The service exposes a /api/compare endpoint that accepts startA, endA, startB, endB parameters and returns both periods' data in a single response. This is also available for Looker Studio or custom dashboard integrations.
FAQ
Frequently asked questions
The dashboard's auto-comparison uses the equivalent previous period, but the API accepts any two arbitrary date ranges. You could compare January to June, or last year to this year, by calling the /api/compare endpoint directly.
As far back as your tracking database has data. SQLite stores everything locally with no expiration. BigQuery and Google Sheets also retain all historical data unless you configure cleanup policies.
Currently, comparison is per-site. The dashboard shows comparison data when you drill into a specific site. Cross-site comparison (e.g., "did Site A grow faster than Site B") is on the roadmap.