How to compare two crawl runs

Use crawl comparison when you want to verify that two crawl configurations return the same SEO-critical output (status, canonicals, titles, headings, indexation signals, and more).

Compare HTML crawl vs JavaScript-rendered crawl

1. Run a crawl with your baseline settings and wait until it is completed.
2. Run a second crawl with the same settings, but enable Execute JavaScript.
3. Wait until the second crawl is completed.
4. Open the Crawls page for your website.
5. Select the two crawl jobs and click Compare.
6. Review the summary and drill down into differences by filters and affected URLs.

   

How to compare the mobile and desktop versions of the website

If content or markup differs by device type, compare mobile and desktop crawl outputs before and after releases.

1. Run a desktop-oriented crawl and wait for completion.
2. Run a second crawl for mobile rendering (or set a mobile User-Agent in Response headers).
3. Wait for completion.
4. Open the Crawls page.
5. Select both crawl jobs and click Compare.
6. Use the comparison report to validate parity (or intentionally document expected differences).