Full-featured online crawler, PageSpeed, W3C, uptime and SEO monitoring

Parameter	How often	Customizable	Turn on/off	Mobile UA	Desktop UA	Alert in case of
Domain
Date expire	weekly	-	+	-	-	expires in less than 30 days
Protocol (HTTP/1, HTTP/2, HTTP/3)	daily	-	+	-	-	changed
Nameservers	weekly	-	+	-	-	changed
SSL expire	daily	-	+	-	-	expires in less than 30 days
DNS BL	weekly	-	+	-	-	record found
Robots.txt
Parameter	How often	Customizable	Turn on/off	Mobile UA	Desktop UA	Alert in case of
Content	weekly	-	+	-	+	changed or Not Found
Sitemap(s)
Parameter	How often	Customizable	Turn on/off	Mobile UA	Desktop UA	Alert in case of
Items count (links or sub sitemaps)	daily	+	+	-	+	Empty content or not found
URL (page)
Parameter	How often	Customizable	Turn on/off	Mobile UA	Desktop UA	Alert in case of
Google "PageSpeed"	twice a day	-	+	+	+	No Alerts the results are not permanent
W3C	twice a day	-	+	-	-	No Alerts
http status	twice a day	+	-	+	+	http status differs from expected
redirect url (if http status = 301, 302 or 307)	twice a day	+	+	+	+	redirect url differs from expected
response time	~ every 10 minutes	+	+	+	+	response time differs from expected
title	twice a day	-	+	+	+	title differs from expected
title count	twice a day	-	+	+	+	title count differs from 1
h1 (max 6 items on page)	twice a day	-	+	+	+	changed
h1 count	twice a day	-	+	+	+	changed
h2 (max 6 items on page)	twice a day	-	+	+	+	changed
h2 count	twice a day	-	+	+	+	changed
h3 (max 6 items on page)	twice a day	-	+	+	+	changed
h3 count	twice a day	-	+	+	+	changed
link canonical	twice a day	-	+	+	+	changed
link canonical count	twice a day	-	+	+	+	link canonical count > 1
canonical in http headers	twice a day	-	+	+	+	changed
hreflang (hreflang + href)	twice a day	-	+	+	+	changed
hreflang count	twice a day	-	+	+	+	changed
hreflang in http headers	twice a day	-	+	+	+	changed
meta robots	twice a day	-	+	+	+	changed
meta robots count	twice a day	-	+	+	+	changed
robots in http headers	twice a day	-	+	+	+	changed
meta description	twice a day	-	+	+	+	changed
meta description count	twice a day	-	+	+	+	meta description count > 1
meta keywords	twice a day	-	+	+	+	changed
meta keywords count	twice a day	-	+	+	+	meta keywords count > 1
og title	twice a day	-	+	+	+	changed
og title count	twice a day	-	+	+	+	og title count > 1
og descriptions	twice a day	-	+	+	+	changed
og descriptions count	twice a day	-	+	+	+	og descriptions count > 1
og descriptions	twice a day	-	+	+	+	changed
custom regex (max 6 items on page) each received value cannot exceed 255 characters	twice a day	+	+	+	+	changed
tag <noindex> or <!--noindex--> count	twice a day	-	+	+	+	changed
data-nosnippet tag count	twice a day	-	+	+	+	changed
Yandex Metrika ID	twice a day	-	+	+	+	changed
Google Analytics ID	twice a day	-	+	+	+	changed
microdata json + html	twice a day	-	+	+	+	changed

You will have access to the artifacts if the requested URL returns text or text/html and the data is changed. We store request headers, response headers, response body that are not related to the time check.

You can set:

User agent (desktop, mobile)
Concurrency
Delay between requests
Ignore robots.txt rules or respect them
Follow or ignore nofollow links
Enable or disable JavaScript execution
Custom request headers
Parseable mime types/content types
Ignore URLs by ending
Ignore URLs containing specific characters
Ignore specific paths
Crawl from a URL list
Crawl from a sitemap

Available data analysis options:

Duplicate value search
Uppercase value search
Lowercase value search
Punctuation character search
Numeric value search

You will be able to use the following operators:

!=
=
<
>
>=
<=
empty
not empty
in
not in
start with
not start with
end with
not end with
contain
not contain
str length less
str length greater
str length =

What data do we collect and analyze during crawling:

url, found on, http status, redirect to, content-type, last modified, http version, title, date, h1 1, h1 2, h1 3, h1 4, h1 5, h1 6, h2 1, h2 2, h2 3, h2 4, h2 5, h2 6, h3 1, h3 2, h3 3, h3 4, h3 5, h3 6, meta descriptions, meta keywords, canonical, robots, http canonical, http robots, og title, og descriptions, metrika, google analytics, hreflang, http hreflang, title count, h1 count, h2 count, h3 count, meta descriptions count, meta keywords count, canonical count, og title count, og descriptions count, http hreflang count, nosnippet count, noindex count, hreflang count, robots count, internal links count, internal links depth sum, depth

The service was created by SEO specialists for SEO specialists. Our mission is to help you track website changes quickly and reliably. You should not have to discover critical changes from Google Search Console after the fact.

Introducing our cutting-edge cloud-based crawler, 2-UA. It offers an extensive range of features to optimize your website's performance and keep everything running smoothly, on par with industry standards.

Key Advantages:

Cloud-Based Technology: 2-UA operates entirely in the cloud, eliminating the need for complex installations and allowing for effortless accessibility from any device or location.
Comprehensive Crawling: Our crawler thoroughly examines every aspect of your website, from page content to metadata, ensuring no stone is left unturned.
Real-Time Detection: With lightning-fast detection capabilities, 2-UA promptly identifies changes on your website, enabling swift response to any updates or issues.
User-Agent Flexibility: Seamlessly switch between mobile and desktop user-agents to accurately assess your website's performance across various devices and platforms.
Customizable Reporting: Tailor reports to suit your specific needs, with detailed insights into crawl data, errors, and performance metrics.
Continuous Monitoring: Keep a vigilant eye on your website's health with automated monitoring features, ensuring optimal performance at all times.

Experience the power and efficiency of 2-UA, the ultimate solution for comprehensive website crawling and analysis.

Track overall page response time with average and percentile metrics (25, 50, 75, 90, 99), separately for mobile and desktop headers
Track response times by day, or use average and percentile metrics for longer periods, separately for mobile and desktop headers
View data-level change history
Export change history data
Search by data
View full-page change history

Google PageSpeed

We check pages expected to return HTTP status 200 OK.

Performance
Accessibility
Best practices
SEO
PWA
LCP
CLS
FCP
INP
TTFB

We collect audit history

Comprehensive SEO Service

Who are we?

Domain

Robots.txt

Sitemap(s)

URL (page)

Key Advantages:

Google PageSpeed

Comprehensive SEO Service

Who are we?

What we are checking

Domain

Robots.txt

Sitemap(s)

URL (page)

Full-featured crawl

Who is this service for?

Key Advantages:

What features does 2-ua.com provide?

Google PageSpeed