Overview of 2-UA crawlers and fetchers

Below is every User-Agent we send from 2-ua.com. Each one carries a link back to this page so you can identify it in your access logs. All crawlers honour robots.txt where applicable and never run aggressive or destructive checks.

2-UAcomBot

Monitoring

Desktop HTTP snapshots for tracked pages and change monitoring (robots.txt-aware).

User-agent token 2-UAcomBot
Full User-Agent string
Mozilla/5.0 (compatible; 2-UAcomBot/1.0; +https://2-ua.com/support/robots)

2-UAcomBot-Mobile

Monitoring

Mobile HTTP snapshots for tracked pages and change monitoring (robots.txt-aware).

User-agent token 2-UAcomBot-Mobile
Full User-Agent string
Mozilla/5.0 (compatible; 2-UAcomBot-Mobile/1.0; +https://2-ua.com/support/robots)

2-UA Page audit

Audit & validators

On-demand fetcher used by the online page audit tool.

User-agent token 2-UA-PageAudit
Full User-Agent string
Mozilla/5.0 (compatible; 2-UA-PageAudit/1.0; +https://2-ua.com/support/robots)

2-UA Schema Validator

Audit & validators

Schema.org structured-data fetcher for the free validator.

User-agent token 2-UA-SchemaValidator
Full User-Agent string
Mozilla/5.0 (compatible; 2-UA-SchemaValidator/1.0; +https://2-ua.com/support/robots)

2-UA Robots Validator

Audit & validators

Fetches robots.txt for the free robots.txt validator.

User-agent token 2-UA-RobotsValidator
Full User-Agent string
Mozilla/5.0 (compatible; 2-UA-RobotsValidator/1.0; +https://2-ua.com/support/robots)

2-UA llms.txt Validator

Audit & validators

Fetches llms.txt for the free llms.txt validator.

User-agent token 2-UA-LlmsTxtValidator
Full User-Agent string
Mozilla/5.0 (compatible; 2-UA-LlmsTxtValidator/1.0; +https://2-ua.com/support/robots)

2-UA Web MCP Validator

Audit & validators

Fetches WebMCP manifests for the free WebMCP validator.

User-agent token 2-UA-WebMCPValidator
Full User-Agent string
Mozilla/5.0 (compatible; 2-UA-WebMCPValidator/1.0; +https://2-ua.com/support/robots)

2-UA Vulnerability Audit

Security

Passive, non-intrusive security risk scanner.

User-agent token 2-UA-VulnerabilityAudit
Full User-Agent string
Mozilla/5.0 (compatible; 2-UA-VulnerabilityAudit/1.0; +https://2-ua.com/support/robots; +safe-passive-scan)

Allow or block 2-UA in robots.txt

By default everything is allowed. You can target a specific bot by its token, or all of them at once with the 2-UA* prefix.

# Block all 2-UA crawlers
User-agent: 2-UAcomBot
User-agent: 2-UAcomBot-Mobile
User-agent: 2-UA-PageAudit
User-agent: 2-UA-SchemaValidator
User-agent: 2-UA-RobotsValidator
User-agent: 2-UA-LlmsTxtValidator
User-agent: 2-UA-WebMCPValidator
User-agent: 2-UA-VulnerabilityAudit
Disallow: /

# Or allow only the monitoring bots and disallow audit fetchers
User-agent: 2-UAcomBot
User-agent: 2-UAcomBot-Mobile
Allow: /

User-agent: 2-UA-PageAudit
Disallow: /

Current month ye@r day *