test_robots

shallow

dev.onpage/onpage · Verify this server

Test a URL against the site's live robots.txt for one or more crawlers, using Google's matching rules (most specific user-agent group, longest matching rule, Allow wins ties, * and $ wildcards). Returns allowed or blocked per crawler and the exact rule that decides it. Optionally test a proposed robots.txt instead of the live one.

100.0/100

1 trials · measured 2 days ago

test_robots scores 100.0/100 on Vouch's measured behaviour index, from 1 real invocation trials against dev.onpage/onpage, measured 6 Oct 2026 under methodology v0.2.0. Every measured component scored 100.

Component breakdown

ComponentWeightValue
Reliability35%not applicable
Schema integrity25%100.0
Failure behaviour15%not applicable
Latency15%not applicable
Concurrency10%not applicable

Tool details

Transport
remote
Credential class
self-provisionable
Input schema
not declared
Output schema
not declared
Side-effect classification
unclassified

Score history

DayScoreTierMethodology
2026-10-06100.0shallowv0.2.0

Probe evidence

ProbeOutcomes
schema_integritypass: 1

Raw request/response logs are not archived yet — the outcome counts above are drawn directly from every recorded trial.

Embed this score

Available for every tool, scored or not — not a verification perk. Always links back to this page.

Vouch score: test_robots
[![Vouch score](https://vouch.tools/api/tools/15751bdb-c274-4144-9681-2f26c90c7327/badge.svg)](https://vouch.tools/tools/15751bdb-c274-4144-9681-2f26c90c7327)