robots_txt

shallow

dev.onpage/onpage · Verify this server

robots.txt for search and AI crawlers. Pick with mode: test = Which crawlers may fetch a URL, and the rule that decides. Needs url. ai_policy = Rules per AI crawler: allow AI search, block training. Needs url, policy.

100.0/100

1 trials · measured today

robots_txt scores 100.0/100 on Vouch's measured behaviour index, from 1 real invocation trials against dev.onpage/onpage, measured 20 Oct 2026 under methodology v0.2.0. Every measured component scored 100.

Component breakdown

ComponentWeightValue
Reliability35%not applicable
Schema integrity25%100.0
Failure behaviour15%not applicable
Latency15%not applicable
Concurrency10%not applicable

Tool details

Transport
remote
Credential class
self-provisionable
Input schema
not declared
Output schema
not declared
Side-effect classification
unclassified

Score history

DayScoreTierMethodology
2026-10-20100.0shallowv0.2.0

Probe evidence

ProbeOutcomes
schema_integritypass: 1

Raw request/response logs are not archived yet — the outcome counts above are drawn directly from every recorded trial.

Embed this score

Available for every tool, scored or not — not a verification perk. Always links back to this page.

Vouch score: robots_txt
[![Vouch score](https://vouch.tools/api/tools/6a215012-bf0a-4e93-a577-3b6e1f7e621f/badge.svg)](https://vouch.tools/tools/6a215012-bf0a-4e93-a577-3b6e1f7e621f)
robots_txt — Vouch