ai_crawler_policy_check

shallow

com.papacasper/mcp-toolbelt · Verify this server

Check a site's robots.txt for explicit directives targeting known AI crawlers (GPTBot, ClaudeBot, CCBot, PerplexityBot, Google-Extended, Bytespider, Amazonbot, and others used for LLM training or AI search/answer products), and check for an llms.txt file. Useful for publishers deciding whether their content policy toward AI crawlers matches their intent, or for auditing a competitor's stance.

100.0/100

1 trials · measured 72 days ago

ai_crawler_policy_check scores 100.0/100 on Vouch's measured behaviour index, from 1 real invocation trials against com.papacasper/mcp-toolbelt, measured 11 Sept 2026 under methodology v0.2.0. Every measured component scored 100.

Component breakdown

ComponentWeightValue
Reliability35%not applicable
Schema integrity25%100.0
Failure behaviour15%not applicable
Latency15%not applicable
Concurrency10%not applicable

Tool details

Transport
remote
Credential class
self-provisionable
Category
Communication
Input schema
not declared
Output schema
not declared
Side-effect classification
unclassified

Score history

DayScoreTierMethodology
2026-09-11100.0shallowv0.2.0

Probe evidence

ProbeOutcomes
schema_integritypass: 1

Raw request/response logs are not archived yet — the outcome counts above are drawn directly from every recorded trial.

Embed this score

Available for every tool, scored or not — not a verification perk. Always links back to this page.

Vouch score: ai_crawler_policy_check
[![Vouch score](https://vouch.tools/api/tools/be9cc57b-f9cc-4abf-a289-e409f7365026/badge.svg)](https://vouch.tools/tools/be9cc57b-f9cc-4abf-a289-e409f7365026)
ai_crawler_policy_check — Vouch