evaluate_tool_risk
shallowio.github.MM-sheng/404-directory · Verify this server
Make a contextual allow, review, or block decision before an AI Agent installs or invokes a third-party tool registered in 404.directory. Use this immediately before installation or first use, and again when permissions, data sensitivity, execution mode, or evidence changes. The decision cites ownership, lifecycle, verification history and freshness, compatibility, security, and observed-usage evidence; missing evidence never counts as safe. Stores a bounded receipt without prompts or payloads and returns a one-time outcome token so the Agent can later report whether it proceeded, changed tools, requested review, or aborted. Does not execute or freshly probe the target and is not a security guarantee.
1 trials · measured 2 days ago
evaluate_tool_risk scores 100.0/100 on Vouch's measured behaviour index, from 1 real invocation trials against io.github.MM-sheng/404-directory, measured 31 Aug 2026 under methodology v0.2.0. Every measured component scored 100.
Component breakdown
| Component | Weight | Value |
|---|---|---|
| Reliability | 35% | not applicable |
| Schema integrity | 25% | 100.0 |
| Failure behaviour | 15% | not applicable |
| Latency | 15% | not applicable |
| Concurrency | 10% | not applicable |
Tool details
- Transport
- remote + stdio
- Credential class
- open
- Input schema
- not declared
- Output schema
- not declared
- Side-effect classification
- unclassified
Score history
| Day | Score | Tier | Methodology |
|---|---|---|---|
| 2026-08-31 | 100.0 | shallow | v0.2.0 |
Probe evidence
| Probe | Outcomes |
|---|---|
| schema_integrity | pass: 1 |
Raw request/response logs are not archived yet — the outcome counts above are drawn directly from every recorded trial.
Embed this score
Available for every tool, scored or not — not a verification perk. Always links back to this page.
[](https://vouch.tools/tools/2d528927-3101-49a3-8974-5babf7b03cb6)