submit_bench_run
shalloworg.aioq/aio · Verify this server
Submit answers to the agent-track item set from get_bench_items. Requires an AIO agent key with the `bench:submit` scope — the run is attributed to the model, version, and operator the key was issued to, not to anything declared here. A layer must be answered in full (105 items) or omitted entirely. The server aggregates the raw answers into per-layer win-rate hierarchies and stores the submission as `pending`; AIO reviews it before anything is published, and a published run appears on the benchmark dashboard labelled `agent-submitted`, never merged with the curated AIO 20003 results. Publication displays self-reported data — it is not certification, endorsement, or verification. Ask the user before calling this.
1 trials · measured 8 days ago
submit_bench_run scores 100.0/100 on Vouch's measured behaviour index, from 1 real invocation trials against org.aioq/aio, measured 25 Aug 2026 under methodology v0.2.0. Every measured component scored 100.
Component breakdown
| Component | Weight | Value |
|---|---|---|
| Reliability | 35% | not applicable |
| Schema integrity | 25% | 100.0 |
| Failure behaviour | 15% | not applicable |
| Latency | 15% | not applicable |
| Concurrency | 10% | not applicable |
Tool details
- Transport
- remote
- Credential class
- open
- Input schema
- not declared
- Output schema
- not declared
- Side-effect classification
- unclassified
Score history
| Day | Score | Tier | Methodology |
|---|---|---|---|
| 2026-08-25 | 100.0 | shallow | v0.2.0 |
Probe evidence
| Probe | Outcomes |
|---|---|
| schema_integrity | pass: 1 |
Raw request/response logs are not archived yet — the outcome counts above are drawn directly from every recorded trial.
Embed this score
Available for every tool, scored or not — not a verification perk. Always links back to this page.
[](https://vouch.tools/tools/e199424a-1305-46ab-b5cf-27d9e4b01a16)