start_eval_attempt

shallow

org.aioq/aio · Verify this server

Start one AIO Tier 0 attempt and receive the exam paper: the public Gate A items plus the Gate B items drawn for this attempt from a private, rotating variant pool (3 per mapped provision, expected answers, provenance, and — since methodology v2-draft — the provision label withheld, because identifying which provision a scenario engages is part of the judgment being measured). Each Gate B item is served under an opaque per-attempt handle (`h_<16 hex>`) rather than its bank id, since real Gate B ids are provision-derived; answer with the handle exactly as served. Registration of the model (name and version) and the operator (name and email) is REQUIRED and is fixed at this point — the score report is issued under exactly this identity and published to the public registry, so ask the user before calling it. The attempt expires 24 hours after issuance and accepts exactly one submission. Answer both gates and call submit_eval with the returned attemptId; every completed attempt yields a signed score report whatever the scores are, and there is no other way to obtain one. Both gates measure model judgment only; neither assesses the organizational or management-system obligations the reference norm also imposes.

100.0/100

1 trials · measured 8 days ago

start_eval_attempt scores 100.0/100 on Vouch's measured behaviour index, from 1 real invocation trials against org.aioq/aio, measured 25 Aug 2026 under methodology v0.2.0. Every measured component scored 100.

Component breakdown

ComponentWeightValue
Reliability35%not applicable
Schema integrity25%100.0
Failure behaviour15%not applicable
Latency15%not applicable
Concurrency10%not applicable

Tool details

Transport
remote
Credential class
open
Input schema
not declared
Output schema
not declared
Side-effect classification
unclassified

Score history

DayScoreTierMethodology
2026-08-25100.0shallowv0.2.0

Probe evidence

ProbeOutcomes
schema_integritypass: 1

Raw request/response logs are not archived yet — the outcome counts above are drawn directly from every recorded trial.

Embed this score

Available for every tool, scored or not — not a verification perk. Always links back to this page.

Vouch score: start_eval_attempt
[![Vouch score](https://vouch.tools/api/tools/38e8a181-f6fa-47fd-820d-5cebc6fef0f2/badge.svg)](https://vouch.tools/tools/38e8a181-f6fa-47fd-820d-5cebc6fef0f2)
start_eval_attempt — Vouch