caliper_evals_runs_item_execution

shallow

ai.zerowidth/caliper · Verify this server

What the flow actually DID on one run item: every step in order (what it said, which tools it called with what arguments, what came back) and the final answer, plus status, duration, and cost. Read this when a low score needs explaining beyond the judge's reasoning — a wrong tool call or an empty tool result is usually the cause, and the fix is different from a prompt fix. Pass the run item's `id` (NOT `itemId`) from caliper_evals_runs_get. Items whose outputs were supplied from outside (external evals) have no trace and return not_found. Steps are capped for transport; the run page in Caliper has the full record.

100.0/100

1 trials · measured 1 day ago

caliper_evals_runs_item_execution scores 100.0/100 on Vouch's measured behaviour index, from 1 real invocation trials against ai.zerowidth/caliper, measured 20 Oct 2026 under methodology v0.2.0. Every measured component scored 100.

Component breakdown

ComponentWeightValue
Reliability35%not applicable
Schema integrity25%100.0
Failure behaviour15%not applicable
Latency15%not applicable
Concurrency10%not applicable

Tool details

Transport
remote
Credential class
open
Input schema
not declared
Output schema
not declared
Side-effect classification
unclassified

Score history

DayScoreTierMethodology
2026-10-20100.0shallowv0.2.0

Probe evidence

ProbeOutcomes
schema_integritypass: 1

Raw request/response logs are not archived yet — the outcome counts above are drawn directly from every recorded trial.

Embed this score

Available for every tool, scored or not — not a verification perk. Always links back to this page.

Vouch score: caliper_evals_runs_item_execution
[![Vouch score](https://vouch.tools/api/tools/9ceb9ce6-e471-425a-92ab-14e35a2689cb/badge.svg)](https://vouch.tools/tools/9ceb9ce6-e471-425a-92ab-14e35a2689cb)
caliper_evals_runs_item_execution — Vouch