run_flow_autotest

shallow

ai.flowcastle/flowcastle · Verify this server

Runs deterministic behavioural tests against flows that are ALREADY applied (compiles them to an AST and simulates a user). Call after apply_actions to verify a build; read `summary` and the failed checks, patch with apply_actions, re-run. Mutates nothing. The smoke layer runs on its own with no input: it walks every entry, taps every button, answers every input step, and reports crashes, dead buttons, unresolved placeholders, and values the bot failed to store. Pass `scenarios` to also replay specific user journeys (at most 6) — that is the only way to assert exact texts or exact stored values. Returns { passed, smoke, scenarios, summary }. `passed` is false when any check or scenario failed; a `summary` saying coverage is "none" means nothing was testable, so a green verdict there proves nothing. Nothing is sent to real users and no state is written.

100.0/100

1 trials · measured 2 days ago

run_flow_autotest scores 100.0/100 on Vouch's measured behaviour index, from 1 real invocation trials against ai.flowcastle/flowcastle, measured 31 Aug 2026 under methodology v0.2.0. Every measured component scored 100.

Component breakdown

ComponentWeightValue
Reliability35%not applicable
Schema integrity25%100.0
Failure behaviour15%not applicable
Latency15%not applicable
Concurrency10%not applicable

Tool details

Transport
remote
Credential class
self-provisionable
Category
Developer infrastructure
Input schema
not declared
Output schema
not declared
Side-effect classification
unclassified

Score history

DayScoreTierMethodology
2026-08-31100.0shallowv0.2.0

Probe evidence

ProbeOutcomes
schema_integritypass: 1

Raw request/response logs are not archived yet — the outcome counts above are drawn directly from every recorded trial.

Embed this score

Available for every tool, scored or not — not a verification perk. Always links back to this page.

Vouch score: run_flow_autotest
[![Vouch score](https://vouch.tools/api/tools/2b45997e-8199-436b-8b36-68731559f37a/badge.svg)](https://vouch.tools/tools/2b45997e-8199-436b-8b36-68731559f37a)
run_flow_autotest — Vouch