design_eval_suite

shallow

io.aipmlab/ai-pm-lab · Verify this server

Build an evaluation suite for a planned AI feature with AI PM Lab's method: test cases (typical, edge, out of scope, attacks), graders with a judge rubric, pass bars, and a JSON test set. Returns instructions to follow with the user's text.

100.0/100

1 trials · measured 1 day ago

design_eval_suite scores 100.0/100 on Vouch's measured behaviour index, from 1 real invocation trials against io.aipmlab/ai-pm-lab, measured 20 Oct 2026 under methodology v0.2.0. Every measured component scored 100.

Component breakdown

ComponentWeightValue
Reliability35%not applicable
Schema integrity25%100.0
Failure behaviour15%not applicable
Latency15%not applicable
Concurrency10%not applicable

Tool details

Transport
remote
Credential class
open
Input schema
not declared
Output schema
not declared
Side-effect classification
unclassified

Score history

DayScoreTierMethodology
2026-10-20100.0shallowv0.2.0

Probe evidence

ProbeOutcomes
schema_integritypass: 1

Raw request/response logs are not archived yet — the outcome counts above are drawn directly from every recorded trial.

Embed this score

Available for every tool, scored or not — not a verification perk. Always links back to this page.

Vouch score: design_eval_suite
[![Vouch score](https://vouch.tools/api/tools/ff121c69-c718-4de5-b515-4c03e1d000ef/badge.svg)](https://vouch.tools/tools/ff121c69-c718-4de5-b515-4c03e1d000ef)
design_eval_suite — Vouch