score_forecasts
shallowio.github.beepboop2025/noisefloor · Verify this server
Backtest NoiseFloor's own one-step forecast on chronological historical prefixes, issuing before observing and then updating without hindsight. Use to evaluate forecast_next's coverage and misses; this tool does not accept externally supplied predictions. At least 20 readings are required; shorter valid histories return ok=false. Successful results contain n_forecasts, empirical_coverage, nominal_coverage, score, baseline_score, beats_baseline, records, misses and worst_misses. Scores are mean weighted interval scores in input units (lower is better), compared with fixed historical-error quantiles. Records use zero-based input indices and retain actual, forecast, interval and missed_by. within_coverage_tolerance and its calibrated alias mean observed coverage is within 0.05 of target; they are descriptive, not a certification or significance test. Coverage and favorable scores do not establish future market performance or profitability.
1 trials · measured 1 day ago
score_forecasts scores 100.0/100 on Vouch's measured behaviour index, from 1 real invocation trials against io.github.beepboop2025/noisefloor, measured 20 Oct 2026 under methodology v0.2.0. Every measured component scored 100.
Component breakdown
| Component | Weight | Value |
|---|---|---|
| Reliability | 35% | not applicable |
| Schema integrity | 25% | 100.0 |
| Failure behaviour | 15% | not applicable |
| Latency | 15% | not applicable |
| Concurrency | 10% | not applicable |
Tool details
- Transport
- remote + stdio
- Credential class
- self-provisionable
- Input schema
- not declared
- Output schema
- not declared
- Side-effect classification
- unclassified
Score history
| Day | Score | Tier | Methodology |
|---|---|---|---|
| 2026-10-20 | 100.0 | shallow | v0.2.0 |
Probe evidence
| Probe | Outcomes |
|---|---|
| schema_integrity | pass: 1 |
Raw request/response logs are not archived yet — the outcome counts above are drawn directly from every recorded trial.
Embed this score
Available for every tool, scored or not — not a verification perk. Always links back to this page.
[](https://vouch.tools/tools/002cb162-ed95-4762-9db3-3345ad2ca17d)