Restormel Testing — open source
Restormel Testing is goal-based, workflow-aware testing infrastructure for AI-enabled software. Define what success looks like. Run it locally and in GitHub Actions. Get verdicts you can act on — not just green ticks on selectors.
Model access and policies flow through Restormel Keys; tests run in GitHub Actions or locally with the same contracts.
Goals live in your repo as YAML: a stable id, a browser (or agent) type, human intent, and explicit success criteria the runner can verify — URL, copy, DOM shape, structured fields — not a pile of incidental selectors.
suites:
- id: web-critical
environment: local
goals:
- id: checkout-happy-path
type: browser
description: User completes checkout with AI-generated copy visible.
success_criteria:
url_matches: "/checkout/complete"
text_present:
- "Order confirmed"
dom_signals:
- "main"
structured_checks:
- id: summary_line
path: "css:[data-testid=order-summary]"
expect: "Thank you"Full suite schema, environments, and Keys references: config guide · test definition
Playwright excels at reliable automation; eval suites excel at model scores. Testing ties user-visible outcomes to explicit pass / fail / indeterminate verdicts — so CI fails when the journey breaks, not only when a single selector flakes or a leaderboard shifts.
Same CLI contract on your laptop and in GitHub Actions. Repo-native config, artefacts under the run directory (summaries, JUnit, traces) — no mandatory hosted control plane for the core loop.
Model calls resolve through Restormel Keys — same policies and BYOK posture as production, not a shadow credential system just for tests.
Restormel Testing is MIT licensed. Self-hostable. Forkable. PRs welcome.
CLI, runner, and GitHub Action — open source. Testing Pro: hosted run history, regression dashboard, and deeper suite integration ship as part of the Restormel Platform plan.
The open-source runner stays the source of truth for local and CI. Pro adds hosted visibility and team workflows for organisations standardising on the Restormel suite.
Walk through install, config, and CI with the in-product docs — no placeholder recording required.
50 founding member slots. 12 months Pro free. Direct access to the roadmap.