An open, framework-agnostic format for what a test run produced — the
.evidence pack, and the library + CLI that validate and seal it.
One shape, whatever made it — a browser agent, a Playwright suite, a Jest run, an API check. An evidence pack is readable by a CI dashboard, an auditor, or a human without knowing the framework that wrote it.
# As a library (Node 18+)
npm install @testmuai/evidence-cli
# Or the CLI, globally
npm install -g @testmuai/evidence-cliimport { validate, finalize } from "@testmuai/evidence-cli";
// Validate a pack — a directory or a sealed .evidence zip — against a profile.
const report = await validate("my-run.evidence", { profile: "L1" });
if (!report.valid) {
for (const d of report.diagnostics) {
console.error(`${d.severity} ${d.location}: ${d.message} [${d.code}]`);
}
}
// Seal a live directory into a flat, range-addressable .evidence zip (atomically).
const { totals, sealedPath } = await finalize("my-run.evidence", {
endedAt: new Date().toISOString(),
});The package ships type definitions; validate and finalize are the load-bearing
entry points, and the pack container types (openContainer, RemoteZipContainer,
…) are exported for reading packs directly — including ranged reads from a blob
store.
evidence validate my-run.evidence --profile L0 # check a directory OR a sealed .evidence zip
evidence validate my-run.evidence --profile L1 # L1 = L0 + the captured-artifact layer
evidence finalize my-run.evidence/ # roll up totals, hash definitions, seal → .evidenceExit codes: 0 valid · 1 invalid · 2 usage error. Add --json for a
machine-readable report.
A pack is a <name>.evidence/ directory (which zips to a <name>.evidence file),
anchored by a top-level run.yaml. At L0 — the minimal profile — only three
artifacts are load-bearing:
<name>.evidence/
run.yaml # required — manifest anchor (run identity, lifecycle, derived totals)
tests/<id>/
<definition> # required, OPAQUE — the framework's own artifact (a Markdown spec, *.spec.ts, an API suite, …)
result.yaml # required — structured per-step outcomes
evidence-cli knows nothing about any framework's definition format. It references and hashes the definition; it never parses it. The format scales by adding optional files and profiles — never by rewriting the L0 core.
- L0 — the minimal, framework-neutral core (above).
- L1 — purely additive: keeps all of L0 and adds the captured evidence artifacts (per-test execution logs and step screenshots, a global coverage directory; video optional).
Version and profile are different axes: a profile only adds requirements and
never changes the version; only a breaking change to an existing meaning bumps
evidence (0.1 → 0.2).
evidence-cli is governed by a living decision log. The design/
directory holds the decisions (proposition → options → decision → reasoning),
the contract, and a web viewer that renders all of it. The JSON
Schemas — the single source of truth, consumed by both the validator and the
viewer — live under src/schemas/0.1/.
The decision is the unit of work. Code is downstream of it. No code lands without a decision; no change lands without updating the structure.
Browse it locally with npm run docs. See GOVERNANCE.md.
- Community: Join us on Discord — questions, discussion, and release announcements.
- Issues / bug reports: GitHub Issues
- Contributing: see CONTRIBUTING.md — every change starts with a decision.
- Security: see SECURITY.md.
- Changelog: CHANGELOG.md.
On January 12, 2026, LambdaTest evolved to TestMu AI, an autonomous Agentic AI Quality Engineering Platform. Same team, same infrastructure, same accounts — existing logins, scripts, and integrations continue to work. Find the new home at testmuai.com.
Apache-2.0 © LambdaTest Inc.