Skip to content

[rig-sampler] Daily Rig sample report — 2026-08-17 #443

Description

@github-actions

Sample Results

# Sample Status
1 skills/rig/samples/174-changelog-entry-gen.md ✅ succeeded
2 skills/rig/samples/77-env-key-checker.md ✅ succeeded
3 skills/rig/samples/218-ts-interface-conflict-checker.md ✅ succeeded
4 skills/rig/samples/156-regex-pattern-tester.md ❌ failed
5 skills/rig/samples/30-github-action-review.md ✅ succeeded

Sample Outputs

174-changelog-entry-gen.md — ✅ succeeded
{"version":"stub","bumpType":"major","changes":{"breaking":["stub"],"features":["stub"],"fixes":["stub"]},"written":true}
77-env-key-checker.md — ✅ succeeded
{"missing":["stub"],"extra":["stub"],"requiredCount":0,"presentCount":0,"status":"complete"}
218-ts-interface-conflict-checker.md — ✅ succeeded
{"interfaces":{},"conflicts":[{"name":"stub","files":["stub"],"conflictingFields":["stub"]}],"conflictCount":0}
156-regex-pattern-tester.md — ❌ failed

Error: Expected stdin program root agent to have no input (omit input or use input: s.object({})).

No output produced.

30-github-action-review.md — ✅ succeeded
{"title":"stub","body":"stub","labels":["stub"]}

Rig Runtime Logs

The sample-coordinator program was executed via the Rig stub SDK harness (vitest + @github/copilot-sdk stub). The following rig.* JSONL lines were captured on stderr with RIG_DEBUG=agent:invoke,agent:retry,agent:error,agent:failure,agent:close,engine:copilot:create,engine:copilot:close.

Samples are run in order; the stub SDK replaces the real Copilot engine so model names appear as typecheck. Sample 4 (156-regex-pattern-tester.md) failed before agent invocation (the harness rejected it for having a non-empty input schema on a stdin program), so no rig.* lines were emitted for it.

174-changelog-entry-gen.md

{"type":"rig.agent:invoke","data":{"agent":"agent","input":"","model":"typecheck","maxTurns":4}}
{"type":"rig.engine:copilot:create","data":{"model":"typecheck","transport":"uri"}}
{"type":"rig.agent:close","data":{"agent":"agent"}}
{"type":"rig.engine:copilot:close"}

77-env-key-checker.md

{"type":"rig.agent:invoke","data":{"agent":"agent","input":"","model":"typecheck","maxTurns":4}}
{"type":"rig.engine:copilot:create","data":{"model":"typecheck","transport":"uri"}}
{"type":"rig.agent:close","data":{"agent":"agent"}}
{"type":"rig.engine:copilot:close"}

218-ts-interface-conflict-checker.md

{"type":"rig.agent:invoke","data":{"agent":"agent","input":"","model":"typecheck","maxTurns":6}}
{"type":"rig.engine:copilot:create","data":{"model":"typecheck","transport":"uri"}}
{"type":"rig.agent:close","data":{"agent":"agent"}}
{"type":"rig.engine:copilot:close"}

156-regex-pattern-tester.md

No rig.* log lines captured. The sample failed before agent invocation: the harness rejected it because its root agent declares a non-empty input schema, which is not allowed for stdin programs.

30-github-action-review.md

{"type":"rig.agent:invoke","data":{"agent":"agent","input":"","model":"typecheck","maxTurns":4}}
{"type":"rig.engine:copilot:create","data":{"model":"typecheck","transport":"uri"}}
{"type":"rig.agent:close","data":{"agent":"agent"}}
{"type":"rig.engine:copilot:close"}

Generated by Daily Rig Sample Report · sonnet46 72.2 AIC · ⌖ 8.72 AIC · ⊞ 5.2K ·

  • expires on Aug 24, 2026, 12:44 PM UTC

Metadata

Metadata

Assignees

No one assigned

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions