feat(profiles): add aig to the production clawhub profile - #48
Conversation
The clawhub profile now runs skillspector, clawscan-static, and aig together instead of evaluating aig only through the clawhub-aig candidate profile. RenderClawHubPrompt now attaches AIG SARIF evidence to the Codex judge whenever aig produced a result, rather than keying off the profile id, so production runs get the same evidence the clawhub-aig candidate already received. The clawhub-aig candidate profile and the malicious-signal heuristic are left unchanged.
|
🦞👀 Pull request received. I will update this pull request when review starts. |
|
Codex review: needs maintainer review before merge. Reviewed August 20, 2026, 4:37 PM ET / 20:37 UTC. ClawSweeper reviewWhat this changesThe PR adds AIG to the production ClawHub profile, forwards its SARIF output to the Codex judge, and maps existing OpenAI/Codex credentials to AIG’s OpenAI runtime defaults. Merge readinessKeep open: current main still has the two-scanner production profile and only attaches AIG evidence for the candidate profile. The branch is a coherent, tested production rollout, but enabling an additional credentialed remote scanner by default remains a maintainer product and operations decision. Priority: P2 Review scores
Verification
How this fits togetherClawScan’s ClawHub profile chooses scanners and a sandbox environment for a security scan, then supplies scanner evidence to a Codex judge. This change makes AIG part of that production scanner set and includes its SARIF findings in the final judging prompt. flowchart LR
A[ClawHub skill or plugin] --> B[Production ClawHub profile]
B --> C[Sandboxed scanners]
C --> D[AIG SARIF evidence]
D --> E[Codex judge prompt]
E --> F[Security verdict]
Decision needed
Why: The patch is technically bounded and preserves existing credential compatibility, but selecting the default production scanner set determines ongoing provider, latency, and cost policy. Before merge
Agent review detailsSecurityNone. Review metrics
Merge-risk optionsMaintainer options:
Technical reviewBest possible solution: Approve the production rollout only if ClawHub intends AIG’s credentialed remote analysis to be part of its default security suite; otherwise retain the evaluated candidate profile as the opt-in path. Do we have a high-confidence way to reproduce the issue? Not applicable as a bug report: this is a production-profile feature change, and the PR discussion supplies a terminal profile check plus a reported fixture-backed scan and judge receipt. Is this the best way to solve the issue? Yes technically: result-based evidence attachment and AIG-only credential fallback are narrower than profile-name coupling or a shared SkillSpector fallback, subject to the production-suite decision. AGENTS.md: found and applied where relevant. Codex review notes: model internal, reasoning high; reviewed against 113c1a8ede9f. LabelsLabel changes:
Label justifications:
EvidenceWhat I checked:
Likely related people:
Rank-up movesOptional improvements that raise the rating; they are not merge blockers.
Rating scale
Overall follows the weaker of proof and patch quality. Workflow
HistoryReview history (2 earlier review cycles)
|
…ents The clawhub profile's Codex judge command already accepts CODEX_API_KEY as an OPENAI_API_KEY substitute, but aig's own credential requirement only recognized LLM_API_KEY/OPENAI_API_KEY, so promoting aig into the production profile broke existing CODEX_API_KEY-only deployments before any scanner could run. applyRuntimeEnvDefaults now backfills OPENAI_API_KEY from CODEX_API_KEY when aig is requested and no other key is set, mirroring the existing SkillSpector provider default. Also fixes a stale "runs both scanners" description now that the clawhub profile lists three scanners.
|
Maintainer repair and proof at
Validation: Fixture-backed production-profile execution also completed all three scanner entries and the judge receipt, with AIG SARIF @clawsweeper re-review |
|
🦞🧹 I asked ClawSweeper to review this item again. Re-review progress:
|
|
Owner decision: approve the production AIG rollout. We accept AIG as a default credentialed scanner in the ClawHub profile, including the additional provider request, latency, and cost. The reviewed provider-safe defaults at |
Summary
clawhubprofile now runsaigalongsideskillspectorandclawscan-static(previouslyaigwas only evaluatedthrough the unpublished
clawhub-aigcandidate profile).RenderClawHubPromptnow attaches AIG SARIF evidence to the Codex judge whenever
aigproduced aresult, instead of keying off
artifact.Profile == "clawhub-aig", soproduction runs get the same evidence the candidate profile already
received.
Security / Trust Impact
aignow runs as part of the productionclawhubprofile, requiringLLM_API_KEY(orOPENAI_API_KEY) at scan time — already listed as anoptional/required env for the
aigscanner adapter and added to thisprofile's
sandbox.env.RenderClawHubPrompt's AIG-evidence attachment isnow driven by scanner-result presence (
clawHubAIGAnalysis(artifact) != nil)rather than the profile id string, so the same evidence path that
clawhub-aigalready exercised now also fires forclawhub. Themalicious-signal heuristic (
clawHubHasMaliciousSignal) is unchanged. Theclawhub-aigcandidate profile is left in place for isolated evaluation.Verification
go test -count=1 ./...go vet ./...go run ./cmd/clawscan --helpgo run ./cmd/clawscan profiles -vconfirms the
clawhubprofile listsskillspector, clawscan-static, aig;added
TestRenderClawHubPromptIncludesAIGEvidenceForProductionProfiletocover AIG evidence reaching the Codex judge prompt under the production
clawhubprofile label.