Skip to content

test(ci): add strict runtime contract gate - #160

Open
KooshaPari wants to merge 1 commit into
mainfrom
fix/strict-runtime-test-gate-20260828
Open

test(ci): add strict runtime contract gate#160
KooshaPari wants to merge 1 commit into
mainfrom
fix/strict-runtime-test-gate-20260828

Conversation

@KooshaPari

@KooshaPari KooshaPari commented Aug 28, 2026

Copy link
Copy Markdown
Owner

User description

Adds one independent, fail-closed Runtime Contract Tests CI job. It installs the locked Bun graph and explicitly preloads tests/setup-dom.ts, then runs ACP, MCP bridge, PTY, and desktop unit-test surfaces. It is intentionally separate from the failing repository-wide typecheck; there is no continue-on-error, || true, contract-content change, or test skip.


CodeAnt-AI Description

Add a strict CI gate for runtime contract tests

What Changed

  • CI now runs ACP, MCP bridge, PTY, and desktop unit contract tests in a dedicated job
  • Tests use the locked Bun dependencies and required DOM setup
  • Failures in these runtime contracts now fail the job instead of being reported only as advisory warnings

Impact

✅ Runtime contract regressions block CI
✅ ACP, MCP, PTY, and desktop behavior is checked on every change
✅ Reproducible test setup from the locked dependency graph

💡 Usage Guide

Checking Your Pull Request

Every time you make a pull request, our system automatically looks through it. We check for security issues, mistakes in how you're setting up your infrastructure, and common code problems. We do this to make sure your changes are solid and won't cause any trouble later.

Talking to CodeAnt AI

Got a question or need a hand with something in your pull request? You can easily get in touch with CodeAnt AI right here. Just type the following in a comment on your pull request, and replace "Your question here" with whatever you want to ask:

@codeant-ai ask: Your question here

This lets you have a chat with CodeAnt AI about your pull request, making it easier to understand and improve your code.

Example

@codeant-ai ask: Can you suggest a safer alternative to storing this secret?

Preserve Org Learnings with CodeAnt

You can record team preferences so CodeAnt AI applies them in future reviews. Reply directly to the specific CodeAnt AI suggestion (in the same thread) and replace "Your feedback here" with your input:

@codeant-ai: Your feedback here

This helps CodeAnt AI learn and adapt to your team's coding style and standards.

Example

@codeant-ai: Do not flag unused imports.

Retrigger review

Ask CodeAnt AI to review the PR again, by typing:

@codeant-ai: review

Check Your Repository Health

To analyze the health of your code repository, visit our dashboard at https://app.codeant.ai. This tool helps you identify potential issues and areas for improvement in your codebase, ensuring your repository maintains high standards of code health.

Copilot AI lite review requested due to automatic review settings August 28, 2026 08:46
@codeant-ai

codeant-ai Bot commented Aug 28, 2026

Copy link
Copy Markdown

🤖 CodeAnt AI — Review Status

Status Commit Started (UTC) Finished (UTC)
✅ Reviewed your PR 88c77b2 Aug 28, 2026 · 08:46 08:46

@codeant-ai

codeant-ai Bot commented Aug 28, 2026

Copy link
Copy Markdown

Thanks for using CodeAnt! 🎉

We're free for open-source projects. if you're enjoying it, help us grow by sharing.

Share on X ·
Reddit ·
LinkedIn

Copilot AI left a comment

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Copilot was unable to review this pull request because the user who requested the review has reached their quota limit.

@codeant-ai codeant-ai Bot added the size:S This PR changes 10-29 lines, ignoring generated files label Aug 28, 2026
@sonarqubecloud

Copy link
Copy Markdown

Quality Gate Failed Quality Gate failed

Failed conditions
C Security Rating on New Code (required ≥ A)

See analysis details on SonarQube Cloud

Catch issues before they fail your Quality Gate with our IDE extension SonarQube for IDE

@github-actions

Copy link
Copy Markdown

Compliance Check ✅

All constitution compliance checks passed!

@github-actions

Copy link
Copy Markdown

⚠️ Self-merge is blocked due to missing requirements:

  • ❌ Not all quality gates have passed
  • ❌ PR does not have required review approval

Please ensure all checks pass before merging.

@chatgpt-codex-connector chatgpt-codex-connector Bot left a comment

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

💡 Codex Review

Here are some automated review suggestions for this pull request.

Reviewed commit: 88c77b2955

ℹ️ About Codex in GitHub

Codex has been enabled to automatically review pull requests in this repo. Reviews are triggered when you

  • Open a pull request for review
  • Mark a draft as ready
  • Comment "@codex review".

If Codex has suggestions, it will comment; otherwise it will react with 👍.

When you sign up for Codex through ChatGPT, Codex can also answer questions or update the PR, like "@codex address that feedback".

Comment thread .github/workflows/ci.yml
Comment on lines +174 to +176
runtime-contract-tests:
name: Runtime Contract Tests
runs-on: ubuntu-latest

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

P1 Badge Feed contract failures into the stable test gate

When branch protection relies on the stable ci / test check, a failure in this new job does not block that check: the downstream test job still has only needs: [lint] and unconditionally reports success. Wire runtime-contract-tests into that gate and make the gate fail when its result is not successful; otherwise a broken ACP/MCP/PTY/desktop contract can retain a green required test status.

Useful? React with 👍 / 👎.

@github-actions

Copy link
Copy Markdown

Quality Gate Report

✅ Unit Tests: PASSED
✅ E2E Tests: PASSED
⏭️ Integration Tests: SKIPPED (no integration directory)
✅ FR Annotations: VALID

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

size:S This PR changes 10-29 lines, ignoring generated files

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants