Skip to content

feat: move regression evals to Codex GPT-5.6 Luna - #277

Merged
mattrossman merged 6 commits into
mainfrom
mattrossman/ai-1200-run-scheduled-regression-evals-on-a-cheaper-model
Sep 9, 2026
Merged

feat: move regression evals to Codex GPT-5.6 Luna#277
mattrossman merged 6 commits into
mainfrom
mattrossman/ai-1200-run-scheduled-regression-evals-on-a-cheaper-model

Conversation

@mattrossman

@mattrossman mattrossman commented Sep 9, 2026

Copy link
Copy Markdown
Collaborator

Moves the nightly regression suite from Claude Code / Sonnet 5 to Codex / GPT-5.6 Luna at medium effort, reusing the existing experiments from #269 . See thread for context on the decision.

This PR doesn't update results, that will come from the next scheduled run.

Closes AI-1200

@vercel

vercel Bot commented Sep 9, 2026

Copy link
Copy Markdown

The latest updates on your projects. Learn more about Vercel for GitHub.

1 Skipped Deployment
Project Deployment Actions Updated
evals Ignored Ignored Preview Sep 9, 2026 8:59pm UTC

Request Review

@mattrossman mattrossman changed the title feat: add Haiku 4.5 and Luna low regression experiments feat: run regression evals on Codex GPT-5.6 Luna instead of Sonnet 5 Sep 9, 2026
@mattrossman
mattrossman marked this pull request as ready for review September 9, 2026 21:06
@mattrossman
mattrossman requested a review from a team September 9, 2026 21:06
@mattrossman mattrossman changed the title feat: run regression evals on Codex GPT-5.6 Luna instead of Sonnet 5 feat: move regression evals to Codex GPT-5.6 Luna Sep 9, 2026
@mattrossman
mattrossman merged commit 7b34913 into main Sep 9, 2026
7 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants