Tests whether AI agents can set up a Hono + Prisma 7 + Prisma Postgres project in a single attempt.
Prompt used: Set up a Hono.js app with Prisma 7 and Prisma Postgres using create-db.
./run-claude.sh # Claude Code
./run-codex.sh # OpenAI Codex CLIRequires claude and codex CLIs to be installed and authenticated.
- Create a fresh folder:
mkdir runs/<platform>-<date> - Open it in your editor, paste the prompt from
prompt.mdinto the agent, let it run - Verify:
./verify.sh runs/<platform>-<date> <platform>verify.sh prints pass/fail per check and saves a JSON summary to results/.
| Check | What it verifies |
|---|---|
| package.json exists | Project was initialized |
| Prisma 7 installed | Correct version used |
| prisma/schema.prisma exists | Prisma was set up |
| DATABASE_URL in .env | create-db ran and wrote the connection string |
| Migration created | prisma migrate dev ran successfully |
| Prisma Client generated | prisma generate ran to the correct output path |
| App entry file exists | Agent wrote actual app code |
| prisma migrate status OK | DB is reachable and in sync |