Skip to content

fix(reporter): print inline failure for non-retriable errors#41026

Draft
yury-s wants to merge 2 commits into
microsoft:mainfrom
yury-s:fix-list-reporter-nonretriable
Draft

fix(reporter): print inline failure for non-retriable errors#41026
yury-s wants to merge 2 commits into
microsoft:mainfrom
yury-s:fix-list-reporter-nonretriable

Conversation

@yury-s
Copy link
Copy Markdown
Member

@yury-s yury-s commented May 28, 2026

Summary

  • list reporter's printFailuresInline relied on willRetry() to decide whether to print a failure inline or defer to the retry. willRetry() only checked the retry budget, ignoring non-retriable errors (e.g. a missing snapshot that was just written), which are never retried.
  • Result: the failure was neither printed inline nor in the (suppressed) epilogue — the error body was dropped from the output entirely.
  • Surface the non-retriable flag onto the test result (live + blob paths) and consult it in willRetry().

yury-s added 2 commits May 27, 2026 19:12
The list reporter's printFailuresInline relies on willRetry() to decide
whether to print a failure now or wait for the retry. willRetry() only
looked at the retry budget and did not account for non-retriable errors
(e.g. a missing snapshot that was just written), which are never retried.
As a result the failure was neither printed inline nor in the suppressed
epilogue, so the error body was dropped from the output entirely.

Surface the non-retriable flag onto the test result (live and blob paths)
and consult it in willRetry().
The golden for "should work with file path" was missing for the
webkit-webview project, causing the test to fail in CI.
@github-actions
Copy link
Copy Markdown
Contributor

Test results for "MCP"

7207 passed, 1113 skipped


Merge workflow run.

@github-actions
Copy link
Copy Markdown
Contributor

Test results for "tests 1"

1 flaky ⚠️ [chromium-library] › library/video.spec.ts:719 › screencast › should work with video+trace `@chromium-ubuntu-22.04-arm-node20`

43957 passed, 864 skipped


Merge workflow run.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant