Skip to content

Move test repetition down to the test case level#1528

Draft
harlanhaskins wants to merge 1 commit intomainfrom
harlan/getting-those-reps-in
Draft

Move test repetition down to the test case level#1528
harlanhaskins wants to merge 1 commit intomainfrom
harlan/getting-those-reps-in

Conversation

@harlanhaskins
Copy link

This changes the runner such that "repeat until success" or the other repetition policies repeat only the affected test case, rather than repeating the entire test plan.

Fixes #1392 and rdar://130508488

Motivation:

The previous behavior was unexpected and does not match the behavior of XCTest. This changes the behavior to align the behaviors (in the way that users expect).

Modifications:

  • Updates the Runner to move the iteration into a helper function, then invokes the helper function from _runTestCase.
  • Adds a test to ensure only the specific failing test case is repeated, not every test case.

Checklist:

  • Code and documentation should follow the style of the Style Guide.
  • If public symbols are renamed or modified, DocC references should be updated.

@harlanhaskins harlanhaskins force-pushed the harlan/getting-those-reps-in branch from f926e06 to 03ba197 Compare February 5, 2026 21:47
@harlanhaskins harlanhaskins marked this pull request as draft February 12, 2026 15:09
@harlanhaskins
Copy link
Author

Converting to a draft for now; there's follow-on discussions we need to have about behavioral changes before we can actually sink this repetition down

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

Support retry-on-failure for only the failing @Test cases

1 participant