Skip to content

Retire the WIP GitHub App: flaky, superseded by native Draft Pull Requests #6646

Description

@hjmjohnson

The WIP GitHub App check (https://github.com/marketplace/wip) is flaky and pre-dates GitHub's native Draft Pull Request feature, which now does the same job more reliably. Recommend removing the app org-wide.

Why the WIP app is obsolete
  • The app (github.com/wip/app) was installed on InsightSoftwareConsortium on 2018-09-05.
  • GitHub's native Draft Pull Request feature entered public beta on 2018-09-19 (two weeks later) and reached general availability on 2019-02-14.
  • So the WIP app was filling a real gap when it was installed — GitHub had no built-in "not ready yet" PR state at the time. Draft PRs have made that gap moot for 7+ years: marking a PR as Draft natively disables the merge button, with no check-run, no webhook, and no third-party dependency involved.
  • ITK's own contribution convention already leans on draft-PR-by-default (see the WIP: commit-message-prefix discussion in DOC: Clarify WIP: prefix workflow; align AI docs with hook #6080/DOC: Fix WIP: guidance to match kw-commit-msg.py reality #6082) and on Utilities/Hooks/kw-commit-msg.py + the required ghostflow-check-main status check, which independently validate the WIP: commit-message prefix. Neither of those depends on the marketplace app.
  • The WIP app's free tier only scans the PR title for "wip"/"work in progress"/🚧 — commit-message or PR-body scanning requires a paid Pro subscription that ITK does not have, so in practice it duplicates a narrow slice of what draft status + ghostflow already cover.
Evidence it's flaky

Observed 2026-07-15: the WIP check-run got stuck at IN_PROGRESS indefinitely (never posting a conclusion) on multiple concurrently open PRs, none of which had "wip" anywhere in the title:

For comparison, #6630 and #6625 show the check completing normally in ~1 second when the app's webhook delivery doesn't misfire. This is the same class of failure as the open-cdash-org check flakiness previously reported in #6140 / #6033, which was ultimately resolved by an upstream fix (#6139) plus the CDash App owner enabling an "always report success" setting — no equivalent setting is documented for the wip app.

WIP is not currently in the repo's required-status-checks list (only ghostflow-check-main is required), so this flakiness doesn't block merging today — but it does make the PR checks list look red/incomplete and causes recurring "why won't this go green" confusion.

How to remove it

The app is installed at the organization level (repository_selection: "all", installation id 322270), so removal requires a GitHub organization owner on InsightSoftwareConsortium — repo-level admin/maintainer access is not sufficient.

Full removal (affects every repo in the org):

  1. Go to https://github.com/organizations/InsightSoftwareConsortium/settings/installations/322270
  2. Click "Uninstall"

Scoped removal (keep it for other org repos, remove only from ITK):

  1. Same settings page as above
  2. Under "Repository access," switch from "All repositories" to "Only select repositories"
  3. Deselect ITK (leave other repos selected if they still want it)

Before a full org-wide uninstall, it's worth confirming no other InsightSoftwareConsortium repo actively relies on it, since repository_selection: "all" means every repo in the org currently has this check.

Activity

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

Labels

type:InfrastructureInfrastructure/ecosystem related changes, such as CMake or buildbots

Type

No type

Projects

No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions