Add Python 3.15 to the test matrix by mdboom · Pull Request #2108 · NVIDIA/cuda-python

mdboom · 2026-05-19T17:07:58Z

Part of #2163.

Add Python 3.15 to the test matrix (Linux x86 only for now) so that we are ready for any issues by October.

copy-pr-bot · 2026-05-19T17:41:04Z

Auto-sync is disabled for draft pull requests in this repository. Workflows must be run manually.

Contributors can view more details about this message here.

mdboom · 2026-05-19T17:50:18Z

/ok to test

mdboom · 2026-05-19T18:16:15Z

/ok to test

mdboom · 2026-05-19T20:29:58Z

/ok to test

leofang · 2026-05-22T21:07:56Z

It seems we need to build PY315 in the 12.9.x branch first, so that we have a cuda-bindings 12.9.x wheel that we can use in the main branch (for building cuda-core).

https://github.com/NVIDIA/cuda-python/actions/runs/26123422715/job/76831314547?pr=2108#step:38:76

Backport of #2108 to the 12.9.x branch so that cuda-bindings 12.9.x wheels are available for Python 3.15, which the main branch needs in order to build cuda-core. - Add 3.15 / 3.15t to the build matrix - Upgrade cibuildwheel to v4.0.0rc1 (required for cpython-prerelease) - Enable cpython-prerelease in CIBW_ENABLE - Add amd64-only test entries for 3.15 / 3.15t (CUDA 12.9.1)

leofang · 2026-05-31T15:11:14Z

It seems we need to build PY315 in the 12.9.x branch first, so that we have a cuda-bindings 12.9.x wheel that we can use in the main branch (for building cuda-core).

This is done in #2133. Need to merge it first and then apply the learnings there in this PR.

* Add Python 3.15 to the build/test matrix Backport of #2108 to the 12.9.x branch so that cuda-bindings 12.9.x wheels are available for Python 3.15, which the main branch needs in order to build cuda-core. - Add 3.15 / 3.15t to the build matrix - Upgrade cibuildwheel to v4.0.0rc1 (required for cpython-prerelease) - Enable cpython-prerelease in CIBW_ENABLE - Add amd64-only test entries for 3.15 / 3.15t (CUDA 12.9.1) * Drop cpython-freethreading from CIBW_ENABLE (default in v4.0) * Drop 3.13t from matrix; fix GNU link.exe on Windows - Remove 3.13t from build matrix and all test matrices (already dropped on main). - Work around Meson finding GNU link.exe (from Git for Windows) instead of MSVC link.exe when building numpy from source for pre-release Python on Windows. * Expand test matrix: arm64 3.15, Windows 3.10-3.15 - Add arm64 entries for 3.15 / 3.15t (linux pull-request) - Add Windows pull-request entries for 3.10, 3.11, 3.14, 3.14t, 3.15, 3.15t to keep in sync with main * Windows test matrix: dual LOCAL_CTK for 3.10/3.11, use 12.9.1 for 3.13 * Pre-build numpy wheel for Python 3.15 (no pre-built wheel yet) NumPy does not ship pre-built wheels for Python 3.15 yet. Build the wheel from source during the build stage (where compilers are available), upload it as an artifact, and download/install it in the test stage before running cuda.bindings tests. * Build numpy in manylinux container for glibc compat; fix Windows glob Linux: build numpy via cibuildwheel inside the manylinux_2_28 container so the wheel is compatible with the ubuntu:22.04 test container (glibc 2.35). Previously, pip wheel on the host produced a linux_x86_64 wheel linked against glibc 2.38+, causing ImportError at test time. Windows: add explicit bash shell to the numpy install step in the test workflow — PowerShell does not expand *.whl globs. Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com> * Fix numpy cibuildwheel: patch cpython-freethreading, unify platforms - Patch numpy 2.4.x pyproject.toml to remove the "cpython-freethreading" enable group, which is invalid in cibuildwheel v4.0 (fixed on numpy main but not yet released). - Consolidate Linux/Windows numpy builds into a single cibuildwheel step, matching how cuda.core and cuda.bindings are built. Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com> * Strip numpy cibuildwheel config; build without BLAS numpy 2.4.x ships [tool.cibuildwheel] config (OpenBLAS scripts, cpython-freethreading, ILP64 settings) incompatible with cibuildwheel v4.0. Strip the entire section from the sdist and build with -Dallow-noblas=true — we only need numpy for testing, not optimized linear algebra. Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com> * Fix numpy pyproject.toml patch to preserve [tool.meson-python] The previous regex stripped everything from [tool.cibuildwheel] to EOF, which also removed [tool.meson-python] with its vendored meson path. Use a line-by-line approach to only remove cibuildwheel sections. Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com> * Fix test_graphics_api_smoketest on py3.10/3.11 Windows On py3.10/3.11, pyglet raises FileNotFoundError (an OSError subclass) when opengl32.dll is missing, rather than AttributeError as on py3.12+. Add OSError to the except clause so the test skips gracefully. Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com> * Exclude Python 3.15 wheels from release publishing Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com> --------- Co-authored-by: Claude Opus 4.6 <noreply@anthropic.com>

leofang · 2026-06-03T14:12:05Z

This is done in #2133. Need to merge it first and then apply the learnings there in this PR.

It's merged now. Once the artifacts become available on the 12.9.x branch, I will push updates to this PR.

Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>

numpy 2.4.x has no pre-built wheel for Python 3.15 yet, and its [tool.cibuildwheel] config is incompatible with cibuildwheel v4.0. Build numpy from patched sdist via cibuildwheel with -Dallow-noblas=true on all platforms (linux-64, linux-aarch64, win-64). Also exclude python315 artifacts from release publishing since 3.15 is pre-release and not ready for PyPI. Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>

copy-pr-bot · 2026-06-03T23:52:36Z

This pull request requires additional validation before any workflows can run on NVIDIA's runners.

Pull request vetters can view their responsibilities here.

Contributors can view more details about this message here.

…lib/cffi Remove the empty CIBW_REPAIR_WHEEL_COMMAND_WINDOWS that was overriding the pyproject.toml delvewheel config. The pyproject.toml already specifies `delvewheel repair --namespace-pkg cuda` which is the correct behavior. Keep matplotlib and cffi as test dependencies but gate them to python_version < 3.15 (no wheels available yet for 3.15). Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>

Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>

leofang · 2026-06-04T01:12:29Z

/ok to test 193cbf9

Main's CIBW_BUILD is cp315-* (not cp315-manylinux* like 12.9.x), so cibuildwheel builds both manylinux and musllinux numpy wheels. The musllinux wheel is incompatible with the glibc-based test runners. Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>

leofang · 2026-06-04T01:56:48Z

/ok to test 2f7a05b

github-actions · 2026-06-04T02:27:43Z

Doc Preview CI
🚀 View preview at https://nvidia.github.io/cuda-python/pr-preview/pr-2108/
https://nvidia.github.io/cuda-python/pr-preview/pr-2108/cuda-core/
https://nvidia.github.io/cuda-python/pr-preview/pr-2108/cuda-bindings/
https://nvidia.github.io/cuda-python/pr-preview/pr-2108/cuda-pathfinder/
Preview will be ready when the GitHub Pages deployment is complete.

- Skip musllinux and win32 when building numpy (CIBW_BUILD=cp315-* matches both win32 and win_amd64; numpy has no pyproject.toml constraint after we strip its cibuildwheel config) - Mark 3.15/3.15t test jobs as continue-on-error so they don't block CI (3.15t segfaults on CPython beta, rlcompleter test changed behavior) - Skip test_opt_out_env_var_disables_patch_even_when_interactive on Python 3.15 (upstream fixed the rlcompleter bug this test relied on) Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>

leofang · 2026-06-04T03:35:50Z

/ok to test d1b8d82

nvidia-cutlass depends on scipy, which has no pre-built wheel for Python 3.15 yet. Version-gate the dependency so pathfinder tests can still install the rest of the test dependencies on 3.15. Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>

Mark every temporary 3.15 hack (version-gated deps, numpy pre-build, continue-on-error, allow-prereleases, cpython-prerelease, release exclusion) with a TODO so they are easy to find and remove once 3.15 is officially supported. Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>

leofang · 2026-06-05T21:47:20Z

/ok to test 839f785

leofang · 2026-06-05T22:17:34Z

The 3.15t pathfinder "see what works" test segfaults, will track it in a separate issue. I configured the CI such that 3.15 test failures are not blocking the status check. This PR is ready for review.

Running pathfinder tests with  LD:see_what_works  FH:see_what_works  BC:see_what_works
/__w/cuda-python/cuda-python/ci/tools/run-tests: line 155:  4249 Segmentation fault      (core dumped) pytest -ra -s -v --durations=0 tests/ 2>&1
      4250 Done                    | tee /tmp/pathfinder_test_log.txt
Error: Process completed with exit code 139.

https://github.com/NVIDIA/cuda-python/actions/runs/27041829125/job/79822100279?pr=2108#step:28:75

nvidia-cutlass is not installed on 3.15 (scipy has no 3.15 wheel), so the pathfinder header discovery tests for cutlass and cute will always fail under all_must_work strictness. Skip those parametrized cases on 3.15+. Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>

Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>

leofang · 2026-06-05T22:37:37Z

/ok to test ff2eccb

leofang · 2026-06-08T17:21:56Z

/ok to test d0e136b

kkraus14 · 2026-06-09T01:53:54Z

+          # TODO: remove cpython-prerelease once 3.15 is officially supported
+          # Allow CPython pre-release builds (currently 3.15 / 3.15t). This is a
+          # no-op for stable Python versions because CIBW_BUILD still filters
+          # the target version.
+          CIBW_ENABLE: cpython-prerelease


Does this have any impact to us once 3.15 is released? We'd just need to readd this when 3.16 needs to ramp up.

Add Python 3.15 to the test matrix

546ce59

github-actions Bot added the CI/CD CI/CD infrastructure label May 19, 2026

mdboom self-assigned this May 19, 2026

mdboom added cuda.bindings Everything related to the cuda.bindings module cuda.core Everything related to the cuda.core module cuda.pathfinder Everything related to the cuda.pathfinder module labels May 19, 2026

Update cibuildwheel

aeb71d2

kkraus14 reviewed May 19, 2026

View reviewed changes

Comment thread ci/test-matrix.yml Outdated

mdboom marked this pull request as draft May 19, 2026 17:41

Remove matplotlib dependency

80af137

Remove cffi as a test dependency

de94e52

Use LOCAL_CTK=0 for Python 3.15

6991490

This was referenced May 22, 2026

Add Python 3.15 to the build/test matrix (12.9.x backport) #2132

Closed

Add Python 3.15 to the build/test matrix (12.9.x backport) #2133

Merged

leofang and others added 2 commits June 3, 2026 23:50

Merge branch 'main' into python-3.15

d5b5bbb

Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>

leofang and others added 2 commits June 4, 2026 01:09

Tighten allow-prereleases to Python 3.15 only

193cbf9

Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>

leofang added the P0 High priority - Must do! label Jun 4, 2026

leofang self-assigned this Jun 4, 2026

leofang and others added 2 commits June 5, 2026 06:51

leofang requested a review from seberg June 5, 2026 22:15

leofang marked this pull request as ready for review June 5, 2026 22:15

leofang added this to the cuda.core v1.1.0 milestone Jun 5, 2026

leofang mentioned this pull request Jun 5, 2026

Python 3.15t pathfinder test collection segfaults #2171

Open

leofang and others added 2 commits June 5, 2026 22:32

Fix ruff SIM118: use in dict instead of in dict.keys()

ff2eccb

Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>

leofang reviewed Jun 8, 2026

View reviewed changes

Comment thread ci/test-matrix.yml Outdated

leofang added 2 commits June 8, 2026 13:20

disable py315t pipeline for now

adc4e38

Merge branch 'main' into python-3.15

d0e136b

leofang requested a review from rwgk June 8, 2026 21:13

kkraus14 approved these changes Jun 9, 2026

View reviewed changes

Conversation

mdboom commented May 19, 2026 • edited by leofang Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

Uh oh!

copy-pr-bot Bot commented May 19, 2026

Uh oh!

mdboom commented May 19, 2026

Uh oh!

mdboom commented May 19, 2026

Uh oh!

mdboom commented May 19, 2026

Uh oh!

leofang commented May 22, 2026

Uh oh!

leofang commented May 31, 2026

Uh oh!

leofang commented Jun 3, 2026

Uh oh!

copy-pr-bot Bot commented Jun 3, 2026

Uh oh!

leofang commented Jun 4, 2026

Uh oh!

leofang commented Jun 4, 2026

Uh oh!

github-actions Bot commented Jun 4, 2026

Preview will be ready when the GitHub Pages deployment is complete.

Uh oh!

leofang commented Jun 4, 2026

Uh oh!

leofang commented Jun 5, 2026

Uh oh!

leofang commented Jun 5, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

leofang commented Jun 5, 2026

Uh oh!

Uh oh!

leofang commented Jun 8, 2026

Uh oh!

kkraus14 Jun 9, 2026

Choose a reason for hiding this comment

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

3 participants

mdboom commented May 19, 2026 •

edited by leofang

Loading

leofang commented Jun 5, 2026 •

edited

Loading