Mesh: Add differentiable shape-to-shape fitting#1821
Draft
loliverhennigh wants to merge 1 commit into
Draft
Conversation
Signed-off-by: Oliver Hennigh <loliverhennigh101@gmail.com>
loliverhennigh
force-pushed
the
codex/shape-to-shape-fitting
branch
from
July 21, 2026 01:00
c119b97 to
a11fe17
Compare
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
PhysicsNeMo Pull Request
Description
Adds differentiable shape-to-shape fitting for prealigned 3D triangle meshes.
The new tensor APIs include:
arap_energy, a batched as-rigid-as-possible edge-graph energy with stable first-order envelope gradients.point_to_mesh_distance, with a memory-bounded Torch baseline and Warp BVH nearest-face search.fit_template_points, a fixed-step local/global fitter with closest-surface correspondences, ARAP regularization, matrix-free conjugate gradient solves, and an implicit first-order adjoint.Mesh.fit_templateprovides a connectivity-preserving object wrapper. The tensor APIs are exported fromphysicsnemo.nn.functional; the Mesh wrapper preserves template connectivity, ordering, attached data, and topology caches while invalidating geometry-dependent caches.The fitting scope is intentionally prealigned, unbatched 3D triangle surfaces with one-way template-vertex-to-target-surface fitting.
DomainMeshis not exposed because its heterogeneous interior and boundary components do not define one unambiguous target surface. Nearest-face, triangle-region, and local-rotation choices are discrete; gradients are branchwise and valid almost everywhere. Higher-order differentiation is outside the fitting contract.Warp accelerates nearest-face selection for CUDA float32. Local rotations, ARAP assembly, and the implicit conjugate gradient solves remain in Torch. The target BVH is rebuilt for each call and fitting step so the public API stays stateless; CUDA Graph capture is not part of the initial contract.
Validation completed:
torch.library.opcheck, finite-difference/gradcheck, dense/conjugate-gradient parity, and Mesh preservation tests passed.CUDA hardware was not available locally. CUDA-specific Warp parity, compiled execution, and device behavior require NVIDIA CI or reviewer hardware.
Checklist
Dependencies
No new dependencies.
Review Process
All PRs are reviewed by the PhysicsNeMo team before merging.
Depending on which files are changed, GitHub may automatically assign a maintainer for review.
We are also testing AI-based code review tools (e.g., Greptile), which may add automated comments with a confidence score.
This score reflects the AI’s assessment of merge readiness and is not a qualitative judgment of your work, nor is
it an indication that the PR will be accepted / rejected.
AI-generated feedback should be reviewed critically for usefulness.
You are not required to respond to every AI comment, but they are intended to help both authors and reviewers.
Please react to Greptile comments with 👍 or 👎 to provide feedback on their accuracy.