|
| 1 | +- title: "Bringing Automatic Differentiation to CUDA with Compiler-Based Source Transformations" |
| 2 | + description: | |
| 3 | + GPUs have become increasingly popular for their ability to perform parallel operations efficiently, driving interest in General-Purpose GPU Programming. Scientific computing, in particular, stands to benefit greatly from these capabilities. However, parallel programming systems such as CUDA introduce challenges for code transformation tools due to their reliance on low-level hardware management primitives. These challenges make implementing automatic differentiation (AD) for parallel systems particularly complex. |
| 4 | + |
| 5 | + CUDA is being widely adopted as an accelerator technology in many scientific algorithms from machine learning to physics simulations. Enabling AD for such codes builds a new valuable capability necessary for advancing scientific computing. |
| 6 | + |
| 7 | + Clad is an LLVM/Clang plugin for automatic differentiation that performs source-to-source transformation by traversing the compiler's internal high-level data structures, and generates a function capable of computing derivatives of a given function at compile time. In this talk, we explore how we recently extended Clad to support GPU kernels and functions, as well as kernel launches and CUDA host functions. We will discuss the underlying techniques and real-world applications in scientific computing. Finally, we will examine current limitations and potential future directions for GPU-accelerated differentiation. |
| 8 | + location: "[Mode 2025](https://indico.cern.ch/event/1481852/contributions/6491917/)" |
| 9 | + date: 2025-06-11 |
| 10 | + speaker: Christina Koutsou |
| 11 | + id: "MODE2025CUDA" |
| 12 | + artifacts: | |
| 13 | + [Link to Slides](/assets/presentations/Christina_CladCudaAD_Mode2025.pdf) |
| 14 | + highlight: 1 |
| 15 | + |
| 16 | +- title: "Scaling RooFit's Automatic Differentiation Capabilities to CMS Combine" |
| 17 | + description: | |
| 18 | + RooFit's integration with the Clad infrastructure has introduced automatic differentiation (AD), leading to significant speedups and driving major improvements in its minimization framework. Besides, the AD integration has also inspired several optimizations and simplifications of key RooFit components in general. The AD framework in RooFit is designed to be extensible, providing all necessary primitives to efficiently traverse RooFit’s computation graphs. |
| 19 | + |
| 20 | + CMS Combine, the primary statistical analysis tool in the CMS experiment, has played a pivotal role in groundbreaking discoveries, including the Higgs boson. Built on RooFit, CMS Combine is making AD a natural extension to improve performance and usability. Recognizing this potential, we have begun a collaborative effort to bridge gaps between the two frameworks with a core focus of enabling AD within CMS Combine through RooFit. |
| 21 | + |
| 22 | + In this talk, we will present our progress, highlight the challenges encountered, and discuss the benefits and opportunities that AD integration brings to the CMS analysis workflow. By sharing insights from our ongoing work, we aim to engage the community in furthering AD adoption in high-energy physics. |
| 23 | + location: "[Mode 2025](https://indico.cern.ch/event/1481852/contributions/6464892)" |
| 24 | + date: 2025-06-11 |
| 25 | + speaker: Vassil Vasilev |
| 26 | + id: "MODE2025ROOFIT" |
| 27 | + artifacts: | |
| 28 | + [Link to Slides](/assets/presentations/Vassil_CladRoofit_Mode2025.pdf) |
| 29 | + highlight: 1 |
| 30 | + |
| 31 | + |
1 | 32 | - title: "Debugging Regressions: Interactive Differential Debugging"
|
2 | 33 | description: |
|
3 | 34 | Software systems have grown to millions lines of code and are developed by a community of hundreds of developers. Often benign changes can trigger undesired behavior which is very challenging to isolate and reproduce. The conventional approach to addressing these regressions is time-consuming, usually requiring the expertise of experienced engineers.
|
|
0 commit comments