v0.14.19

Flux v0.14.19

Diff since v0.14.18

Merged pull requests:

• Allow loading of ConvTranspose state without .outpad field (#2477) (@mcabbott)

Closed issues:

• Model saved under Flux v0.14.16 does not load on v0.14.17 (#2476)

v0.14.18

Flux v0.14.18

Diff since v0.14.17

Merged pull requests:

• Bump deps (#2475) (@pxl-th)

v0.14.17

Flux v0.14.17

Diff since v0.14.16

Merged pull requests:

• Add Enzyme train function (#2446) (@wsmoses)
• Bump actions/checkout from 4.1.5 to 4.1.7 (#2460) (@dependabot[bot])
• Add output padding for ConvTranspose (#2462) (@guiyrt)
• Fix ConvTranspose symmetric non-constant padding (#2463) (@paulnovo)
• CompatHelper: add new compat entry for Enzyme at version 0.12, (keep existing compat) (#2466) (@github-actions[bot])
• move enzyme to extension (#2467) (@CarloLucibello)
• Fix function _size_check() (#2472) (@gruberchr)
• Fix ConvTranspose output padding on AMDGPU (#2473) (@paulnovo)

Closed issues:

• Hoping to offer a version without cuda (#2155)
• ConvTranspose errors with symmetric non-constant pad (#2424)
• Create a flag to use Enzyme as the AD in training/etc. (#2443)
• Can't load a Fluxml trained & saved model. Getting ERROR: CUDA error: invalid device context (code 201, ERROR_INVALID_CONTEXT) (#2461)
• Requires deprecated cuNN.jl package (#2470)

v0.14.16

Flux v0.14.16

Diff since v0.14.15

Merged pull requests:

• Make sure first example in Custom Layers docs uses type parameter (#2415) (@BioTurboNick)
• Add GPU GC comment to Performance Tips (#2416) (@BioTurboNick)
• Fix some typos in docs (#2418) (@JoshuaLampert)
• fix component arrays test (#2419) (@CarloLucibello)
• Bump julia-actions/setup-julia from 1 to 2 (#2420) (@dependabot[bot])
• documentation update (#2422) (@CarloLucibello)
• remove public dropout (#2423) (@mcabbott)
• Allow BatchNorm on CUDA with track_stats=False (#2427) (@paulnovo)
• Bump actions/checkout from 4.1.2 to 4.1.3 (#2428) (@dependabot[bot])
• Add working downloads badge (#2429) (@pricklypointer)
• Bump actions/checkout from 4.1.3 to 4.1.4 (#2430) (@dependabot[bot])
• Add tip for non-CUDA users (#2434) (@micahscopes)
• Add hint for choosing a different GPU backend (#2435) (@micahscopes)
• Patch Flux._isleaf for abstract arrays with bitstype elements (#2436) (@jondeuce)
• Bump julia-actions/cache from 1 to 2 (#2437) (@dependabot[bot])
• Bump actions/checkout from 4.1.4 to 4.1.5 (#2438) (@dependabot[bot])
• Enzyme: bump version and mark models as working [test] (#2439) (@wsmoses)
• Enable remaining enzyme test (#2442) (@wsmoses)
• Bump AMDGPU to 0.9 (#2449) (@pxl-th)
• Do not install all GPU backends at once (#2453) (@pxl-th)
• CompatHelper: add new compat entry for BSON at version 0.3, (keep existing compat) (#2457) (@github-actions[bot])
• remove BSON dependence (#2458) (@CarloLucibello)

Closed issues:

• How to have a stable GPU memory while being performant? (#780)
• Why is Flux.destructure type unstable? (#2405)
• tests are failing due to ComponentArrays (#2411)
• Significant time spent moving medium-size arrays to GPU, type instability (#2414)
• Dense layers with shared parameters (#2432)
• why is my withgradient type unstable ? (#2456)

v0.14.15

Flux v0.14.15

Diff since v0.14.14

Merged pull requests:

• Restore some support for Tracker.jl (#2387) (@mcabbott)
• start testing Enzyme (#2392) (@CarloLucibello)
• Add Ignite.jl to ecosystem.md (#2395) (@mcabbott)
• Bump actions/checkout from 4.1.1 to 4.1.2 (#2401) (@dependabot[bot])
• More lazy strings (#2402) (@lassepe)
• Fix dead link in docs (#2403) (@BioTurboNick)
• Improve errors for conv layers (#2404) (@mcabbott)

Closed issues:

• Given that DataLoader implements length shouldn't it also be able to provide size? (#2372)
• Dimensions check for Conv is incomplete, leading to confusing error (#2398)

v0.14.14

Flux v0.14.14

Diff since v0.14.13

Merged pull requests:

• Bump actions/cache from 3 to 4 (#2371) (@dependabot[bot])
• Use LazyString in depwarn (#2400) (@mcabbott)

Closed issues:

• precompilation issue on Julia 1.10 (#2354)
• Flux installation error under Julia 1.10 on Apple Silicon (#2366)
• Compilation time of Flux models (#2391)
• Flux.setup buggy and broken in latest v.0.13.17 (#2394)
• 2x performance regression due to 5e80211 (#2399)

v0.14.13

Flux v0.14.13

Diff since v0.14.12

Merged pull requests:

• Add a macro to opt-in to fancy printing, and to everything else (#1932) (@mcabbott)
• Small upgrades to training docs (#2331) (@mcabbott)
• Bump codecov/codecov-action from 3 to 4 (#2376) (@dependabot[bot])
• Bump dorny/paths-filter from 3.0.0 to 3.0.1 (#2381) (@dependabot[bot])
• Bump thollander/actions-comment-pull-request from 2.4.3 to 2.5.0 (#2382) (@dependabot[bot])
• Fix #2380 (#2384) (@diegozea)
• Allow cpu(::DataLoader) (#2388) (@mcabbott)
• Bump dorny/paths-filter from 3.0.1 to 3.0.2 (#2389) (@dependabot[bot])
• doc changes re at-functor and at-layer (#2390) (@mcabbott)

Closed issues:

• Macro to display model struct the way Flux does (#2044)
• Update GH Actions across all repos (#2170)
• Flux.jl Documentation (Training API Reference) (#2303)
• Flux docs missing withgradient() call for multi-objective loss functions (#2325)

v0.14.12

Flux v0.14.12

Diff since v0.14.11

Merged pull requests:

• Add SignDecay for L1 norm (#2377) (@mcabbott)
• Update mlutils.md (#2379) (@diegozea)

Closed issues:

• The dedicated tutorial on DataLoader is missing (#2378)

v0.14.11

Flux v0.14.11

Diff since v0.14.10

Merged pull requests:

• Bump dorny/paths-filter from 2.11.1 to 3.0.0 (#2373) (@dependabot[bot])
• Support Adapt.jl v4 (#2374) (@vpuri3)

v0.14.10

Flux v0.14.10

Diff since v0.14.9

Merged pull requests:

• Update GPU CI coverage (#2236) (@ToucheSir)
• Add back missing rng_from_array(::CuArray) method (#2369) (@Red-Portal)