File tree Expand file tree Collapse file tree 2 files changed +5
-3
lines changed Expand file tree Collapse file tree 2 files changed +5
-3
lines changed Original file line number Diff line number Diff line change 1212
1313## What's New
1414
15- ## Oct 16, 2025
15+ ## Oct 16-20 , 2025
1616* Add an impl of the Muon optimizer (based on https://github.com/KellerJordan/Muon ) with customizations
1717 * extra flexibility and improved handling for conv weights and fallbacks for weight shapes not suited for orthogonalization
1818 * small speedup for NS iterations by reducing allocs and using fused (b)add(b)mm ops
1919 * by default uses AdamW (or NAdamW if ` nesterov=True ` ) updates if muon not suitable for parameter shape (or excluded via param group flag)
2020 * like torch impl, select from several LR scale adjustment fns via ` adjust_lr_fn `
2121 * select from several NS coefficient presets or specify your own via ` ns_coefficients `
22- * First 2 steps of 'meta' device model initalization supported
22+ * First 2 steps of 'meta' device model initialization supported
2323 * Fix several ops that were breaking creation under 'meta' device context
2424 * Add device & dtype factory kwarg support to all models and modules (anything inherting from nn.Module) in ` timm `
25+ * License fields added to pretrained cfgs in code
26+ * Release 1.0.21
2527
2628## Sept 21, 2025
2729* Remap DINOv3 ViT weight tags from ` lvd_1689m ` -> ` lvd1689m ` to match (same for ` sat_493m ` -> ` sat493m ` )
Original file line number Diff line number Diff line change 1- __version__ = '1.0.21.dev0 '
1+ __version__ = '1.0.21'
You can’t perform that action at this time.
0 commit comments