#

sharpness-aware-minimization

Here are 12 public repositories matching this topic...

val-iisc / SDAT

[ICML 2022]Source code for "A Closer Look at Smoothness in Domain Adversarial Training",

pytorch domain-adaptation adversarial-training dann sharpness-aware-minimization icml-2022

Updated Apr 11, 2024
Python

understanding-sam

tml-epfl / understanding-sam

Towards Understanding Sharpness-Aware Minimization [ICML 2022]

generalization sharpness flatness sharpness-aware-minimization understanding-deep-learning

Updated Jun 14, 2022
Jupyter Notebook

wangermeng2021 / FastClassification

FastClassification is a tensorflow toolbox for class classification. It provides a training module with various backbones and training tricks towards state-of-the-art class classification.

sam image-classification mixup autoaugment lr-finder tensorflow2 cutmix randaugment sharpness-aware-minimization progressive-resizing

Updated Jun 26, 2021
Python

sanketvmehta / lifelong-learning-pretraining-and-sam

Code for the paper "Mehta, S. V., Patil, D., Chandar, S., & Strubell, E. (2023). An Empirical Investigation of the Role of Pre-training in Lifelong Learning. The Journal of Machine Learning Research 24 (2023)"

lifelong-learning continual-learning pre-training sharpness-aware-minimization flat-minima

Updated Mar 18, 2024
Python

CGCL-codes / TransferAttackSurrogates

The official code of IEEE S&P 2024 paper "Why Does Little Robustness Help? A Further Step Towards Understanding Adversarial Transferability". We study how to train surrogates model for boosting transfer attack.

data-augmentation adversarial-attacks adversarial-training gradient-regularization black-box-attack transfer-attack sharpness-aware-minimization distribution-shift

Updated Aug 22, 2024
Python

Lee-Gihun / FedSOL

(CVPR 2024) Official Implementation of "FedSOL: Stabilized Orthogonal Learning with Proximal Restrictions in Federated Learning"

machine-learning computer-vision deep-learning optimization scaffold moon federated-learning continual-learning distributed-learning federated-learning-framework fedavg fedprox sharpness-aware-minimization fedntd fednova fedsol fedsam perfedavg knnper

Updated Jun 28, 2024
Python

TrustAIoT / CR-SAM

Code for AAAI 2024 paper: CR-SAM: Curvature Regularized Sharpness-Aware Minimization

deep-neural-networks optimization sharpness-aware-minimization

Updated Dec 27, 2023
Python

sanderson4030 / SharpnessAwareMinimization

Sharpness Aware Minimization for Fastai

deep-learning deep-learning-papers fastai fastai-extensions sharpness-aware-minimization

Updated Feb 26, 2021
Python

EnnengYang / DFGP

Data Augmented Flatness-aware Gradient Projection for Continual Learning. ICCV, 2023.

data-augmentation subspace-learning continual-learning catastrophic-forgetting orthogonal-projection sharpness-aware-minimization gradient-projection

Updated Sep 29, 2023
Python

gjlee0802 / LeNet-5

LeNet-5 with SAM, Generalization

mnist generalization lenet-5 generalization-ability sharpness-aware-minimization generalization-of-deep-cnn

Updated May 5, 2024
Jupyter Notebook

cerebrai / pgn_sam.pytorch

PyTorch implementation of Penalizing Gradient Norm for Efficiently Improving Generalization in Deep Learning

machine-learning deep-learning optimization pytorch pytorch-implementation sharpness-aware-minimization penalizing-gradient-norm

Updated Aug 11, 2024
Python

vinnik-dmitry07 / full-batch

Super-Convergence on CIFAR10

sophia cifar10 lion second-order-optimization adamw super-convergence weight-decay sharpness-aware-minimization madgrad large-batch-optimization lion-optimizer

Updated Jun 17, 2024
Python

Improve this page

Add a description, image, and links to the sharpness-aware-minimization topic page so that developers can more easily learn about it.

Curate this topic

Add this topic to your repo

To associate your repository with the sharpness-aware-minimization topic, visit your repo's landing page and select "manage topics."