Skip to content

Commit

Permalink
[pre-commit.ci] auto fixes from pre-commit.com hooks
Browse files Browse the repository at this point in the history
for more information, see https://pre-commit.ci
  • Loading branch information
pre-commit-ci[bot] committed Nov 20, 2024
1 parent f2c4092 commit bb1c160
Showing 1 changed file with 2 additions and 1 deletion.
3 changes: 2 additions & 1 deletion transformer_engine/pytorch/graph.py
Original file line number Diff line number Diff line change
Expand Up @@ -526,7 +526,8 @@ def new_fwd(*user_args, **user_kwargs):
# Only Set the FP8 meta for the modules included by forward
continue
fp8_recipe = FP8GlobalStateManager.get_fp8_recipe()
from transformer_engine.pytorch.attention import DotProductAttention
from transformer_engine.pytorch.attention import DotProductAttention

if (
isinstance(m, DotProductAttention)
and not fp8_recipe.fp8_mha
Expand Down

0 comments on commit bb1c160

Please sign in to comment.