Skip to content

Commit

Permalink
[pre-commit.ci] auto fixes from pre-commit.com hooks
Browse files Browse the repository at this point in the history
for more information, see https://pre-commit.ci
  • Loading branch information
pre-commit-ci[bot] committed Dec 16, 2024
1 parent a8ca89c commit dd9159b
Showing 1 changed file with 4 additions and 1 deletion.
5 changes: 4 additions & 1 deletion transformer_engine/pytorch/attention.py
Original file line number Diff line number Diff line change
Expand Up @@ -1266,7 +1266,10 @@ def get_alibi(
_alibi_cache["_bottom_right_diagonal"] = bottom_right_diagonal
bias_dtype = torch.float32 if bias_dtype is None else bias_dtype
_alibi_cache["_bias_dtype"] = bias_dtype
_alibi_cache["_actual_seqlens_q"], _alibi_cache["_actual_seqlens_kv"] = actual_seqlens_q, actual_seqlens_kv
_alibi_cache["_actual_seqlens_q"], _alibi_cache["_actual_seqlens_kv"] = (
actual_seqlens_q,
actual_seqlens_kv,
)
_alibi_cache["_alibi_bias"] = bias.contiguous().to(dtype=bias_dtype, device="cuda")
_alibi_cache["_alibi_bias_require_update"] = False

Expand Down

0 comments on commit dd9159b

Please sign in to comment.