Skip to content

Commit

Permalink
fix and/or logic in get_backend
Browse files Browse the repository at this point in the history
Signed-off-by: Charlene Yang <[email protected]>
  • Loading branch information
cyanguwa committed Nov 14, 2023
1 parent d05c7ef commit a30f49e
Showing 1 changed file with 1 addition and 1 deletion.
2 changes: 1 addition & 1 deletion transformer_engine/common/fused_attn/fused_attn.cpp
Original file line number Diff line number Diff line change
Expand Up @@ -120,7 +120,7 @@ NVTE_Fused_Attn_Backend nvte_get_fused_attn_backend(
flag_m512 = true;
}
if ((cudnn_runtime_version >= 8903 && sm_arch_ >= 80)
&& (cudnn_runtime_version < 8903 && sm_arch_ == 80 || sm_arch_ == 90)
&& (cudnn_runtime_version < 8903 && (sm_arch_ == 80 || sm_arch_ == 90))
&& (max_seqlen_q % 64 == 0)
&& (max_seqlen_kv % 64 == 0)
&& (num_attn_heads == num_gqa_groups)
Expand Down

0 comments on commit a30f49e

Please sign in to comment.