Add SDPA edge case test coverage#328
Conversation
jhjpark
left a comment
There was a problem hiding this comment.
Is it possible to combine the edge case tester with test_mhas_v2.py? I think it would be nice if test_mhas_v2 could cover it by itself.
I'd prefer keeping the deterministic edge cases separate. They already use the same tester and reference implementation as test_mhas_v2 Integrating them into random generation would either weaken coverage or add constrained combinations and unnecessary test expansion. |
|
@hwanseoc will submit after necessary waives. LGTM |
|
@cudnn-ci-bot run |
|
🚀 Running mirror pipeline Branch: cudnn-gh/pr-328-be17996 |
|
@cudnn-ci-bot run |
|
🚀 Running mirror pipeline Branch: cudnn-gh/pr-328-be17996 |
|
@cudnn-ci-bot run |
|
🚀 Running mirror pipeline Branch: cudnn-gh/pr-328-be17996 |
@coderabbitai ignore
Summary
seq_len_*and prefix-sumcu_seq_len_*inputs.cu_seq_len_*cases are forward-only because backward plumbing is not supported.Validation
7 passed, 3 skipped(packedseq_len_*backward unsupported)10 passed10 passedtest_sdpa_random_fwd_L0[test1]passed