env B200
test with CUDA12.9 ok
test with CUDA13.0 fail
root@localhost:/#python3 tests/test_fwd.py
Testing shape: [1, 8192, 96, 128]
67072.0 67072.0
output | avg_rtol: 3.68277053297561e-09, max_rtol: 4.6591722480116005e-07
output | avg_atol: 6.617795200725141e-09, max_atol: 0.03125
Traceback (most recent call last):
File "/home/users/qyp/flash-kda/tests/test_fwd.py", line 428, in
test_fwd()
File "/home/users/qyp/flash-kda/tests/test_fwd.py", line 260, in test_fwd
assert torch.equal(out_kernel, out_ref), "output mismatch between kernel and torch ref"
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
AssertionError: output mismatch between kernel and torch ref
env B200
test with CUDA12.9 ok
test with CUDA13.0 fail