Does SageAttention support hunyuan video

[anoyiuhu]

Dear SageAttention team,

May I ask if there exist the example codes for hunyuan video?

[jason-huang03]

Yes of course! @jt-zhang can you provide the example code?

[anoyiuhu]

Thanks in advance! I encountered an error of "head dime (>512) not supported" when I tried it by myself

That's why I seek guidance from you!

[jason-huang03]

Hi, please refer to how SageAttention is integrated with mochi as an example. There might be some attention operation in the video model outside the DiT block that has an abnormal shape.

[zhiwei-dong]

Any tutorial for this?

[wangshankun]

e. There might be some attention operation in the video model outside the DiT block that has an abnormal shape.

@jason-huang03 sage triton kernel compile errror for hunyuan video: