You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
I'm still working on finding a minimal repro, but I'm running into issues working with a full Flux pipeline and isolated the issue to t5xxl. When I replace t5xxl_bf16 with a fp32 variant, everything works fine, but with bf16 the images don't follow the prompt. t5 bf16 mlir t5 fp32 mlir
What happened?
I'm still working on finding a minimal repro, but I'm running into issues working with a full Flux pipeline and isolated the issue to t5xxl. When I replace t5xxl_bf16 with a fp32 variant, everything works fine, but with bf16 the images don't follow the prompt.
t5 bf16 mlir
t5 fp32 mlir
Steps to reproduce your issue
~/kherndon/iree-build/tools/iree-compile --iree-hal-target-backends=rocm --iree-hip-target=gfx942 t5xxl_bf16.mlir -o t5xxl.vmfb
What component(s) does this issue relate to?
Compiler
Version information
278e63a
Additional context
I was also able to run this model correctly with bf16 eager through sharktank, but after compilation it fails.
The text was updated successfully, but these errors were encountered: