We read every piece of feedback, and take your input very seriously.
To see all available qualifiers, see our documentation.
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
HDiT arch is not traceable,
Fixes :
K_DIFFUSION_USE_COMPILE
0
models/modules/hdit/flags.py#L9
apply_rotary_embed_
However apply_rotary_embed models/modules/hdit/hdit.py#L202
apply_rotary_embed
So it should be a matter of monkey patching the two functions at export time :
Example :
def export(opt, cuda, model_in_file, model_out_file, opset_version, export_type): model = gan_networks.define_G(**vars(opt)) if isinstance(model, models.modules.hdit.hdit.HDiT): models.modules.hdit.hdit.apply_rotary_emb_ = ( models.modules.hdit.hdit.apply_rotary_emb )
PR should be up in the following days
The text was updated successfully, but these errors were encountered:
No branches or pull requests
HDiT arch is not traceable,
Fixes :
K_DIFFUSION_USE_COMPILE
should be set to0
at export time in order to bypass the torch.compile ops that can't be tracedmodels/modules/hdit/flags.py#L9
apply_rotary_embed_
is not traceable models/modules/hdit/hdit.py#L218However
apply_rotary_embed
models/modules/hdit/hdit.py#L202So it should be a matter of monkey patching the two functions at export time :
Example :
PR should be up in the following days
The text was updated successfully, but these errors were encountered: