You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
I used convert_float_to_float16 function to convert fp32 models to fp16, but some models have outputs that have changed significantly due to overflow.
I think bf16 is useful to avoid overflow in such cases.
In the convert_float_to_float16 function, FLOAT16 is hard-coded and could not be changed to BFLOAT16 and so on.
I think that it would be more useful if it could be changed.
Thank you.
The text was updated successfully, but these errors were encountered:
I used
convert_float_to_float16
function to convert fp32 models to fp16, but some models have outputs that have changed significantly due to overflow.I think bf16 is useful to avoid overflow in such cases.
In the
convert_float_to_float16
function,FLOAT16
is hard-coded and could not be changed toBFLOAT16
and so on.I think that it would be more useful if it could be changed.
Thank you.
The text was updated successfully, but these errors were encountered: