Skip to content

Commit

Permalink
fixed incorrect kwarg name in TP overlap test
Browse files Browse the repository at this point in the history
Signed-off-by: Alp Dener <[email protected]>
  • Loading branch information
denera committed Nov 22, 2024
1 parent 7bd26b0 commit ab9e05f
Showing 1 changed file with 1 addition and 1 deletion.
2 changes: 1 addition & 1 deletion tests/pytorch/distributed/run_layer_with_overlap.py
Original file line number Diff line number Diff line change
Expand Up @@ -266,7 +266,7 @@ def dist_print(msg, src=None, end="\n", debug=False, error=False):
use_fp8=opts.fp8,
dtype=torch.bfloat16,
bootstrap_backend=opts.bootstrap_backend,
ub_cfg=_get_ub_cfg(opts.layer_type),
ub_cfgs=_get_ub_cfg(opts.layer_type),
)

# Initialize the Transformer Engine layer with overlap
Expand Down

0 comments on commit ab9e05f

Please sign in to comment.