Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Enable MLIR by default in migraphx builds #2037

Merged
merged 21 commits into from
Aug 11, 2023
Merged

Enable MLIR by default in migraphx builds #2037

merged 21 commits into from
Aug 11, 2023

Conversation

pfultz2
Copy link
Collaborator

@pfultz2 pfultz2 commented Aug 3, 2023

No description provided.

@codecov
Copy link

codecov bot commented Aug 4, 2023

Codecov Report

Merging #2037 (ac60ff6) into develop (065d06a) will not change coverage.
The diff coverage is n/a.

❗ Current head ac60ff6 differs from pull request most recent head e9bd9ac. Consider uploading reports for the commit e9bd9ac to get more accurate results

@@           Coverage Diff            @@
##           develop    #2037   +/-   ##
========================================
  Coverage    91.40%   91.40%           
========================================
  Files          422      422           
  Lines        15645    15645           
========================================
  Hits         14301    14301           
  Misses        1344     1344           

rbuild.ini Outdated Show resolved Hide resolved
@umangyadav
Copy link
Member

what's the purpose behind having it enabled by default ?
I see that we already have Jenkins job that builds MIGraphX with MLIR.

@@ -77,6 +77,9 @@ ADD dev-requirements.txt /dev-requirements.txt
ADD requirements.txt /requirements.txt
ADD rbuild.ini /rbuild.ini

# Temporarily install a new cmake until switching to ubuntu 22.04
RUN pip3 install cmake==3.22.1
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

ORT needs 3.26.4 would it make sense to bump this to 3.26.4 too?

Copy link
Collaborator Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

no, we should make sure our stuff builds with the cmake in ubuntu 22.04.

Copy link
Collaborator

@causten causten left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

builds and runs as expected.

@pfultz2
Copy link
Collaborator Author

pfultz2 commented Aug 4, 2023

The tidy error requires a fix in rocm-cmake: ROCm/rocm-cmake#140

@migraphx-bot
Copy link
Collaborator

migraphx-bot commented Aug 9, 2023

Test Batch Rate new
e9bd9a
Rate old
065d06
Diff Compare
torchvision-resnet50 64 2,275.64 2,276.51 -0.04%
torchvision-resnet50_fp16 64 5,341.92 5,340.77 0.02%
torchvision-densenet121 32 1,833.33 1,837.64 -0.23%
torchvision-densenet121_fp16 32 3,382.42 3,375.49 0.21%
torchvision-inceptionv3 32 1,343.84 1,343.71 0.01%
torchvision-inceptionv3_fp16 32 2,529.36 2,520.84 0.34%
cadene-inceptionv4 16 675.95 677.79 -0.27%
cadene-resnext64x4 16 589.31 591.12 -0.31%
slim-mobilenet 64 7,213.80 7,207.63 0.09%
slim-nasnetalarge 64 236.14 236.08 0.03%
slim-resnet50v2 64 2,521.58 2,519.90 0.07%
bert-mrpc-onnx 8 719.26 717.63 0.23%
bert-mrpc-tf 1 363.29 364.68 -0.38%
pytorch-examples-wlang-gru 1 315.74 312.99 0.88%
pytorch-examples-wlang-lstm 1 318.16 315.97 0.69%
torchvision-resnet50_1 1 562.83 556.65 1.11%
torchvision-inceptionv3_1 1 306.32 305.74 0.19%
cadene-dpn92_1 1 358.96 354.11 1.37%
cadene-resnext101_1 1 219.74 219.79 -0.02%
slim-vgg16_1 1 223.67 223.39 0.13%
slim-mobilenet_1 1 1,486.87 1,449.30 2.59%
slim-inceptionv4_1 1 222.07 223.03 -0.43%
onnx-taau-downsample 1 321.11 320.68 0.14%
dlrm-criteoterabyte 1 21.67 21.65 0.10%
dlrm-criteoterabyte_fp16 1 40.55 40.57 -0.06%
agentmodel 1 5,761.80 5,856.41 -1.62%
unet_fp16 2 54.99 55.00 -0.03%

This build is OK for merge ✅

@migraphx-bot
Copy link
Collaborator


    :white_check_mark:bert-mrpc-onnx: PASSED: MIGraphX meets tolerance

    :white_check_mark:bert-mrpc-tf: PASSED: MIGraphX meets tolerance

    :white_check_mark:pytorch-examples-wlang-gru: PASSED: MIGraphX meets tolerance

    :white_check_mark:pytorch-examples-wlang-lstm: PASSED: MIGraphX meets tolerance

    :white_check_mark:torchvision-resnet50_1: PASSED: MIGraphX meets tolerance

🔴torchvision-inceptionv3_1: FAILED: MIGraphX is not within tolerance - check verbose output


🔴cadene-dpn92_1: FAILED: MIGraphX is not within tolerance - check verbose output


    :white_check_mark:cadene-resnext101_1: PASSED: MIGraphX meets tolerance

    :white_check_mark:slim-vgg16_1: PASSED: MIGraphX meets tolerance

    :white_check_mark:slim-mobilenet_1: PASSED: MIGraphX meets tolerance

🔴slim-inceptionv4_1: FAILED: MIGraphX is not within tolerance - check verbose output


    :white_check_mark:dlrm-criteoterabyte: PASSED: MIGraphX meets tolerance

    :white_check_mark:agentmodel: PASSED: MIGraphX meets tolerance

    :white_check_mark:unet: PASSED: MIGraphX meets tolerance

@causten
Copy link
Collaborator

causten commented Aug 9, 2023

what's the purpose behind having it enabled by default ? I see that we already have Jenkins job that builds MIGraphX with MLIR.

The goal has been to use rocMLIR to aid in performance optimizations. Just waiting until rocm5.7 was branched to turn it on. Now all teams can simple turn on a runtime flag rather then rebuilding migraphx manually

@causten causten merged commit 110eb00 into develop Aug 11, 2023
11 checks passed
@causten causten deleted the default-mlir branch August 11, 2023 00:58
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants