Skip to content

cuda-perf

cuda-perf #105

Triggered via schedule December 23, 2025 08:01
Status Failure
Total duration 1h 23m 25s
Artifacts 28

cuda-perf.yml

on: schedule
set-parameters
9s
set-parameters
Matrix: export-models
Matrix: benchmark-cuda
upload-benchmark-results
1m 16s
upload-benchmark-results
Fit to window
Zoom out
Zoom in

Annotations

10 errors and 2 warnings
export-models (openai/whisper-large-v3-turbo, quantized-int4-weight-only, openai_whisper-large-v3... / linux-job
clone of 'https://github.com/nlohmann/json.git' into submodule path '/home/ec2-user/actions-runner/_work/executorch/executorch/pytorch/executorch/extension/llm/tokenizers/third-party/json' failed
benchmark-cuda (mistralai/Voxtral-Mini-3B-2507, non-quantized, mistralai_Voxtral-Mini-3B-2507, 50) / linux-job
Fetched in submodule path 'shim', but it did not contain cf6a954aae4bee7b4515e13475878460115027d1. Direct fetching of that commit failed.
benchmark-cuda (openai/whisper-medium, quantized-int4-weight-only, openai_whisper-medium, 50) / linux-job
The process '/usr/bin/git' failed with exit code 128
benchmark-cuda (openai/whisper-medium, quantized-int4-weight-only, openai_whisper-medium, 50) / linux-job
Fetched in submodule path 'backends/xnnpack/third-party/pthreadpool', but it did not contain c2ba5c50bb58d1397b693740cf75fad836a0d1bf. Direct fetching of that commit failed.
benchmark-cuda (google/gemma-3-4b-it, non-quantized, google_gemma-3-4b-it, 50) / linux-job
unable to access 'https://github.com/zherczeg/sljit.git/': Connection timed out after 300039 milliseconds
benchmark-cuda (mistralai/Voxtral-Mini-3B-2507, non-quantized, mistralai_Voxtral-Mini-3B-2507, 50) / linux-job
No files were found with the provided path: /home/ec2-user/actions-runner/_work/_temp/artifacts/. No artifacts will be uploaded.
benchmark-cuda (openai/whisper-medium, quantized-int4-weight-only, openai_whisper-medium, 50) / linux-job
No files were found with the provided path: /home/ec2-user/actions-runner/_work/_temp/artifacts/. No artifacts will be uploaded.

Artifacts

Produced during runtime
Name Size Digest
model-google_gemma-3-4b-it-non-quantized Expired
7.22 GB
sha256:42ea6e96b2f46549fa2160721e97ddab675dc2df3774ef202f910f930fc07265
model-google_gemma-3-4b-it-quantized-int4-tile-packed Expired
3.36 GB
sha256:94081e9fa67b5f7488ba3ce2c77bd28ce05485fa12de88ab3349056ab3ecf33e
model-google_gemma-3-4b-it-quantized-int4-weight-only Expired
6.95 GB
sha256:04cb886dcdc9ec9d0e25515c838cf8eaab11d4917311bbc5348a1993e7c43ef6
model-mistralai_Voxtral-Mini-3B-2507-non-quantized Expired
6.82 GB
sha256:357fb1ec8c56ba4d536e0ea9d9e47b2667bcd8ceca2701cfad4a38c3b2f04e79
model-mistralai_Voxtral-Mini-3B-2507-quantized-int4-tile-packed Expired
2.8 GB
sha256:a633174785a343e95905507508afb065c5b890322ea48593b645d63467d415d6
model-mistralai_Voxtral-Mini-3B-2507-quantized-int4-weight-only Expired
6.14 GB
sha256:8135c8ac1e36f71cabef29c0c87ab97e0ac5de455d5aee40ab2e20687757854c
model-openai_whisper-large-v3-turbo-non-quantized Expired
1.18 GB
sha256:bc92ce72c9ce7a827d7ffd92c8122fae1fbdc5028ebc370f4336fdcf552abdfb
model-openai_whisper-large-v3-turbo-quantized-int4-tile-packed Expired
491 MB
sha256:aac48c3fe1f2e98aa2bcc2da6a082dbf04d66e44328714096d3ad9d82a8b120c
model-openai_whisper-large-v3-turbo-quantized-int4-weight-only Expired
485 MB
sha256:7cd6240cc184fc6070e29fcbd07fe280e1999d81d48467287c5c51d005bead08
model-openai_whisper-medium-non-quantized Expired
1.12 GB
sha256:1605a265e2e0cdfbffe6efffe82bf8fbe81df404e17c4279a187eada4f2dd329
model-openai_whisper-medium-quantized-int4-tile-packed Expired
471 MB
sha256:6896c19459c46cd993135e0ca27c60d7cdb06d2fc1a0cb2a75bf756272302bf3
model-openai_whisper-medium-quantized-int4-weight-only Expired
806 MB
sha256:10c190f3b9a22e851489110b7cc1cac6aad5add28935df1d388c9af955ddcd53
model-openai_whisper-small-non-quantized Expired
361 MB
sha256:a3fffb818db8029eae18a757fdf53051a688d9e56e8c496823ac449c999c490b
model-openai_whisper-small-quantized-int4-tile-packed Expired
172 MB
sha256:5dd8abf769812af1e5f53b53120ee565165185a50e350f14e885a20219b72bcb
model-openai_whisper-small-quantized-int4-weight-only Expired
270 MB
sha256:7068929988f3e67e165f8be60ea5bb684496edf2df150d2346f785a8d9a203b8
results-google_gemma-3-4b-it-non-quantized Expired
1.66 KB
sha256:fd180b3a8ab923e55da1f7280fc42b00832248202acb47b5e3c4adbed290b096
results-google_gemma-3-4b-it-quantized-int4-tile-packed Expired
1.68 KB
sha256:b53bf923df35cff0f0210f4b07810e205e020d63f7ee7db9a0af93a463ff1970
results-google_gemma-3-4b-it-quantized-int4-weight-only Expired
1.69 KB
sha256:c70fc47f1bb276fe93fb07f2e770fe08c23565273b04edb6d1cd9a3990a94374
results-mistralai_Voxtral-Mini-3B-2507-quantized-int4-tile-packed Expired
1.69 KB
sha256:8bea9af281d5e4507ada17584d044ffdd8e145211b93b96e86790a9f9e2bbc3e
results-mistralai_Voxtral-Mini-3B-2507-quantized-int4-weight-only Expired
1.7 KB
sha256:c5b4e9e8bd9a22105ed335398553f699f6a620896574d1d4e2712f705dbc5abb
results-openai_whisper-large-v3-turbo-non-quantized Expired
1.18 GB
sha256:eb40ce94c686873e20bd54edbc21d0884cc6e591a3c6849fe4ef4f32188f7da9
results-openai_whisper-large-v3-turbo-quantized-int4-tile-packed Expired
1.72 KB
sha256:76fe63de34580873fd7ee87248aa110335ca35896040c6eb29cf9a5871107430
results-openai_whisper-large-v3-turbo-quantized-int4-weight-only Expired
1.73 KB
sha256:9962ce219489729cc4aad6ba6d61ef79a6ced5b34eaf9ee62a74e5c3e52d4491
results-openai_whisper-medium-non-quantized Expired
1.68 KB
sha256:19570e75ed7f89da6a77472be8890ffeeb749dab1259c7b6a6d5a1c27d8564fd
results-openai_whisper-medium-quantized-int4-tile-packed Expired
1.7 KB
sha256:ff20eea0ec98aef7e8615433f2554c608d1a693d059dd8765329699174ed6bed
results-openai_whisper-small-non-quantized Expired
1.67 KB
sha256:3e75a22b2a1c65ed3c09613a184acdb4afc0d81e6a784f26eecfa804661e14ea
results-openai_whisper-small-quantized-int4-tile-packed Expired
1.68 KB
sha256:29b3bac80bc816f51880ee9b18554b2faa0f9508affef590beae9fca3b760781
results-openai_whisper-small-quantized-int4-weight-only Expired
1.7 KB
sha256:d02002aa493d0a4096d50b7c5316cf64a63af5c13e3dca5e6e54aa48d38c5514