[taskcluster 2025-01-17 21:20:57.683Z] Task ID: RRuu1gE2R1WvTsjeFbfdFQ
[taskcluster 2025-01-17 21:20:57.684Z] Worker ID: 1765379935702579093
[taskcluster 2025-01-17 21:20:57.684Z] Worker Group: us-central1-b
[taskcluster 2025-01-17 21:20:57.684Z] Worker Node Type: projects/887720501152/machineTypes/n2-standard-2
[taskcluster 2025-01-17 21:20:57.684Z] Worker Pool: translations-1/decision-gcp
[taskcluster 2025-01-17 21:20:57.684Z] Worker Version: 38.0.5
[taskcluster 2025-01-17 21:20:57.684Z] Public IP: 34.66.198.173
[taskcluster 2025-01-17 21:20:57.684Z] Hostname: translations-1-decision-gcp-pex28od1tvif72bks1othw
[taskcluster 2025-01-17 21:20:57.684Z] using cache "translations-level-1-checkouts-sparse-v2" -> /builds/worker/checkouts

559df9a599c4 - Started downloading
3bb7dd3accd0 - Started downloading
b57ab501a8f4 - Started downloading
559df9a599c4 - Downloaded in 0.098 seconds
fad8d951cdaf - Started downloading
b57ab501a8f4 - Downloaded in 0.266 seconds
fad8d951cdaf - Downloaded in 0.018 seconds
3bb7dd3accd0 - Downloaded in 1.104 seconds
Digest: sha256:8c57e30214c85625856479812e63212dc2873b1ffcd97467a7c93508cbb3075a
Status: Downloaded newer image for mozillareleases/taskgraph@sha256:8c57e30214c85625856479812e63212dc2873b1ffcd97467a7c93508cbb3075a
[taskcluster 2025-01-17 21:21:08.189Z] === Task Starting ===
[setup 2025-01-17T21:21:08.836Z] run-task started in /
[setup 2025-01-17T21:21:08.836Z] Invoked by command: --translations-checkout=/builds/worker/checkouts/src -- bash -cx cd /builds/worker/checkouts/src && ln -s /builds/worker/artifacts artifacts && taskgraph decision --pushlog-id='0' --pushdate='0' --project='translations' --owner='[email protected]' --level='1' --repository-type=git --tasks-for='github-pull-request' --base-repository='https://github.com/mozilla/translations' --base-ref='main' --base-rev='2eb36983958147fec3ab223827aea2084379bc15' --head-repository='https://github.com/bhearsum/firefox-translations-training' --head-ref='gpu-multi' --head-rev='c755fc022253a519a7909dce9788b177f00cb150' 

[setup 2025-01-17T21:21:08.836Z] Python version: 3.11.2
[vcs 2025-01-17T21:21:08.838Z] WARNING: vcs checkout path (/builds/worker/checkouts/src) not in cache or volume; performance will likely suffer
[setup 2025-01-17T21:21:08.838Z] running as worker:worker
[vcs 2025-01-17T21:21:08.838Z] executing ['git', 'config', '--global', '--add', 'safe.directory', '/builds/worker/checkouts/src']
[vcs 2025-01-17T21:21:08.840Z] executing ['git', 'clone', 'https://github.com/mozilla/translations', '/builds/worker/checkouts/src']
[vcs 2025-01-17T21:21:08.841Z] Cloning into '/builds/worker/checkouts/src'...
[vcs 2025-01-17T21:21:10.084Z] executing ['git', 'fetch', 'origin', 'main']
[vcs 2025-01-17T21:21:10.313Z] From https://github.com/mozilla/translations
[vcs 2025-01-17T21:21:10.315Z]  * branch            main       -> FETCH_HEAD
[vcs 2025-01-17T21:21:10.321Z] executing ['git', 'checkout', 'main']
[vcs 2025-01-17T21:21:10.375Z] Already on 'main'
[vcs 2025-01-17T21:21:10.376Z] Your branch is up to date with 'origin/main'.
[vcs 2025-01-17T21:21:10.376Z] executing ['git', 'fetch', 'origin', '2eb36983958147fec3ab223827aea2084379bc15']
[vcs 2025-01-17T21:21:10.569Z] From https://github.com/mozilla/translations
[vcs 2025-01-17T21:21:10.569Z]  * branch            2eb36983958147fec3ab223827aea2084379bc15 -> FETCH_HEAD
[vcs 2025-01-17T21:21:10.577Z] executing ['git', 'fetch', '--no-tags', 'https://github.com/bhearsum/firefox-translations-training', 'gpu-multi']
[vcs 2025-01-17T21:21:10.886Z] From https://github.com/bhearsum/firefox-translations-training
[vcs 2025-01-17T21:21:10.886Z]  * branch            gpu-multi  -> FETCH_HEAD
[vcs 2025-01-17T21:21:10.889Z] executing ['git', 'checkout', '-f', '-B', 'gpu-multi', 'c755fc022253a519a7909dce9788b177f00cb150']
[vcs 2025-01-17T21:21:10.990Z] Switched to a new branch 'gpu-multi'
[vcs 2025-01-17T21:21:10.991Z] executing ['git', 'submodule', 'init']
[vcs 2025-01-17T21:21:11.011Z] Submodule '3rd_party/browsermt-marian-dev' (https://github.com/browsermt/marian-dev) registered for path '3rd_party/browsermt-marian-dev'
[vcs 2025-01-17T21:21:11.011Z] Submodule 'extract-lex' (https://github.com/marian-nmt/extract-lex) registered for path '3rd_party/extract-lex'
[vcs 2025-01-17T21:21:11.012Z] Submodule 'fast_align' (https://github.com/clab/fast_align) registered for path '3rd_party/fast_align'
[vcs 2025-01-17T21:21:11.013Z] Submodule '3rd_party/kenlm' (https://github.com/kpu/kenlm) registered for path '3rd_party/kenlm'
[vcs 2025-01-17T21:21:11.014Z] Submodule '3rd_party/marian-dev' (https://github.com/marian-nmt/marian-dev) registered for path '3rd_party/marian-dev'
[vcs 2025-01-17T21:21:11.014Z] Submodule '3rd_party/preprocess' (https://github.com/kpu/preprocess.git) registered for path '3rd_party/preprocess'
[vcs 2025-01-17T21:21:11.015Z] Submodule 'inference/3rd_party/browsermt-marian-dev' (https://github.com/browsermt/marian-dev) registered for path 'inference/3rd_party/browsermt-marian-dev'
[vcs 2025-01-17T21:21:11.016Z] Submodule 'inference/3rd_party/emsdk' (https://github.com/emscripten-core/emsdk.git) registered for path 'inference/3rd_party/emsdk'
[vcs 2025-01-17T21:21:11.016Z] Submodule 'inference/3rd_party/ssplit-cpp' (https://github.com/browsermt/ssplit-cpp) registered for path 'inference/3rd_party/ssplit-cpp'
[vcs 2025-01-17T21:21:11.017Z] executing ['git', 'submodule', 'update', '--force']
[vcs 2025-01-17T21:21:11.038Z] Cloning into '/builds/worker/checkouts/src/3rd_party/browsermt-marian-dev'...
[vcs 2025-01-17T21:21:13.167Z] Cloning into '/builds/worker/checkouts/src/3rd_party/extract-lex'...
[vcs 2025-01-17T21:21:13.437Z] Cloning into '/builds/worker/checkouts/src/3rd_party/fast_align'...
[vcs 2025-01-17T21:21:13.743Z] Cloning into '/builds/worker/checkouts/src/3rd_party/kenlm'...
[vcs 2025-01-17T21:21:14.516Z] Cloning into '/builds/worker/checkouts/src/3rd_party/marian-dev'...
[vcs 2025-01-17T21:21:17.017Z] Cloning into '/builds/worker/checkouts/src/3rd_party/preprocess'...
[vcs 2025-01-17T21:21:17.509Z] Cloning into '/builds/worker/checkouts/src/inference/3rd_party/browsermt-marian-dev'...
[vcs 2025-01-17T21:21:19.579Z] Cloning into '/builds/worker/checkouts/src/inference/3rd_party/emsdk'...
[vcs 2025-01-17T21:21:20.216Z] Cloning into '/builds/worker/checkouts/src/inference/3rd_party/ssplit-cpp'...
[vcs 2025-01-17T21:21:20.613Z] Submodule path '3rd_party/browsermt-marian-dev': checked out '11c6ae7c46be21ef96ed10c60f28022fa968939f'
[vcs 2025-01-17T21:21:20.618Z] Submodule path '3rd_party/extract-lex': checked out '42fa605b53f32eaf6c6e0b5677255c21c91b3d49'
[vcs 2025-01-17T21:21:20.624Z] Submodule path '3rd_party/fast_align': checked out 'cab1e9aac8d3bb02ff5ae58218d8d225a039fa11'
[vcs 2025-01-17T21:21:20.645Z] Submodule path '3rd_party/kenlm': checked out 'bbf4fc511266c5d4515047055d7bdec659a6e158'
[vcs 2025-01-17T21:21:20.747Z] Submodule path '3rd_party/marian-dev': checked out 'e8a1a2530fb84cbff7383302ebca393e5875c441'
[vcs 2025-01-17T21:21:20.762Z] Submodule path '3rd_party/preprocess': checked out '64307314b4d5a9a0bd529b5c1036b0710d995eec'
[vcs 2025-01-17T21:21:20.824Z] Submodule path 'inference/3rd_party/browsermt-marian-dev': checked out '2781d735d4a10dca876d61be587afdab2726293c'
[vcs 2025-01-17T21:21:20.838Z] Submodule path 'inference/3rd_party/emsdk': checked out '2346baa7bb44a4a0571cc75f1986ab9aaa35aa03'
[vcs 2025-01-17T21:21:20.846Z] Submodule path 'inference/3rd_party/ssplit-cpp': checked out 'a311f9865ade34db1e8e080e6cc146f55dafb067'
[vcs 2025-01-17T21:21:20.847Z] cleaning git checkout...
[vcs 2025-01-17T21:21:20.847Z] executing ['git', 'clean', '-nxdff']
[vcs 2025-01-17T21:21:20.852Z] removing []
[vcs 2025-01-17T21:21:20.852Z] successfully cleaned git checkout!
[vcs 2025-01-17T21:21:20.853Z] TinderboxPrint:<a href='https://github.com/bhearsum/firefox-translations-training/commit/c755fc022253a519a7909dce9788b177f00cb150' title='Built from firefox-translations-training commit c755fc022253a519a7909dce9788b177f00cb150'>c755fc022253a519a7909dce9788b177f00cb150</a>
[task 2025-01-17T21:21:20.853Z] executing ['bash', '-cx', "cd /builds/worker/checkouts/src && ln -s /builds/worker/artifacts artifacts && taskgraph decision --pushlog-id='0' --pushdate='0' --project='translations' --owner='[email protected]' --level='1' --repository-type=git --tasks-for='github-pull-request' --base-repository='https://github.com/mozilla/translations' --base-ref='main' --base-rev='2eb36983958147fec3ab223827aea2084379bc15' --head-repository='https://github.com/bhearsum/firefox-translations-training' --head-ref='gpu-multi' --head-rev='c755fc022253a519a7909dce9788b177f00cb150' \n"]
[task 2025-01-17T21:21:20.855Z] + cd /builds/worker/checkouts/src
[task 2025-01-17T21:21:20.856Z] + ln -s /builds/worker/artifacts artifacts
[task 2025-01-17T21:21:20.857Z] + taskgraph decision --pushlog-id=0 --pushdate=0 --project=translations [email protected] --level=1 --repository-type=git --tasks-for=github-pull-request --base-repository=https://github.com/mozilla/translations --base-ref=main --base-rev=2eb36983958147fec3ab223827aea2084379bc15 --head-repository=https://github.com/bhearsum/firefox-translations-training --head-ref=gpu-multi --head-rev=c755fc022253a519a7909dce9788b177f00cb150
[task 2025-01-17T21:21:21.092Z] 2025-01-17 21:21:21,092 - INFO - Loading graph configuration.
[task 2025-01-17T21:21:21.111Z] 2025-01-17 21:21:21,111 - INFO - base_rev is not an ancestor of head_rev.
[task 2025-01-17T21:21:21.111Z] 2025-01-17 21:21:21,111 - INFO - base_rev has been reset from "2eb36983958147fec3ab223827aea2084379bc15" to "65d58e9828e54e8a96346dd0683f1adaac363f63".
[task 2025-01-17T21:21:21.114Z] 2025-01-17 21:21:21,114 - WARNING - using default project parameters; add translations to PER_PROJECT_PARAMETERS in /usr/local/lib/python3.11/dist-packages/taskgraph/decision.py to customize behavior for this project
[task 2025-01-17T21:21:21.122Z] 2025-01-17 21:21:21,122 - INFO - Using Parameters(id=01774d65db7d) (from defaults)
[task 2025-01-17T21:21:21.124Z] 2025-01-17 21:21:21,124 - INFO - writing artifact file `parameters.yml`
[task 2025-01-17T21:21:21.133Z] 2025-01-17 21:21:21,132 - INFO - writing artifact file `actions.json`
[task 2025-01-17T21:21:21.135Z] 2025-01-17 21:21:21,135 - INFO - Loading kinds
[task 2025-01-17T21:21:21.165Z] 2025-01-17 21:21:21,165 - INFO - Generating full task set
[task 2025-01-17T21:21:21.192Z] 2025-01-17 21:21:21,192 - INFO - Generated 12 tasks for kind dataset
[task 2025-01-17T21:21:21.193Z] 2025-01-17 21:21:21,193 - INFO - Writing docker-contexts/base.tar.gz for docker image base
[task 2025-01-17T21:21:21.210Z] 2025-01-17 21:21:21,210 - INFO - Writing docker-contexts/inference.tar.gz for docker image inference
[task 2025-01-17T21:21:21.211Z] 2025-01-17 21:21:21,211 - INFO - Writing docker-contexts/test.tar.gz for docker image test
[task 2025-01-17T21:21:21.212Z] 2025-01-17 21:21:21,212 - INFO - Writing docker-contexts/train.tar.gz for docker image train
[task 2025-01-17T21:21:21.212Z] 2025-01-17 21:21:21,212 - INFO - Writing docker-contexts/toolchain-build.tar.gz for docker image toolchain-build
[task 2025-01-17T21:21:21.231Z] 2025-01-17 21:21:21,231 - INFO - Generated 5 tasks for kind docker-image
[task 2025-01-17T21:21:21.240Z] 2025-01-17 21:21:21,240 - INFO - Generated 9 tasks for kind fetch
[task 2025-01-17T21:21:21.320Z] 2025-01-17 21:21:21,320 - INFO - Generated 10 tasks for kind toolchain
[task 2025-01-17T21:21:21.325Z] 2025-01-17 21:21:21,325 - INFO - Generated 4 tasks for kind analyze-corpus
[task 2025-01-17T21:21:21.329Z] 2025-01-17 21:21:21,329 - INFO - Generated 4 tasks for kind analyze-mono
[task 2025-01-17T21:21:21.335Z] 2025-01-17 21:21:21,335 - INFO - Generated 4 tasks for kind clean-corpus
[task 2025-01-17T21:21:21.337Z] 2025-01-17 21:21:21,337 - INFO - Generated 1 tasks for kind bicleaner-model
[task 2025-01-17T21:21:21.343Z] 2025-01-17 21:21:21,343 - INFO - Generated 4 tasks for kind bicleaner
[task 2025-01-17T21:21:21.348Z] 2025-01-17 21:21:21,348 - INFO - Generated 4 tasks for kind clean-mono
[task 2025-01-17T21:21:21.352Z] 2025-01-17 21:21:21,352 - INFO - Generated 1 tasks for kind merge-corpus
[task 2025-01-17T21:21:21.356Z] 2025-01-17 21:21:21,356 - INFO - Generated 2 tasks for kind merge-mono
[task 2025-01-17T21:21:21.358Z] 2025-01-17 21:21:21,358 - INFO - Generated 1 tasks for kind train-vocab
[task 2025-01-17T21:21:21.360Z] 2025-01-17 21:21:21,360 - INFO - Generated 1 tasks for kind split-corpus
[task 2025-01-17T21:21:21.363Z] 2025-01-17 21:21:21,363 - INFO - Generated 1 tasks for kind merge-devset
[task 2025-01-17T21:21:21.367Z] 2025-01-17 21:21:21,367 - INFO - Generated 4 tasks for kind inference
[task 2025-01-17T21:21:21.371Z] 2025-01-17 21:21:21,371 - INFO - Generated 1 tasks for kind train-backwards
[task 2025-01-17T21:21:21.373Z] 2025-01-17 21:21:21,373 - INFO - Generated 1 tasks for kind split-mono-src
[task 2025-01-17T21:21:21.376Z] 2025-01-17 21:21:21,376 - INFO - Generated 1 tasks for kind split-mono-trg
[task 2025-01-17T21:21:21.380Z] 2025-01-17 21:21:21,380 - INFO - Generated 7 tasks for kind tests
[task 2025-01-17T21:21:21.384Z] 2025-01-17 21:21:21,384 - INFO - Generated 2 tasks for kind translate-mono-trg
[task 2025-01-17T21:21:21.388Z] 2025-01-17 21:21:21,388 - INFO - Generated 1 tasks for kind collect-mono-trg
[task 2025-01-17T21:21:21.390Z] 2025-01-17 21:21:21,390 - INFO - Generated 1 tasks for kind alignments-original
[task 2025-01-17T21:21:21.393Z] 2025-01-17 21:21:21,393 - INFO - Generated 1 tasks for kind alignments-backtranslated
[task 2025-01-17T21:21:21.396Z] 2025-01-17 21:21:21,396 - INFO - Generated 1 tasks for kind train-teacher
[task 2025-01-17T21:21:21.399Z] 2025-01-17 21:21:21,399 - INFO - Generated 1 tasks for kind evaluate-teacher-ensemble
[task 2025-01-17T21:21:21.403Z] 2025-01-17 21:21:21,403 - INFO - Generated 2 tasks for kind translate-corpus
[task 2025-01-17T21:21:21.406Z] 2025-01-17 21:21:21,406 - INFO - Generated 2 tasks for kind extract-best
[task 2025-01-17T21:21:21.408Z] 2025-01-17 21:21:21,408 - INFO - Generated 1 tasks for kind collect-corpus
[task 2025-01-17T21:21:21.412Z] 2025-01-17 21:21:21,412 - INFO - Generated 2 tasks for kind translate-mono-src
[task 2025-01-17T21:21:21.414Z] 2025-01-17 21:21:21,414 - INFO - Generated 1 tasks for kind collect-mono-src
[task 2025-01-17T21:21:21.417Z] 2025-01-17 21:21:21,417 - INFO - Generated 1 tasks for kind merge-translated
[task 2025-01-17T21:21:21.419Z] 2025-01-17 21:21:21,419 - INFO - Generated 1 tasks for kind score
[task 2025-01-17T21:21:21.421Z] 2025-01-17 21:21:21,421 - INFO - Generated 1 tasks for kind cefilter
[task 2025-01-17T21:21:21.424Z] 2025-01-17 21:21:21,424 - INFO - Generated 1 tasks for kind shortlist
[task 2025-01-17T21:21:21.426Z] 2025-01-17 21:21:21,426 - INFO - Generated 1 tasks for kind alignments-student
[task 2025-01-17T21:21:21.429Z] 2025-01-17 21:21:21,428 - INFO - Generated 1 tasks for kind train-student
[task 2025-01-17T21:21:21.431Z] 2025-01-17 21:21:21,431 - INFO - Generated 1 tasks for kind finetune-student
[task 2025-01-17T21:21:21.433Z] 2025-01-17 21:21:21,433 - INFO - Generated 1 tasks for kind quantize
[task 2025-01-17T21:21:21.436Z] 2025-01-17 21:21:21,436 - INFO - Generated 1 tasks for kind export
[task 2025-01-17T21:21:21.438Z] 2025-01-17 21:21:21,438 - INFO - Generated 1 tasks for kind evaluate-quantized
[task 2025-01-17T21:21:21.444Z] 2025-01-17 21:21:21,444 - INFO - Generated 4 tasks for kind evaluate
[task 2025-01-17T21:21:21.446Z] 2025-01-17 21:21:21,446 - INFO - Generated 1 tasks for kind all-pipeline
[task 2025-01-17T21:21:21.447Z] 2025-01-17 21:21:21,447 - INFO - Generated 1 tasks for kind all-pr-pipeline
[task 2025-01-17T21:21:21.447Z] 2025-01-17 21:21:21,447 - INFO - Generating full task graph
[task 2025-01-17T21:21:21.447Z] 2025-01-17 21:21:21,447 - INFO - Full task graph contains 108 tasks and 333 dependencies
[task 2025-01-17T21:21:21.452Z] 2025-01-17 21:21:21,452 - INFO - writing artifact file `full-task-graph.json`
[task 2025-01-17T21:21:21.473Z] 2025-01-17 21:21:21,473 - INFO - writing artifact file `runnable-jobs.json`
[task 2025-01-17T21:21:21.474Z] 2025-01-17 21:21:21,474 - INFO - Generating target task set
[task 2025-01-17T21:21:21.475Z] 2025-01-17 21:21:21,475 - INFO - Filter filter_target_tasks pruned 86 tasks (22 remain)
[task 2025-01-17T21:21:21.475Z] 2025-01-17 21:21:21,475 - INFO - writing artifact file `target-tasks.json`
[task 2025-01-17T21:21:21.475Z] 2025-01-17 21:21:21,475 - INFO - Generating target task graph
[task 2025-01-17T21:21:21.475Z] 2025-01-17 21:21:21,475 - INFO - Adding 5 tasks with `always_target` attribute
[task 2025-01-17T21:21:21.476Z] 2025-01-17 21:21:21,476 - INFO - Generating optimized task graph
[task 2025-01-17T21:21:21.481Z] 2025-01-17 21:21:21,481 - INFO - Removed 4 tasks by skip-unless-changed (skip-unless-changed) during optimization.
[task 2025-01-17T21:21:21.824Z] 2025-01-17 21:21:21,824 - INFO - Replaced 93 tasks by index-search (index-search) during optimization.
[task 2025-01-17T21:21:21.825Z] 2025-01-17 21:21:21,825 - INFO - writing artifact file `task-graph.json`
[task 2025-01-17T21:21:21.827Z] 2025-01-17 21:21:21,827 - INFO - writing artifact file `label-to-taskid.json`
[task 2025-01-17T21:21:21.829Z] 2025-01-17 21:21:21,829 - INFO - Creating task with taskId Qbq43w88TUqJeG4hm8CcRA for evaluate-quantized-flores-devtest-ru-en
[task 2025-01-17T21:21:21.830Z] 2025-01-17 21:21:21,830 - INFO - Creating task with taskId WfQ8JzM1R0-P_J-p2v3qMw for tests-taskgraph-diff
[task 2025-01-17T21:21:21.834Z] 2025-01-17 21:21:21,833 - INFO - Creating task with taskId H6RBv4epSW2ZbRtz4h8VAw for tests-lint-ruff
[task 2025-01-17T21:21:21.835Z] 2025-01-17 21:21:21,835 - INFO - Creating task with taskId GyAurJiuR16Db12H2zyaWg for tests-lint-pyright
[task 2025-01-17T21:21:21.841Z] 2025-01-17 21:21:21,841 - INFO - Creating task with taskId KyWeMRtlTV-CbbCYl-krDA for tests-taskgraph-definition
[task 2025-01-17T21:21:21.844Z] 2025-01-17 21:21:21,844 - INFO - Creating task with taskId IeQCOgD8Rf6_blggxwLWnw for tests-lint-eslint
[task 2025-01-17T21:21:21.847Z] 2025-01-17 21:21:21,845 - INFO - Creating task with taskId HBhx2r3PTK2WiHCmWT8Jyw for tests-lint-black
[task 2025-01-17T21:21:21.849Z] 2025-01-17 21:21:21,849 - INFO - Creating task with taskId OviEUK8YTj-oyL1-lY8gCg for tests-test
[task 2025-01-17T21:21:21.979Z] 2025-01-17 21:21:21,979 - INFO - Creating task with taskId FmqRtZCsTkamnVUcSMJkVg for all-pr-pipeline-ru-en-1
[taskcluster 2025-01-17 21:21:22.742Z] === Task Finished ===
[taskcluster 2025-01-17 21:21:25.001Z] Successful task run with exit code: 0 completed in 27.319 seconds