fix Dataset importer problems #342
Open
firefoxci-taskcluster / Decision Task (pull-request)
succeeded
Jan 29, 2024 in 24s
FirefoxCI (pull_request)
The task that creates all of the other tasks in the task graph
Details
View task in Taskcluster
View logs in Taskcluster
[taskcluster 2024-01-29 17:42:10.010Z] Task ID: N4_KnVy-TDieuZ7WQILuAg
[taskcluster 2024-01-29 17:42:10.010Z] Worker ID: 5476596880548454069
[taskcluster 2024-01-29 17:42:10.010Z] Worker Group: us-central1
[taskcluster 2024-01-29 17:42:10.010Z] Worker Node Type: projects/887720501152/machineTypes/n2-standard-2
[taskcluster 2024-01-29 17:42:10.010Z] Worker Pool: translations-1/decision-gcp
[taskcluster 2024-01-29 17:42:10.010Z] Worker Version: 38.0.5
[taskcluster 2024-01-29 17:42:10.010Z] Public IP: 34.41.64.215
[taskcluster 2024-01-29 17:42:10.010Z] Hostname: translations-1-decision-gcp-f-p8-thiqv202kh4mnzz-a
[taskcluster 2024-01-29 17:42:10.010Z] using cache "translations-level-1-checkouts-sparse-v2" -> /builds/worker/checkouts
[taskcluster 2024-01-29 17:42:10.587Z] === Task Starting ===
[setup 2024-01-29T17:42:10.929Z] run-task started in /
[setup 2024-01-29T17:42:10.929Z] Invoked by command: --firefox_translations_training-checkout=/builds/worker/checkouts/src -- bash -cx cd /builds/worker/checkouts/src && ln -s /builds/worker/artifacts artifacts && ~/.local/bin/taskgraph decision --pushlog-id='0' --pushdate='0' --project='firefox-translations-training' --owner='AmitMY@users.noreply.github.com' --level='1' --repository-type=git --tasks-for='github-pull-request' --base-repository='https://github.com/mozilla/firefox-translations-training' --base-ref='main' --base-rev='225b30df9a61a6ea8e6239a1290522a9de81b40c' --head-repository='https://github.com/AmitMY/firefox-translations-training' --head-ref='patch-11' --head-rev='11268076b51421847e9698a5bd754f8a39de9f2c'
[setup 2024-01-29T17:42:10.929Z] Python version: 3.11.2
[vcs 2024-01-29T17:42:10.931Z] WARNING: vcs checkout path (/builds/worker/checkouts/src) not in cache or volume; performance will likely suffer
[setup 2024-01-29T17:42:10.931Z] running as worker:worker
[vcs 2024-01-29T17:42:10.931Z] executing ['git', 'config', '--global', '--add', 'safe.directory', '/builds/worker/checkouts/src']
[vcs 2024-01-29T17:42:10.933Z] executing ['git', 'fetch', 'origin', 'main']
[vcs 2024-01-29T17:42:11.174Z] From https://github.com/mozilla/firefox-translations-training
[vcs 2024-01-29T17:42:11.176Z] * branch main -> FETCH_HEAD
[vcs 2024-01-29T17:42:11.180Z] executing ['git', 'checkout', 'main']
[vcs 2024-01-29T17:42:11.206Z] Switched to branch 'main'
[vcs 2024-01-29T17:42:11.207Z] Your branch is behind 'origin/main' by 1 commit, and can be fast-forwarded.
[vcs 2024-01-29T17:42:11.207Z] (use "git pull" to update your local branch)
[vcs 2024-01-29T17:42:11.207Z] executing ['git', 'fetch', 'origin', '225b30df9a61a6ea8e6239a1290522a9de81b40c']
[vcs 2024-01-29T17:42:11.477Z] From https://github.com/mozilla/firefox-translations-training
[vcs 2024-01-29T17:42:11.477Z] * branch 225b30df9a61a6ea8e6239a1290522a9de81b40c -> FETCH_HEAD
[vcs 2024-01-29T17:42:11.484Z] executing ['git', 'fetch', '--no-tags', 'https://github.com/AmitMY/firefox-translations-training', 'patch-11']
[vcs 2024-01-29T17:42:11.769Z] From https://github.com/AmitMY/firefox-translations-training
[vcs 2024-01-29T17:42:11.769Z] * branch patch-11 -> FETCH_HEAD
[vcs 2024-01-29T17:42:11.772Z] executing ['git', 'checkout', '-f', '-B', 'patch-11', '11268076b51421847e9698a5bd754f8a39de9f2c']
[vcs 2024-01-29T17:42:11.778Z] Switched to a new branch 'patch-11'
[vcs 2024-01-29T17:42:11.778Z] executing ['git', 'submodule', 'init']
[vcs 2024-01-29T17:42:11.802Z] executing ['git', 'submodule', 'update', '--force']
[vcs 2024-01-29T17:42:11.835Z] Submodule path '3rd_party/browsermt-marian-dev': checked out '11c6ae7c46be21ef96ed10c60f28022fa968939f'
[vcs 2024-01-29T17:42:11.841Z] Submodule path '3rd_party/extract-lex': checked out '42fa605b53f32eaf6c6e0b5677255c21c91b3d49'
[vcs 2024-01-29T17:42:11.848Z] Submodule path '3rd_party/fast_align': checked out 'cab1e9aac8d3bb02ff5ae58218d8d225a039fa11'
[vcs 2024-01-29T17:42:11.855Z] Submodule path '3rd_party/kenlm': checked out 'bbf4fc511266c5d4515047055d7bdec659a6e158'
[vcs 2024-01-29T17:42:11.866Z] Submodule path '3rd_party/marian-dev': checked out 'e8a1a2530fb84cbff7383302ebca393e5875c441'
[vcs 2024-01-29T17:42:11.874Z] Submodule path '3rd_party/preprocess': checked out '64307314b4d5a9a0bd529b5c1036b0710d995eec'
[vcs 2024-01-29T17:42:11.875Z] cleaning git checkout...
[vcs 2024-01-29T17:42:11.875Z] executing ['git', 'clean', '-nxdff']
[vcs 2024-01-29T17:42:11.879Z] removing ['/builds/worker/checkouts/src/artifacts', '/builds/worker/checkouts/src/docker-contexts/', '/builds/worker/checkouts/src/taskcluster/translations_taskgraph/__pycache__/', '/builds/worker/checkouts/src/taskcluster/translations_taskgraph/actions/__pycache__/', '/builds/worker/checkouts/src/taskcluster/translations_taskgraph/transforms/__pycache__/', '/builds/worker/checkouts/src/taskcluster/translations_taskgraph/util/__pycache__/']
[vcs 2024-01-29T17:42:11.881Z] successfully cleaned git checkout!
[vcs 2024-01-29T17:42:11.883Z] TinderboxPrint:<a href='https://github.com/AmitMY/firefox-translations-training/commit/11268076b51421847e9698a5bd754f8a39de9f2c' title='Built from firefox-translations-training commit 11268076b51421847e9698a5bd754f8a39de9f2c'>11268076b51421847e9698a5bd754f8a39de9f2c</a>
[pip-install 2024-01-29T17:42:11.883Z] executing ['/usr/bin/python3', '-mpip', 'install', '--break-system-packages', '--require-hashes', '-r', '/builds/worker/checkouts/src/taskcluster/requirements.txt']
[pip-install 2024-01-29T17:42:12.200Z] Defaulting to user installation because normal site-packages is not writeable
[pip-install 2024-01-29T17:42:12.306Z] Requirement already satisfied: appdirs==1.4.4 in /usr/local/lib/python3.11/dist-packages (from -r /builds/worker/checkouts/src/taskcluster/requirements.txt (line 7)) (1.4.4)
[pip-install 2024-01-29T17:42:12.411Z] Collecting arrow==1.3.0
[pip-install 2024-01-29T17:42:12.575Z] Downloading arrow-1.3.0-py3-none-any.whl (66 kB)
[pip-install 2024-01-29T17:42:12.626Z] ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 66.4/66.4 kB 1.3 MB/s eta 0:00:00
[pip-install 2024-01-29T17:42:12.631Z] Requirement already satisfied: binaryornot==0.4.4 in /usr/local/lib/python3.11/dist-packages (from -r /builds/worker/checkouts/src/taskcluster/requirements.txt (line 15)) (0.4.4)
[pip-install 2024-01-29T17:42:12.665Z] Collecting certifi==2023.11.17
[pip-install 2024-01-29T17:42:12.707Z] Downloading certifi-2023.11.17-py3-none-any.whl (162 kB)
[pip-install 2024-01-29T17:42:12.755Z] ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 162.5/162.5 kB 3.4 MB/s eta 0:00:00
[pip-install 2024-01-29T17:42:12.778Z] Collecting chardet==5.2.0
[pip-install 2024-01-29T17:42:12.820Z] Downloading chardet-5.2.0-py3-none-any.whl (199 kB)
[pip-install 2024-01-29T17:42:12.836Z] ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 199.4/199.4 kB 14.8 MB/s eta 0:00:00
[pip-install 2024-01-29T17:42:12.992Z] Collecting charset-normalizer==3.3.2
[pip-install 2024-01-29T17:42:13.034Z] Downloading charset_normalizer-3.3.2-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (140 kB)
[pip-install 2024-01-29T17:42:13.043Z] ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 140.3/140.3 kB 24.6 MB/s eta 0:00:00
[pip-install 2024-01-29T17:42:13.080Z] Collecting click==8.1.7
[pip-install 2024-01-29T17:42:13.123Z] Downloading click-8.1.7-py3-none-any.whl (97 kB)
[pip-install 2024-01-29T17:42:13.130Z] ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 97.9/97.9 kB 25.9 MB/s eta 0:00:00
[pip-install 2024-01-29T17:42:13.160Z] Collecting cookiecutter==2.5.0
[pip-install 2024-01-29T17:42:13.201Z] Downloading cookiecutter-2.5.0-py3-none-any.whl (39 kB)
[pip-install 2024-01-29T17:42:13.227Z] Collecting giturlparse==0.12.0
[pip-install 2024-01-29T17:42:13.268Z] Downloading giturlparse-0.12.0-py2.py3-none-any.whl (15 kB)
[pip-install 2024-01-29T17:42:13.297Z] Collecting idna==3.6
[pip-install 2024-01-29T17:42:13.339Z] Downloading idna-3.6-py3-none-any.whl (61 kB)
[pip-install 2024-01-29T17:42:13.345Z] ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 61.6/61.6 kB 22.8 MB/s eta 0:00:00
[pip-install 2024-01-29T17:42:13.349Z] Requirement already satisfied: jinja2==3.1.2 in /usr/local/lib/python3.11/dist-packages (from -r /builds/worker/checkouts/src/taskcluster/requirements.txt (line 135)) (3.1.2)
[pip-install 2024-01-29T17:42:13.372Z] Collecting json-e==4.6.0
[pip-install 2024-01-29T17:42:13.414Z] Downloading json_e-4.6.0-py3-none-any.whl (13 kB)
[pip-install 2024-01-29T17:42:13.450Z] Collecting markdown-it-py==3.0.0
[pip-install 2024-01-29T17:42:13.491Z] Downloading markdown_it_py-3.0.0-py3-none-any.whl (87 kB)
[pip-install 2024-01-29T17:42:13.498Z] ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 87.5/87.5 kB 22.7 MB/s eta 0:00:00
[pip-install 2024-01-29T17:42:13.502Z] Requirement already satisfied: markupsafe==2.1.3 in /usr/local/lib/python3.11/dist-packages (from -r /builds/worker/checkouts/src/taskcluster/requirements.txt (line 147)) (2.1.3)
[pip-install 2024-01-29T17:42:13.521Z] Collecting mdurl==0.1.2
[pip-install 2024-01-29T17:42:13.568Z] Downloading mdurl-0.1.2-py3-none-any.whl (10.0 kB)
[pip-install 2024-01-29T17:42:13.572Z] Requirement already satisfied: mozilla-repo-urls==0.1.1 in /usr/local/lib/python3.11/dist-packages (from -r /builds/worker/checkouts/src/taskcluster/requirements.txt (line 213)) (0.1.1)
[pip-install 2024-01-29T17:42:13.614Z] Collecting pygments==2.17.2
[pip-install 2024-01-29T17:42:13.656Z] Downloading pygments-2.17.2-py3-none-any.whl (1.2 MB)
[pip-install 2024-01-29T17:42:13.724Z] ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 1.2/1.2 MB 17.9 MB/s eta 0:00:00
[pip-install 2024-01-29T17:42:13.733Z] Requirement already satisfied: python-dateutil==2.8.2 in /usr/local/lib/python3.11/dist-packages (from -r /builds/worker/checkouts/src/taskcluster/requirements.txt (line 221)) (2.8.2)
[pip-install 2024-01-29T17:42:13.734Z] Requirement already satisfied: python-slugify==8.0.1 in /usr/local/lib/python3.11/dist-packages (from -r /builds/worker/checkouts/src/taskcluster/requirements.txt (line 225)) (8.0.1)
[pip-install 2024-01-29T17:42:13.804Z] Collecting pyyaml==6.0.1
[pip-install 2024-01-29T17:42:13.845Z] Downloading PyYAML-6.0.1-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (757 kB)
[pip-install 2024-01-29T17:42:13.859Z] ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 757.7/757.7 kB 75.6 MB/s eta 0:00:00
[pip-install 2024-01-29T17:42:13.864Z] Requirement already satisfied: redo==2.0.4 in /usr/local/lib/python3.11/dist-packages (from -r /builds/worker/checkouts/src/taskcluster/requirements.txt (line 283)) (2.0.4)
[pip-install 2024-01-29T17:42:13.866Z] Requirement already satisfied: requests==2.31.0 in /usr/local/lib/python3.11/dist-packages (from -r /builds/worker/checkouts/src/taskcluster/requirements.txt (line 287)) (2.31.0)
[pip-install 2024-01-29T17:42:13.962Z] Collecting rich==13.7.0
[pip-install 2024-01-29T17:42:14.004Z] Downloading rich-13.7.0-py3-none-any.whl (240 kB)
[pip-install 2024-01-29T17:42:14.010Z] ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 240.6/240.6 kB 71.1 MB/s eta 0:00:00
[pip-install 2024-01-29T17:42:14.015Z] Requirement already satisfied: six==1.16.0 in /usr/local/lib/python3.11/dist-packages (from -r /builds/worker/checkouts/src/taskcluster/requirements.txt (line 297)) (1.16.0)
[pip-install 2024-01-29T17:42:14.016Z] Requirement already satisfied: slugid==2.0.0 in /usr/local/lib/python3.11/dist-packages (from -r /builds/worker/checkouts/src/taskcluster/requirements.txt (line 301)) (2.0.0)
[pip-install 2024-01-29T17:42:14.051Z] Collecting taskcluster-taskgraph==7.1.0
[pip-install 2024-01-29T17:42:14.093Z] Downloading taskcluster_taskgraph-7.1.0-py3-none-any.whl (185 kB)
[pip-install 2024-01-29T17:42:14.099Z] ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 185.8/185.8 kB 67.2 MB/s eta 0:00:00
[pip-install 2024-01-29T17:42:14.103Z] Requirement already satisfied: taskcluster-urls==13.0.1 in /usr/local/lib/python3.11/dist-packages (from -r /builds/worker/checkouts/src/taskcluster/requirements.txt (line 309)) (13.0.1)
[pip-install 2024-01-29T17:42:14.104Z] Requirement already satisfied: text-unidecode==1.3 in /usr/local/lib/python3.11/dist-packages (from -r /builds/worker/checkouts/src/taskcluster/requirements.txt (line 314)) (1.3)
[pip-install 2024-01-29T17:42:14.133Z] Collecting types-python-dateutil==2.8.19.20240106
[pip-install 2024-01-29T17:42:14.175Z] Downloading types_python_dateutil-2.8.19.20240106-py3-none-any.whl (9.7 kB)
[pip-install 2024-01-29T17:42:14.233Z] Collecting urllib3==2.1.0
[pip-install 2024-01-29T17:42:14.274Z] Downloading urllib3-2.1.0-py3-none-any.whl (104 kB)
[pip-install 2024-01-29T17:42:14.280Z] ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 104.6/104.6 kB 42.9 MB/s eta 0:00:00
[pip-install 2024-01-29T17:42:14.306Z] Collecting voluptuous==0.14.1
[pip-install 2024-01-29T17:42:14.347Z] Downloading voluptuous-0.14.1-py3-none-any.whl (30 kB)
[pip-install 2024-01-29T17:42:14.777Z] Installing collected packages: json-e, voluptuous, urllib3, types-python-dateutil, pyyaml, pygments, mdurl, idna, giturlparse, click, charset-normalizer, chardet, certifi, markdown-it-py, arrow, rich, cookiecutter, taskcluster-taskgraph
[pip-install 2024-01-29T17:42:15.575Z] WARNING: The script pygmentize is installed in '/builds/worker/.local/bin' which is not on PATH.
[pip-install 2024-01-29T17:42:15.576Z] Consider adding this directory to PATH or, if you prefer to suppress this warning, use --no-warn-script-location.
[pip-install 2024-01-29T17:42:15.770Z] WARNING: The script normalizer is installed in '/builds/worker/.local/bin' which is not on PATH.
[pip-install 2024-01-29T17:42:15.771Z] Consider adding this directory to PATH or, if you prefer to suppress this warning, use --no-warn-script-location.
[pip-install 2024-01-29T17:42:15.948Z] WARNING: The script chardetect is installed in '/builds/worker/.local/bin' which is not on PATH.
[pip-install 2024-01-29T17:42:15.949Z] Consider adding this directory to PATH or, if you prefer to suppress this warning, use --no-warn-script-location.
[pip-install 2024-01-29T17:42:16.020Z] WARNING: The script markdown-it is installed in '/builds/worker/.local/bin' which is not on PATH.
[pip-install 2024-01-29T17:42:16.021Z] Consider adding this directory to PATH or, if you prefer to suppress this warning, use --no-warn-script-location.
[pip-install 2024-01-29T17:42:16.267Z] WARNING: The script cookiecutter is installed in '/builds/worker/.local/bin' which is not on PATH.
[pip-install 2024-01-29T17:42:16.267Z] Consider adding this directory to PATH or, if you prefer to suppress this warning, use --no-warn-script-location.
[pip-install 2024-01-29T17:42:16.360Z] WARNING: The script taskgraph is installed in '/builds/worker/.local/bin' which is not on PATH.
[pip-install 2024-01-29T17:42:16.360Z] Consider adding this directory to PATH or, if you prefer to suppress this warning, use --no-warn-script-location.
[pip-install 2024-01-29T17:42:16.427Z] Successfully installed arrow-1.3.0 certifi-2023.11.17 chardet-5.2.0 charset-normalizer-3.3.2 click-8.1.7 cookiecutter-2.5.0 giturlparse-0.12.0 idna-3.6 json-e-4.6.0 markdown-it-py-3.0.0 mdurl-0.1.2 pygments-2.17.2 pyyaml-6.0.1 rich-13.7.0 taskcluster-taskgraph-7.1.0 types-python-dateutil-2.8.19.20240106 urllib3-2.1.0 voluptuous-0.14.1
[task 2024-01-29T17:42:16.537Z] executing ['bash', '-cx', "cd /builds/worker/checkouts/src && ln -s /builds/worker/artifacts artifacts && ~/.local/bin/taskgraph decision --pushlog-id='0' --pushdate='0' --project='firefox-translations-training' --owner='AmitMY@users.noreply.github.com' --level='1' --repository-type=git --tasks-for='github-pull-request' --base-repository='https://github.com/mozilla/firefox-translations-training' --base-ref='main' --base-rev='225b30df9a61a6ea8e6239a1290522a9de81b40c' --head-repository='https://github.com/AmitMY/firefox-translations-training' --head-ref='patch-11' --head-rev='11268076b51421847e9698a5bd754f8a39de9f2c' \n"]
[task 2024-01-29T17:42:16.539Z] + cd /builds/worker/checkouts/src
[task 2024-01-29T17:42:16.540Z] + ln -s /builds/worker/artifacts artifacts
[task 2024-01-29T17:42:16.541Z] + /builds/worker/.local/bin/taskgraph decision --pushlog-id=0 --pushdate=0 --project=firefox-translations-training --owner=AmitMY@users.noreply.github.com --level=1 --repository-type=git --tasks-for=github-pull-request --base-repository=https://github.com/mozilla/firefox-translations-training --base-ref=main --base-rev=225b30df9a61a6ea8e6239a1290522a9de81b40c --head-repository=https://github.com/AmitMY/firefox-translations-training --head-ref=patch-11 --head-rev=11268076b51421847e9698a5bd754f8a39de9f2c
[task 2024-01-29T17:42:16.787Z] 2024-01-29 17:42:16,787 - INFO - Loading graph configuration.
[task 2024-01-29T17:42:16.807Z] 2024-01-29 17:42:16,806 - WARNING - using default project parameters; add firefox-translations-training to PER_PROJECT_PARAMETERS in /builds/worker/.local/lib/python3.11/site-packages/taskgraph/decision.py to customize behavior for this project
[task 2024-01-29T17:42:16.808Z] 2024-01-29 17:42:16,807 - INFO - Using Parameters(id=6edce002fdbd) (from defaults)
[task 2024-01-29T17:42:16.809Z] 2024-01-29 17:42:16,809 - INFO - writing artifact file `parameters.yml`
[task 2024-01-29T17:42:16.817Z] 2024-01-29 17:42:16,817 - INFO - writing artifact file `actions.json`
[task 2024-01-29T17:42:16.818Z] 2024-01-29 17:42:16,818 - INFO - Loading kinds
[task 2024-01-29T17:42:17.070Z] 2024-01-29 17:42:17,070 - INFO - Generating full task set
[task 2024-01-29T17:42:17.098Z] 2024-01-29 17:42:17,098 - INFO - Generated 7 tasks for kind dataset
[task 2024-01-29T17:42:17.100Z] 2024-01-29 17:42:17,099 - INFO - Writing docker-contexts/base.tar.gz for docker image base
[task 2024-01-29T17:42:17.116Z] 2024-01-29 17:42:17,116 - INFO - Writing docker-contexts/test.tar.gz for docker image test
[task 2024-01-29T17:42:17.117Z] 2024-01-29 17:42:17,117 - INFO - Writing docker-contexts/train.tar.gz for docker image train
[task 2024-01-29T17:42:17.118Z] 2024-01-29 17:42:17,118 - INFO - Writing docker-contexts/toolchain-build.tar.gz for docker image toolchain-build
[task 2024-01-29T17:42:17.136Z] 2024-01-29 17:42:17,136 - INFO - Generated 4 tasks for kind docker-image
[task 2024-01-29T17:42:17.151Z] 2024-01-29 17:42:17,151 - INFO - Generated 9 tasks for kind fetch
[task 2024-01-29T17:42:17.156Z] 2024-01-29 17:42:17,155 - INFO - Generated 5 tasks for kind tests
[task 2024-01-29T17:42:17.215Z] 2024-01-29 17:42:17,215 - INFO - Generated 9 tasks for kind toolchain
[task 2024-01-29T17:42:17.219Z] 2024-01-29 17:42:17,219 - INFO - Generated 1 tasks for kind bicleaner-model
[task 2024-01-29T17:42:17.224Z] 2024-01-29 17:42:17,224 - INFO - Generated 2 tasks for kind clean-corpus
[task 2024-01-29T17:42:17.228Z] 2024-01-29 17:42:17,228 - INFO - Generated 2 tasks for kind bicleaner
[task 2024-01-29T17:42:17.232Z] 2024-01-29 17:42:17,232 - INFO - Generated 2 tasks for kind clean-mono
[task 2024-01-29T17:42:17.237Z] 2024-01-29 17:42:17,237 - INFO - Generated 1 tasks for kind merge-corpus
[task 2024-01-29T17:42:17.242Z] 2024-01-29 17:42:17,242 - INFO - Generated 2 tasks for kind merge-mono
[task 2024-01-29T17:42:17.257Z] 2024-01-29 17:42:17,257 - INFO - Generated 1 tasks for kind train-vocab
[task 2024-01-29T17:42:17.261Z] 2024-01-29 17:42:17,261 - INFO - Generated 1 tasks for kind split-corpus
[task 2024-01-29T17:42:17.265Z] 2024-01-29 17:42:17,265 - INFO - Generated 1 tasks for kind merge-devset
[task 2024-01-29T17:42:17.270Z] 2024-01-29 17:42:17,270 - INFO - Generated 1 tasks for kind train-backwards
[task 2024-01-29T17:42:17.273Z] 2024-01-29 17:42:17,273 - INFO - Generated 1 tasks for kind split-mono-src
[task 2024-01-29T17:42:17.276Z] 2024-01-29 17:42:17,276 - INFO - Generated 1 tasks for kind split-mono-trg
[task 2024-01-29T17:42:17.281Z] 2024-01-29 17:42:17,281 - INFO - Generated 2 tasks for kind translate-mono-trg
[task 2024-01-29T17:42:17.285Z] 2024-01-29 17:42:17,285 - INFO - Generated 1 tasks for kind collect-mono-trg
[task 2024-01-29T17:42:17.289Z] 2024-01-29 17:42:17,288 - INFO - Generated 1 tasks for kind train-teacher
[task 2024-01-29T17:42:17.293Z] 2024-01-29 17:42:17,293 - INFO - Generated 2 tasks for kind translate-corpus
[task 2024-01-29T17:42:17.296Z] 2024-01-29 17:42:17,296 - INFO - Generated 2 tasks for kind extract-best
[task 2024-01-29T17:42:17.299Z] 2024-01-29 17:42:17,299 - INFO - Generated 1 tasks for kind collect-corpus
[task 2024-01-29T17:42:17.303Z] 2024-01-29 17:42:17,303 - INFO - Generated 2 tasks for kind translate-mono-src
[task 2024-01-29T17:42:17.306Z] 2024-01-29 17:42:17,305 - INFO - Generated 1 tasks for kind collect-mono-src
[task 2024-01-29T17:42:17.309Z] 2024-01-29 17:42:17,309 - INFO - Generated 1 tasks for kind merge-translated
[task 2024-01-29T17:42:17.311Z] 2024-01-29 17:42:17,311 - INFO - Generated 1 tasks for kind score
[task 2024-01-29T17:42:17.314Z] 2024-01-29 17:42:17,314 - INFO - Generated 1 tasks for kind cefilter
[task 2024-01-29T17:42:17.317Z] 2024-01-29 17:42:17,317 - INFO - Generated 1 tasks for kind alignments
[task 2024-01-29T17:42:17.320Z] 2024-01-29 17:42:17,319 - INFO - Generated 1 tasks for kind train-student
[task 2024-01-29T17:42:17.322Z] 2024-01-29 17:42:17,322 - INFO - Generated 1 tasks for kind finetune-student
[task 2024-01-29T17:42:17.325Z] 2024-01-29 17:42:17,325 - INFO - Generated 1 tasks for kind quantize
[task 2024-01-29T17:42:17.328Z] 2024-01-29 17:42:17,328 - INFO - Generated 1 tasks for kind export
[task 2024-01-29T17:42:17.331Z] 2024-01-29 17:42:17,331 - INFO - Generated 1 tasks for kind evaluate-quantized
[task 2024-01-29T17:42:17.337Z] 2024-01-29 17:42:17,337 - INFO - Generated 4 tasks for kind evaluate
[task 2024-01-29T17:42:17.341Z] 2024-01-29 17:42:17,341 - INFO - Generated 1 tasks for kind evaluate-teacher-ensemble
[task 2024-01-29T17:42:17.342Z] 2024-01-29 17:42:17,342 - INFO - Generated 1 tasks for kind all
[task 2024-01-29T17:42:17.347Z] 2024-01-29 17:42:17,346 - INFO - Generated 1 tasks for kind all-pr
[task 2024-01-29T17:42:17.347Z] 2024-01-29 17:42:17,347 - INFO - Generating full task graph
[task 2024-01-29T17:42:17.348Z] 2024-01-29 17:42:17,347 - INFO - Full task graph contains 78 tasks and 216 dependencies
[task 2024-01-29T17:42:17.352Z] 2024-01-29 17:42:17,352 - INFO - writing artifact file `full-task-graph.json`
[task 2024-01-29T17:42:17.370Z] 2024-01-29 17:42:17,369 - INFO - writing artifact file `runnable-jobs.json`
[task 2024-01-29T17:42:17.371Z] 2024-01-29 17:42:17,371 - INFO - Generating target task set
[task 2024-01-29T17:42:17.371Z] 2024-01-29 17:42:17,371 - INFO - Filter filter_target_tasks pruned 63 tasks (15 remain)
[task 2024-01-29T17:42:17.372Z] 2024-01-29 17:42:17,371 - INFO - writing artifact file `target-tasks.json`
[task 2024-01-29T17:42:17.372Z] 2024-01-29 17:42:17,372 - INFO - Generating target task graph
[task 2024-01-29T17:42:17.372Z] 2024-01-29 17:42:17,372 - INFO - Adding 4 tasks with `always_target` attribute
[task 2024-01-29T17:42:17.373Z] 2024-01-29 17:42:17,373 - INFO - Generating optimized task graph
[task 2024-01-29T17:42:17.375Z] 2024-01-29 17:42:17,375 - INFO - Removed 1 tasks by skip-unless-changed (skip-unless-changed) during optimization.
[task 2024-01-29T17:42:25.010Z] 2024-01-29 17:42:25,010 - INFO - Replaced 37 tasks by index-search (index-search) during optimization.
[task 2024-01-29T17:42:25.015Z] 2024-01-29 17:42:25,015 - INFO - writing artifact file `task-graph.json`
[task 2024-01-29T17:42:25.025Z] 2024-01-29 17:42:25,025 - INFO - writing artifact file `label-to-taskid.json`
[task 2024-01-29T17:42:25.027Z] 2024-01-29 17:42:25,027 - INFO - Creating task with taskId ZR-wfF-STMy9lgHeq-cERw for tests-taskgraph-definition
[task 2024-01-29T17:42:25.030Z] 2024-01-29 17:42:25,030 - INFO - Creating task with taskId bCoDa7F2SfWAQQsYK9FjVg for tests-test
[task 2024-01-29T17:42:25.033Z] 2024-01-29 17:42:25,033 - INFO - Creating task with taskId UvQ41ae_SCGVV7s6qy8daQ for tests-black
[task 2024-01-29T17:42:25.035Z] 2024-01-29 17:42:25,033 - INFO - Creating task with taskId VNpW_h9NSRWRdP4ydlneeA for tests-lint
[task 2024-01-29T17:42:25.036Z] 2024-01-29 17:42:25,036 - INFO - Creating task with taskId Xcib9p1oQ1ivlMFErcewsQ for merge-devset-ru-en
[task 2024-01-29T17:42:25.038Z] 2024-01-29 17:42:25,038 - INFO - Creating task with taskId DslASQLrSSerb1-tYs8hmA for bicleaner-model-ru-en
[task 2024-01-29T17:42:25.220Z] 2024-01-29 17:42:25,220 - INFO - Creating task with taskId FMRo8vVwQQatOg_7yVGNWg for bicleaner-ai-opus-ELRC-3075-wikipedia_health_v1-ru-en
[task 2024-01-29T17:42:25.221Z] 2024-01-29 17:42:25,221 - INFO - Creating task with taskId RhPfusAWSzGrkgaZB6tNIw for bicleaner-ai-opus-ada83_v1-ru-en
[task 2024-01-29T17:42:25.384Z] 2024-01-29 17:42:25,384 - INFO - Creating task with taskId bpAaAvWbRZm96ct1rdqGTA for merge-corpus-ru-en
[task 2024-01-29T17:42:25.497Z] 2024-01-29 17:42:25,496 - INFO - Creating task with taskId THrz4CknSTq715yn3eOuyg for train-vocab-ru-en
[task 2024-01-29T17:42:25.497Z] 2024-01-29 17:42:25,497 - INFO - Creating task with taskId fk__o_J5Tf2Ar5Ln8K3dgA for split-corpus-ru-en
[task 2024-01-29T17:42:25.597Z] 2024-01-29 17:42:25,597 - INFO - Creating task with taskId IvflSNvsRy2STsi_SCwyrA for train-backwards-ru-en
[task 2024-01-29T17:42:25.702Z] 2024-01-29 17:42:25,702 - INFO - Creating task with taskId DCbLEc4NQtmvEjDE1RtvuQ for translate-mono-trg-ru-en-2/2
[task 2024-01-29T17:42:25.704Z] 2024-01-29 17:42:25,702 - INFO - Creating task with taskId clYsiauKRtO-HZPceKy-kQ for translate-mono-trg-ru-en-1/2
[task 2024-01-29T17:42:25.706Z] 2024-01-29 17:42:25,706 - INFO - Creating task with taskId DAm6FnGwS3G9GANkKlK6Vw for evaluate-backward-flores-devtest-ru-en
[task 2024-01-29T17:42:25.840Z] 2024-01-29 17:42:25,840 - INFO - Creating task with taskId P82h_zHZQ7K1p7ezgozRzA for collect-mono-trg-ru-en
[task 2024-01-29T17:42:25.963Z] 2024-01-29 17:42:25,963 - INFO - Creating task with taskId PHGiEjzlRPewK14kC8q0kA for train-teacher-ru-en-1/1
[task 2024-01-29T17:42:26.081Z] 2024-01-29 17:42:26,081 - INFO - Creating task with taskId XEVLk9FiQPKQ5Tiu9Of4PQ for translate-corpus-ru-en-2/2
[task 2024-01-29T17:42:26.082Z] 2024-01-29 17:42:26,081 - INFO - Creating task with taskId IIPTAWgnQb20k8NUjZuSFA for evaluate-teacher-flores-flores_devtest-ru-en-1/1
[task 2024-01-29T17:42:26.085Z] 2024-01-29 17:42:26,081 - INFO - Creating task with taskId AZ2t7KPOQ7iA2xpy2xlE6w for translate-mono-src-ru-en-2/2
[task 2024-01-29T17:42:26.086Z] 2024-01-29 17:42:26,081 - INFO - Creating task with taskId OEiB4sfiTP62coNzfnyVeQ for evaluate-teacher-ensemble-flores-flores_devtest-ru-en
[task 2024-01-29T17:42:26.088Z] 2024-01-29 17:42:26,082 - INFO - Creating task with taskId OOSs_4bjRiug_iGWVkwCjA for translate-mono-src-ru-en-1/2
[task 2024-01-29T17:42:26.093Z] 2024-01-29 17:42:26,082 - INFO - Creating task with taskId K2-QJUHrQlOBkaFRi8l9Aw for translate-corpus-ru-en-1/2
[task 2024-01-29T17:42:26.192Z] 2024-01-29 17:42:26,192 - INFO - Creating task with taskId WXPAa_X5TZqHT3IuNjVywg for extract-best-ru-en-2/2
[task 2024-01-29T17:42:26.301Z] 2024-01-29 17:42:26,301 - INFO - Creating task with taskId QQ-bEoWTTeGumIGBOd1sew for collect-mono-src-ru-en
[task 2024-01-29T17:42:26.302Z] 2024-01-29 17:42:26,302 - INFO - Creating task with taskId H570yN1gTU6YLCqKH1be8w for extract-best-ru-en-1/2
[task 2024-01-29T17:42:26.441Z] 2024-01-29 17:42:26,441 - INFO - Creating task with taskId XL935a97ThWyeqRgT5QPfQ for collect-corpus-ru-en
[task 2024-01-29T17:42:26.571Z] 2024-01-29 17:42:26,571 - INFO - Creating task with taskId fmnwcj_oREqXgdrmsjjGQQ for merge-translated-ru-en
[task 2024-01-29T17:42:26.672Z] 2024-01-29 17:42:26,672 - INFO - Creating task with taskId TFyB0-MWTnmzis6voVMexw for score-ru-en
[task 2024-01-29T17:42:26.788Z] 2024-01-29 17:42:26,788 - INFO - Creating task with taskId SLgqHJvjQGKbQoGdp706kw for cefilter-ru-en
[task 2024-01-29T17:42:26.929Z] 2024-01-29 17:42:26,929 - INFO - Creating task with taskId MB_7-_hUQi6KipWChfpCPQ for alignments-ru-en
[task 2024-01-29T17:42:27.072Z] 2024-01-29 17:42:27,072 - INFO - Creating task with taskId CARge9dkTG-70h6j8qebNw for train-student-ru-en
[task 2024-01-29T17:42:27.198Z] 2024-01-29 17:42:27,198 - INFO - Creating task with taskId XHEF2aQBT2W_9Bzojv4mYw for finetune-student-ru-en
[task 2024-01-29T17:42:27.200Z] 2024-01-29 17:42:27,199 - INFO - Creating task with taskId dID18FvZSYqaW9txMdnWTw for evaluate-student-flores-devtest-ru-en
[task 2024-01-29T17:42:27.303Z] 2024-01-29 17:42:27,302 - INFO - Creating task with taskId Io_famPsTUKDMGzB8fKX6A for quantize-ru-en
[task 2024-01-29T17:42:27.305Z] 2024-01-29 17:42:27,303 - INFO - Creating task with taskId DoEar1hjTgGAqgnKsdmpxQ for evaluate-finetuned-student-flores-devtest-ru-en
[task 2024-01-29T17:42:27.418Z] 2024-01-29 17:42:27,418 - INFO - Creating task with taskId cnBgpRTfRB6bvNhqRHgQFA for evaluate-quantized-flores-devtest-ru-en
[task 2024-01-29T17:42:27.420Z] 2024-01-29 17:42:27,418 - INFO - Creating task with taskId HuZ8w10KQXq0g6ZObS9aRg for export-ru-en
[task 2024-01-29T17:42:27.554Z] 2024-01-29 17:42:27,554 - INFO - Creating task with taskId ByAOZnJGRjuKLp8C2EmLNA for all-pr-ru-en-1
[taskcluster 2024-01-29 17:42:27.965Z] === Task Finished ===
[taskcluster 2024-01-29 17:42:29.860Z] Successful task run with exit code: 0 completed in 19.851 seconds
Loading