Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

fix Dataset importer problems #342

Open
wants to merge 4 commits into
base: main
Choose a base branch
from

Merge branch 'main' into patch-11

1126807
Select commit
Loading
Failed to load commit list.
Open

fix Dataset importer problems #342

Merge branch 'main' into patch-11
1126807
Select commit
Loading
Failed to load commit list.
firefoxci-taskcluster / Decision Task (pull-request) succeeded Jan 29, 2024 in 24s

FirefoxCI (pull_request)

The task that creates all of the other tasks in the task graph

Details

View task in Taskcluster
View logs in Taskcluster


[taskcluster 2024-01-29 17:42:10.010Z] Task ID: N4_KnVy-TDieuZ7WQILuAg
[taskcluster 2024-01-29 17:42:10.010Z] Worker ID: 5476596880548454069
[taskcluster 2024-01-29 17:42:10.010Z] Worker Group: us-central1
[taskcluster 2024-01-29 17:42:10.010Z] Worker Node Type: projects/887720501152/machineTypes/n2-standard-2
[taskcluster 2024-01-29 17:42:10.010Z] Worker Pool: translations-1/decision-gcp
[taskcluster 2024-01-29 17:42:10.010Z] Worker Version: 38.0.5
[taskcluster 2024-01-29 17:42:10.010Z] Public IP: 34.41.64.215
[taskcluster 2024-01-29 17:42:10.010Z] Hostname: translations-1-decision-gcp-f-p8-thiqv202kh4mnzz-a
[taskcluster 2024-01-29 17:42:10.010Z] using cache "translations-level-1-checkouts-sparse-v2" -> /builds/worker/checkouts

[taskcluster 2024-01-29 17:42:10.587Z] === Task Starting ===
[setup 2024-01-29T17:42:10.929Z] run-task started in /
[setup 2024-01-29T17:42:10.929Z] Invoked by command: --firefox_translations_training-checkout=/builds/worker/checkouts/src -- bash -cx cd /builds/worker/checkouts/src && ln -s /builds/worker/artifacts artifacts && ~/.local/bin/taskgraph decision --pushlog-id='0' --pushdate='0' --project='firefox-translations-training' --owner='AmitMY@users.noreply.github.com' --level='1' --repository-type=git --tasks-for='github-pull-request' --base-repository='https://github.com/mozilla/firefox-translations-training' --base-ref='main' --base-rev='225b30df9a61a6ea8e6239a1290522a9de81b40c' --head-repository='https://github.com/AmitMY/firefox-translations-training' --head-ref='patch-11' --head-rev='11268076b51421847e9698a5bd754f8a39de9f2c' 

[setup 2024-01-29T17:42:10.929Z] Python version: 3.11.2
[vcs 2024-01-29T17:42:10.931Z] WARNING: vcs checkout path (/builds/worker/checkouts/src) not in cache or volume; performance will likely suffer
[setup 2024-01-29T17:42:10.931Z] running as worker:worker
[vcs 2024-01-29T17:42:10.931Z] executing ['git', 'config', '--global', '--add', 'safe.directory', '/builds/worker/checkouts/src']
[vcs 2024-01-29T17:42:10.933Z] executing ['git', 'fetch', 'origin', 'main']
[vcs 2024-01-29T17:42:11.174Z] From https://github.com/mozilla/firefox-translations-training
[vcs 2024-01-29T17:42:11.176Z]  * branch            main       -> FETCH_HEAD
[vcs 2024-01-29T17:42:11.180Z] executing ['git', 'checkout', 'main']
[vcs 2024-01-29T17:42:11.206Z] Switched to branch 'main'
[vcs 2024-01-29T17:42:11.207Z] Your branch is behind 'origin/main' by 1 commit, and can be fast-forwarded.
[vcs 2024-01-29T17:42:11.207Z]   (use "git pull" to update your local branch)
[vcs 2024-01-29T17:42:11.207Z] executing ['git', 'fetch', 'origin', '225b30df9a61a6ea8e6239a1290522a9de81b40c']
[vcs 2024-01-29T17:42:11.477Z] From https://github.com/mozilla/firefox-translations-training
[vcs 2024-01-29T17:42:11.477Z]  * branch            225b30df9a61a6ea8e6239a1290522a9de81b40c -> FETCH_HEAD
[vcs 2024-01-29T17:42:11.484Z] executing ['git', 'fetch', '--no-tags', 'https://github.com/AmitMY/firefox-translations-training', 'patch-11']
[vcs 2024-01-29T17:42:11.769Z] From https://github.com/AmitMY/firefox-translations-training
[vcs 2024-01-29T17:42:11.769Z]  * branch            patch-11   -> FETCH_HEAD
[vcs 2024-01-29T17:42:11.772Z] executing ['git', 'checkout', '-f', '-B', 'patch-11', '11268076b51421847e9698a5bd754f8a39de9f2c']
[vcs 2024-01-29T17:42:11.778Z] Switched to a new branch 'patch-11'
[vcs 2024-01-29T17:42:11.778Z] executing ['git', 'submodule', 'init']
[vcs 2024-01-29T17:42:11.802Z] executing ['git', 'submodule', 'update', '--force']
[vcs 2024-01-29T17:42:11.835Z] Submodule path '3rd_party/browsermt-marian-dev': checked out '11c6ae7c46be21ef96ed10c60f28022fa968939f'
[vcs 2024-01-29T17:42:11.841Z] Submodule path '3rd_party/extract-lex': checked out '42fa605b53f32eaf6c6e0b5677255c21c91b3d49'
[vcs 2024-01-29T17:42:11.848Z] Submodule path '3rd_party/fast_align': checked out 'cab1e9aac8d3bb02ff5ae58218d8d225a039fa11'
[vcs 2024-01-29T17:42:11.855Z] Submodule path '3rd_party/kenlm': checked out 'bbf4fc511266c5d4515047055d7bdec659a6e158'
[vcs 2024-01-29T17:42:11.866Z] Submodule path '3rd_party/marian-dev': checked out 'e8a1a2530fb84cbff7383302ebca393e5875c441'
[vcs 2024-01-29T17:42:11.874Z] Submodule path '3rd_party/preprocess': checked out '64307314b4d5a9a0bd529b5c1036b0710d995eec'
[vcs 2024-01-29T17:42:11.875Z] cleaning git checkout...
[vcs 2024-01-29T17:42:11.875Z] executing ['git', 'clean', '-nxdff']
[vcs 2024-01-29T17:42:11.879Z] removing ['/builds/worker/checkouts/src/artifacts', '/builds/worker/checkouts/src/docker-contexts/', '/builds/worker/checkouts/src/taskcluster/translations_taskgraph/__pycache__/', '/builds/worker/checkouts/src/taskcluster/translations_taskgraph/actions/__pycache__/', '/builds/worker/checkouts/src/taskcluster/translations_taskgraph/transforms/__pycache__/', '/builds/worker/checkouts/src/taskcluster/translations_taskgraph/util/__pycache__/']
[vcs 2024-01-29T17:42:11.881Z] successfully cleaned git checkout!
[vcs 2024-01-29T17:42:11.883Z] TinderboxPrint:<a href='https://github.com/AmitMY/firefox-translations-training/commit/11268076b51421847e9698a5bd754f8a39de9f2c' title='Built from firefox-translations-training commit 11268076b51421847e9698a5bd754f8a39de9f2c'>11268076b51421847e9698a5bd754f8a39de9f2c</a>
[pip-install 2024-01-29T17:42:11.883Z] executing ['/usr/bin/python3', '-mpip', 'install', '--break-system-packages', '--require-hashes', '-r', '/builds/worker/checkouts/src/taskcluster/requirements.txt']
[pip-install 2024-01-29T17:42:12.200Z] Defaulting to user installation because normal site-packages is not writeable
[pip-install 2024-01-29T17:42:12.306Z] Requirement already satisfied: appdirs==1.4.4 in /usr/local/lib/python3.11/dist-packages (from -r /builds/worker/checkouts/src/taskcluster/requirements.txt (line 7)) (1.4.4)
[pip-install 2024-01-29T17:42:12.411Z] Collecting arrow==1.3.0
[pip-install 2024-01-29T17:42:12.575Z]   Downloading arrow-1.3.0-py3-none-any.whl (66 kB)
[pip-install 2024-01-29T17:42:12.626Z]      ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 66.4/66.4 kB 1.3 MB/s eta 0:00:00
[pip-install 2024-01-29T17:42:12.631Z] Requirement already satisfied: binaryornot==0.4.4 in /usr/local/lib/python3.11/dist-packages (from -r /builds/worker/checkouts/src/taskcluster/requirements.txt (line 15)) (0.4.4)
[pip-install 2024-01-29T17:42:12.665Z] Collecting certifi==2023.11.17
[pip-install 2024-01-29T17:42:12.707Z]   Downloading certifi-2023.11.17-py3-none-any.whl (162 kB)
[pip-install 2024-01-29T17:42:12.755Z]      ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 162.5/162.5 kB 3.4 MB/s eta 0:00:00
[pip-install 2024-01-29T17:42:12.778Z] Collecting chardet==5.2.0
[pip-install 2024-01-29T17:42:12.820Z]   Downloading chardet-5.2.0-py3-none-any.whl (199 kB)
[pip-install 2024-01-29T17:42:12.836Z]      ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 199.4/199.4 kB 14.8 MB/s eta 0:00:00
[pip-install 2024-01-29T17:42:12.992Z] Collecting charset-normalizer==3.3.2
[pip-install 2024-01-29T17:42:13.034Z]   Downloading charset_normalizer-3.3.2-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (140 kB)
[pip-install 2024-01-29T17:42:13.043Z]      ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 140.3/140.3 kB 24.6 MB/s eta 0:00:00
[pip-install 2024-01-29T17:42:13.080Z] Collecting click==8.1.7
[pip-install 2024-01-29T17:42:13.123Z]   Downloading click-8.1.7-py3-none-any.whl (97 kB)
[pip-install 2024-01-29T17:42:13.130Z]      ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 97.9/97.9 kB 25.9 MB/s eta 0:00:00
[pip-install 2024-01-29T17:42:13.160Z] Collecting cookiecutter==2.5.0
[pip-install 2024-01-29T17:42:13.201Z]   Downloading cookiecutter-2.5.0-py3-none-any.whl (39 kB)
[pip-install 2024-01-29T17:42:13.227Z] Collecting giturlparse==0.12.0
[pip-install 2024-01-29T17:42:13.268Z]   Downloading giturlparse-0.12.0-py2.py3-none-any.whl (15 kB)
[pip-install 2024-01-29T17:42:13.297Z] Collecting idna==3.6
[pip-install 2024-01-29T17:42:13.339Z]   Downloading idna-3.6-py3-none-any.whl (61 kB)
[pip-install 2024-01-29T17:42:13.345Z]      ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 61.6/61.6 kB 22.8 MB/s eta 0:00:00
[pip-install 2024-01-29T17:42:13.349Z] Requirement already satisfied: jinja2==3.1.2 in /usr/local/lib/python3.11/dist-packages (from -r /builds/worker/checkouts/src/taskcluster/requirements.txt (line 135)) (3.1.2)
[pip-install 2024-01-29T17:42:13.372Z] Collecting json-e==4.6.0
[pip-install 2024-01-29T17:42:13.414Z]   Downloading json_e-4.6.0-py3-none-any.whl (13 kB)
[pip-install 2024-01-29T17:42:13.450Z] Collecting markdown-it-py==3.0.0
[pip-install 2024-01-29T17:42:13.491Z]   Downloading markdown_it_py-3.0.0-py3-none-any.whl (87 kB)
[pip-install 2024-01-29T17:42:13.498Z]      ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 87.5/87.5 kB 22.7 MB/s eta 0:00:00
[pip-install 2024-01-29T17:42:13.502Z] Requirement already satisfied: markupsafe==2.1.3 in /usr/local/lib/python3.11/dist-packages (from -r /builds/worker/checkouts/src/taskcluster/requirements.txt (line 147)) (2.1.3)
[pip-install 2024-01-29T17:42:13.521Z] Collecting mdurl==0.1.2
[pip-install 2024-01-29T17:42:13.568Z]   Downloading mdurl-0.1.2-py3-none-any.whl (10.0 kB)
[pip-install 2024-01-29T17:42:13.572Z] Requirement already satisfied: mozilla-repo-urls==0.1.1 in /usr/local/lib/python3.11/dist-packages (from -r /builds/worker/checkouts/src/taskcluster/requirements.txt (line 213)) (0.1.1)
[pip-install 2024-01-29T17:42:13.614Z] Collecting pygments==2.17.2
[pip-install 2024-01-29T17:42:13.656Z]   Downloading pygments-2.17.2-py3-none-any.whl (1.2 MB)
[pip-install 2024-01-29T17:42:13.724Z]      ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 1.2/1.2 MB 17.9 MB/s eta 0:00:00
[pip-install 2024-01-29T17:42:13.733Z] Requirement already satisfied: python-dateutil==2.8.2 in /usr/local/lib/python3.11/dist-packages (from -r /builds/worker/checkouts/src/taskcluster/requirements.txt (line 221)) (2.8.2)
[pip-install 2024-01-29T17:42:13.734Z] Requirement already satisfied: python-slugify==8.0.1 in /usr/local/lib/python3.11/dist-packages (from -r /builds/worker/checkouts/src/taskcluster/requirements.txt (line 225)) (8.0.1)
[pip-install 2024-01-29T17:42:13.804Z] Collecting pyyaml==6.0.1
[pip-install 2024-01-29T17:42:13.845Z]   Downloading PyYAML-6.0.1-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (757 kB)
[pip-install 2024-01-29T17:42:13.859Z]      ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 757.7/757.7 kB 75.6 MB/s eta 0:00:00
[pip-install 2024-01-29T17:42:13.864Z] Requirement already satisfied: redo==2.0.4 in /usr/local/lib/python3.11/dist-packages (from -r /builds/worker/checkouts/src/taskcluster/requirements.txt (line 283)) (2.0.4)
[pip-install 2024-01-29T17:42:13.866Z] Requirement already satisfied: requests==2.31.0 in /usr/local/lib/python3.11/dist-packages (from -r /builds/worker/checkouts/src/taskcluster/requirements.txt (line 287)) (2.31.0)
[pip-install 2024-01-29T17:42:13.962Z] Collecting rich==13.7.0
[pip-install 2024-01-29T17:42:14.004Z]   Downloading rich-13.7.0-py3-none-any.whl (240 kB)
[pip-install 2024-01-29T17:42:14.010Z]      ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 240.6/240.6 kB 71.1 MB/s eta 0:00:00
[pip-install 2024-01-29T17:42:14.015Z] Requirement already satisfied: six==1.16.0 in /usr/local/lib/python3.11/dist-packages (from -r /builds/worker/checkouts/src/taskcluster/requirements.txt (line 297)) (1.16.0)
[pip-install 2024-01-29T17:42:14.016Z] Requirement already satisfied: slugid==2.0.0 in /usr/local/lib/python3.11/dist-packages (from -r /builds/worker/checkouts/src/taskcluster/requirements.txt (line 301)) (2.0.0)
[pip-install 2024-01-29T17:42:14.051Z] Collecting taskcluster-taskgraph==7.1.0
[pip-install 2024-01-29T17:42:14.093Z]   Downloading taskcluster_taskgraph-7.1.0-py3-none-any.whl (185 kB)
[pip-install 2024-01-29T17:42:14.099Z]      ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 185.8/185.8 kB 67.2 MB/s eta 0:00:00
[pip-install 2024-01-29T17:42:14.103Z] Requirement already satisfied: taskcluster-urls==13.0.1 in /usr/local/lib/python3.11/dist-packages (from -r /builds/worker/checkouts/src/taskcluster/requirements.txt (line 309)) (13.0.1)
[pip-install 2024-01-29T17:42:14.104Z] Requirement already satisfied: text-unidecode==1.3 in /usr/local/lib/python3.11/dist-packages (from -r /builds/worker/checkouts/src/taskcluster/requirements.txt (line 314)) (1.3)
[pip-install 2024-01-29T17:42:14.133Z] Collecting types-python-dateutil==2.8.19.20240106
[pip-install 2024-01-29T17:42:14.175Z]   Downloading types_python_dateutil-2.8.19.20240106-py3-none-any.whl (9.7 kB)
[pip-install 2024-01-29T17:42:14.233Z] Collecting urllib3==2.1.0
[pip-install 2024-01-29T17:42:14.274Z]   Downloading urllib3-2.1.0-py3-none-any.whl (104 kB)
[pip-install 2024-01-29T17:42:14.280Z]      ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 104.6/104.6 kB 42.9 MB/s eta 0:00:00
[pip-install 2024-01-29T17:42:14.306Z] Collecting voluptuous==0.14.1
[pip-install 2024-01-29T17:42:14.347Z]   Downloading voluptuous-0.14.1-py3-none-any.whl (30 kB)
[pip-install 2024-01-29T17:42:14.777Z] Installing collected packages: json-e, voluptuous, urllib3, types-python-dateutil, pyyaml, pygments, mdurl, idna, giturlparse, click, charset-normalizer, chardet, certifi, markdown-it-py, arrow, rich, cookiecutter, taskcluster-taskgraph
[pip-install 2024-01-29T17:42:15.575Z]   WARNING: The script pygmentize is installed in '/builds/worker/.local/bin' which is not on PATH.
[pip-install 2024-01-29T17:42:15.576Z]   Consider adding this directory to PATH or, if you prefer to suppress this warning, use --no-warn-script-location.
[pip-install 2024-01-29T17:42:15.770Z]   WARNING: The script normalizer is installed in '/builds/worker/.local/bin' which is not on PATH.
[pip-install 2024-01-29T17:42:15.771Z]   Consider adding this directory to PATH or, if you prefer to suppress this warning, use --no-warn-script-location.
[pip-install 2024-01-29T17:42:15.948Z]   WARNING: The script chardetect is installed in '/builds/worker/.local/bin' which is not on PATH.
[pip-install 2024-01-29T17:42:15.949Z]   Consider adding this directory to PATH or, if you prefer to suppress this warning, use --no-warn-script-location.
[pip-install 2024-01-29T17:42:16.020Z]   WARNING: The script markdown-it is installed in '/builds/worker/.local/bin' which is not on PATH.
[pip-install 2024-01-29T17:42:16.021Z]   Consider adding this directory to PATH or, if you prefer to suppress this warning, use --no-warn-script-location.
[pip-install 2024-01-29T17:42:16.267Z]   WARNING: The script cookiecutter is installed in '/builds/worker/.local/bin' which is not on PATH.
[pip-install 2024-01-29T17:42:16.267Z]   Consider adding this directory to PATH or, if you prefer to suppress this warning, use --no-warn-script-location.
[pip-install 2024-01-29T17:42:16.360Z]   WARNING: The script taskgraph is installed in '/builds/worker/.local/bin' which is not on PATH.
[pip-install 2024-01-29T17:42:16.360Z]   Consider adding this directory to PATH or, if you prefer to suppress this warning, use --no-warn-script-location.
[pip-install 2024-01-29T17:42:16.427Z] Successfully installed arrow-1.3.0 certifi-2023.11.17 chardet-5.2.0 charset-normalizer-3.3.2 click-8.1.7 cookiecutter-2.5.0 giturlparse-0.12.0 idna-3.6 json-e-4.6.0 markdown-it-py-3.0.0 mdurl-0.1.2 pygments-2.17.2 pyyaml-6.0.1 rich-13.7.0 taskcluster-taskgraph-7.1.0 types-python-dateutil-2.8.19.20240106 urllib3-2.1.0 voluptuous-0.14.1
[task 2024-01-29T17:42:16.537Z] executing ['bash', '-cx', "cd /builds/worker/checkouts/src && ln -s /builds/worker/artifacts artifacts && ~/.local/bin/taskgraph decision --pushlog-id='0' --pushdate='0' --project='firefox-translations-training' --owner='AmitMY@users.noreply.github.com' --level='1' --repository-type=git --tasks-for='github-pull-request' --base-repository='https://github.com/mozilla/firefox-translations-training' --base-ref='main' --base-rev='225b30df9a61a6ea8e6239a1290522a9de81b40c' --head-repository='https://github.com/AmitMY/firefox-translations-training' --head-ref='patch-11' --head-rev='11268076b51421847e9698a5bd754f8a39de9f2c' \n"]
[task 2024-01-29T17:42:16.539Z] + cd /builds/worker/checkouts/src
[task 2024-01-29T17:42:16.540Z] + ln -s /builds/worker/artifacts artifacts
[task 2024-01-29T17:42:16.541Z] + /builds/worker/.local/bin/taskgraph decision --pushlog-id=0 --pushdate=0 --project=firefox-translations-training --owner=AmitMY@users.noreply.github.com --level=1 --repository-type=git --tasks-for=github-pull-request --base-repository=https://github.com/mozilla/firefox-translations-training --base-ref=main --base-rev=225b30df9a61a6ea8e6239a1290522a9de81b40c --head-repository=https://github.com/AmitMY/firefox-translations-training --head-ref=patch-11 --head-rev=11268076b51421847e9698a5bd754f8a39de9f2c
[task 2024-01-29T17:42:16.787Z] 2024-01-29 17:42:16,787 - INFO - Loading graph configuration.
[task 2024-01-29T17:42:16.807Z] 2024-01-29 17:42:16,806 - WARNING - using default project parameters; add firefox-translations-training to PER_PROJECT_PARAMETERS in /builds/worker/.local/lib/python3.11/site-packages/taskgraph/decision.py to customize behavior for this project
[task 2024-01-29T17:42:16.808Z] 2024-01-29 17:42:16,807 - INFO - Using Parameters(id=6edce002fdbd) (from defaults)
[task 2024-01-29T17:42:16.809Z] 2024-01-29 17:42:16,809 - INFO - writing artifact file `parameters.yml`
[task 2024-01-29T17:42:16.817Z] 2024-01-29 17:42:16,817 - INFO - writing artifact file `actions.json`
[task 2024-01-29T17:42:16.818Z] 2024-01-29 17:42:16,818 - INFO - Loading kinds
[task 2024-01-29T17:42:17.070Z] 2024-01-29 17:42:17,070 - INFO - Generating full task set
[task 2024-01-29T17:42:17.098Z] 2024-01-29 17:42:17,098 - INFO - Generated 7 tasks for kind dataset
[task 2024-01-29T17:42:17.100Z] 2024-01-29 17:42:17,099 - INFO - Writing docker-contexts/base.tar.gz for docker image base
[task 2024-01-29T17:42:17.116Z] 2024-01-29 17:42:17,116 - INFO - Writing docker-contexts/test.tar.gz for docker image test
[task 2024-01-29T17:42:17.117Z] 2024-01-29 17:42:17,117 - INFO - Writing docker-contexts/train.tar.gz for docker image train
[task 2024-01-29T17:42:17.118Z] 2024-01-29 17:42:17,118 - INFO - Writing docker-contexts/toolchain-build.tar.gz for docker image toolchain-build
[task 2024-01-29T17:42:17.136Z] 2024-01-29 17:42:17,136 - INFO - Generated 4 tasks for kind docker-image
[task 2024-01-29T17:42:17.151Z] 2024-01-29 17:42:17,151 - INFO - Generated 9 tasks for kind fetch
[task 2024-01-29T17:42:17.156Z] 2024-01-29 17:42:17,155 - INFO - Generated 5 tasks for kind tests
[task 2024-01-29T17:42:17.215Z] 2024-01-29 17:42:17,215 - INFO - Generated 9 tasks for kind toolchain
[task 2024-01-29T17:42:17.219Z] 2024-01-29 17:42:17,219 - INFO - Generated 1 tasks for kind bicleaner-model
[task 2024-01-29T17:42:17.224Z] 2024-01-29 17:42:17,224 - INFO - Generated 2 tasks for kind clean-corpus
[task 2024-01-29T17:42:17.228Z] 2024-01-29 17:42:17,228 - INFO - Generated 2 tasks for kind bicleaner
[task 2024-01-29T17:42:17.232Z] 2024-01-29 17:42:17,232 - INFO - Generated 2 tasks for kind clean-mono
[task 2024-01-29T17:42:17.237Z] 2024-01-29 17:42:17,237 - INFO - Generated 1 tasks for kind merge-corpus
[task 2024-01-29T17:42:17.242Z] 2024-01-29 17:42:17,242 - INFO - Generated 2 tasks for kind merge-mono
[task 2024-01-29T17:42:17.257Z] 2024-01-29 17:42:17,257 - INFO - Generated 1 tasks for kind train-vocab
[task 2024-01-29T17:42:17.261Z] 2024-01-29 17:42:17,261 - INFO - Generated 1 tasks for kind split-corpus
[task 2024-01-29T17:42:17.265Z] 2024-01-29 17:42:17,265 - INFO - Generated 1 tasks for kind merge-devset
[task 2024-01-29T17:42:17.270Z] 2024-01-29 17:42:17,270 - INFO - Generated 1 tasks for kind train-backwards
[task 2024-01-29T17:42:17.273Z] 2024-01-29 17:42:17,273 - INFO - Generated 1 tasks for kind split-mono-src
[task 2024-01-29T17:42:17.276Z] 2024-01-29 17:42:17,276 - INFO - Generated 1 tasks for kind split-mono-trg
[task 2024-01-29T17:42:17.281Z] 2024-01-29 17:42:17,281 - INFO - Generated 2 tasks for kind translate-mono-trg
[task 2024-01-29T17:42:17.285Z] 2024-01-29 17:42:17,285 - INFO - Generated 1 tasks for kind collect-mono-trg
[task 2024-01-29T17:42:17.289Z] 2024-01-29 17:42:17,288 - INFO - Generated 1 tasks for kind train-teacher
[task 2024-01-29T17:42:17.293Z] 2024-01-29 17:42:17,293 - INFO - Generated 2 tasks for kind translate-corpus
[task 2024-01-29T17:42:17.296Z] 2024-01-29 17:42:17,296 - INFO - Generated 2 tasks for kind extract-best
[task 2024-01-29T17:42:17.299Z] 2024-01-29 17:42:17,299 - INFO - Generated 1 tasks for kind collect-corpus
[task 2024-01-29T17:42:17.303Z] 2024-01-29 17:42:17,303 - INFO - Generated 2 tasks for kind translate-mono-src
[task 2024-01-29T17:42:17.306Z] 2024-01-29 17:42:17,305 - INFO - Generated 1 tasks for kind collect-mono-src
[task 2024-01-29T17:42:17.309Z] 2024-01-29 17:42:17,309 - INFO - Generated 1 tasks for kind merge-translated
[task 2024-01-29T17:42:17.311Z] 2024-01-29 17:42:17,311 - INFO - Generated 1 tasks for kind score
[task 2024-01-29T17:42:17.314Z] 2024-01-29 17:42:17,314 - INFO - Generated 1 tasks for kind cefilter
[task 2024-01-29T17:42:17.317Z] 2024-01-29 17:42:17,317 - INFO - Generated 1 tasks for kind alignments
[task 2024-01-29T17:42:17.320Z] 2024-01-29 17:42:17,319 - INFO - Generated 1 tasks for kind train-student
[task 2024-01-29T17:42:17.322Z] 2024-01-29 17:42:17,322 - INFO - Generated 1 tasks for kind finetune-student
[task 2024-01-29T17:42:17.325Z] 2024-01-29 17:42:17,325 - INFO - Generated 1 tasks for kind quantize
[task 2024-01-29T17:42:17.328Z] 2024-01-29 17:42:17,328 - INFO - Generated 1 tasks for kind export
[task 2024-01-29T17:42:17.331Z] 2024-01-29 17:42:17,331 - INFO - Generated 1 tasks for kind evaluate-quantized
[task 2024-01-29T17:42:17.337Z] 2024-01-29 17:42:17,337 - INFO - Generated 4 tasks for kind evaluate
[task 2024-01-29T17:42:17.341Z] 2024-01-29 17:42:17,341 - INFO - Generated 1 tasks for kind evaluate-teacher-ensemble
[task 2024-01-29T17:42:17.342Z] 2024-01-29 17:42:17,342 - INFO - Generated 1 tasks for kind all
[task 2024-01-29T17:42:17.347Z] 2024-01-29 17:42:17,346 - INFO - Generated 1 tasks for kind all-pr
[task 2024-01-29T17:42:17.347Z] 2024-01-29 17:42:17,347 - INFO - Generating full task graph
[task 2024-01-29T17:42:17.348Z] 2024-01-29 17:42:17,347 - INFO - Full task graph contains 78 tasks and 216 dependencies
[task 2024-01-29T17:42:17.352Z] 2024-01-29 17:42:17,352 - INFO - writing artifact file `full-task-graph.json`
[task 2024-01-29T17:42:17.370Z] 2024-01-29 17:42:17,369 - INFO - writing artifact file `runnable-jobs.json`
[task 2024-01-29T17:42:17.371Z] 2024-01-29 17:42:17,371 - INFO - Generating target task set
[task 2024-01-29T17:42:17.371Z] 2024-01-29 17:42:17,371 - INFO - Filter filter_target_tasks pruned 63 tasks (15 remain)
[task 2024-01-29T17:42:17.372Z] 2024-01-29 17:42:17,371 - INFO - writing artifact file `target-tasks.json`
[task 2024-01-29T17:42:17.372Z] 2024-01-29 17:42:17,372 - INFO - Generating target task graph
[task 2024-01-29T17:42:17.372Z] 2024-01-29 17:42:17,372 - INFO - Adding 4 tasks with `always_target` attribute
[task 2024-01-29T17:42:17.373Z] 2024-01-29 17:42:17,373 - INFO - Generating optimized task graph
[task 2024-01-29T17:42:17.375Z] 2024-01-29 17:42:17,375 - INFO - Removed 1 tasks by skip-unless-changed (skip-unless-changed) during optimization.
[task 2024-01-29T17:42:25.010Z] 2024-01-29 17:42:25,010 - INFO - Replaced 37 tasks by index-search (index-search) during optimization.
[task 2024-01-29T17:42:25.015Z] 2024-01-29 17:42:25,015 - INFO - writing artifact file `task-graph.json`
[task 2024-01-29T17:42:25.025Z] 2024-01-29 17:42:25,025 - INFO - writing artifact file `label-to-taskid.json`
[task 2024-01-29T17:42:25.027Z] 2024-01-29 17:42:25,027 - INFO - Creating task with taskId ZR-wfF-STMy9lgHeq-cERw for tests-taskgraph-definition
[task 2024-01-29T17:42:25.030Z] 2024-01-29 17:42:25,030 - INFO - Creating task with taskId bCoDa7F2SfWAQQsYK9FjVg for tests-test
[task 2024-01-29T17:42:25.033Z] 2024-01-29 17:42:25,033 - INFO - Creating task with taskId UvQ41ae_SCGVV7s6qy8daQ for tests-black
[task 2024-01-29T17:42:25.035Z] 2024-01-29 17:42:25,033 - INFO - Creating task with taskId VNpW_h9NSRWRdP4ydlneeA for tests-lint
[task 2024-01-29T17:42:25.036Z] 2024-01-29 17:42:25,036 - INFO - Creating task with taskId Xcib9p1oQ1ivlMFErcewsQ for merge-devset-ru-en
[task 2024-01-29T17:42:25.038Z] 2024-01-29 17:42:25,038 - INFO - Creating task with taskId DslASQLrSSerb1-tYs8hmA for bicleaner-model-ru-en
[task 2024-01-29T17:42:25.220Z] 2024-01-29 17:42:25,220 - INFO - Creating task with taskId FMRo8vVwQQatOg_7yVGNWg for bicleaner-ai-opus-ELRC-3075-wikipedia_health_v1-ru-en
[task 2024-01-29T17:42:25.221Z] 2024-01-29 17:42:25,221 - INFO - Creating task with taskId RhPfusAWSzGrkgaZB6tNIw for bicleaner-ai-opus-ada83_v1-ru-en
[task 2024-01-29T17:42:25.384Z] 2024-01-29 17:42:25,384 - INFO - Creating task with taskId bpAaAvWbRZm96ct1rdqGTA for merge-corpus-ru-en
[task 2024-01-29T17:42:25.497Z] 2024-01-29 17:42:25,496 - INFO - Creating task with taskId THrz4CknSTq715yn3eOuyg for train-vocab-ru-en
[task 2024-01-29T17:42:25.497Z] 2024-01-29 17:42:25,497 - INFO - Creating task with taskId fk__o_J5Tf2Ar5Ln8K3dgA for split-corpus-ru-en
[task 2024-01-29T17:42:25.597Z] 2024-01-29 17:42:25,597 - INFO - Creating task with taskId IvflSNvsRy2STsi_SCwyrA for train-backwards-ru-en
[task 2024-01-29T17:42:25.702Z] 2024-01-29 17:42:25,702 - INFO - Creating task with taskId DCbLEc4NQtmvEjDE1RtvuQ for translate-mono-trg-ru-en-2/2
[task 2024-01-29T17:42:25.704Z] 2024-01-29 17:42:25,702 - INFO - Creating task with taskId clYsiauKRtO-HZPceKy-kQ for translate-mono-trg-ru-en-1/2
[task 2024-01-29T17:42:25.706Z] 2024-01-29 17:42:25,706 - INFO - Creating task with taskId DAm6FnGwS3G9GANkKlK6Vw for evaluate-backward-flores-devtest-ru-en
[task 2024-01-29T17:42:25.840Z] 2024-01-29 17:42:25,840 - INFO - Creating task with taskId P82h_zHZQ7K1p7ezgozRzA for collect-mono-trg-ru-en
[task 2024-01-29T17:42:25.963Z] 2024-01-29 17:42:25,963 - INFO - Creating task with taskId PHGiEjzlRPewK14kC8q0kA for train-teacher-ru-en-1/1
[task 2024-01-29T17:42:26.081Z] 2024-01-29 17:42:26,081 - INFO - Creating task with taskId XEVLk9FiQPKQ5Tiu9Of4PQ for translate-corpus-ru-en-2/2
[task 2024-01-29T17:42:26.082Z] 2024-01-29 17:42:26,081 - INFO - Creating task with taskId IIPTAWgnQb20k8NUjZuSFA for evaluate-teacher-flores-flores_devtest-ru-en-1/1
[task 2024-01-29T17:42:26.085Z] 2024-01-29 17:42:26,081 - INFO - Creating task with taskId AZ2t7KPOQ7iA2xpy2xlE6w for translate-mono-src-ru-en-2/2
[task 2024-01-29T17:42:26.086Z] 2024-01-29 17:42:26,081 - INFO - Creating task with taskId OEiB4sfiTP62coNzfnyVeQ for evaluate-teacher-ensemble-flores-flores_devtest-ru-en
[task 2024-01-29T17:42:26.088Z] 2024-01-29 17:42:26,082 - INFO - Creating task with taskId OOSs_4bjRiug_iGWVkwCjA for translate-mono-src-ru-en-1/2
[task 2024-01-29T17:42:26.093Z] 2024-01-29 17:42:26,082 - INFO - Creating task with taskId K2-QJUHrQlOBkaFRi8l9Aw for translate-corpus-ru-en-1/2
[task 2024-01-29T17:42:26.192Z] 2024-01-29 17:42:26,192 - INFO - Creating task with taskId WXPAa_X5TZqHT3IuNjVywg for extract-best-ru-en-2/2
[task 2024-01-29T17:42:26.301Z] 2024-01-29 17:42:26,301 - INFO - Creating task with taskId QQ-bEoWTTeGumIGBOd1sew for collect-mono-src-ru-en
[task 2024-01-29T17:42:26.302Z] 2024-01-29 17:42:26,302 - INFO - Creating task with taskId H570yN1gTU6YLCqKH1be8w for extract-best-ru-en-1/2
[task 2024-01-29T17:42:26.441Z] 2024-01-29 17:42:26,441 - INFO - Creating task with taskId XL935a97ThWyeqRgT5QPfQ for collect-corpus-ru-en
[task 2024-01-29T17:42:26.571Z] 2024-01-29 17:42:26,571 - INFO - Creating task with taskId fmnwcj_oREqXgdrmsjjGQQ for merge-translated-ru-en
[task 2024-01-29T17:42:26.672Z] 2024-01-29 17:42:26,672 - INFO - Creating task with taskId TFyB0-MWTnmzis6voVMexw for score-ru-en
[task 2024-01-29T17:42:26.788Z] 2024-01-29 17:42:26,788 - INFO - Creating task with taskId SLgqHJvjQGKbQoGdp706kw for cefilter-ru-en
[task 2024-01-29T17:42:26.929Z] 2024-01-29 17:42:26,929 - INFO - Creating task with taskId MB_7-_hUQi6KipWChfpCPQ for alignments-ru-en
[task 2024-01-29T17:42:27.072Z] 2024-01-29 17:42:27,072 - INFO - Creating task with taskId CARge9dkTG-70h6j8qebNw for train-student-ru-en
[task 2024-01-29T17:42:27.198Z] 2024-01-29 17:42:27,198 - INFO - Creating task with taskId XHEF2aQBT2W_9Bzojv4mYw for finetune-student-ru-en
[task 2024-01-29T17:42:27.200Z] 2024-01-29 17:42:27,199 - INFO - Creating task with taskId dID18FvZSYqaW9txMdnWTw for evaluate-student-flores-devtest-ru-en
[task 2024-01-29T17:42:27.303Z] 2024-01-29 17:42:27,302 - INFO - Creating task with taskId Io_famPsTUKDMGzB8fKX6A for quantize-ru-en
[task 2024-01-29T17:42:27.305Z] 2024-01-29 17:42:27,303 - INFO - Creating task with taskId DoEar1hjTgGAqgnKsdmpxQ for evaluate-finetuned-student-flores-devtest-ru-en
[task 2024-01-29T17:42:27.418Z] 2024-01-29 17:42:27,418 - INFO - Creating task with taskId cnBgpRTfRB6bvNhqRHgQFA for evaluate-quantized-flores-devtest-ru-en
[task 2024-01-29T17:42:27.420Z] 2024-01-29 17:42:27,418 - INFO - Creating task with taskId HuZ8w10KQXq0g6ZObS9aRg for export-ru-en
[task 2024-01-29T17:42:27.554Z] 2024-01-29 17:42:27,554 - INFO - Creating task with taskId ByAOZnJGRjuKLp8C2EmLNA for all-pr-ru-en-1
[taskcluster 2024-01-29 17:42:27.965Z] === Task Finished ===
[taskcluster 2024-01-29 17:42:29.860Z] Successful task run with exit code: 0 completed in 19.851 seconds