phabricator D199070 #44120
phabricator D199070 #44120
Community-TC (pull_request)
Smoketests for wptrunner
Details
View task in Taskcluster
View logs in Taskcluster
WPT Command: python3 ./wpt run --log-tbpl=- --log-wptreport=../artifacts/wptreport-chrome.json --logcat-dir=../artifacts/ --metadata=infrastructure/metadata/ --include=infrastructure/ --log-mach-level=info --log-mach=- -y --no-pause --no-restart-on-unexpected --install-fonts --no-headless --verify-log-full --enable-swiftshader chrome
WPT Command: python3 ./wpt run --log-tbpl=- --log-wptreport=../artifacts/wptreport-firefox.json --logcat-dir=../artifacts/ --metadata=infrastructure/metadata/ --include=infrastructure/ --log-mach-level=info --log-mach=- -y --no-pause --no-restart-on-unexpected --install-fonts --no-headless --verify-log-full --binary=/home/test/build/firefox/firefox firefox
WPT Command: python3 ./wpt run --log-tbpl=- --log-wptreport=../artifacts/wptreport-firefox_android.json --logcat-dir=../artifacts/ --metadata=infrastructure/metadata/ --include=infrastructure/ --log-mach-level=info --log-mach=- -y --no-pause --no-restart-on-unexpected --install-fonts --no-headless --verify-log-full --install-browser --install-webdriver --logcat-dir /home/test/artifacts/ firefox_android
8:00.38 TEST_START: /infrastructure/reftest/legacy/reftest_fuzzy_chain_ini.html
TEST-START | /infrastructure/reftest/legacy/reftest_fuzzy_chain_ini.html
8:01.51 TEST_END: PASS
TEST-PASS | /infrastructure/reftest/legacy/reftest_fuzzy_chain_ini.html | took 1131ms
8:01.51 TEST_START: /infrastructure/reftest/reftest.https.html
TEST-START | /infrastructure/reftest/reftest.https.html
8:02.24 TEST_END: PASS
TEST-PASS | /infrastructure/reftest/reftest.https.html | took 733ms
8:02.24 TEST_START: /infrastructure/reftest/reftest.www.sub.html
TEST-START | /infrastructure/reftest/reftest.www.sub.html
8:02.84 TEST_END: PASS
TEST-PASS | /infrastructure/reftest/reftest.www.sub.html | took 600ms
8:02.84 TEST_START: /infrastructure/reftest/reftest_fuzzy_1.html
TEST-START | /infrastructure/reftest/reftest_fuzzy_1.html
8:03.94 TEST_END: PASS
TEST-PASS | /infrastructure/reftest/reftest_fuzzy_1.html | took 1101ms
8:03.94 TEST_START: /infrastructure/reftest/reftest_fuzzy_ini_full.html
TEST-START | /infrastructure/reftest/reftest_fuzzy_ini_full.html
8:04.50 TEST_END: PASS
TEST-PASS | /infrastructure/reftest/reftest_fuzzy_ini_full.html | took 550ms
8:04.50 TEST_START: /infrastructure/reftest/reftest_fuzzy_ini_ref_only.html
TEST-START | /infrastructure/reftest/reftest_fuzzy_ini_ref_only.html
8:05.07 TEST_END: PASS
TEST-PASS | /infrastructure/reftest/reftest_fuzzy_ini_ref_only.html | took 572ms
8:05.07 TEST_START: /infrastructure/reftest/reftest_fuzzy_ini_short.html
TEST-START | /infrastructure/reftest/reftest_fuzzy_ini_short.html
8:05.61 TEST_END: PASS
TEST-PASS | /infrastructure/reftest/reftest_fuzzy_ini_short.html | took 537ms
8:05.61 TEST_START: /infrastructure/reftest/reftest_fuzzy_no_differences.html
TEST-START | /infrastructure/reftest/reftest_fuzzy_no_differences.html
8:06.17 TEST_END: PASS
TEST-PASS | /infrastructure/reftest/reftest_fuzzy_no_differences.html | took 568ms
8:06.18 TEST_START: /infrastructure/reftest/reftest_fuzzy_no_differences_1.html
TEST-START | /infrastructure/reftest/reftest_fuzzy_no_differences_1.html
8:06.72 TEST_END: PASS
TEST-PASS | /infrastructure/reftest/reftest_fuzzy_no_differences_1.html | took 548ms
8:06.72 TEST_START: /infrastructure/reftest/reftest_match.html
TEST-START | /infrastructure/reftest/reftest_match.html
8:07.27 TEST_END: PASS
TEST-PASS | /infrastructure/reftest/reftest_match.html | took 548ms
8:07.27 TEST_START: /infrastructure/reftest/reftest_match_and_mismatch-0.html
TEST-START | /infrastructure/reftest/reftest_match_and_mismatch-0.html
8:08.33 TEST_END: FAIL
TEST-FAIL | /infrastructure/reftest/reftest_match_and_mismatch-0.html | took 1054ms
8:08.33 TEST_START: /infrastructure/reftest/reftest_match_and_mismatch-1.html
TEST-START | /infrastructure/reftest/reftest_match_and_mismatch-1.html
8:08.86 TEST_END: FAIL
TEST-FAIL | /infrastructure/reftest/reftest_match_and_mismatch-1.html | took 535ms
8:08.87 TEST_START: /infrastructure/reftest/reftest_match_and_mismatch-2.html
TEST-START | /infrastructure/reftest/reftest_match_and_mismatch-2.html
8:09.86 TEST_END: PASS
TEST-PASS | /infrastructure/reftest/reftest_match_and_mismatch-2.html | took 997ms
8:09.86 TEST_START: /infrastructure/reftest/reftest_match_and_mismatch-3.html
TEST-START | /infrastructure/reftest/reftest_match_and_mismatch-3.html
8:10.38 TEST_END: PASS
TEST-PASS | /infrastructure/reftest/reftest_match_and_mismatch-3.html | took 511ms
8:10.38 TEST_START: /infrastructure/reftest/reftest_match_and_mismatch-4.html
TEST-START | /infrastructure/reftest/reftest_match_and_mismatch-4.html
8:11.28 TEST_END: FAIL
TEST-FAIL | /infrastructure/reftest/reftest_match_and_mismatch-4.html | took 905ms
8:11.28 TEST_START: /infrastructure/reftest/reftest_match_and_mismatch-5.html
TEST-START | /infrastructure/reftest/reftest_match_and_mismatch-5.html
8:12.23 TEST_END: FAIL
TEST-FAIL | /infrastructure/reftest/reftest_match_and_mismatch-5.html | took 949ms
8:12.23 TEST_START: /infrastructure/reftest/reftest_match_and_mismatch-6.html
TEST-START | /infrastructure/reftest/reftest_match_and_mismatch-6.html
8:13.99 TEST_END: FAIL
TEST-FAIL | /infrastructure/reftest/reftest_match_and_mismatch-6.html | took 1758ms
8:13.99 TEST_START: /infrastructure/reftest/reftest_match_and_mismatch-7.html
TEST-START | /infrastructure/reftest/reftest_match_and_mismatch-7.html
8:14.57 TEST_END: FAIL
TEST-FAIL | /infrastructure/reftest/reftest_match_and_mismatch-7.html | took 580ms
8:14.57 TEST_START: /infrastructure/reftest/reftest_match_fail.html
TEST-START | /infrastructure/reftest/reftest_match_fail.html
8:15.10 TEST_END: FAIL
TEST-FAIL | /infrastructure/reftest/reftest_match_fail.html | took 526ms
8:15.10 TEST_START: /infrastructure/reftest/reftest_mismatch.html
TEST-START | /infrastructure/reftest/reftest_mismatch.html
8:15.61 TEST_END: PASS
TEST-PASS | /infrastructure/reftest/reftest_mismatch.html | took 511ms
8:15.61 TEST_START: /infrastructure/reftest/reftest_mismatch_fail.html
TEST-START | /infrastructure/reftest/reftest_mismatch_fail.html
8:16.13 TEST_END: FAIL
TEST-FAIL | /infrastructure/reftest/reftest_mismatch_fail.html | took 513ms
8:16.13 TEST_START: /infrastructure/reftest/reftest_multiple_match-0.html
TEST-START | /infrastructure/reftest/reftest_multiple_match-0.html
8:17.58 TEST_END: PASS
TEST-PASS | /infrastructure/reftest/reftest_multiple_match-0.html | took 1450ms
8:17.58 TEST_START: /infrastructure/reftest/reftest_multiple_match-1.html
TEST-START | /infrastructure/reftest/reftest_multiple_match-1.html
8:18.12 TEST_END: PASS
TEST-PASS | /infrastructure/reftest/reftest_multiple_match-1.html | took 546ms
8:18.12 TEST_START: /infrastructure/reftest/reftest_multiple_mismatch-0.html
TEST-START | /infrastructure/reftest/reftest_multiple_mismatch-0.html
8:19.99 TEST_END: FAIL
TEST-FAIL | /infrastructure/reftest/reftest_multiple_mismatch-0.html | took 1869ms
8:20.00 TEST_START: /infrastructure/reftest/reftest_multiple_mismatch-1.html
TEST-START | /infrastructure/reftest/reftest_multiple_mismatch-1.html
8:21.17 TEST_END: FAIL
TEST-FAIL | /infrastructure/reftest/reftest_multiple_mismatch-1.html | took 1178ms
8:21.18 TEST_START: /infrastructure/reftest/reftest_ref_timeout.html
TEST-START | /infrastructure/reftest/reftest_ref_timeout.html
8:41.31 TEST_END: TIMEOUT
TEST-TIMEOUT | /infrastructure/reftest/reftest_ref_timeout.html | took 20134ms
8:41.31 TEST_START: /infrastructure/reftest/reftest_timeout.html
TEST-START | /infrastructure/reftest/reftest_timeout.html
mem avail: 11952 of 15806 MiB (75 %), swap free: 0 of 0 MiB ( 0 %)
9:02.96 TEST_END: TIMEOUT
TEST-TIMEOUT | /infrastructure/reftest/reftest_timeout.html | took 21646ms
9:02.96 TEST_START: /infrastructure/reftest/reftest_wait_0.html
TEST-START | /infrastructure/reftest/reftest_wait_0.html
9:06.15 TEST_END: PASS
TEST-PASS | /infrastructure/reftest/reftest_wait_0.html | took 3194ms
9:06.15 TEST_START: /infrastructure/reftest/reftest_wait_TestRendered.html
TEST-START | /infrastructure/reftest/reftest_wait_TestRendered.html
9:07.30 TEST_END: PASS
TEST-PASS | /infrastructure/reftest/reftest_wait_TestRendered.html | took 1151ms
9:07.30 TEST_START: /infrastructure/reftest/reftest_window_load.html
TEST-START | /infrastructure/reftest/reftest_window_load.html
9:08.59 TEST_END: PASS
TEST-PASS | /infrastructure/reftest/reftest_window_load.html | took 1289ms
9:08.59 TEST_START: /infrastructure/reftest/size.html
TEST-START | /infrastructure/reftest/size.html
9:09.81 TEST_END: PASS
TEST-PASS | /infrastructure/reftest/size.html | took 1215ms
9:09.81 TEST_START: /infrastructure/reftest-wait.html
TEST-START | /infrastructure/reftest-wait.html
9:11.93 TEST_END: PASS
TEST-PASS | /infrastructure/reftest-wait.html | took 2126ms
9:11.94 INFO Restarting browser for new test type:crashtest
Restarting browser for new test type:crashtest
9:12.54 INFO STDOUT: cleanup aborted: Unable to remount device
STDOUT: cleanup aborted: Unable to remount device
9:12.16 INFO Closing logging queue
Closing logging queue
9:12.16 INFO queue closed
queue closed
9:12.74 INFO STDOUT: cleanup aborted: Unable to remount device
STDOUT: cleanup aborted: Unable to remount device
9:12.93 INFO STDOUT: cleanup aborted: Unable to remount device
STDOUT: cleanup aborted: Unable to remount device
9:12.95 INFO --certutil-binary not supplied; Firefox will not check certificates
--certutil-binary not supplied; Firefox will not check certificates
9:13.80 web-platform-tests INFO Granting important runtime permissions to org.mozilla.geckoview.test_runner
web-platform-tests Granting important runtime permissions to org.mozilla.geckoview.test_runner
9:15.18 web-platform-tests INFO launch_application: am start -W -n org.mozilla.geckoview.test_runner/org.mozilla.geckoview.test_runner.TestRunnerActivity -a android.intent.action.MAIN --es env0 MOZ_CRASHREPORTER=1 --es env1 MOZ_CRASHREPORTER_NO_REPORT=1 --es env2 MOZ_CRASHREPORTER_SHUTDOWN=1 --es env3 MOZ_HIDE_RESULTS_TABLE=1 --es env4 MOZ_IN_AUTOMATION=1 --es env5 MOZ_LOG=signaling:3,mtransport:4,DataChannel:4,jsep:4 --es env6 R_LOG_LEVEL=6 --es env7 R_LOG_DESTINATION=stderr --es env8 R_LOG_VERBOSE=1 --es env9 MOZ_PROCESS_LOG=/tmp/tmp0akd9lzypidlog --es env10 MOZ_DISABLE_NONLOCAL_CONNECTIONS=1 --es arg0 -no-remote --es arg1 -profile --es arg2 /data/local/tmp/test_root/profile --es arg3 --marionette --es arg4 about:blank --ez use_multiprocess True
web-platform-tests launch_application: am start -W -n org.mozilla.geckoview.test_runner/org.mozilla.geckoview.test_runner.TestRunnerActivity -a android.intent.action.MAIN --es env0 MOZ_CRASHREPORTER=1 --es env1 MOZ_CRASHREPORTER_NO_REPORT=1 --es env2 MOZ_CRASHREPORTER_SHUTDOWN=1 --es env3 MOZ_HIDE_RESULTS_TABLE=1 --es env4 MOZ_IN_AUTOMATION=1 --es env5 MOZ_LOG=signaling:3,mtransport:4,DataChannel:4,jsep:4 --es env6 R_LOG_LEVEL=6 --es env7 R_LOG_DESTINATION=stderr --es env8 R_LOG_VERBOSE=1 --es env9 MOZ_PROCESS_LOG=/tmp/tmp0akd9lzypidlog --es env10 MOZ_DISABLE_NONLOCAL_CONNECTIONS=1 --es arg0 -no-remote --es arg1 -profile --es arg2 /data/local/tmp/test_root/profile --es arg3 --marionette --es arg4 about:blank --ez use_multiprocess True
9:17.43 INFO Starting runner
Starting runner
9:18.77 TEST_START: /infrastructure/crashtests/example.html
TEST-START | /infrastructure/crashtests/example.html
9:19.45 TEST_END: PASS
TEST-PASS | /infrastructure/crashtests/example.html | took 670ms
9:19.45 INFO Restarting browser for new test type:wdspec
Restarting browser for new test type:wdspec
9:20.10 INFO STDOUT: cleanup aborted: Unable to remount device
STDOUT: cleanup aborted: Unable to remount device
9:19.69 INFO Closing logging queue
Closing logging queue
9:20.31 INFO STDOUT: cleanup aborted: Unable to remount device
STDOUT: cleanup aborted: Unable to remount device
9:19.69 INFO queue closed
queue closed
9:20.54 INFO STDOUT: cleanup aborted: Unable to remount device
STDOUT: cleanup aborted: Unable to remount device
9:20.55 INFO --certutil-binary not supplied; Firefox will not check certificates
--certutil-binary not supplied; Firefox will not check certificates
9:21.08 pid:12952 Full command: /home/test/web-platform-tests/_venv3/bin/geckodriver --host 127.0.0.1 --port 0
pid:12952 1706000112989 geckodriver INFO Listening on 127.0.0.1:33639
PID 12952 | 1706000112989 geckodriver INFO Listening on 127.0.0.1:33639
9:21.08 INFO Starting runner
Starting runner
9:21.33 TEST_START: /infrastructure/webdriver/tests/test_load_file.py
TEST-START | /infrastructure/webdriver/tests/test_load_file.py
9:22.15 INFO STDOUT: ============================= test session starts ==============================
STDOUT: ============================= test session starts ==============================
9:22.15 INFO STDOUT: platform linux -- Python 3.8.10, pytest-7.0.1, pluggy-unknown -- /usr/bin/python3
STDOUT: platform linux -- Python 3.8.10, pytest-7.0.1, pluggy-unknown -- /usr/bin/python3
9:22.16 INFO STDOUT: rootdir: /home/test/web-platform-tests
STDOUT: rootdir: /home/test/web-platform-tests
9:22.16 INFO STDOUT: plugins: asyncio-0.19.0
STDOUT: plugins: asyncio-0.19.0
9:22.16 INFO STDOUT: asyncio: mode=strict
STDOUT: asyncio: mode=strict
9:22.16 INFO STDOUT: collecting ...
STDOUT: collecting ...
9:22.16 INFO STDOUT: collected 1 item
STDOUT: collected 1 item
9:22.16 INFO STDOUT: infrastructure/webdriver/tests/test_load_file.py::test_load
STDOUT: infrastructure/webdriver/tests/test_load_file.py::test_load
9:22.30 pid:12952 1706000114295 mozdevice INFO Device is rooted
PID 12952 | 1706000114295 mozdevice INFO Device is rooted
9:26.86 INFO STDOUT: PASSED
STDOUT: PASSED
9:28.33 INFO STDOUT: ============================== 1 passed in 6.18s ===============================
STDOUT: ============================== 1 passed in 6.18s ===============================
TEST-PASS | /infrastructure/webdriver/tests/test_load_file.py | test_load
9:28.33 TEST_END: Test OK. Subtests passed 1/1. Unexpected 0
TEST-OK | /infrastructure/webdriver/tests/test_load_file.py | took 7008ms
9:28.33 INFO No more tests
No more tests
9:28.34 INFO No more tests
No more tests
9:28.34 INFO Closing logging queue
Closing logging queue
9:28.34 INFO queue closed
queue closed
9:28.44 SUITE_END
web-platform-test
~~~~~~~~~~~~~~~~~
Ran 367 checks (219 subtests, 148 tests)
Expected results: 366
Skipped: 1 tests
Unexpected results: 0
OK
SUITE-END | took 422s
9:28.44 INFO Got 0 unexpected results, with 0 unexpected passes
Got 0 unexpected results, with 0 unexpected passes
9:28.51 wptserve INFO Stopped http server on 127.0.0.1:9000
wptserve Stopped http server on 127.0.0.1:9000
9:28.57 wptserve INFO Close on: (<AddressFamily.AF_INET: 2>, <SocketKind.SOCK_STREAM: 1>, 6, '', ('127.0.0.1', 8889))
wptserve Close on: (<AddressFamily.AF_INET: 2>, <SocketKind.SOCK_STREAM: 1>, 6, '', ('127.0.0.1', 8889))
9:28.65 wptserve INFO Stopped http server on 127.0.0.1:8443
wptserve Stopped http server on 127.0.0.1:8443
9:28.70 wptserve INFO Close on: (<AddressFamily.AF_INET: 2>, <SocketKind.SOCK_STREAM: 1>, 6, '', ('127.0.0.1', 8888))
wptserve Close on: (<AddressFamily.AF_INET: 2>, <SocketKind.SOCK_STREAM: 1>, 6, '', ('127.0.0.1', 8888))
9:28.72 wptserve INFO Stopped http server on 127.0.0.1:8445
wptserve Stopped http server on 127.0.0.1:8445
9:28.76 wptserve INFO Stopped http server on 127.0.0.1:8002
wptserve Stopped http server on 127.0.0.1:8002
9:28.77 wptserve INFO Stopped http server on 127.0.0.1:8001
wptserve Stopped http server on 127.0.0.1:8001
9:28.80 wptserve INFO Stopped http server on 127.0.0.1:8446
wptserve Stopped http server on 127.0.0.1:8446
9:28.82 wptserve INFO Stopped http server on 127.0.0.1:8444
wptserve Stopped http server on 127.0.0.1:8444
9:28.84 wptserve INFO Stopped http server on 127.0.0.1:8000
wptserve Stopped http server on 127.0.0.1:8000
9:28.89 wptserve INFO Stopped http server on 127.0.0.1:8003
wptserve Stopped http server on 127.0.0.1:8003
9:28.94 INFO Removed font: Ahem.ttf
Removed font: Ahem.ttf
9:28.97 INFO Closing logging queue
Closing logging queue
9:28.97 INFO queue closed
queue closed
[taskcluster 2024-01-23 08:55:23.316Z] === Task Finished ===
[taskcluster 2024-01-23 08:55:24.776Z] Successful task run with exit code: 0 completed in 1025.421 seconds