matrix-react-sdk End to End Tests #2460
downstream-end-to-end-tests.yml
on: merge_group
Playwright
/
Build Element-Web
2m 10s
Matrix: Playwright / playwright
Playwright
/
end-to-end-tests
1m 7s
Annotations
13 errors, 28 warnings, and 6 notices
[Chrome] › audio-player/audio-player.spec.ts:243:9 › Audio player › should support creating a reply chain with multiple audio files @no-firefox @no-webkit @screenshot:
playwright/e2e/audio-player/audio-player.spec.ts#L1
1) [Chrome] › audio-player/audio-player.spec.ts:243:9 › Audio player › should support creating a reply chain with multiple audio files @no-firefox @no-webkit @screenshot
Test timeout of 30000ms exceeded.
|
[Chrome] › audio-player/audio-player.spec.ts:243:9 › Audio player › should support creating a reply chain with multiple audio files @no-firefox @no-webkit @screenshot:
playwright/e2e/audio-player/audio-player.spec.ts#L257
1) [Chrome] › audio-player/audio-player.spec.ts:243:9 › Audio player › should support creating a reply chain with multiple audio files @no-firefox @no-webkit @screenshot
Error: locator.click: Test timeout of 30000ms exceeded.
Call log:
- waiting for locator('.mx_EventTile_last').getByRole('button', { name: 'Reply', exact: true })
255 | const clickButtonReply = async () => {
256 | await tile.hover();
> 257 | await tile.getByRole("button", { name: "Reply", exact: true }).click();
| ^
258 | };
259 |
260 | await uploadFile(page, "playwright/sample-files/upload-first.ogg");
at clickButtonReply (/home/runner/work/matrix-js-sdk/matrix-js-sdk/playwright/e2e/audio-player/audio-player.spec.ts:257:80)
at /home/runner/work/matrix-js-sdk/matrix-js-sdk/playwright/e2e/audio-player/audio-player.spec.ts:273:13
|
[Chrome] › timeline/timeline.spec.ts:589:13 › Timeline › message displaying › should set inline start padding to a hidden event line @screenshot:
playwright/e2e/timeline/timeline.spec.ts#L612
1) [Chrome] › timeline/timeline.spec.ts:589:13 › Timeline › message displaying › should set inline start padding to a hidden event line @screenshot
Error: Timed out 5000ms waiting for expect(locator).toHaveCSS(expected)
Locator: locator('.mx_EventTile[data-layout=irc].mx_EventTile_info .mx_EventTile_line').first()
Expected string: "0px"
Received: <element(s) not found>
Call log:
- expect.toHaveCSS with timeout 5000ms
- waiting for locator('.mx_EventTile[data-layout=irc].mx_EventTile_info .mx_EventTile_line').first()
610 | await expect(
611 | page.locator(".mx_EventTile[data-layout=irc].mx_EventTile_info .mx_EventTile_line").first(),
> 612 | ).toHaveCSS("padding-inline-start", "0px");
| ^
613 |
614 | // Exclude timestamp and read marker from snapshot
615 | const screenshotOptions = {
at /home/runner/work/matrix-js-sdk/matrix-js-sdk/playwright/e2e/timeline/timeline.spec.ts:612:19
|
[Chrome] › sliding-sync/sliding-sync.spec.ts:365:5 › Sliding Sync › should send unsubscribe_rooms for every room switch:
playwright/e2e/sliding-sync/sliding-sync.spec.ts#L1
1) [Chrome] › sliding-sync/sliding-sync.spec.ts:365:5 › Sliding Sync › should send unsubscribe_rooms for every room switch
Test timeout of 30000ms exceeded.
|
[Chrome] › sliding-sync/sliding-sync.spec.ts:365:5 › Sliding Sync › should send unsubscribe_rooms for every room switch:
playwright/e2e/sliding-sync/sliding-sync.spec.ts#L406
1) [Chrome] › sliding-sync/sliding-sync.spec.ts:365:5 › Sliding Sync › should send unsubscribe_rooms for every room switch
Error: page.waitForRequest: Test timeout of 30000ms exceeded.
404 | await Promise.all([
405 | page.waitForRequest(matchRoomSubRequest(roomOId)),
> 406 | page.waitForRequest(matchRoomUnsubRequest(roomPId)),
| ^
407 | page.getByRole("treeitem", { name: "Orange", exact: true }).click(),
408 | ]);
409 |
at /home/runner/work/matrix-js-sdk/matrix-js-sdk/playwright/e2e/sliding-sync/sliding-sync.spec.ts:406:18
|
[Chrome] › spotlight/spotlight.spec.ts:132:9 › Spotlight › should find known public rooms:
playwright/e2e/spotlight/spotlight.spec.ts#L138
2) [Chrome] › spotlight/spotlight.spec.ts:132:9 › Spotlight › should find known public rooms ─────
Error: Timed out 5000ms waiting for expect(locator).toHaveCount(expected)
Locator: locator('[role=dialog][aria-label="Search Dialog"]').locator('.mx_SpotlightDialog_section.mx_SpotlightDialog_results .mx_SpotlightDialog_option')
Expected: 1
Received: 3
Call log:
- expect.toHaveCount with timeout 5000ms
- waiting for locator('[role=dialog][aria-label="Search Dialog"]').locator('.mx_SpotlightDialog_section.mx_SpotlightDialog_results .mx_SpotlightDialog_option')
2 × locator resolved to 0 elements
- unexpected value "0"
7 × locator resolved to 3 elements
- unexpected value "3"
136 | await spotlight.search(room1Name);
137 | const resultLocator = spotlight.results;
> 138 | await expect(resultLocator).toHaveCount(1);
| ^
139 | await expect(resultLocator.first()).toContainText(room1Name);
140 | await expect(resultLocator.first()).toContainText("View");
141 | await resultLocator.first().click();
at /home/runner/work/matrix-js-sdk/matrix-js-sdk/playwright/e2e/spotlight/spotlight.spec.ts:138:37
|
[Chrome] › spotlight/spotlight.spec.ts:146:9 › Spotlight › should find unknown public rooms:
playwright/e2e/spotlight/spotlight.spec.ts#L152
3) [Chrome] › spotlight/spotlight.spec.ts:146:9 › Spotlight › should find unknown public rooms ───
Error: Timed out 5000ms waiting for expect(locator).toHaveCount(expected)
Locator: locator('[role=dialog][aria-label="Search Dialog"]').locator('.mx_SpotlightDialog_section.mx_SpotlightDialog_results .mx_SpotlightDialog_option')
Expected: 1
Received: 2
Call log:
- expect.toHaveCount with timeout 5000ms
- waiting for locator('[role=dialog][aria-label="Search Dialog"]').locator('.mx_SpotlightDialog_section.mx_SpotlightDialog_results .mx_SpotlightDialog_option')
2 × locator resolved to 0 elements
- unexpected value "0"
7 × locator resolved to 2 elements
- unexpected value "2"
150 | await spotlight.search(room2Name);
151 | const resultLocator = spotlight.results;
> 152 | await expect(resultLocator).toHaveCount(1);
| ^
153 | await expect(resultLocator.first()).toContainText(room2Name);
154 | await expect(resultLocator.first()).toContainText("Join");
155 | await resultLocator.first().click();
at /home/runner/work/matrix-js-sdk/matrix-js-sdk/playwright/e2e/spotlight/spotlight.spec.ts:152:37
|
[Chrome] › spotlight/spotlight.spec.ts:161:9 › Spotlight › should find unknown public world readable rooms:
playwright/e2e/spotlight/spotlight.spec.ts#L167
4) [Chrome] › spotlight/spotlight.spec.ts:161:9 › Spotlight › should find unknown public world readable rooms
Error: Timed out 5000ms waiting for expect(locator).toHaveCount(expected)
Locator: locator('[role=dialog][aria-label="Search Dialog"]').locator('.mx_SpotlightDialog_section.mx_SpotlightDialog_results .mx_SpotlightDialog_option')
Expected: 1
Received: 2
Call log:
- expect.toHaveCount with timeout 5000ms
- waiting for locator('[role=dialog][aria-label="Search Dialog"]').locator('.mx_SpotlightDialog_section.mx_SpotlightDialog_results .mx_SpotlightDialog_option')
2 × locator resolved to 0 elements
- unexpected value "0"
7 × locator resolved to 2 elements
- unexpected value "2"
165 | await spotlight.search(room3Name);
166 | const resultLocator = spotlight.results;
> 167 | await expect(resultLocator).toHaveCount(1);
| ^
168 | await expect(resultLocator.first()).toContainText(room3Name);
169 | await expect(resultLocator.first()).toContainText("View");
170 | await resultLocator.first().click();
at /home/runner/work/matrix-js-sdk/matrix-js-sdk/playwright/e2e/spotlight/spotlight.spec.ts:167:37
|
[Chrome] › spotlight/spotlight.spec.ts:220:9 › Spotlight › should find unknown people:
playwright/e2e/spotlight/spotlight.spec.ts#L226
5) [Chrome] › spotlight/spotlight.spec.ts:220:9 › Spotlight › should find unknown people ─────────
Error: Timed out 5000ms waiting for expect(locator).toHaveCount(expected)
Locator: locator('[role=dialog][aria-label="Search Dialog"]').locator('.mx_SpotlightDialog_section.mx_SpotlightDialog_results .mx_SpotlightDialog_option')
Expected: 1
Received: 3
Call log:
- expect.toHaveCount with timeout 5000ms
- waiting for locator('[role=dialog][aria-label="Search Dialog"]').locator('.mx_SpotlightDialog_section.mx_SpotlightDialog_results .mx_SpotlightDialog_option')
2 × locator resolved to 0 elements
- unexpected value "0"
7 × locator resolved to 3 elements
- unexpected value "3"
224 | await spotlight.search(bot2Name);
225 | const resultLocator = spotlight.results;
> 226 | await expect(resultLocator).toHaveCount(1);
| ^
227 | await expect(resultLocator.first()).toContainText(bot2Name);
228 | await resultLocator.first().click();
229 | await expect(roomHeaderName(page)).toHaveText(bot2Name);
at /home/runner/work/matrix-js-sdk/matrix-js-sdk/playwright/e2e/spotlight/spotlight.spec.ts:226:37
|
[Chrome] › spotlight/spotlight.spec.ts:321:9 › Spotlight › should allow opening group chat dialog:
playwright/e2e/spotlight/spotlight.spec.ts#L329
6) [Chrome] › spotlight/spotlight.spec.ts:321:9 › Spotlight › should allow opening group chat dialog
Error: Timed out 5000ms waiting for expect(locator).toHaveCount(expected)
Locator: locator('[role=dialog][aria-label="Search Dialog"]').locator('.mx_SpotlightDialog_section.mx_SpotlightDialog_results .mx_SpotlightDialog_option')
Expected: 1
Received: 4
Call log:
- expect.toHaveCount with timeout 5000ms
- waiting for locator('[role=dialog][aria-label="Search Dialog"]').locator('.mx_SpotlightDialog_section.mx_SpotlightDialog_results .mx_SpotlightDialog_option')
9 × locator resolved to 4 elements
- unexpected value "4"
327 |
328 | const resultLocator = spotlight.results;
> 329 | await expect(resultLocator).toHaveCount(1);
| ^
330 | await expect(resultLocator.first()).toContainText(bot2Name);
331 |
332 | await expect(spotlight.dialog.locator(".mx_SpotlightDialog_startGroupChat")).toContainText(
at /home/runner/work/matrix-js-sdk/matrix-js-sdk/playwright/e2e/spotlight/spotlight.spec.ts:329:37
|
[Chrome] › spotlight/spotlight.spec.ts:339:9 › Spotlight › should close spotlight after starting a DM:
playwright/e2e/spotlight/spotlight.spec.ts#L27
7) [Chrome] › spotlight/spotlight.spec.ts:339:9 › Spotlight › should close spotlight after starting a DM
Error: Timed out 5000ms waiting for expect(locator).toHaveCount(expected)
Locator: locator('[role=dialog][aria-label="Search Dialog"]').locator('.mx_SpotlightDialog_section.mx_SpotlightDialog_results .mx_SpotlightDialog_option')
Expected: 1
Received: 2
Call log:
- expect.toHaveCount with timeout 5000ms
- waiting for locator('[role=dialog][aria-label="Search Dialog"]').locator('.mx_SpotlightDialog_section.mx_SpotlightDialog_results .mx_SpotlightDialog_option')
9 × locator resolved to 2 elements
- unexpected value "2"
25 | await expect(spotlight.dialog.locator(".mx_Spinner")).not.toBeAttached();
26 | const result = spotlight.results;
> 27 | await expect(result).toHaveCount(1);
| ^
28 | await expect(result.first()).toContainText(name);
29 | await result.first().click();
30 |
at startDM (/home/runner/work/matrix-js-sdk/matrix-js-sdk/playwright/e2e/spotlight/spotlight.spec.ts:27:26)
at /home/runner/work/matrix-js-sdk/matrix-js-sdk/playwright/e2e/spotlight/spotlight.spec.ts:340:9
|
[Chrome] › spotlight/spotlight.spec.ts:344:9 › Spotlight › should show the same user only once:
playwright/e2e/spotlight/spotlight.spec.ts#L27
8) [Chrome] › spotlight/spotlight.spec.ts:344:9 › Spotlight › should show the same user only once
Error: Timed out 5000ms waiting for expect(locator).toHaveCount(expected)
Locator: locator('[role=dialog][aria-label="Search Dialog"]').locator('.mx_SpotlightDialog_section.mx_SpotlightDialog_results .mx_SpotlightDialog_option')
Expected: 1
Received: 2
Call log:
- expect.toHaveCount with timeout 5000ms
- waiting for locator('[role=dialog][aria-label="Search Dialog"]').locator('.mx_SpotlightDialog_section.mx_SpotlightDialog_results .mx_SpotlightDialog_option')
9 × locator resolved to 2 elements
- unexpected value "2"
25 | await expect(spotlight.dialog.locator(".mx_Spinner")).not.toBeAttached();
26 | const result = spotlight.results;
> 27 | await expect(result).toHaveCount(1);
| ^
28 | await expect(result.first()).toContainText(name);
29 | await result.first().click();
30 |
at startDM (/home/runner/work/matrix-js-sdk/matrix-js-sdk/playwright/e2e/spotlight/spotlight.spec.ts:27:26)
at /home/runner/work/matrix-js-sdk/matrix-js-sdk/playwright/e2e/spotlight/spotlight.spec.ts:345:9
|
[Chrome] › spotlight/spotlight.spec.ts:357:9 › Spotlight › should be able to navigate results via keyboard:
playwright/e2e/spotlight/spotlight.spec.ts#L364
9) [Chrome] › spotlight/spotlight.spec.ts:357:9 › Spotlight › should be able to navigate results via keyboard
Error: Timed out 5000ms waiting for expect(locator).toHaveCount(expected)
Locator: locator('[role=dialog][aria-label="Search Dialog"]').locator('.mx_SpotlightDialog_section.mx_SpotlightDialog_results .mx_SpotlightDialog_option')
Expected: 2
Received: 4
Call log:
- expect.toHaveCount with timeout 5000ms
- waiting for locator('[role=dialog][aria-label="Search Dialog"]').locator('.mx_SpotlightDialog_section.mx_SpotlightDialog_results .mx_SpotlightDialog_option')
2 × locator resolved to 1 element
- unexpected value "1"
7 × locator resolved to 4 elements
- unexpected value "4"
362 |
363 | let resultLocator = spotlight.results;
> 364 | await expect(resultLocator).toHaveCount(2);
| ^
365 | await expect(resultLocator.first()).toHaveAttribute("aria-selected", "true");
366 | await expect(resultLocator.last()).toHaveAttribute("aria-selected", "false");
367 |
at /home/runner/work/matrix-js-sdk/matrix-js-sdk/playwright/e2e/spotlight/spotlight.spec.ts:364:37
|
Slow Test:
[Chrome] › read-receipts/high-level.spec.ts#L1
[Chrome] › read-receipts/high-level.spec.ts took 3.0m
|
Slow Test:
[Chrome] › read-receipts/new-messages-in-threads.spec.ts#L1
[Chrome] › read-receipts/new-messages-in-threads.spec.ts took 58.1s
|
Slow Test:
[Chrome] › read-receipts/new-messages-main-timeline.spec.ts#L1
[Chrome] › read-receipts/new-messages-main-timeline.spec.ts took 39.2s
|
Slow Test:
[Chrome] › read-receipts/new-messages-thread-roots.spec.ts#L1
[Chrome] › read-receipts/new-messages-thread-roots.spec.ts took 28.0s
|
Slow Test:
[Chrome] › messages/messages.spec.ts#L1
[Chrome] › messages/messages.spec.ts took 57.6s
|
Slow Test:
[Chrome] › pinned-messages/pinned-messages.spec.ts#L1
[Chrome] › pinned-messages/pinned-messages.spec.ts took 56.0s
|
Slow Test:
[Chrome] › read-receipts/editing-messages-in-threads.spec.ts#L1
[Chrome] › read-receipts/editing-messages-in-threads.spec.ts took 38.0s
|
Slow Test:
[Chrome] › read-receipts/editing-messages-main-timeline.spec.ts#L1
[Chrome] › read-receipts/editing-messages-main-timeline.spec.ts took 37.5s
|
Slow Test:
[Chrome] › invite/invite-dialog.spec.ts#L1
[Chrome] › invite/invite-dialog.spec.ts took 30.2s
|
Slow Test:
[Chrome] › read-receipts/redactions-in-threads.spec.ts#L1
[Chrome] › read-receipts/redactions-in-threads.spec.ts took 1.5m
|
Slow Test:
[Chrome] › read-receipts/redactions-main-timeline.spec.ts#L1
[Chrome] › read-receipts/redactions-main-timeline.spec.ts took 1.1m
|
Slow Test:
[Chrome] › read-receipts/reactions-in-threads.spec.ts#L1
[Chrome] › read-receipts/reactions-in-threads.spec.ts took 57.1s
|
Slow Test:
[Chrome] › read-receipts/read-receipts.spec.ts#L1
[Chrome] › read-receipts/read-receipts.spec.ts took 46.6s
|
Slow Test:
[Chrome] › read-receipts/redactions-thread-roots.spec.ts#L1
[Chrome] › read-receipts/redactions-thread-roots.spec.ts took 30.9s
|
Slow Test:
[Chrome] › crypto/event-shields.spec.ts#L1
[Chrome] › crypto/event-shields.spec.ts took 52.5s
|
Slow Test:
[Chrome] › composer/RTE.spec.ts#L1
[Chrome] › composer/RTE.spec.ts took 36.0s
|
Slow Test:
[Chrome] › crypto/crypto.spec.ts#L1
[Chrome] › crypto/crypto.spec.ts took 34.0s
|
Slow Test:
[Chrome] › accessibility/keyboard-navigation.spec.ts#L1
[Chrome] › accessibility/keyboard-navigation.spec.ts took 30.6s
|
Slow Test:
[Chrome] › crypto/decryption-failure-messages.spec.ts#L1
[Chrome] › crypto/decryption-failure-messages.spec.ts took 28.8s
|
Slow Test:
[Chrome] › login/login-consent.spec.ts#L1
[Chrome] › login/login-consent.spec.ts took 1.1m
|
Slow Test:
[Chrome] › threads/threads.spec.ts#L1
[Chrome] › threads/threads.spec.ts took 31.2s
|
Slow Test:
[Chrome] › crypto/backups-mas.spec.ts#L1
[Chrome] › crypto/backups-mas.spec.ts took 29.9s
|
Slow Test:
[Chrome] › app-loading/guest-registration.spec.ts#L1
[Chrome] › app-loading/guest-registration.spec.ts took 27.1s
|
Slow Test:
[Chrome] › user-onboarding/user-onboarding-new.spec.ts#L1
[Chrome] › user-onboarding/user-onboarding-new.spec.ts took 23.6s
|
Slow Test:
[Chrome] › spaces/threads-activity-centre/threadsActivityCentre.spec.ts#L1
[Chrome] › spaces/threads-activity-centre/threadsActivityCentre.spec.ts took 47.6s
|
Slow Test:
[Chrome] › room/room-header.spec.ts#L1
[Chrome] › room/room-header.spec.ts took 32.8s
|
Slow Test:
[Chrome] › spaces/spaces.spec.ts#L1
[Chrome] › spaces/spaces.spec.ts took 30.1s
|
Slow Test:
[Chrome] › settings/account-user-settings-tab.spec.ts#L1
[Chrome] › settings/account-user-settings-tab.spec.ts took 16.8s
|
🎭 Playwright Run Summary
43 skipped
33 passed (5.3m)
|
🎭 Playwright Run Summary
2 skipped
79 passed (6.1m)
|
🎭 Playwright Run Summary
2 skipped
75 passed (6.7m)
|
🎭 Playwright Run Summary
1 flaky
[Chrome] › audio-player/audio-player.spec.ts:243:9 › Audio player › should support creating a reply chain with multiple audio files @no-firefox @no-webkit @screenshot
81 passed (7.3m)
|
🎭 Playwright Run Summary
1 flaky
[Chrome] › timeline/timeline.spec.ts:589:13 › Timeline › message displaying › should set inline start padding to a hidden event line @screenshot
70 passed (7.3m)
|
🎭 Playwright Run Summary
9 flaky
[Chrome] › sliding-sync/sliding-sync.spec.ts:365:5 › Sliding Sync › should send unsubscribe_rooms for every room switch
[Chrome] › spotlight/spotlight.spec.ts:132:9 › Spotlight › should find known public rooms ──────
[Chrome] › spotlight/spotlight.spec.ts:146:9 › Spotlight › should find unknown public rooms ────
[Chrome] › spotlight/spotlight.spec.ts:161:9 › Spotlight › should find unknown public world readable rooms
[Chrome] › spotlight/spotlight.spec.ts:220:9 › Spotlight › should find unknown people ──────────
[Chrome] › spotlight/spotlight.spec.ts:321:9 › Spotlight › should allow opening group chat dialog
[Chrome] › spotlight/spotlight.spec.ts:339:9 › Spotlight › should close spotlight after starting a DM
[Chrome] › spotlight/spotlight.spec.ts:344:9 › Spotlight › should show the same user only once ─
[Chrome] › spotlight/spotlight.spec.ts:357:9 › Spotlight › should be able to navigate results via keyboard
2 skipped
72 passed (9.2m)
|
Artifacts
Produced during runtime
Name | Size | |
---|---|---|
all-blob-reports-Chrome-1
Expired
|
5.47 MB |
|
all-blob-reports-Chrome-2
Expired
|
295 KB |
|
all-blob-reports-Chrome-3
Expired
|
210 KB |
|
all-blob-reports-Chrome-4
Expired
|
327 KB |
|
all-blob-reports-Chrome-5
Expired
|
39.2 MB |
|
all-blob-reports-Chrome-6
Expired
|
4.31 MB |
|
html-report
Expired
|
43.5 MB |
|
webapp
Expired
|
28.7 MB |
|