matrix-react-sdk End to End Tests #2407
downstream-end-to-end-tests.yml
on: merge_group
Playwright
/
Build Element-Web
1m 53s
Matrix: Playwright / playwright
Playwright
/
end-to-end-tests
32s
Annotations
15 errors, 30 warnings, and 6 notices
[Chrome] › room_options/marked_unread.spec.ts:22:9 › Mark as Unread › should mark a room as unread:
playwright/e2e/room_options/marked_unread.spec.ts#L51
1) [Chrome] › room_options/marked_unread.spec.ts:22:9 › Mark as Unread › should mark a room as unread
Error: expect(locator).toBeVisible()
Locator: getByLabel('The mark unread test room Unread messages.')
Expected: visible
Received: <element(s) not found>
Call log:
- expect.toBeVisible with timeout 5000ms
- waiting for getByLabel('The mark unread test room Unread messages.')
49 | await page.getByRole("menuitem", { name: "Mark as unread" }).click();
50 |
> 51 | expect(page.getByLabel(TEST_ROOM_NAME + " Unread messages.")).toBeVisible();
| ^
52 | });
53 | });
54 |
at /home/runner/work/matrix-js-sdk/matrix-js-sdk/playwright/e2e/room_options/marked_unread.spec.ts:51:71
|
[Chrome] › settings/general-room-settings-tab.spec.ts:39:9 › General room settings tab › long address should not cause dialog to overflow @no-webkit:
playwright/e2e/settings/general-room-settings-tab.spec.ts#L47
2) [Chrome] › settings/general-room-settings-tab.spec.ts:39:9 › General room settings tab › long address should not cause dialog to overflow @no-webkit
Error: Timed out 5000ms waiting for expect(locator).toHaveValue(expected)
Locator: locator('.mx_Dialog').filter({ has: locator('.mx_RoomSettingsDialog') }).locator('#canonicalAlias')
Expected string: "#abcasdhjasjhdaj1jh1asdhasjdhajsdhjavhjksdabcasdhjasjhdaj1jh1asdhasjdhajsdhjavhjksdabcasdhjasjhdaj1jh1asdhasjdhajsdhjavhjksdabcasdhjasjhdaj1jh1asdhasjdhajsdhjavhjksd:localhost"
Received string: ""
Call log:
- expect.toHaveValue with timeout 5000ms
- waiting for locator('.mx_Dialog').filter({ has: locator('.mx_RoomSettingsDialog') }).locator('#canonicalAlias')
9 × locator resolved to <select type="text" id="canonicalAlias" label="Main address" placeholder="Main address">…</select>
- unexpected value ""
45 |
46 | // 2. wait for the new setting to apply ...
> 47 | await expect(settings.locator("#canonicalAlias")).toHaveValue(`#${longString}:localhost`);
| ^
48 |
49 | // 3. Check if the dialog overflows
50 | const dialogBoundingBox = await page.locator(".mx_Dialog").boundingBox();
at /home/runner/work/matrix-js-sdk/matrix-js-sdk/playwright/e2e/settings/general-room-settings-tab.spec.ts:47:59
|
[Chrome] › settings/general-room-settings-tab.spec.ts:39:9 › General room settings tab › long address should not cause dialog to overflow @no-webkit:
playwright/e2e/settings/general-room-settings-tab.spec.ts#L47
2) [Chrome] › settings/general-room-settings-tab.spec.ts:39:9 › General room settings tab › long address should not cause dialog to overflow @no-webkit
Retry #1 ───────────────────────────────────────────────────────────────────────────────────────
Error: Timed out 5000ms waiting for expect(locator).toHaveValue(expected)
Locator: locator('.mx_Dialog').filter({ has: locator('.mx_RoomSettingsDialog') }).locator('#canonicalAlias')
Expected string: "#abcasdhjasjhdaj1jh1asdhasjdhajsdhjavhjksdabcasdhjasjhdaj1jh1asdhasjdhajsdhjavhjksdabcasdhjasjhdaj1jh1asdhasjdhajsdhjavhjksdabcasdhjasjhdaj1jh1asdhasjdhajsdhjavhjksd:localhost"
Received string: ""
Call log:
- expect.toHaveValue with timeout 5000ms
- waiting for locator('.mx_Dialog').filter({ has: locator('.mx_RoomSettingsDialog') }).locator('#canonicalAlias')
9 × locator resolved to <select type="text" id="canonicalAlias" label="Main address" placeholder="Main address">…</select>
- unexpected value ""
45 |
46 | // 2. wait for the new setting to apply ...
> 47 | await expect(settings.locator("#canonicalAlias")).toHaveValue(`#${longString}:localhost`);
| ^
48 |
49 | // 3. Check if the dialog overflows
50 | const dialogBoundingBox = await page.locator(".mx_Dialog").boundingBox();
at /home/runner/work/matrix-js-sdk/matrix-js-sdk/playwright/e2e/settings/general-room-settings-tab.spec.ts:47:59
|
[Chrome] › share-dialog/share-dialog.spec.ts:19:9 › Share dialog › should share a room @screenshot:
playwright/element-web-test.ts#L367
3) [Chrome] › share-dialog/share-dialog.spec.ts:19:9 › Share dialog › should share a room @screenshot
Error: expect.toHaveScreenshot(share-dialog-room.png): Test ended.
Call log:
- expect.toHaveScreenshot(share-dialog-room.png) with timeout 5000ms
- verifying given screenshot expectation
- waiting for getByRole('dialog', { name: 'Share room' })
at ../element-web-test.ts:367
365 |
366 | const screenshotName = sanitizeFilePathBeforeExtension(name);
> 367 | await baseExpect(receiver).toHaveScreenshot(screenshotName, options);
| ^
368 |
369 | await style.evaluate((tag) => tag.remove());
370 |
at Object.toMatchScreenshot (/home/runner/work/matrix-js-sdk/matrix-js-sdk/playwright/element-web-test.ts:367:9)
|
[Chrome] › share-dialog/share-dialog.spec.ts:32:9 › Share dialog › should share a room member @screenshot:
playwright/element-web-test.ts#L362
4) [Chrome] › share-dialog/share-dialog.spec.ts:32:9 › Share dialog › should share a room member @screenshot
Error: expect.toMatchScreenshot: Test ended.
at ../element-web-test.ts:362
360 |
361 | // We add a custom style tag before taking screenshots
> 362 | const style = (await page.addStyleTag({
| ^
363 | content: css,
364 | })) as ElementHandle<Element>;
365 |
at Object.toMatchScreenshot (/home/runner/work/matrix-js-sdk/matrix-js-sdk/playwright/element-web-test.ts:362:35)
at /home/runner/work/matrix-js-sdk/matrix-js-sdk/playwright/e2e/share-dialog/share-dialog.spec.ts:43:24
|
[Chrome] › share-dialog/share-dialog.spec.ts:49:9 › Share dialog › should share an event @screenshot:
playwright/element-web-test.ts#L367
5) [Chrome] › share-dialog/share-dialog.spec.ts:49:9 › Share dialog › should share an event @screenshot
Error: expect.toHaveScreenshot(share-dialog-event.png): Test ended.
Call log:
- expect.toHaveScreenshot(share-dialog-event.png) with timeout 5000ms
- verifying given screenshot expectation
- waiting for getByRole('dialog', { name: 'Share Room Message' })
- locator resolved to <div role="dialog" class="mx_ShareDialog" data-focus-lock-disabled="false" aria-describedby="mx_Dialog_content" aria-labelledby="mx_BaseDialog_title">…</div>
- taking element screenshot
- disabled all CSS animations
- waiting for fonts to load...
- fonts loaded
- attempting scroll into view action
- waiting for element to be stable
at ../element-web-test.ts:367
365 |
366 | const screenshotName = sanitizeFilePathBeforeExtension(name);
> 367 | await baseExpect(receiver).toHaveScreenshot(screenshotName, options);
| ^
368 |
369 | await style.evaluate((tag) => tag.remove());
370 |
at Object.toMatchScreenshot (/home/runner/work/matrix-js-sdk/matrix-js-sdk/playwright/element-web-test.ts:367:9)
|
[Chrome] › integration-manager/send_event.spec.ts:227:9 › Integration Manager: Send Event › should fail to send an event type which is not allowed:
playwright/e2e/integration-manager/send_event.spec.ts#L105
1) [Chrome] › integration-manager/send_event.spec.ts:227:9 › Integration Manager: Send Event › should fail to send an event type which is not allowed
Test timeout of 30000ms exceeded while running "beforeEach" hook.
103 | });
104 |
> 105 | test.beforeEach(async ({ page, user, app, room }) => {
| ^
106 | await app.client.setAccountData("m.widgets", {
107 | "m.integration_manager": {
108 | content: {
at /home/runner/work/matrix-js-sdk/matrix-js-sdk/playwright/e2e/integration-manager/send_event.spec.ts:105:10
|
[Chrome] › integration-manager/send_event.spec.ts:227:9 › Integration Manager: Send Event › should fail to send an event type which is not allowed:
playwright/pages/ElementAppPage.ts#L96
1) [Chrome] › integration-manager/send_event.spec.ts:227:9 › Integration Manager: Send Event › should fail to send an event type which is not allowed
Error: locator.click: Test timeout of 30000ms exceeded.
Call log:
- waiting for getByRole('tree', { name: 'Rooms' }).locator('[title="Integration Manager Test"],[aria-label="Integration Manager Test"]').first()
at ../pages/ElementAppPage.ts:96
94 | .locator(`[title="${name}"],[aria-label="${name}"]`)
95 | .first()
> 96 | .click();
| ^
97 | }
98 |
99 | public async viewRoomById(roomId: string): Promise<void> {
at ElementAppPage.viewRoomByName (/home/runner/work/matrix-js-sdk/matrix-js-sdk/playwright/pages/ElementAppPage.ts:96:14)
at /home/runner/work/matrix-js-sdk/matrix-js-sdk/playwright/e2e/integration-manager/send_event.spec.ts:132:19
|
[Chrome] › audio-player/audio-player.spec.ts:177:9 › Audio player › should play an audio file @no-firefox @no-webkit:
playwright/e2e/audio-player/audio-player.spec.ts#L125
1) [Chrome] › audio-player/audio-player.spec.ts:177:9 › Audio player › should play an audio file @no-firefox @no-webkit
Test timeout of 30000ms exceeded while running "beforeEach" hook.
123 | };
124 |
> 125 | test.beforeEach(async ({ page, app, user }) => {
| ^
126 | await app.client.createRoom({ name: "Test Room" });
127 | await app.viewRoomByName("Test Room");
128 |
at /home/runner/work/matrix-js-sdk/matrix-js-sdk/playwright/e2e/audio-player/audio-player.spec.ts:125:10
|
[Chrome] › audio-player/audio-player.spec.ts:177:9 › Audio player › should play an audio file @no-firefox @no-webkit:
playwright/pages/ElementAppPage.ts#L96
1) [Chrome] › audio-player/audio-player.spec.ts:177:9 › Audio player › should play an audio file @no-firefox @no-webkit
Error: locator.click: Test timeout of 30000ms exceeded.
Call log:
- waiting for getByRole('tree', { name: 'Rooms' }).locator('[title="Test Room"],[aria-label="Test Room"]').first()
at ../pages/ElementAppPage.ts:96
94 | .locator(`[title="${name}"],[aria-label="${name}"]`)
95 | .first()
> 96 | .click();
| ^
97 | }
98 |
99 | public async viewRoomById(roomId: string): Promise<void> {
at ElementAppPage.viewRoomByName (/home/runner/work/matrix-js-sdk/matrix-js-sdk/playwright/pages/ElementAppPage.ts:96:14)
at /home/runner/work/matrix-js-sdk/matrix-js-sdk/playwright/e2e/audio-player/audio-player.spec.ts:127:19
|
[Chrome] › audio-player/audio-player.spec.ts:243:9 › Audio player › should support creating a reply chain with multiple audio files @no-firefox @no-webkit @screenshot:
playwright/e2e/audio-player/audio-player.spec.ts#L1
2) [Chrome] › audio-player/audio-player.spec.ts:243:9 › Audio player › should support creating a reply chain with multiple audio files @no-firefox @no-webkit @screenshot
Test timeout of 30000ms exceeded.
|
[Chrome] › audio-player/audio-player.spec.ts:243:9 › Audio player › should support creating a reply chain with multiple audio files @no-firefox @no-webkit @screenshot:
playwright/e2e/audio-player/audio-player.spec.ts#L257
2) [Chrome] › audio-player/audio-player.spec.ts:243:9 › Audio player › should support creating a reply chain with multiple audio files @no-firefox @no-webkit @screenshot
Error: locator.click: Test timeout of 30000ms exceeded.
Call log:
- waiting for locator('.mx_EventTile_last').getByRole('button', { name: 'Reply', exact: true })
255 | const clickButtonReply = async () => {
256 | await tile.hover();
> 257 | await tile.getByRole("button", { name: "Reply", exact: true }).click();
| ^
258 | };
259 |
260 | await uploadFile(page, "playwright/sample-files/upload-first.ogg");
at clickButtonReply (/home/runner/work/matrix-js-sdk/matrix-js-sdk/playwright/e2e/audio-player/audio-player.spec.ts:257:80)
at /home/runner/work/matrix-js-sdk/matrix-js-sdk/playwright/e2e/audio-player/audio-player.spec.ts:273:13
|
[Chrome] › crypto/backups.spec.ts:30:12 › Encryption state after registration › Key backup is enabled by default:
playwright/e2e/crypto/backups.spec.ts#L1
3) [Chrome] › crypto/backups.spec.ts:30:12 › Encryption state after registration › Key backup is enabled by default
Test timeout of 30000ms exceeded.
|
[Chrome] › crypto/backups.spec.ts:30:12 › Encryption state after registration › Key backup is enabled by default:
playwright/pages/settings.ts#L22
3) [Chrome] › crypto/backups.spec.ts:30:12 › Encryption state after registration › Key backup is enabled by default
Error: locator.click: Test timeout of 30000ms exceeded.
Call log:
- waiting for getByRole('button', { name: 'User menu' })
at ../pages/settings.ts:22
20 | const locator = this.page.locator(".mx_ContextualMenu");
21 | if (await locator.locator(".mx_UserMenu_contextMenu_header").isVisible()) return locator;
> 22 | await this.page.getByRole("button", { name: "User menu" }).click();
| ^
23 | await locator.waitFor();
24 | return locator;
25 | }
at Settings.openUserMenu (/home/runner/work/matrix-js-sdk/matrix-js-sdk/playwright/pages/settings.ts:22:68)
at Settings.openUserSettings (/home/runner/work/matrix-js-sdk/matrix-js-sdk/playwright/pages/settings.ts:79:25)
at /home/runner/work/matrix-js-sdk/matrix-js-sdk/playwright/e2e/crypto/backups.spec.ts:35:9
|
[Chrome] › integration-manager/kick.spec.ts:158:9 › Integration Manager: Kick › should kick the target:
playwright/e2e/integration-manager/kick.spec.ts#L92
4) [Chrome] › integration-manager/kick.spec.ts:158:9 › Integration Manager: Kick › should kick the target
Error: Timed out 5000ms waiting for expect(locator).toBeVisible()
Locator: getByText('Alice removed Bob: Goodbye')
Expected: visible
Received: <element(s) not found>
Call log:
- expect.toBeVisible with timeout 5000ms
- waiting for getByText('Alice removed Bob: Goodbye')
90 |
91 | // Check for the event message (or lack thereof)
> 92 | await expect(page.getByText(`${USER_DISPLAY_NAME} removed ${BOT_DISPLAY_NAME}: ${KICK_REASON}`)).toBeVisible({
| ^
93 | visible: shouldExist,
94 | });
95 | }
at expectKickedMessage (/home/runner/work/matrix-js-sdk/matrix-js-sdk/playwright/e2e/integration-manager/kick.spec.ts:92:102)
at /home/runner/work/matrix-js-sdk/matrix-js-sdk/playwright/e2e/integration-manager/kick.spec.ts:166:9
|
Slow Test:
[Chrome] › read-receipts/high-level.spec.ts#L1
[Chrome] › read-receipts/high-level.spec.ts took 3.1m
|
Slow Test:
[Chrome] › read-receipts/new-messages-in-threads.spec.ts#L1
[Chrome] › read-receipts/new-messages-in-threads.spec.ts took 1.5m
|
Slow Test:
[Chrome] › read-receipts/editing-messages-in-threads.spec.ts#L1
[Chrome] › read-receipts/editing-messages-in-threads.spec.ts took 1.2m
|
Slow Test:
[Chrome] › read-receipts/new-messages-main-timeline.spec.ts#L1
[Chrome] › read-receipts/new-messages-main-timeline.spec.ts took 1.1m
|
Slow Test:
[Chrome] › read-receipts/editing-messages-main-timeline.spec.ts#L1
[Chrome] › read-receipts/editing-messages-main-timeline.spec.ts took 1.1m
|
Slow Test:
[Chrome] › timeline/timeline.spec.ts#L1
[Chrome] › timeline/timeline.spec.ts took 2.5m
|
Slow Test:
[Chrome] › spotlight/spotlight.spec.ts#L1
[Chrome] › spotlight/spotlight.spec.ts took 2.1m
|
Slow Test:
[Chrome] › spaces/threads-activity-centre/threadsActivityCentre.spec.ts#L1
[Chrome] › spaces/threads-activity-centre/threadsActivityCentre.spec.ts took 1.6m
|
Slow Test:
[Chrome] › user-onboarding/user-onboarding-new.spec.ts#L1
[Chrome] › user-onboarding/user-onboarding-new.spec.ts took 34.2s
|
Slow Test:
[Chrome] › threads/threads.spec.ts#L1
[Chrome] › threads/threads.spec.ts took 32.4s
|
Slow Test:
[Chrome] › read-receipts/redactions-in-threads.spec.ts#L1
[Chrome] › read-receipts/redactions-in-threads.spec.ts took 2.5m
|
Slow Test:
[Chrome] › read-receipts/redactions-main-timeline.spec.ts#L1
[Chrome] › read-receipts/redactions-main-timeline.spec.ts took 1.9m
|
Slow Test:
[Chrome] › read-receipts/read-receipts.spec.ts#L1
[Chrome] › read-receipts/read-receipts.spec.ts took 1.1m
|
Slow Test:
[Chrome] › read-receipts/reactions-in-threads.spec.ts#L1
[Chrome] › read-receipts/reactions-in-threads.spec.ts took 55.9s
|
Slow Test:
[Chrome] › read-receipts/new-messages-thread-roots.spec.ts#L1
[Chrome] › read-receipts/new-messages-thread-roots.spec.ts took 53.1s
|
Slow Test:
[Chrome] › sliding-sync/sliding-sync.spec.ts#L1
[Chrome] › sliding-sync/sliding-sync.spec.ts took 1.5m
|
Slow Test:
[Chrome] › spaces/spaces.spec.ts#L1
[Chrome] › spaces/spaces.spec.ts took 58.9s
|
Slow Test:
[Chrome] › right-panel/right-panel.spec.ts#L1
[Chrome] › right-panel/right-panel.spec.ts took 51.6s
|
Slow Test:
[Chrome] › settings/account-user-settings-tab.spec.ts#L1
[Chrome] › settings/account-user-settings-tab.spec.ts took 41.5s
|
Slow Test:
[Chrome] › right-panel/file-panel.spec.ts#L1
[Chrome] › right-panel/file-panel.spec.ts took 36.7s
|
Slow Test:
[Chrome] › messages/messages.spec.ts#L1
[Chrome] › messages/messages.spec.ts took 2.1m
|
Slow Test:
[Chrome] › pinned-messages/pinned-messages.spec.ts#L1
[Chrome] › pinned-messages/pinned-messages.spec.ts took 1.7m
|
Slow Test:
[Chrome] › login/login.spec.ts#L1
[Chrome] › login/login.spec.ts took 1.0m
|
Slow Test:
[Chrome] › knock/knock-into-room.spec.ts#L1
[Chrome] › knock/knock-into-room.spec.ts took 36.7s
|
Slow Test:
[Chrome] › integration-manager/read_events.spec.ts#L1
[Chrome] › integration-manager/read_events.spec.ts took 36.5s
|
Slow Test:
[Chrome] › composer/RTE.spec.ts#L1
[Chrome] › composer/RTE.spec.ts took 1.2m
|
Slow Test:
[Chrome] › crypto/event-shields.spec.ts#L1
[Chrome] › crypto/event-shields.spec.ts took 1.1m
|
Slow Test:
[Chrome] › crypto/crypto.spec.ts#L1
[Chrome] › crypto/crypto.spec.ts took 57.9s
|
Slow Test:
[Chrome] › crypto/device-verification.spec.ts#L1
[Chrome] › crypto/device-verification.spec.ts took 40.9s
|
Slow Test:
[Chrome] › crypto/decryption-failure-messages.spec.ts#L1
[Chrome] › crypto/decryption-failure-messages.spec.ts took 38.8s
|
🎭 Playwright Run Summary
32 skipped
50 passed (8.9m)
|
🎭 Playwright Run Summary
3 skipped
69 passed (9.3m)
|
🎭 Playwright Run Summary
15 skipped
60 passed (9.3m)
|
🎭 Playwright Run Summary
5 flaky
[Chrome] › room_options/marked_unread.spec.ts:22:9 › Mark as Unread › should mark a room as unread
[Chrome] › settings/general-room-settings-tab.spec.ts:39:9 › General room settings tab › long address should not cause dialog to overflow @no-webkit
[Chrome] › share-dialog/share-dialog.spec.ts:19:9 › Share dialog › should share a room @screenshot
[Chrome] › share-dialog/share-dialog.spec.ts:32:9 › Share dialog › should share a room member @screenshot
[Chrome] › share-dialog/share-dialog.spec.ts:49:9 › Share dialog › should share an event @screenshot
1 skipped
74 passed (11.0m)
|
🎭 Playwright Run Summary
1 flaky
[Chrome] › integration-manager/send_event.spec.ts:227:9 › Integration Manager: Send Event › should fail to send an event type which is not allowed
1 skipped
76 passed (10.8m)
|
🎭 Playwright Run Summary
4 flaky
[Chrome] › audio-player/audio-player.spec.ts:177:9 › Audio player › should play an audio file @no-firefox @no-webkit
[Chrome] › audio-player/audio-player.spec.ts:243:9 › Audio player › should support creating a reply chain with multiple audio files @no-firefox @no-webkit @screenshot
[Chrome] › crypto/backups.spec.ts:30:12 › Encryption state after registration › Key backup is enabled by default
[Chrome] › integration-manager/kick.spec.ts:158:9 › Integration Manager: Kick › should kick the target
78 passed (13.1m)
|
Artifacts
Produced during runtime
Name | Size | |
---|---|---|
all-blob-reports-Chrome-1
Expired
|
16.9 MB |
|
all-blob-reports-Chrome-2
Expired
|
3.63 MB |
|
all-blob-reports-Chrome-3
Expired
|
306 KB |
|
all-blob-reports-Chrome-4
Expired
|
326 KB |
|
all-blob-reports-Chrome-5
Expired
|
17.6 MB |
|
all-blob-reports-Chrome-6
Expired
|
778 KB |
|
html-report
Expired
|
38.8 MB |
|
webapp
Expired
|
28.3 MB |
|