Skip to content

matrix-react-sdk End to End Tests #2407

matrix-react-sdk End to End Tests

matrix-react-sdk End to End Tests #2407

Triggered via merge group January 7, 2025 14:02
Status Success
Total duration 17m 43s
Artifacts 8
Playwright  /  Build Element-Web
1m 53s
Playwright / Build Element-Web
Matrix: Playwright / playwright
Playwright  /  end-to-end-tests
32s
Playwright / end-to-end-tests
Fit to window
Zoom out
Zoom in

Annotations

15 errors, 30 warnings, and 6 notices
[Chrome] › room_options/marked_unread.spec.ts:22:9 › Mark as Unread › should mark a room as unread: playwright/e2e/room_options/marked_unread.spec.ts#L51
1) [Chrome] › room_options/marked_unread.spec.ts:22:9 › Mark as Unread › should mark a room as unread Error: expect(locator).toBeVisible() Locator: getByLabel('The mark unread test room Unread messages.') Expected: visible Received: <element(s) not found> Call log: - expect.toBeVisible with timeout 5000ms - waiting for getByLabel('The mark unread test room Unread messages.') 49 | await page.getByRole("menuitem", { name: "Mark as unread" }).click(); 50 | > 51 | expect(page.getByLabel(TEST_ROOM_NAME + " Unread messages.")).toBeVisible(); | ^ 52 | }); 53 | }); 54 | at /home/runner/work/matrix-js-sdk/matrix-js-sdk/playwright/e2e/room_options/marked_unread.spec.ts:51:71
[Chrome] › settings/general-room-settings-tab.spec.ts:39:9 › General room settings tab › long address should not cause dialog to overflow @no-webkit: playwright/e2e/settings/general-room-settings-tab.spec.ts#L47
2) [Chrome] › settings/general-room-settings-tab.spec.ts:39:9 › General room settings tab › long address should not cause dialog to overflow @no-webkit Error: Timed out 5000ms waiting for expect(locator).toHaveValue(expected) Locator: locator('.mx_Dialog').filter({ has: locator('.mx_RoomSettingsDialog') }).locator('#canonicalAlias') Expected string: "#abcasdhjasjhdaj1jh1asdhasjdhajsdhjavhjksdabcasdhjasjhdaj1jh1asdhasjdhajsdhjavhjksdabcasdhjasjhdaj1jh1asdhasjdhajsdhjavhjksdabcasdhjasjhdaj1jh1asdhasjdhajsdhjavhjksd:localhost" Received string: "" Call log: - expect.toHaveValue with timeout 5000ms - waiting for locator('.mx_Dialog').filter({ has: locator('.mx_RoomSettingsDialog') }).locator('#canonicalAlias') 9 × locator resolved to <select type="text" id="canonicalAlias" label="Main address" placeholder="Main address">…</select> - unexpected value "" 45 | 46 | // 2. wait for the new setting to apply ... > 47 | await expect(settings.locator("#canonicalAlias")).toHaveValue(`#${longString}:localhost`); | ^ 48 | 49 | // 3. Check if the dialog overflows 50 | const dialogBoundingBox = await page.locator(".mx_Dialog").boundingBox(); at /home/runner/work/matrix-js-sdk/matrix-js-sdk/playwright/e2e/settings/general-room-settings-tab.spec.ts:47:59
[Chrome] › settings/general-room-settings-tab.spec.ts:39:9 › General room settings tab › long address should not cause dialog to overflow @no-webkit: playwright/e2e/settings/general-room-settings-tab.spec.ts#L47
2) [Chrome] › settings/general-room-settings-tab.spec.ts:39:9 › General room settings tab › long address should not cause dialog to overflow @no-webkit Retry #1 ─────────────────────────────────────────────────────────────────────────────────────── Error: Timed out 5000ms waiting for expect(locator).toHaveValue(expected) Locator: locator('.mx_Dialog').filter({ has: locator('.mx_RoomSettingsDialog') }).locator('#canonicalAlias') Expected string: "#abcasdhjasjhdaj1jh1asdhasjdhajsdhjavhjksdabcasdhjasjhdaj1jh1asdhasjdhajsdhjavhjksdabcasdhjasjhdaj1jh1asdhasjdhajsdhjavhjksdabcasdhjasjhdaj1jh1asdhasjdhajsdhjavhjksd:localhost" Received string: "" Call log: - expect.toHaveValue with timeout 5000ms - waiting for locator('.mx_Dialog').filter({ has: locator('.mx_RoomSettingsDialog') }).locator('#canonicalAlias') 9 × locator resolved to <select type="text" id="canonicalAlias" label="Main address" placeholder="Main address">…</select> - unexpected value "" 45 | 46 | // 2. wait for the new setting to apply ... > 47 | await expect(settings.locator("#canonicalAlias")).toHaveValue(`#${longString}:localhost`); | ^ 48 | 49 | // 3. Check if the dialog overflows 50 | const dialogBoundingBox = await page.locator(".mx_Dialog").boundingBox(); at /home/runner/work/matrix-js-sdk/matrix-js-sdk/playwright/e2e/settings/general-room-settings-tab.spec.ts:47:59
[Chrome] › share-dialog/share-dialog.spec.ts:19:9 › Share dialog › should share a room @screenshot: playwright/element-web-test.ts#L367
3) [Chrome] › share-dialog/share-dialog.spec.ts:19:9 › Share dialog › should share a room @screenshot Error: expect.toHaveScreenshot(share-dialog-room.png): Test ended. Call log: - expect.toHaveScreenshot(share-dialog-room.png) with timeout 5000ms - verifying given screenshot expectation - waiting for getByRole('dialog', { name: 'Share room' }) at ../element-web-test.ts:367 365 | 366 | const screenshotName = sanitizeFilePathBeforeExtension(name); > 367 | await baseExpect(receiver).toHaveScreenshot(screenshotName, options); | ^ 368 | 369 | await style.evaluate((tag) => tag.remove()); 370 | at Object.toMatchScreenshot (/home/runner/work/matrix-js-sdk/matrix-js-sdk/playwright/element-web-test.ts:367:9)
[Chrome] › share-dialog/share-dialog.spec.ts:32:9 › Share dialog › should share a room member @screenshot: playwright/element-web-test.ts#L362
4) [Chrome] › share-dialog/share-dialog.spec.ts:32:9 › Share dialog › should share a room member @screenshot Error: expect.toMatchScreenshot: Test ended. at ../element-web-test.ts:362 360 | 361 | // We add a custom style tag before taking screenshots > 362 | const style = (await page.addStyleTag({ | ^ 363 | content: css, 364 | })) as ElementHandle<Element>; 365 | at Object.toMatchScreenshot (/home/runner/work/matrix-js-sdk/matrix-js-sdk/playwright/element-web-test.ts:362:35) at /home/runner/work/matrix-js-sdk/matrix-js-sdk/playwright/e2e/share-dialog/share-dialog.spec.ts:43:24
[Chrome] › share-dialog/share-dialog.spec.ts:49:9 › Share dialog › should share an event @screenshot: playwright/element-web-test.ts#L367
5) [Chrome] › share-dialog/share-dialog.spec.ts:49:9 › Share dialog › should share an event @screenshot Error: expect.toHaveScreenshot(share-dialog-event.png): Test ended. Call log: - expect.toHaveScreenshot(share-dialog-event.png) with timeout 5000ms - verifying given screenshot expectation - waiting for getByRole('dialog', { name: 'Share Room Message' }) - locator resolved to <div role="dialog" class="mx_ShareDialog" data-focus-lock-disabled="false" aria-describedby="mx_Dialog_content" aria-labelledby="mx_BaseDialog_title">…</div> - taking element screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - attempting scroll into view action - waiting for element to be stable at ../element-web-test.ts:367 365 | 366 | const screenshotName = sanitizeFilePathBeforeExtension(name); > 367 | await baseExpect(receiver).toHaveScreenshot(screenshotName, options); | ^ 368 | 369 | await style.evaluate((tag) => tag.remove()); 370 | at Object.toMatchScreenshot (/home/runner/work/matrix-js-sdk/matrix-js-sdk/playwright/element-web-test.ts:367:9)
[Chrome] › integration-manager/send_event.spec.ts:227:9 › Integration Manager: Send Event › should fail to send an event type which is not allowed: playwright/e2e/integration-manager/send_event.spec.ts#L105
1) [Chrome] › integration-manager/send_event.spec.ts:227:9 › Integration Manager: Send Event › should fail to send an event type which is not allowed Test timeout of 30000ms exceeded while running "beforeEach" hook. 103 | }); 104 | > 105 | test.beforeEach(async ({ page, user, app, room }) => { | ^ 106 | await app.client.setAccountData("m.widgets", { 107 | "m.integration_manager": { 108 | content: { at /home/runner/work/matrix-js-sdk/matrix-js-sdk/playwright/e2e/integration-manager/send_event.spec.ts:105:10
[Chrome] › integration-manager/send_event.spec.ts:227:9 › Integration Manager: Send Event › should fail to send an event type which is not allowed: playwright/pages/ElementAppPage.ts#L96
1) [Chrome] › integration-manager/send_event.spec.ts:227:9 › Integration Manager: Send Event › should fail to send an event type which is not allowed Error: locator.click: Test timeout of 30000ms exceeded. Call log: - waiting for getByRole('tree', { name: 'Rooms' }).locator('[title="Integration Manager Test"],[aria-label="Integration Manager Test"]').first() at ../pages/ElementAppPage.ts:96 94 | .locator(`[title="${name}"],[aria-label="${name}"]`) 95 | .first() > 96 | .click(); | ^ 97 | } 98 | 99 | public async viewRoomById(roomId: string): Promise<void> { at ElementAppPage.viewRoomByName (/home/runner/work/matrix-js-sdk/matrix-js-sdk/playwright/pages/ElementAppPage.ts:96:14) at /home/runner/work/matrix-js-sdk/matrix-js-sdk/playwright/e2e/integration-manager/send_event.spec.ts:132:19
[Chrome] › audio-player/audio-player.spec.ts:177:9 › Audio player › should play an audio file @no-firefox @no-webkit: playwright/e2e/audio-player/audio-player.spec.ts#L125
1) [Chrome] › audio-player/audio-player.spec.ts:177:9 › Audio player › should play an audio file @no-firefox @no-webkit Test timeout of 30000ms exceeded while running "beforeEach" hook. 123 | }; 124 | > 125 | test.beforeEach(async ({ page, app, user }) => { | ^ 126 | await app.client.createRoom({ name: "Test Room" }); 127 | await app.viewRoomByName("Test Room"); 128 | at /home/runner/work/matrix-js-sdk/matrix-js-sdk/playwright/e2e/audio-player/audio-player.spec.ts:125:10
[Chrome] › audio-player/audio-player.spec.ts:177:9 › Audio player › should play an audio file @no-firefox @no-webkit: playwright/pages/ElementAppPage.ts#L96
1) [Chrome] › audio-player/audio-player.spec.ts:177:9 › Audio player › should play an audio file @no-firefox @no-webkit Error: locator.click: Test timeout of 30000ms exceeded. Call log: - waiting for getByRole('tree', { name: 'Rooms' }).locator('[title="Test Room"],[aria-label="Test Room"]').first() at ../pages/ElementAppPage.ts:96 94 | .locator(`[title="${name}"],[aria-label="${name}"]`) 95 | .first() > 96 | .click(); | ^ 97 | } 98 | 99 | public async viewRoomById(roomId: string): Promise<void> { at ElementAppPage.viewRoomByName (/home/runner/work/matrix-js-sdk/matrix-js-sdk/playwright/pages/ElementAppPage.ts:96:14) at /home/runner/work/matrix-js-sdk/matrix-js-sdk/playwright/e2e/audio-player/audio-player.spec.ts:127:19
[Chrome] › audio-player/audio-player.spec.ts:243:9 › Audio player › should support creating a reply chain with multiple audio files @no-firefox @no-webkit @screenshot: playwright/e2e/audio-player/audio-player.spec.ts#L1
2) [Chrome] › audio-player/audio-player.spec.ts:243:9 › Audio player › should support creating a reply chain with multiple audio files @no-firefox @no-webkit @screenshot Test timeout of 30000ms exceeded.
[Chrome] › audio-player/audio-player.spec.ts:243:9 › Audio player › should support creating a reply chain with multiple audio files @no-firefox @no-webkit @screenshot: playwright/e2e/audio-player/audio-player.spec.ts#L257
2) [Chrome] › audio-player/audio-player.spec.ts:243:9 › Audio player › should support creating a reply chain with multiple audio files @no-firefox @no-webkit @screenshot Error: locator.click: Test timeout of 30000ms exceeded. Call log: - waiting for locator('.mx_EventTile_last').getByRole('button', { name: 'Reply', exact: true }) 255 | const clickButtonReply = async () => { 256 | await tile.hover(); > 257 | await tile.getByRole("button", { name: "Reply", exact: true }).click(); | ^ 258 | }; 259 | 260 | await uploadFile(page, "playwright/sample-files/upload-first.ogg"); at clickButtonReply (/home/runner/work/matrix-js-sdk/matrix-js-sdk/playwright/e2e/audio-player/audio-player.spec.ts:257:80) at /home/runner/work/matrix-js-sdk/matrix-js-sdk/playwright/e2e/audio-player/audio-player.spec.ts:273:13
[Chrome] › crypto/backups.spec.ts:30:12 › Encryption state after registration › Key backup is enabled by default: playwright/e2e/crypto/backups.spec.ts#L1
3) [Chrome] › crypto/backups.spec.ts:30:12 › Encryption state after registration › Key backup is enabled by default Test timeout of 30000ms exceeded.
[Chrome] › crypto/backups.spec.ts:30:12 › Encryption state after registration › Key backup is enabled by default: playwright/pages/settings.ts#L22
3) [Chrome] › crypto/backups.spec.ts:30:12 › Encryption state after registration › Key backup is enabled by default Error: locator.click: Test timeout of 30000ms exceeded. Call log: - waiting for getByRole('button', { name: 'User menu' }) at ../pages/settings.ts:22 20 | const locator = this.page.locator(".mx_ContextualMenu"); 21 | if (await locator.locator(".mx_UserMenu_contextMenu_header").isVisible()) return locator; > 22 | await this.page.getByRole("button", { name: "User menu" }).click(); | ^ 23 | await locator.waitFor(); 24 | return locator; 25 | } at Settings.openUserMenu (/home/runner/work/matrix-js-sdk/matrix-js-sdk/playwright/pages/settings.ts:22:68) at Settings.openUserSettings (/home/runner/work/matrix-js-sdk/matrix-js-sdk/playwright/pages/settings.ts:79:25) at /home/runner/work/matrix-js-sdk/matrix-js-sdk/playwright/e2e/crypto/backups.spec.ts:35:9
[Chrome] › integration-manager/kick.spec.ts:158:9 › Integration Manager: Kick › should kick the target: playwright/e2e/integration-manager/kick.spec.ts#L92
4) [Chrome] › integration-manager/kick.spec.ts:158:9 › Integration Manager: Kick › should kick the target Error: Timed out 5000ms waiting for expect(locator).toBeVisible() Locator: getByText('Alice removed Bob: Goodbye') Expected: visible Received: <element(s) not found> Call log: - expect.toBeVisible with timeout 5000ms - waiting for getByText('Alice removed Bob: Goodbye') 90 | 91 | // Check for the event message (or lack thereof) > 92 | await expect(page.getByText(`${USER_DISPLAY_NAME} removed ${BOT_DISPLAY_NAME}: ${KICK_REASON}`)).toBeVisible({ | ^ 93 | visible: shouldExist, 94 | }); 95 | } at expectKickedMessage (/home/runner/work/matrix-js-sdk/matrix-js-sdk/playwright/e2e/integration-manager/kick.spec.ts:92:102) at /home/runner/work/matrix-js-sdk/matrix-js-sdk/playwright/e2e/integration-manager/kick.spec.ts:166:9
Slow Test: [Chrome] › read-receipts/high-level.spec.ts#L1
[Chrome] › read-receipts/high-level.spec.ts took 3.1m
Slow Test: [Chrome] › read-receipts/new-messages-in-threads.spec.ts#L1
[Chrome] › read-receipts/new-messages-in-threads.spec.ts took 1.5m
Slow Test: [Chrome] › read-receipts/editing-messages-in-threads.spec.ts#L1
[Chrome] › read-receipts/editing-messages-in-threads.spec.ts took 1.2m
Slow Test: [Chrome] › read-receipts/new-messages-main-timeline.spec.ts#L1
[Chrome] › read-receipts/new-messages-main-timeline.spec.ts took 1.1m
Slow Test: [Chrome] › read-receipts/editing-messages-main-timeline.spec.ts#L1
[Chrome] › read-receipts/editing-messages-main-timeline.spec.ts took 1.1m
Slow Test: [Chrome] › timeline/timeline.spec.ts#L1
[Chrome] › timeline/timeline.spec.ts took 2.5m
Slow Test: [Chrome] › spotlight/spotlight.spec.ts#L1
[Chrome] › spotlight/spotlight.spec.ts took 2.1m
Slow Test: [Chrome] › spaces/threads-activity-centre/threadsActivityCentre.spec.ts#L1
[Chrome] › spaces/threads-activity-centre/threadsActivityCentre.spec.ts took 1.6m
Slow Test: [Chrome] › user-onboarding/user-onboarding-new.spec.ts#L1
[Chrome] › user-onboarding/user-onboarding-new.spec.ts took 34.2s
Slow Test: [Chrome] › threads/threads.spec.ts#L1
[Chrome] › threads/threads.spec.ts took 32.4s
Slow Test: [Chrome] › read-receipts/redactions-in-threads.spec.ts#L1
[Chrome] › read-receipts/redactions-in-threads.spec.ts took 2.5m
Slow Test: [Chrome] › read-receipts/redactions-main-timeline.spec.ts#L1
[Chrome] › read-receipts/redactions-main-timeline.spec.ts took 1.9m
Slow Test: [Chrome] › read-receipts/read-receipts.spec.ts#L1
[Chrome] › read-receipts/read-receipts.spec.ts took 1.1m
Slow Test: [Chrome] › read-receipts/reactions-in-threads.spec.ts#L1
[Chrome] › read-receipts/reactions-in-threads.spec.ts took 55.9s
Slow Test: [Chrome] › read-receipts/new-messages-thread-roots.spec.ts#L1
[Chrome] › read-receipts/new-messages-thread-roots.spec.ts took 53.1s
Slow Test: [Chrome] › sliding-sync/sliding-sync.spec.ts#L1
[Chrome] › sliding-sync/sliding-sync.spec.ts took 1.5m
Slow Test: [Chrome] › spaces/spaces.spec.ts#L1
[Chrome] › spaces/spaces.spec.ts took 58.9s
Slow Test: [Chrome] › right-panel/right-panel.spec.ts#L1
[Chrome] › right-panel/right-panel.spec.ts took 51.6s
Slow Test: [Chrome] › settings/account-user-settings-tab.spec.ts#L1
[Chrome] › settings/account-user-settings-tab.spec.ts took 41.5s
Slow Test: [Chrome] › right-panel/file-panel.spec.ts#L1
[Chrome] › right-panel/file-panel.spec.ts took 36.7s
Slow Test: [Chrome] › messages/messages.spec.ts#L1
[Chrome] › messages/messages.spec.ts took 2.1m
Slow Test: [Chrome] › pinned-messages/pinned-messages.spec.ts#L1
[Chrome] › pinned-messages/pinned-messages.spec.ts took 1.7m
Slow Test: [Chrome] › login/login.spec.ts#L1
[Chrome] › login/login.spec.ts took 1.0m
Slow Test: [Chrome] › knock/knock-into-room.spec.ts#L1
[Chrome] › knock/knock-into-room.spec.ts took 36.7s
Slow Test: [Chrome] › integration-manager/read_events.spec.ts#L1
[Chrome] › integration-manager/read_events.spec.ts took 36.5s
Slow Test: [Chrome] › composer/RTE.spec.ts#L1
[Chrome] › composer/RTE.spec.ts took 1.2m
Slow Test: [Chrome] › crypto/event-shields.spec.ts#L1
[Chrome] › crypto/event-shields.spec.ts took 1.1m
Slow Test: [Chrome] › crypto/crypto.spec.ts#L1
[Chrome] › crypto/crypto.spec.ts took 57.9s
Slow Test: [Chrome] › crypto/device-verification.spec.ts#L1
[Chrome] › crypto/device-verification.spec.ts took 40.9s
Slow Test: [Chrome] › crypto/decryption-failure-messages.spec.ts#L1
[Chrome] › crypto/decryption-failure-messages.spec.ts took 38.8s
🎭 Playwright Run Summary
32 skipped 50 passed (8.9m)
🎭 Playwright Run Summary
3 skipped 69 passed (9.3m)
🎭 Playwright Run Summary
15 skipped 60 passed (9.3m)
🎭 Playwright Run Summary
5 flaky [Chrome] › room_options/marked_unread.spec.ts:22:9 › Mark as Unread › should mark a room as unread [Chrome] › settings/general-room-settings-tab.spec.ts:39:9 › General room settings tab › long address should not cause dialog to overflow @no-webkit [Chrome] › share-dialog/share-dialog.spec.ts:19:9 › Share dialog › should share a room @screenshot [Chrome] › share-dialog/share-dialog.spec.ts:32:9 › Share dialog › should share a room member @screenshot [Chrome] › share-dialog/share-dialog.spec.ts:49:9 › Share dialog › should share an event @screenshot 1 skipped 74 passed (11.0m)
🎭 Playwright Run Summary
1 flaky [Chrome] › integration-manager/send_event.spec.ts:227:9 › Integration Manager: Send Event › should fail to send an event type which is not allowed 1 skipped 76 passed (10.8m)
🎭 Playwright Run Summary
4 flaky [Chrome] › audio-player/audio-player.spec.ts:177:9 › Audio player › should play an audio file @no-firefox @no-webkit [Chrome] › audio-player/audio-player.spec.ts:243:9 › Audio player › should support creating a reply chain with multiple audio files @no-firefox @no-webkit @screenshot [Chrome] › crypto/backups.spec.ts:30:12 › Encryption state after registration › Key backup is enabled by default [Chrome] › integration-manager/kick.spec.ts:158:9 › Integration Manager: Kick › should kick the target 78 passed (13.1m)

Artifacts

Produced during runtime
Name Size
all-blob-reports-Chrome-1 Expired
16.9 MB
all-blob-reports-Chrome-2 Expired
3.63 MB
all-blob-reports-Chrome-3 Expired
306 KB
all-blob-reports-Chrome-4 Expired
326 KB
all-blob-reports-Chrome-5 Expired
17.6 MB
all-blob-reports-Chrome-6 Expired
778 KB
html-report Expired
38.8 MB
webapp Expired
28.3 MB