Skip to content

matrix-react-sdk End to End Tests #2466

matrix-react-sdk End to End Tests

matrix-react-sdk End to End Tests #2466

Triggered via merge group January 14, 2025 10:21
Status Success
Total duration 12m 29s
Artifacts 8
Playwright  /  Build Element-Web
1m 45s
Playwright / Build Element-Web
Matrix: Playwright / playwright
Playwright  /  end-to-end-tests
43s
Playwright / end-to-end-tests
Fit to window
Zoom out
Zoom in

Annotations

14 errors, 28 warnings, and 6 notices
[Chrome] › read-receipts/new-messages-main-timeline.spec.ts:50:17 › Read receipts › new messages › in the main timeline › Reading an older message leaves the room unread @mergequeue: playwright/e2e/read-receipts/index.ts#L488
1) [Chrome] › read-receipts/new-messages-main-timeline.spec.ts:50:17 › Read receipts › new messages › in the main timeline › Reading an older message leaves the room unread @mergequeue Error: expect(received).toBeLessThan(expected) Expected: < 30 Received: 30 Call Log: - Timeout 5000ms exceeded while waiting on the predicate at read-receipts/index.ts:488 486 | // https://playwright.dev/docs/test-assertions#expectpoll 487 | // .toBeLessThan doesn't have a retry mechanism, so we use .poll > 488 | await expect | ^ 489 | .poll(async () => { 490 | return parseInt(await tile.locator(".mx_NotificationBadge_count").textContent(), 10); 491 | }) at Helpers.assertUnreadLessThan (/home/runner/work/matrix-js-sdk/matrix-js-sdk/playwright/e2e/read-receipts/index.ts:488:9) at /home/runner/work/matrix-js-sdk/matrix-js-sdk/playwright/e2e/read-receipts/new-messages-main-timeline.spec.ts:65:17
[Chrome] › audio-player/audio-player.spec.ts:243:9 › Audio player › should support creating a reply chain with multiple audio files @no-firefox @no-webkit @screenshot: playwright/e2e/audio-player/audio-player.spec.ts#L1
1) [Chrome] › audio-player/audio-player.spec.ts:243:9 › Audio player › should support creating a reply chain with multiple audio files @no-firefox @no-webkit @screenshot Test timeout of 30000ms exceeded.
[Chrome] › audio-player/audio-player.spec.ts:243:9 › Audio player › should support creating a reply chain with multiple audio files @no-firefox @no-webkit @screenshot: playwright/e2e/audio-player/audio-player.spec.ts#L257
1) [Chrome] › audio-player/audio-player.spec.ts:243:9 › Audio player › should support creating a reply chain with multiple audio files @no-firefox @no-webkit @screenshot Error: locator.click: Test timeout of 30000ms exceeded. Call log: - waiting for locator('.mx_EventTile_last').getByRole('button', { name: 'Reply', exact: true }) 255 | const clickButtonReply = async () => { 256 | await tile.hover(); > 257 | await tile.getByRole("button", { name: "Reply", exact: true }).click(); | ^ 258 | }; 259 | 260 | await uploadFile(page, "playwright/sample-files/upload-first.ogg"); at clickButtonReply (/home/runner/work/matrix-js-sdk/matrix-js-sdk/playwright/e2e/audio-player/audio-player.spec.ts:257:80) at /home/runner/work/matrix-js-sdk/matrix-js-sdk/playwright/e2e/audio-player/audio-player.spec.ts:273:13
[Chrome] › spotlight/spotlight.spec.ts:132:9 › Spotlight › should find known public rooms: playwright/e2e/spotlight/spotlight.spec.ts#L138
1) [Chrome] › spotlight/spotlight.spec.ts:132:9 › Spotlight › should find known public rooms ───── Error: Timed out 5000ms waiting for expect(locator).toHaveCount(expected) Locator: locator('[role=dialog][aria-label="Search Dialog"]').locator('.mx_SpotlightDialog_section.mx_SpotlightDialog_results .mx_SpotlightDialog_option') Expected: 1 Received: 3 Call log: - expect.toHaveCount with timeout 5000ms - waiting for locator('[role=dialog][aria-label="Search Dialog"]').locator('.mx_SpotlightDialog_section.mx_SpotlightDialog_results .mx_SpotlightDialog_option') 2 × locator resolved to 0 elements - unexpected value "0" 7 × locator resolved to 3 elements - unexpected value "3" 136 | await spotlight.search(room1Name); 137 | const resultLocator = spotlight.results; > 138 | await expect(resultLocator).toHaveCount(1); | ^ 139 | await expect(resultLocator.first()).toContainText(room1Name); 140 | await expect(resultLocator.first()).toContainText("View"); 141 | await resultLocator.first().click(); at /home/runner/work/matrix-js-sdk/matrix-js-sdk/playwright/e2e/spotlight/spotlight.spec.ts:138:37
[Chrome] › spotlight/spotlight.spec.ts:146:9 › Spotlight › should find unknown public rooms: playwright/e2e/spotlight/spotlight.spec.ts#L152
2) [Chrome] › spotlight/spotlight.spec.ts:146:9 › Spotlight › should find unknown public rooms ─── Error: Timed out 5000ms waiting for expect(locator).toHaveCount(expected) Locator: locator('[role=dialog][aria-label="Search Dialog"]').locator('.mx_SpotlightDialog_section.mx_SpotlightDialog_results .mx_SpotlightDialog_option') Expected: 1 Received: 2 Call log: - expect.toHaveCount with timeout 5000ms - waiting for locator('[role=dialog][aria-label="Search Dialog"]').locator('.mx_SpotlightDialog_section.mx_SpotlightDialog_results .mx_SpotlightDialog_option') 2 × locator resolved to 0 elements - unexpected value "0" 7 × locator resolved to 2 elements - unexpected value "2" 150 | await spotlight.search(room2Name); 151 | const resultLocator = spotlight.results; > 152 | await expect(resultLocator).toHaveCount(1); | ^ 153 | await expect(resultLocator.first()).toContainText(room2Name); 154 | await expect(resultLocator.first()).toContainText("Join"); 155 | await resultLocator.first().click(); at /home/runner/work/matrix-js-sdk/matrix-js-sdk/playwright/e2e/spotlight/spotlight.spec.ts:152:37
[Chrome] › spotlight/spotlight.spec.ts:161:9 › Spotlight › should find unknown public world readable rooms: playwright/e2e/spotlight/spotlight.spec.ts#L167
3) [Chrome] › spotlight/spotlight.spec.ts:161:9 › Spotlight › should find unknown public world readable rooms Error: Timed out 5000ms waiting for expect(locator).toHaveCount(expected) Locator: locator('[role=dialog][aria-label="Search Dialog"]').locator('.mx_SpotlightDialog_section.mx_SpotlightDialog_results .mx_SpotlightDialog_option') Expected: 1 Received: 2 Call log: - expect.toHaveCount with timeout 5000ms - waiting for locator('[role=dialog][aria-label="Search Dialog"]').locator('.mx_SpotlightDialog_section.mx_SpotlightDialog_results .mx_SpotlightDialog_option') 2 × locator resolved to 0 elements - unexpected value "0" 7 × locator resolved to 2 elements - unexpected value "2" 165 | await spotlight.search(room3Name); 166 | const resultLocator = spotlight.results; > 167 | await expect(resultLocator).toHaveCount(1); | ^ 168 | await expect(resultLocator.first()).toContainText(room3Name); 169 | await expect(resultLocator.first()).toContainText("View"); 170 | await resultLocator.first().click(); at /home/runner/work/matrix-js-sdk/matrix-js-sdk/playwright/e2e/spotlight/spotlight.spec.ts:167:37
[Chrome] › spotlight/spotlight.spec.ts:220:9 › Spotlight › should find unknown people: playwright/e2e/spotlight/spotlight.spec.ts#L226
4) [Chrome] › spotlight/spotlight.spec.ts:220:9 › Spotlight › should find unknown people ───────── Error: Timed out 5000ms waiting for expect(locator).toHaveCount(expected) Locator: locator('[role=dialog][aria-label="Search Dialog"]').locator('.mx_SpotlightDialog_section.mx_SpotlightDialog_results .mx_SpotlightDialog_option') Expected: 1 Received: 3 Call log: - expect.toHaveCount with timeout 5000ms - waiting for locator('[role=dialog][aria-label="Search Dialog"]').locator('.mx_SpotlightDialog_section.mx_SpotlightDialog_results .mx_SpotlightDialog_option') 2 × locator resolved to 0 elements - unexpected value "0" 7 × locator resolved to 3 elements - unexpected value "3" 224 | await spotlight.search(bot2Name); 225 | const resultLocator = spotlight.results; > 226 | await expect(resultLocator).toHaveCount(1); | ^ 227 | await expect(resultLocator.first()).toContainText(bot2Name); 228 | await resultLocator.first().click(); 229 | await expect(roomHeaderName(page)).toHaveText(bot2Name); at /home/runner/work/matrix-js-sdk/matrix-js-sdk/playwright/e2e/spotlight/spotlight.spec.ts:226:37
[Chrome] › spotlight/spotlight.spec.ts:321:9 › Spotlight › should allow opening group chat dialog: playwright/e2e/spotlight/spotlight.spec.ts#L329
5) [Chrome] › spotlight/spotlight.spec.ts:321:9 › Spotlight › should allow opening group chat dialog Error: Timed out 5000ms waiting for expect(locator).toHaveCount(expected) Locator: locator('[role=dialog][aria-label="Search Dialog"]').locator('.mx_SpotlightDialog_section.mx_SpotlightDialog_results .mx_SpotlightDialog_option') Expected: 1 Received: 4 Call log: - expect.toHaveCount with timeout 5000ms - waiting for locator('[role=dialog][aria-label="Search Dialog"]').locator('.mx_SpotlightDialog_section.mx_SpotlightDialog_results .mx_SpotlightDialog_option') 9 × locator resolved to 4 elements - unexpected value "4" 327 | 328 | const resultLocator = spotlight.results; > 329 | await expect(resultLocator).toHaveCount(1); | ^ 330 | await expect(resultLocator.first()).toContainText(bot2Name); 331 | 332 | await expect(spotlight.dialog.locator(".mx_SpotlightDialog_startGroupChat")).toContainText( at /home/runner/work/matrix-js-sdk/matrix-js-sdk/playwright/e2e/spotlight/spotlight.spec.ts:329:37
[Chrome] › spotlight/spotlight.spec.ts:339:9 › Spotlight › should close spotlight after starting a DM: playwright/e2e/spotlight/spotlight.spec.ts#L27
6) [Chrome] › spotlight/spotlight.spec.ts:339:9 › Spotlight › should close spotlight after starting a DM Error: Timed out 5000ms waiting for expect(locator).toHaveCount(expected) Locator: locator('[role=dialog][aria-label="Search Dialog"]').locator('.mx_SpotlightDialog_section.mx_SpotlightDialog_results .mx_SpotlightDialog_option') Expected: 1 Received: 2 Call log: - expect.toHaveCount with timeout 5000ms - waiting for locator('[role=dialog][aria-label="Search Dialog"]').locator('.mx_SpotlightDialog_section.mx_SpotlightDialog_results .mx_SpotlightDialog_option') 9 × locator resolved to 2 elements - unexpected value "2" 25 | await expect(spotlight.dialog.locator(".mx_Spinner")).not.toBeAttached(); 26 | const result = spotlight.results; > 27 | await expect(result).toHaveCount(1); | ^ 28 | await expect(result.first()).toContainText(name); 29 | await result.first().click(); 30 | at startDM (/home/runner/work/matrix-js-sdk/matrix-js-sdk/playwright/e2e/spotlight/spotlight.spec.ts:27:26) at /home/runner/work/matrix-js-sdk/matrix-js-sdk/playwright/e2e/spotlight/spotlight.spec.ts:340:9
[Chrome] › spotlight/spotlight.spec.ts:344:9 › Spotlight › should show the same user only once: playwright/e2e/spotlight/spotlight.spec.ts#L27
7) [Chrome] › spotlight/spotlight.spec.ts:344:9 › Spotlight › should show the same user only once Error: Timed out 5000ms waiting for expect(locator).toHaveCount(expected) Locator: locator('[role=dialog][aria-label="Search Dialog"]').locator('.mx_SpotlightDialog_section.mx_SpotlightDialog_results .mx_SpotlightDialog_option') Expected: 1 Received: 2 Call log: - expect.toHaveCount with timeout 5000ms - waiting for locator('[role=dialog][aria-label="Search Dialog"]').locator('.mx_SpotlightDialog_section.mx_SpotlightDialog_results .mx_SpotlightDialog_option') 9 × locator resolved to 2 elements - unexpected value "2" 25 | await expect(spotlight.dialog.locator(".mx_Spinner")).not.toBeAttached(); 26 | const result = spotlight.results; > 27 | await expect(result).toHaveCount(1); | ^ 28 | await expect(result.first()).toContainText(name); 29 | await result.first().click(); 30 | at startDM (/home/runner/work/matrix-js-sdk/matrix-js-sdk/playwright/e2e/spotlight/spotlight.spec.ts:27:26) at /home/runner/work/matrix-js-sdk/matrix-js-sdk/playwright/e2e/spotlight/spotlight.spec.ts:345:9
[Chrome] › spotlight/spotlight.spec.ts:357:9 › Spotlight › should be able to navigate results via keyboard: playwright/e2e/spotlight/spotlight.spec.ts#L364
8) [Chrome] › spotlight/spotlight.spec.ts:357:9 › Spotlight › should be able to navigate results via keyboard Error: Timed out 5000ms waiting for expect(locator).toHaveCount(expected) Locator: locator('[role=dialog][aria-label="Search Dialog"]').locator('.mx_SpotlightDialog_section.mx_SpotlightDialog_results .mx_SpotlightDialog_option') Expected: 2 Received: 4 Call log: - expect.toHaveCount with timeout 5000ms - waiting for locator('[role=dialog][aria-label="Search Dialog"]').locator('.mx_SpotlightDialog_section.mx_SpotlightDialog_results .mx_SpotlightDialog_option') 2 × locator resolved to 1 element - unexpected value "1" 7 × locator resolved to 4 elements - unexpected value "4" 362 | 363 | let resultLocator = spotlight.results; > 364 | await expect(resultLocator).toHaveCount(2); | ^ 365 | await expect(resultLocator.first()).toHaveAttribute("aria-selected", "true"); 366 | await expect(resultLocator.last()).toHaveAttribute("aria-selected", "false"); 367 | at /home/runner/work/matrix-js-sdk/matrix-js-sdk/playwright/e2e/spotlight/spotlight.spec.ts:364:37
[Chrome] › read-receipts/reactions-in-threads.spec.ts:16:17 › Read receipts › reactions › in threads › A reaction to a threaded message does not make the room unread @mergequeue: playwright/e2e/read-receipts/reactions-in-threads.spec.ts#L1
1) [Chrome] › read-receipts/reactions-in-threads.spec.ts:16:17 › Read receipts › reactions › in threads › A reaction to a threaded message does not make the room unread @mergequeue Test timeout of 30000ms exceeded while setting up "homeserver".
[Chrome] › read-receipts/reactions-in-threads.spec.ts:16:17 › Read receipts › reactions › in threads › A reaction to a threaded message does not make the room unread @mergequeue: playwright/e2e/read-receipts/reactions-in-threads.spec.ts#L1
1) [Chrome] › read-receipts/reactions-in-threads.spec.ts:16:17 › Read receipts › reactions › in threads › A reaction to a threaded message does not make the room unread @mergequeue Error: (HTTP code 403) unexpected - error while removing network: network 842ec3d37c3f id beddc37f982c7f38d3ef8d2d495a4be8c7ce22fa6251486041571daf58d3c515 has active endpoints at /home/runner/work/matrix-js-sdk/matrix-js-sdk/node_modules/docker-modem/lib/modem.js:343:17 at getCause (/home/runner/work/matrix-js-sdk/matrix-js-sdk/node_modules/docker-modem/lib/modem.js:373:7) at Modem.buildPayload (/home/runner/work/matrix-js-sdk/matrix-js-sdk/node_modules/docker-modem/lib/modem.js:342:5) at IncomingMessage.<anonymous> (/home/runner/work/matrix-js-sdk/matrix-js-sdk/node_modules/docker-modem/lib/modem.js:310:16)
[Chrome] › read-receipts/redactions-main-timeline.spec.ts:271:17 › Read receipts › redactions › in the main timeline › A reply to a redacted message makes the room unread @mergequeue: playwright/e2e/read-receipts/index.ts#L473
2) [Chrome] › read-receipts/redactions-main-timeline.spec.ts:271:17 › Read receipts › redactions › in the main timeline › A reply to a redacted message makes the room unread @mergequeue Error: Timed out 5000ms waiting for expect(locator).toHaveText(expected) Locator: getByRole('treeitem', { name: /^Room Beta/ }).locator('.mx_NotificationBadge_count') Expected string: "2" Received string: "1" Call log: - expect.toHaveText with timeout 5000ms - waiting for getByRole('treeitem', { name: /^Room Beta/ }).locator('.mx_NotificationBadge_count') 9 × locator resolved to <span class="mx_NotificationBadge_count">1</span> - unexpected value "1" at read-receipts/index.ts:473 471 | await expect(tile.locator(".mx_NotificationBadge_dot")).toBeVisible(); 472 | } else { > 473 | await expect(tile.locator(".mx_NotificationBadge_count")).toHaveText(count.toString()); | ^ 474 | } 475 | } 476 | at Helpers.assertUnread (/home/runner/work/matrix-js-sdk/matrix-js-sdk/playwright/e2e/read-receipts/index.ts:473:71) at /home/runner/work/matrix-js-sdk/matrix-js-sdk/playwright/e2e/read-receipts/redactions-main-timeline.spec.ts:280:28
Slow Test: [Chrome] › read-receipts/high-level.spec.ts#L1
[Chrome] › read-receipts/high-level.spec.ts took 3.0m
Slow Test: [Chrome] › read-receipts/new-messages-in-threads.spec.ts#L1
[Chrome] › read-receipts/new-messages-in-threads.spec.ts took 59.0s
Slow Test: [Chrome] › read-receipts/new-messages-thread-roots.spec.ts#L1
[Chrome] › read-receipts/new-messages-thread-roots.spec.ts took 28.6s
Slow Test: [Chrome] › messages/messages.spec.ts#L1
[Chrome] › messages/messages.spec.ts took 59.7s
Slow Test: [Chrome] › pinned-messages/pinned-messages.spec.ts#L1
[Chrome] › pinned-messages/pinned-messages.spec.ts took 56.7s
Slow Test: [Chrome] › read-receipts/editing-messages-in-threads.spec.ts#L1
[Chrome] › read-receipts/editing-messages-in-threads.spec.ts took 38.7s
Slow Test: [Chrome] › read-receipts/editing-messages-main-timeline.spec.ts#L1
[Chrome] › read-receipts/editing-messages-main-timeline.spec.ts took 38.3s
Slow Test: [Chrome] › read-receipts/editing-messages-thread-roots.spec.ts#L1
[Chrome] › read-receipts/editing-messages-thread-roots.spec.ts took 30.5s
Slow Test: [Chrome] › timeline/timeline.spec.ts#L1
[Chrome] › timeline/timeline.spec.ts took 1.3m
Slow Test: [Chrome] › login/login-consent.spec.ts#L1
[Chrome] › login/login-consent.spec.ts took 54.9s
Slow Test: [Chrome] › threads/threads.spec.ts#L1
[Chrome] › threads/threads.spec.ts took 30.9s
Slow Test: [Chrome] › crypto/backups-mas.spec.ts#L1
[Chrome] › crypto/backups-mas.spec.ts took 26.6s
Slow Test: [Chrome] › user-onboarding/user-onboarding-new.spec.ts#L1
[Chrome] › user-onboarding/user-onboarding-new.spec.ts took 23.7s
Slow Test: [Chrome] › crypto/event-shields.spec.ts#L1
[Chrome] › crypto/event-shields.spec.ts took 52.4s
Slow Test: [Chrome] › composer/RTE.spec.ts#L1
[Chrome] › composer/RTE.spec.ts took 35.8s
Slow Test: [Chrome] › crypto/crypto.spec.ts#L1
[Chrome] › crypto/crypto.spec.ts took 34.0s
Slow Test: [Chrome] › accessibility/keyboard-navigation.spec.ts#L1
[Chrome] › accessibility/keyboard-navigation.spec.ts took 29.3s
Slow Test: [Chrome] › crypto/decryption-failure-messages.spec.ts#L1
[Chrome] › crypto/decryption-failure-messages.spec.ts took 28.8s
Slow Test: [Chrome] › sliding-sync/sliding-sync.spec.ts#L1
[Chrome] › sliding-sync/sliding-sync.spec.ts took 53.3s
Slow Test: [Chrome] › spaces/threads-activity-centre/threadsActivityCentre.spec.ts#L1
[Chrome] › spaces/threads-activity-centre/threadsActivityCentre.spec.ts took 47.3s
Slow Test: [Chrome] › room/room-header.spec.ts#L1
[Chrome] › room/room-header.spec.ts took 30.9s
Slow Test: [Chrome] › spaces/spaces.spec.ts#L1
[Chrome] › spaces/spaces.spec.ts took 30.8s
Slow Test: [Chrome] › settings/account-user-settings-tab.spec.ts#L1
[Chrome] › settings/account-user-settings-tab.spec.ts took 16.7s
Slow Test: [Chrome] › read-receipts/redactions-in-threads.spec.ts#L1
[Chrome] › read-receipts/redactions-in-threads.spec.ts took 1.5m
Slow Test: [Chrome] › read-receipts/read-receipts.spec.ts#L1
[Chrome] › read-receipts/read-receipts.spec.ts took 46.0s
Slow Test: [Chrome] › read-receipts/redactions-thread-roots.spec.ts#L1
[Chrome] › read-receipts/redactions-thread-roots.spec.ts took 31.0s
Slow Test: [Chrome] › right-panel/right-panel.spec.ts#L1
[Chrome] › right-panel/right-panel.spec.ts took 24.0s
Slow Test: [Chrome] › read-receipts/reactions-main-timeline.spec.ts#L1
[Chrome] › read-receipts/reactions-main-timeline.spec.ts took 19.5s
🎭 Playwright Run Summary
1 flaky [Chrome] › read-receipts/new-messages-main-timeline.spec.ts:50:17 › Read receipts › new messages › in the main timeline › Reading an older message leaves the room unread @mergequeue 43 skipped 32 passed (5.6m)
🎭 Playwright Run Summary
2 skipped 79 passed (6.2m)
🎭 Playwright Run Summary
71 passed (6.7m)
🎭 Playwright Run Summary
1 flaky [Chrome] › audio-player/audio-player.spec.ts:243:9 › Audio player › should support creating a reply chain with multiple audio files @no-firefox @no-webkit @screenshot 81 passed (7.3m)
🎭 Playwright Run Summary
8 flaky [Chrome] › spotlight/spotlight.spec.ts:132:9 › Spotlight › should find known public rooms ────── [Chrome] › spotlight/spotlight.spec.ts:146:9 › Spotlight › should find unknown public rooms ──── [Chrome] › spotlight/spotlight.spec.ts:161:9 › Spotlight › should find unknown public world readable rooms [Chrome] › spotlight/spotlight.spec.ts:220:9 › Spotlight › should find unknown people ────────── [Chrome] › spotlight/spotlight.spec.ts:321:9 › Spotlight › should allow opening group chat dialog [Chrome] › spotlight/spotlight.spec.ts:339:9 › Spotlight › should close spotlight after starting a DM [Chrome] › spotlight/spotlight.spec.ts:344:9 › Spotlight › should show the same user only once ─ [Chrome] › spotlight/spotlight.spec.ts:357:9 › Spotlight › should be able to navigate results via keyboard 2 skipped 73 passed (8.5m)
🎭 Playwright Run Summary
2 flaky [Chrome] › read-receipts/reactions-in-threads.spec.ts:16:17 › Read receipts › reactions › in threads › A reaction to a threaded message does not make the room unread @mergequeue [Chrome] › read-receipts/redactions-main-timeline.spec.ts:271:17 › Read receipts › redactions › in the main timeline › A reply to a redacted message makes the room unread @mergequeue 2 skipped 73 passed (7.4m)

Artifacts

Produced during runtime
Name Size
all-blob-reports-Chrome-1 Expired
5.52 MB
all-blob-reports-Chrome-2 Expired
296 KB
all-blob-reports-Chrome-3 Expired
5.64 MB
all-blob-reports-Chrome-4 Expired
7.25 MB
all-blob-reports-Chrome-5 Expired
36.1 MB
all-blob-reports-Chrome-6 Expired
941 KB
html-report Expired
48.5 MB
webapp Expired
28.7 MB