Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Improve reliability of the ssh units #2941

Merged
merged 1 commit into from
May 22, 2024

Conversation

a-b
Copy link
Member

@a-b a-b commented May 21, 2024

Description of the Change

Utilize Ginkgo v2 granular FlakeAttempts() to improve reliability of util/clissh/ssh_test.go on mac workers.

Why Is This PR Valuable?

Less false negative tests.

Backport

Branch PR
V8 #2942
V7 #2943

@a-b
Copy link
Member Author

a-b commented May 21, 2024

After multiple consecutive re-runs, the SSH suit looks ok. Recently there was one unrelated failure here.

@a-b
Copy link
Member Author

a-b commented May 21, 2024

Related runs are filtered here

@a-b
Copy link
Member Author

a-b commented May 22, 2024

Looks promising:

Both got tcp timeouts in SSH suit - both recovered.

image

I'm wondering if nine attempts is a bit excessive, but IMO that's a good start.

@a-b a-b requested a review from gururajsh May 22, 2024 08:53
@a-b
Copy link
Member Author

a-b commented May 22, 2024

Looks pretty stable to me
image

@a-b a-b marked this pull request as ready for review May 22, 2024 08:59
@a-b a-b force-pushed the 187325694-flaky-ssh-units-on-mac branch from 8d3bdea to 21b5840 Compare May 22, 2024 09:08
@a-b a-b changed the title Retry flaky ssh test on mac Improve reliability of the ssh units May 22, 2024
Copy link
Contributor

@joaopapereira joaopapereira left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

- Simplified CLI SSH Suit execution to run togetheer with other non-plugin tests

https://onsi.github.io/ginkgo/#repeating-spec-runs-and-managing-flaky-specs
@a-b a-b force-pushed the 187325694-flaky-ssh-units-on-mac branch from 21b5840 to a59d826 Compare May 22, 2024 17:32
Copy link
Contributor

@Samze Samze left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

Copy link
Member

@gururajsh gururajsh left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@gururajsh gururajsh merged commit 01a610c into main May 22, 2024
12 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants