From d9841c059378d03d6ed59539aded7e4e213356c3 Mon Sep 17 00:00:00 2001 From: Sergei Iartsev Date: Thu, 22 Aug 2024 11:45:55 +0300 Subject: [PATCH] Apply suggestions from code review Co-authored-by: Anton Malinskiy --- docs/cloud/intro/overview.md | 6 +++--- 1 file changed, 3 insertions(+), 3 deletions(-) diff --git a/docs/cloud/intro/overview.md b/docs/cloud/intro/overview.md index 1d3443978..45a19d154 100644 --- a/docs/cloud/intro/overview.md +++ b/docs/cloud/intro/overview.md @@ -22,7 +22,7 @@ Whenever you submit an application and test application to Marathon Cloud, the f When you run tests with Marathon Cloud for the first time, we begin storing the test history in our database. The next time you run these tests, we already have information on the average time and the probability of a successful execution for each test. -Using this data, we calculate the necessary number of devices to ensure that your tests will complete within 15 minutes, whether that requires 5 devices or 200. +Using this data, we calculate the necessary number of devices to ensure that your tests will be completed within 15 minutes, be it 5 or 200. We also monitor the progress of test executions and adjust the distribution of tests across devices as needed. While the tests are running, our service can dynamically increase the number of devices to expedite the execution process. @@ -36,10 +36,10 @@ but please note that this may lead to an increase in the number of devices requi However, the total execution time will still be 15 minutes. ### Retries -Retries are a cornerstone of effective testing. The larger your test suite, the greater the likelihood that one test might fail due to environmental instability, commonly known as test flakiness. While adding retries can improve test stability, it also increases the total testing time. +Retries are a cornerstone of effective testing. The larger your test suite, the greater the likelihood that one test might fail due to non-determinism, commonly known as test flakiness. While adding retries can improve test stability, it also increases the total testing time. Marathon offers two retry strategies and several enhancements to strike a balance between stability and efficiency: - Predictive retries: By analyzing past test executions, we can determine the success rate of each test. For flaky tests, we can run multiple executions to ensure at least one succeeds. -- Common retries: If a test fails, we will rerun it up to three times. Marathon will attempt to run the test on a different device to minimize environmental impact on the results. +- Common retries: If a test fails, we will rerun it up to three times. Marathon will attempt to run the test on a different device to minimize the environmental impact on the results. - Additional features: Sorting, batching, test rebalancing, and more.