Skip to content
This repository has been archived by the owner on Aug 26, 2022. It is now read-only.

v3.2.0
Compare
Choose a tag to compare
@jc-rh jc-rh released this 15 Dec 17:57
v3.2.0
2550a51
This commit was created on GitHub.com and signed with GitHub’s verified signature. The key has expired.
GPG key ID: 4AEE18F83AFDEB23
Expired
Learn about vigilant mode.

What's Changed

Framework Enhancements

  • Auto discovery
    • HPA discovery for all deployments under test
    • Optimized test target discovery across multiple namespaces
    • IP address discovery without requiring ip binary in the pod under test
  • Robustness
    • Improved handling of debug pod termination and recreation
    • Improved timeout handling for tests with long running command, such as podman diff in the base image test
  • Usability
    • Auto detect OCP cluster vs non OCP K8S cluster
    • Artifacts from test runs initiated by GitHub Actions are now archived properly
    • HTML visualization added for test reports with easy navigation among test configuration, test environment and test results
  • General
    • GolangCI updated to v1.43.0
    • Improved unit test coverage
    • Go updated to 1.17.4

Improved Test Cases

  • Scaling test now supports deployments with HPA
  • Namespaces test now verifies custom resource objects and pods, in addition to namespaces (see details here)
  • Host resource test
    • SCC test now works properly when multiple capabilities are present in the pod spec
    • All tests now continue to verify all Pods instead of stopping upon the first pod that fails the test
  • Pod scheduling test now detects node selector properly
  • Pod scaling and recreation test now capture pending pod status and node status on failure scenarios
  • Pod recreation test now recovers the cluster properly on failure scenarios instead of leaving some node cordoned
  • Service account / role binding / cluster role binding / container logging / CRD status test now continues to verify all targets instead of stopping upon the first failure
  • Re-designed network connectivity test
    • No more dependency on binaries (ip, ping etc) in the pods under test
    • Test partner pod no longer required. ICMP ping is done between the pods that are attached to the same network
    • Multus networks supported without requiring a customized partner pod
    • No longer repeat tests between the same source and destination addresses when pod under test has more than one containers
  • Node hardware / CNI plugin / CSI driver diagnostic tests now work on non OCP cluster as well

New Test Cases

  • Container image pull policy test
  • Service account token automount test

Full Changelog: v3.1.0...v3.2.0

Assets 2
Loading