Skip to content
This repository has been archived by the owner on Aug 26, 2022. It is now read-only.

Release v2.0.0
Compare
Choose a tag to compare
@ryandgoulding ryandgoulding released this 16 Jun 15:19
v2.0.0
2333527

The formal release of the second major version of test-network-function.

CNF Certification v2.0.0 includes:

  • A significant increase in test coverage. In particular, a number of container and operator best practices tests were added.
  • Improved Lifecycle tests. Several lifecycle tests as well as forward looking building blocks were created to improve our OLM coverage.
  • A streamlined configuration: The configuration is now handled by a single file. Additionally, configuration can be autodiscovered through the use of labeling appropriate items.
  • Support to run the test suite as a container. No longer does a user need to compile the code locally to run the test suites!
  • Improved smoketest infrastructure through the inclusion of GitHub Actions which run tests against minikube.
  • User/developer experience improvements. A huge number of rough edges were worked out in our second major release to improve developer velocity and consumer adoption.
  • Results grading and analysis. A tool is added to help interpret test results.
  • Many other great contributions, try it out yourself!

Commits in this release:

  • c189344 2021-06-16 | Release v2.0.0 [Ryan Goulding]
  • 2a4ef77 2021-06-09 | Enable TNF image publishing for 2.0 release [Marek Kochanowski]
  • 6e3b511 2021-06-13 | gradetool - propose grade from test results [Yaron Dayagi]
  • ecdffa8 2021-06-15 | Resolves issues with checking operator subscription (yaron/main) [Ryan Goulding]
  • 78a617b 2021-06-14 | Query for operator/container certification only when present [Ryan Goulding]
  • 4504df8 2021-06-14 | Disable pod-recreation test [Ryan Goulding]
  • 2a3069e 2021-06-07 | CTONET-530 Fix the issue from the podman change and also invoke the test suite in run-tnf-container.sh [Jun Chen]
  • 6a48200 2021-06-09 | Add in functionality to uncordon nodes [Ryan Goulding]
  • ab2e74c 2021-06-09 | Resolves issue in the command to derive machineconfig set for a node [Ryan Goulding]
  • a3a20a4 2021-06-09 | CTONET-880 - don't run on minikube [Isaac Dorfman]
  • 108d7e0 2021-06-07 | CTONET-880 refactored suite.go to use runAndValidateTest [Isaac Dorfman]
  • 4d319c8 2021-06-07 | CTONET-880 [Isaac Dorfman]
  • 5a3832e 2021-06-08 | Automatic terminal prompt emulation [Ryan Goulding]
  • 099db31 2021-06-08 | Ignore non key/value pairs in kernelArguments [Ryan Goulding]
  • d93cf3b 2021-06-08 | Increase default buffer size [Ryan Goulding]
  • 5f15e4e 2021-05-25 | CTONET-971 + CTONET-974 [Isaak Dorfman]
  • 4d17338 2021-06-03 | Cleanup suite_test.go [Ryan Goulding]
  • 5f820ea 2021-06-07 | Fix typo in exported TNF_CONTAINER_CLIENT env var [Marek Kochanowski]
  • bcfaf39 2021-06-03 | Add a link to CATALOG.md in README.md [Ryan Goulding]
  • 9a629c6 2021-06-03 | Explicitly allow use of "docker" instead of "podman" [Ryan Goulding]
  • 336addb 2021-06-02 | 776-Done! [Shimrit peretz]
  • 6458968 2021-06-02 | Pull oc binary rather than build from source (shimrit/main) [Ryan Goulding]
  • 6e6ee3f 2021-06-03 | Bump github.com/onsi/ginkgo from 1.16.3 to 1.16.4 [dependabot[bot]]
  • 9ef3a69 2021-06-02 | Bump github.com/onsi/ginkgo from 1.16.2 to 1.16.3 [dependabot[bot]]
  • 3150e8d 2021-06-02 | CTONET-999: Resolves issues with generic test suite [Ryan Goulding]
  • 353ef21 2021-05-26 | Create descriptions/remediations for each JUnit test case [Ryan Goulding]
  • 005d183 2021-05-27 | Bump github.com/onsi/gomega from 1.12.0 to 1.13.0 [dependabot[bot]]
    ryangoulding@rgouldin-mac test-network-function % git hist
  • c189344 2021-06-16 | Release v2.0.0 (HEAD -> 2.0.x, ryandgoulding/release_2.0.0, release_2.0.0) [Ryan Goulding]
  • 2a4ef77 2021-06-09 | Enable TNF image publishing for 2.0 release (origin/main, origin/HEAD, main) [Marek Kochanowski]
  • 6e3b511 2021-06-13 | gradetool - propose grade from test results [Yaron Dayagi]
  • ecdffa8 2021-06-15 | Resolves issues with checking operator subscription (yaron/main) [Ryan Goulding]
  • 78a617b 2021-06-14 | Query for operator/container certification only when present [Ryan Goulding]
  • 4504df8 2021-06-14 | Disable pod-recreation test [Ryan Goulding]
  • 2a3069e 2021-06-07 | CTONET-530 Fix the issue from the podman change and also invoke the test suite in run-tnf-container.sh [Jun Chen]
  • 6a48200 2021-06-09 | Add in functionality to uncordon nodes [Ryan Goulding]
  • ab2e74c 2021-06-09 | Resolves issue in the command to derive machineconfig set for a node [Ryan Goulding]
  • a3a20a4 2021-06-09 | CTONET-880 - don't run on minikube [Isaac Dorfman]
  • 108d7e0 2021-06-07 | CTONET-880 refactored suite.go to use runAndValidateTest [Isaac Dorfman]
  • 4d319c8 2021-06-07 | CTONET-880 [Isaac Dorfman]
  • 5a3832e 2021-06-08 | Automatic terminal prompt emulation [Ryan Goulding]
  • 099db31 2021-06-08 | Ignore non key/value pairs in kernelArguments [Ryan Goulding]
  • d93cf3b 2021-06-08 | Increase default buffer size [Ryan Goulding]
  • 5f15e4e 2021-05-25 | CTONET-971 + CTONET-974 [Isaak Dorfman]
  • 4d17338 2021-06-03 | Cleanup suite_test.go [Ryan Goulding]
  • 5f820ea 2021-06-07 | Fix typo in exported TNF_CONTAINER_CLIENT env var [Marek Kochanowski]
  • bcfaf39 2021-06-03 | Add a link to CATALOG.md in README.md [Ryan Goulding]
  • 9a629c6 2021-06-03 | Explicitly allow use of "docker" instead of "podman" [Ryan Goulding]
  • 336addb 2021-06-02 | 776-Done! [Shimrit peretz]
  • 6458968 2021-06-02 | Pull oc binary rather than build from source (shimrit/main) [Ryan Goulding]
  • 6e6ee3f 2021-06-03 | Bump github.com/onsi/ginkgo from 1.16.3 to 1.16.4 [dependabot[bot]]
  • 9ef3a69 2021-06-02 | Bump github.com/onsi/ginkgo from 1.16.2 to 1.16.3 [dependabot[bot]]
  • 3150e8d 2021-06-02 | CTONET-999: Resolves issues with generic test suite [Ryan Goulding]
  • 353ef21 2021-05-26 | Create descriptions/remediations for each JUnit test case [Ryan Goulding]
  • 005d183 2021-05-27 | Bump github.com/onsi/gomega from 1.12.0 to 1.13.0 [dependabot[bot]]
  • 933a9c3 2021-05-27 | Extend CI smoke tests with generic test suite [Marek Kochanowski]
  • 3b3e4ff 2021-05-27 | Enhance run-container.sh's autodiscovery feature [Marek Kochanowski]
  • 2d81850 2021-05-27 | log node selector/affinity warning to extra info [Yaron Dayagi]
  • 80fe35d 2021-05-27 | log termination grace period warning to extra info [Yaron Dayagi]
  • 6b590ab 2021-05-26 | Add doc.go for diagnostic package [Ryan Goulding]
  • 8b43fc5 2021-05-25 | Support for our own results stream and unique identifiers [Ryan Goulding]
  • 3dcb24b 2021-05-26 | CTONET-530 Fixed a bug revealed by the junit file output path fix [Jun Chen]
  • 5c8a0db 2021-05-25 | CTONET-530 Addressed review comments from PR #206 [Jun Chen]
  • 573a76d 2021-05-17 | CTONET-530 Invoke cnf feature deploy test suite [Jun Chen]
  • 1f98e99 2021-05-26 | Disable kernel boot params test on minikube [Marek Kochanowski]
  • 1045b0a 2021-05-25 | Remove use of deprecated Ginkgo APIs, and correct hardcoded Junit path for cnf-certification-tests_junit.xml [wying3]
  • 4c71400 2021-05-21 | add autodiscovery capabilities to the operator spec [Charlie Wheeler-Robinson]
  • ccb07d1 2021-05-21 | add struct and methods in prep for CSV autodiscovery [Charlie Wheeler-Robinson]
  • 798309c 2021-05-21 | correct doubled namespace in error message [Charlie Wheeler-Robinson]
  • 0c09882 2021-05-21 | correct error and behaviour in CNF autodiscovery [Charlie Wheeler-Robinson]
  • 4566c62 2021-05-21 | report correct annotation key in error message [Charlie Wheeler-Robinson]
  • 11e5671 2021-05-20 | better organise autoconfig resource discovery methods [Charlie Wheeler-Robinson]
  • a93d7f2 2021-05-20 | document testDeployments testRoles testNamespace [Yaron Dayagi]
  • 34b36b7 2021-05-23 | skip testDeployments if using minikube [Yaron Dayagi]
  • b79160d 2021-05-20 | Bump google.golang.org/grpc from 1.37.1 to 1.38.0 (fucking_around) [dependabot[bot]]
  • 38645e0 2021-05-20 | Fix broken pipeline [Ryan Goulding]
  • 8e58583 2021-05-19 | CTONET-845 - added test for machineconfig and node kernel params compatibility (CTONET-883) [Isaac Dorfman]
  • b0bb3dd 2021-05-12 | add extra info per test [Yaron Dayagi]
  • ef950e9 2021-05-18 | fix a bug when checking autodiscovery env var (fork) [Charlie Wheeler-Robinson]
  • 5dec85d 2021-05-17 | add automatic config discovery for container spec [Charlie Wheeler-Robinson]
  • 9baab61 2021-05-17 | give autodiscover.GetGenericContainers a more descriptive name [Charlie Wheeler-Robinson]
  • 72865ba 2021-05-17 | clarify misleading wording of container spec config [Charlie Wheeler-Robinson]
  • e46b9cd 2021-05-17 | add a note about certification status async failures [Charlie Wheeler-Robinson]
  • 99bab2e 2021-05-14 | move generic-specific method out from general autodiscovery [Charlie Wheeler-Robinson]
  • f2045b3 2021-05-14 | Add automatic publishing of unstable TNF images [Marek Kochanowski]
  • 16305f7 2021-05-18 | Disable tnf-image.yaml workflow on forked repos [Marek Kochanowski]
  • 0aa0bab 2021-05-14 | correct example config files (4.7.z, 4.6.z) [Charlie Wheeler-Robinson]
  • 93cd5f4 2021-05-13 | Add automatic publishing of TNF container images [Marek Kochanowski]
  • e1e5bb7 2021-05-13 | Extend pre-main.yaml CI workflow with Smoke Tests [Marek Kochanowski]
  • f4caaaf 2021-05-13 | skip fs diff test if no container configured [Charlie Wheeler-Robinson]
  • 93e1264 2021-05-13 | Fix tnf_config.yml missing in TNF container [Marek Kochanowski]
  • 2e507b8 2021-05-12 | Bump google.golang.org/grpc from 1.37.0 to 1.37.1 [dependabot[bot]]
  • 4c73110 2021-05-12 | Fix debug messages for run-container.sh [Marek Kochanowski]
  • 7790c02 2021-05-12 | Revert "removing custom ginkgo reporters" [Ryan Goulding]
  • c6adb4f 2021-05-12 | Revert "modify GINKGO_ARGS in run-cnf-suite.sh" [Ryan Goulding]
  • da70247 2021-05-11 | Automatically configure generic spec (#190) (revert) [Charlie Wheeler-Robinson]
  • c2811a6 2021-05-06 | Bump github.com/onsi/gomega from 1.11.0 to 1.12.0 [dependabot[bot]]
  • a5d86a1 2021-05-11 | Add network mode settings to run-container.sh [Marek Kochanowski]
  • 54b4315 2021-05-06 | update config docs to reflect new structure [Charlie Wheeler-Robinson]
  • f7c1d35 2021-05-05 | decouple certification request config from operator info [Charlie Wheeler-Robinson]
  • 54b0ba6 2021-05-05 | decouple certification request from cnf info [Charlie Wheeler-Robinson]
  • f37e21f 2021-05-11 | CTONET-886 print warning if nodeSelector or nodeAffinity are present [Isaac Dorfman]
  • 3142fa2 2021-05-11 | control FS Diff test with TNF_MINIKUBE_ONLY env var [wying3]
  • 5e072c9 2021-05-05 | Bump github.com/onsi/ginkgo from 1.16.1 to 1.16.2 [dependabot[bot]]
  • e6c6ae8 2021-05-10 | Add support for external TNF source repositories [Marek Kochanowski]
  • adedf38 2021-05-04 | Pods should be managed by DaemonSets/Deployments [Yaron Dayagi]
  • 1cb9a91 2021-05-06 | CTONET-645 - fix empty resourceNames (example-cnf) [Piotr Kliczewski]
  • 3c2694f 2021-05-04 | fix a bug that caused each operator test to run twice [Charlie Wheeler-Robinson]
  • dccd41b 2021-05-04 | Previous PR accidently changed timeout [Yaron Dayagi]
  • 5c109ff 2021-04-29 | modify GINKGO_ARGS in run-cnf-suite.sh [wying3]
  • ab92da8 2021-04-28 | removing custom ginkgo reporters [wying3]
  • 243f8c3 2021-05-04 | fix documentation issue introduced in 5430a4c [Charlie Wheeler-Robinson]
  • 307cabb 2021-04-28 | ensure a CNF is usable after cordoning a node [Yaron Dayagi]
  • 63e246f 2021-04-27 | Provide ability to define Go-templated JSON tests [Ryan Goulding]
  • a5bf4d7 2021-04-26 | Add an optional parameter -i to run-container.sh [Marek Kochanowski]
  • 46a30ae 2021-04-22 | update copyright notice with current year (template) [Charlie Wheeler-Robinson]
  • 8117cc5 2021-04-22 | Bump github.com/onsi/ginkgo from 1.16.0 to 1.16.1 [dependabot[bot]]
  • c3f882b 2021-04-08 | Bump google.golang.org/grpc from 1.36.1 to 1.37.0 [dependabot[bot]]
  • d2275b1 2021-04-08 | Combine the config mechanisms [Charlie Wheeler-Robinson]
  • a2d7d10 2021-04-21 | CTONET-845 - print warning when terminationGracePeriod is default [Isaac Dorfman]
  • 95d07c2 2021-04-20 | CTONET-645 - scc verification [Piotr Kliczewski]
  • 3767970 2021-04-19 | Test worker nodes' hugepages [Yaron Dayagi]
  • 6b58ab6 2021-04-12 | Test that node kernels are not tainted [Yaron Dayagi]
  • 2714274 2021-04-15 | Add documentation surrounding excluding containers from connectivity suite [Ryan Goulding]
  • fdd7a80 2021-04-14 | Update .golangci.yml (#160) [wying3]
  • a05750a 2021-04-13 | added test to check if PUT installed packages at runtime [Isaac Dorfman]
  • 50d6ba5 2021-04-06 | Add configuration and documentation surrounding buffer sizes [Ryan Goulding]
  • 5811e2c 2021-04-09 | CTONET-782 - Subscription verification [Piotr Kliczewski]
  • a5d42b4 2021-04-08 | Fix problems with the linter workflow [Ryan Goulding]
  • 1239f19 2021-04-07 | Test NodePort services do not exist (ginkgo_issue) [Yaron Dayagi]
  • 4a640ca 2021-04-07 | Resolves golangci-lint rules and addresses issues in main [Ryan Goulding]
  • 32d1d72 2021-03-24 | Test pod priviliges [Yaron Dayagi]
  • 61468ed 2021-04-05 | Bump github.com/onsi/ginkgo from 1.15.2 to 1.16.0 [dependabot[bot]]
  • dd4b7e2 2021-04-01 | Update to the latest version of google/goexpect [Ryan Goulding]
  • aacb9e4 2021-03-30 | Bump google.golang.org/grpc from 1.31.0 to 1.36.1 (ryandgoulding/main) [dependabot[bot]]
  • 45a0659 2021-03-30 | Bump github.com/spf13/cobra from 1.1.1 to 1.1.3 [dependabot[bot]]
  • f959458 2021-03-30 | Bump google.golang.org/grpc from 1.31.0 to 1.36.1 [dependabot[bot]]
  • 634d9a0 2021-03-30 | Bump github.com/test-network-function/test-network-function-claim [dependabot[bot]]
  • e58bd89 2021-03-30 | Bump github.com/onsi/gomega from 1.10.5 to 1.11.0 [dependabot[bot]]
  • 8e37403 2021-03-30 | Bump github.com/onsi/ginkgo from 1.15.0 to 1.15.2 [dependabot[bot]]
  • 3f20123 2021-03-30 | Bump github.com/onsi/ginkgo from 1.15.0 to 1.15.2 [dependabot[bot]]
  • 4156665 2021-03-30 | Bump github.com/stretchr/testify from 1.6.1 to 1.7.0 [dependabot[bot]]
  • ed0dc2b 2021-03-30 | Bump github.com/sirupsen/logrus from 1.6.0 to 1.8.1 [dependabot[bot]]
  • d6ff353 2021-03-30 | Create dependabot.yml [Ryan Goulding]
  • 00998a1 2021-03-26 | remove ununsed configuration options [Charlie Wheeler-Robinson]
  • f0cc2d0 2021-03-26 | Add autodiscovery for local kubeconfig files [Marek Kochanowski]
  • 977775d 2021-03-22 | Ease the pain of integrating new PTY executables [Ryan Goulding]
  • 4c2f48d 2021-03-22 | Test CNF pod namespace [Yaron Dayagi]
  • 9ec80ce 2021-03-22 | Version bump for release (tag: v1.0.5) [Charlie Wheeler-Robinson]
  • 6d046b5 2021-03-18 | fix image env and add json tests [Charlie Wheeler-Robinson]
  • 9823e68 2021-03-18 | Add Charlie Wheeler-Robinson to the committers list (isaac/1.0.x, network_test_exclusions) [Ryan Goulding]
  • a55d29e 2021-03-18 | add short discussion of Go Templates to docs [Charlie Wheeler-Robinson]
  • 4eded54 2021-03-17 | Rename the organization from redhat-nfvpe to test-network-function [Ryan Goulding]
  • 8e325f5 2021-03-17 | Include go report card [Ryan Goulding]
  • 4e790f9 2021-03-17 | add in a merge job and corresponding badge [Ryan Goulding]
  • 1f5be9e 2021-03-17 | add in a merge job and corresponding badge [Ryan Goulding]
  • 66804fa 2021-03-10 | add a map for test result code to Unix return code [Charlie Wheeler-Robinson]
  • ec06f4c 2021-03-16 | make order of args in Catalog API more intuitive [Charlie Wheeler-Robinson]
  • 3983e87 2021-03-16 | fix incorrect arg order [Charlie Wheeler-Robinson]
  • 2699aaa 2021-03-04 | add link to quay.io in container docs and runner (yaron/turnium) [Charlie Wheeler-Robinson]
  • b4dc25f 2021-03-03 | Add the ability to exclude certain CNF containers from connectivity tests [Ryan Goulding]
  • 882f797 2021-03-03 | Release containerized solution (tag: v1.0.4) [Ryan Goulding]
  • a865029 2021-03-02 | update docs with container instructions [Charlie Wheeler-Robinson]
  • f4be1b9 2021-03-02 | add a wrapper to set up and run containerised tests [Charlie Wheeler-Robinson]
  • 6d57d7f 2021-03-02 | add a Dockerfile to build tnf container [Charlie Wheeler-Robinson]
  • e78c9b1 2021-03-03 | upgrade dependencies ginkgo, gomega, gomock [Charlie Wheeler-Robinson]
  • ac4eb1a 2021-03-03 | Fix update-deps Makefile target [Ryan Goulding]
  • f9d7eac 2021-03-02 | Version bump for release (tag: v1.0.3, tag: v1.0.2) [Ryan Goulding]
  • c57a741 2021-03-02 | Allow non-Server release versions of RHEL [Ryan Goulding]
  • 4fc1900 2021-03-02 | Rename reel.Reel receivers [Ryan Goulding]
  • ecc93fe 2021-03-02 | Let ping.go tnf.Test end naturally [Ryan Goulding]
  • 6087a5d 2021-03-01 | Add flag to control claim output location [Charlie Wheeler-Robinson]
  • 04a72fb 2021-03-01 | document correct dependency make targets [Charlie Wheeler-Robinson]
  • d7299e3 2021-02-22 | Add in better descriptions of the existing test specs (tag: 1.0.2) [Ryan Goulding]
  • a5d3c6e 2021-01-12 | Improve branching vernacular (tag: v1.0.1) [Ryan Goulding]
  • f532bb1 2021-01-11 | add new make targets to README [Charlie Wheeler-Robinson]
  • 93f1d3a 2021-01-08 | rework Makefile to be clearer [Charlie Wheeler-Robinson]
  • 3537b4f 2021-01-08 | remove unneeded export of env var [Charlie Wheeler-Robinson]
  • 73b5e5b 2021-01-08 | Remove unneeded "GO111MODULE" [Charlie Wheeler-Robinson]
  • d6b5262 2021-01-08 | remove unused nolint comment [Charlie Wheeler-Robinson]
  • 835ba7a 2021-01-12 | rename master to main in workflow [Charlie Wheeler-Robinson]
  • 8ae97ae 2020-12-18 | Fix a broken link to claim.schema.json [Ryan Goulding]
Assets 2
Loading