1.22.0

What's Changed

New Tests

• Add tests for checking GPU usage in Workbenches by @bdattoma in #696

Enhancements

• Fix sidebar checks for RHODS v1.22 by @bdattoma in #680
• Fix "Save changes" keyword and ODS-488 by @bdattoma in #684
• Fix UI checks in Managed Starburst tests by @bdattoma in #686
• Implement CR deletion using OpenshiftLibrary instead of UI by @bdattoma in #685
• More fixes for Starburst UI testing by @bdattoma in #687
• Add teardown to CUDA smoke verification by @lugi0 in #693
• Fix ODS-489 and ODS-1768 by @bdattoma in #697

Enhancements in scripts and CI/CD

• Bump upload-artifact to v3 in dryrun action by @lugi0 in #682

Documentation

• Fix variable name in infrastructure_configuration_variables.md by @pablofelix in #683

Misc

• Sort all the python file imports by @tarukumar in #689
• Added Isort job support by @tarukumar in #691

Other Changes

• Fix number for resource created(size) for OCP using using Hive by @tarukumar in #692

Full Changelog: 1.21.0...1.22.0

1.21.0

What's Changed

New Tests

• Add test to check that a base user can stop their server by @lugi0 in #677
• Add test for tolerations on workbeches by @bdattoma in #675
• Add event log test plus refine data connection tests in DS Projects by @bdattoma in #674
• Add test for Log Out options in workbenches by @bdattoma in #679

Enhancements

• Run "Suite Availability Setup" only on RHODS Managed by @jgarciao in #671
• Self-Managed: skip monitoring tests requiring RHODS prometheus by @jgarciao in #672
• Fix dashboard broken tests in Sanity by @bdattoma in #669
• Improve log message when creating clusters with ocm by @tarukumar in #673
• Remove product bug from ODS-760 (AiKit) by @bdattoma in #670
• Fix unsupported env vars edge case by @lugi0 in #676

Documentation

• Add infrastructure variables documentation by @pablofelix in #668

Other Changes

• Removed self-managed installer support and added support to install RHODS from Operatorhub by @tarukumar in #678

Full Changelog: 1.20.1...1.21.0

1.20.1

What's Changed

Enhancements

• Restore ODS-1081 and fix Keyword to fetch cluster environment by @bdattoma in #660
• Add teardown to autoscaling-gpus test suite by @lugi0 in #661
• Fix keyword to check if RHODS is Self managed by @bdattoma in #662
• bump cuda expected version to 12 by @lugi0 in #663
• Add some checks on RHODS Self-managed in Dashboard tests by @bdattoma in #665
• Improve keyword to wait for dashboard and remove Seldon folder by @bdattoma in #658
• Upgrade to RF 5 by @lugi0 in #664
• Misc fixes to Sanity and Smoke by @bdattoma in #666

Other Changes

• refactor using RF5 keywords by @lugi0 in #667

Full Changelog: 1.20.0...1.20.1

1.20.0

What's Changed

New Tests

• Add tasks for Managed Starburst and first tests by @bdattoma in #633
• Add SEP TC for Monitoring by @mwaykole in #640
• Add more tests for Managed Starburst by @bdattoma in #635
• Happy path test for Model Serving UI by @lugi0 in #631

New Tasks

• Add GCP provision by @pablofelix in #636

Enhancements

• Added support for rhods installtion by olm repo by @tarukumar in #628
• Update tests to account for prebuilt CUDA images by @lugi0 in #625
• Fix smoke failure due to cpu billing tests by @lugi0 in #639
• Add notebook spawning with basic user in Smoke suite by @bdattoma in #637
• fix SERH Test-case by @mwaykole in #642
• [Model Serving] Skip deletion steps in teardown if no model deployed by @lugi0 in #645
• Fix Dashboard XPaths for RHODS v1.20 by @bdattoma in #643
• Wait for a possible popup in "Spawn Notebook With Arguments" by @jgarciao in #632
• Skip the grafana Test case execution for RHODS 1.20 by @tarukumar in #646
• update utils files with S3 vars by @lugi0 in #648
• Restore ODS-293 test case by @bdattoma in #634
• Fix Test Metric "Notebook CPU Usage" On ODS Prometheus by @jgarciao in #647
• Move sla disruptive tests to Tier3 by @jgarciao in #649
• Fix DS Projects tests for RHODS v1.20 by @bdattoma in #644
• Fix expected error page in ODS-293 by @bdattoma in #650
• Fix test-versions tooltip xpath by @lugi0 in #652
• In RHOSi Setup and Teardown, warn if alerts are firing or pending by @jgarciao in #630
• Add AutomationBug tag to failing tests. Prepare ods-ci 1.20 release by @jgarciao in #651
• Fix failures in T2 tests for RHODS 1.20 by @lugi0 in #653
• Fix expected error page in ODS-572 plus add 1.19 compatibility in ODS-293 by @bdattoma in #656
• Smarter comparison for model inference output by @lugi0 in #655
• Additional fixes for ods-ci 1.20 by @jgarciao in #654
• Fix test of status API based on RHODS version by @bdattoma in #657

Full Changelog: 1.19.0...1.20.0

1.19.0

What's Changed

New Tests

• Check and verify rhods version and display name by @tarukumar in #617
• Add new rules in Dashboard clusterrole by @pablofelix in #619
• Add tests for Data Science Projects page by @bdattoma in #583

Enhancements

• Support for deploying/uninstalling rhods in GCP cluster by @tarukumar in #613
• Modify aws cluster config to expose variables to user by @aloganat in #612
• Add Robocop support to scan ods-ci by @tarukumar in #620
• Update ODS-488 and Add ODS-1890 to check only expected ISVs are displayed in Explore page by @bdattoma in #626
• Add fixes for RHOSAK UI testing by @bdattoma in #627
• Bugfixes for releasing ods-ci 1.19. Add AutomationBug and ProductBug by @jgarciao in #629

Misc

• Add pre-req pkgs for a jenkins worker node by @aloganat in #614

Other Changes

• Tweak model serving TCs for openvino backend by @lugi0 in #621

Full Changelog: 1.18.0...1.19.0

1.18.0

What's Changed

New Tests

• Fix pod toleration test case, add new TC for unsupported tolerations by @lugi0 in #591
• Add test for unsupported environment variable names by @lugi0 in #596
• Add test case to verify it is possible to create custom Dashboard items (Application,QuickStarts,HowTo,Tutorial,Documentation) by @bdattoma in #333
• Add test suite for gpu autoscaling by @lugi0 in #602

Enhancements

• Remove dot from expected text when changing cluster settings by @lugi0 in #597
• Wait for cuda builds in Sanity by @jgarciao in #599
• Complete information about product bug in some dashboard tests by @bdattoma in #594
• Fix tests affected by changes in HTML by @bdattoma in #598
• Remove check on pachyderm secret creation by @bdattoma in #595
• Adapt ODS-488,1303,771 to account for dashboard differences in Self-managed by @bdattoma in #581
• Adapt API Access tests after new changes in dashboard endpoints by @bdattoma in #593
• Disable XLarge test by @lugi0 in #607
• update model serving tests for ovms by @lugi0 in #603
• Modify the image to Centos stream for terraform provisioning by @aloganat in #611

Other Changes

• Save cluster details in file and add sshkey option in config yaml by @aloganat in #601
• Check for modal error message when there's not enough resources to spawn notebook by @lugi0 in #590
• Implement Github Action for dry runs of the whole repo. Replace OpenShiftCLI by OpenShiftLibrary by @lugi0 in #588
• Fix dryrun action permissions by @lugi0 in #604
• Update dryrun comment workflow by @lugi0 in #608
• "Add support to perform OSD upgrade" by @mwaykole in #610

Full Changelog: 1.17.0...1.18.0

1.17.0

What's Changed

New Tests

• Added new TCs for Notebook Controller Routes and Jupyter Notebook by @tarukumar in #574
• Verify Clean Up ODS Deployer Post-Migration by @pablofelix in #576

Enhancements

• Add product bug and and remove flaky test from operator test by @tarukumar in #572
• Fix bug in keyword "Verify Operator Pod Status" by @jgarciao in #573
• Fix qaprodauth url by @bdattoma in #577
• Update performance tests for kfnbc by @tarukumar in #561
• Add support to install rhods using the self-managed-installer by @tarukumar in #555
• Add ODS-650 to Anaconda e2e test case by @bdattoma in #570
• Fix failures in Dashboard API testing by @bdattoma in #575
• Fix test on Dashboard deployment increasing expected replicas to 5 by @bdattoma in #578
• Added support for new uninstaller by @tarukumar in #580
• Shellcheck lineter implementation by @tarukumar in #584
• Add self managed catalog source by @tarukumar in #586
• Prepare ods-ci 1.17.0 release by @jgarciao in #592
• Add parameter to spawn notebook in new tab by @lugi0 in #587

Other Changes

• Spawn in same tab for rhods 1.17+ by @lugi0 in #571
• Cluster config by @aloganat in #579
• Model serving test suite by @lugi0 in #582

Full Changelog: 1.16.0...1.17.0

1.16.0

What's Changed

New Tests

• Add test to verify app switcher menu in RHODS Dashboard by @bdattoma in #482
• Add TCs for pod tolerations by @lugi0 in #531
• Add TC's for Admin UI by @mwaykole in #532
• Add tests for new kubeflow alerts by @jgarciao in #553
• Add Feature AWS Provisioning Beta by @pablofelix in #562
• Add tests for testing API based on user permission by @bdattoma in #556

Enhancements

• Add further check on doc links from Dashboard in ODS-327 by @bdattoma in #492
• Increase build timeout when waiting for CUDA builds by @jgarciao in #510
• Fix ODS-1491 to remove Openvino from dashboard after uninstall in ODS-1491 by @bdattoma in #484
• added code to skip the TC since traefik pod is removed by @tarukumar in #513
• Minor Fixes by @bdattoma in #509
• Update telemetry configmap and secret for kubeflow. Fix RHOSi Setup when prometheus is not running by @jgarciao in #511
• Adapt different TCs to work with KFNBC and without old config maps by @bdattoma in #533
• Update ODS-488 to remove perceptilabs check for Jupyter (instead of JupyterHub) by @bdattoma in #503
• Add python linter by @tarukumar in #535
• Fix wrong label selector in Smoke by @lugi0 in #537
• Update monitoring tests for kubeflow (Tier1, Tier2) by @jgarciao in #534
• Fix some failing smoke tests due to JH to Jupyter migration by @bdattoma in #536
• fix-minor-issue size=Default to size=Small by @tarukumar in #540
• Fix gpu selector handling by @lugi0 in #542
• Run black formatter only on python file by @tarukumar in #544
• Update fix spawner status keyword for KFNBC by @lugi0 in #545
• Fix spawner typos by @lugi0 in #546
• Update expected CUDA version to 11.7 by @lugi0 in #547
• added support to check rhods operator by @tarukumar in #487
• Update culler test suite for KFNBC by @lugi0 in #543
• Fix metrics tests for kubeflow by @jgarciao in #550
• Workaround for modal not appearing during spawn by @lugi0 in #549
• Added changes to PVC related tc to support KFNBC by @tarukumar in #551
• Added rhods version to be available globally by @tarukumar in #552
• Fix Jupyter tests in Tier2 by @lugi0 in #554
• Fix PSI related TC by @tarukumar in #558
• Update ODS-469 to use Notebook CR for last spawn details by @lugi0 in #560
• Fix typo in spawn keyword by @lugi0 in #564
• Add namespace parameter to oc call by @lugi0 in #568
• Fix Anaconda and Application Switcher test cases based on results from automated runs by @bdattoma in #563
• Attempt at optimizing openshift login step by @lugi0 in #559

Enhancements in scripts and CI/CD

• Add support to create osd cluster on gcp by @aloganat in #548

Documentation

• Black doc by @tarukumar in #538

Misc

• Add AutomationBug tags after TFA for Dashboard and ISV TCs by @bdattoma in #569

Other Changes

• Merge KFNBC branch onto main by @lugi0 in #521
• Use shell script for configuring aws by @aloganat in #557
• Change container size in multiple-gpus test by @lugi0 in #565
• Install GPU operator on self managed cluster by @tarukumar in #566
• Make sure Pod Toleration setting is applied before running TC by @lugi0 in #567

Full Changelog: 1.15.0...1.16.0

1.15.0

What's Changed

New Tasks

• Add PSI uninstall by @pablofelix in #491

Enhancements

• added fix for smoke run by @tarukumar in #494
• chnage default gpu node by @tarukumar in #495
• Verify cuda buildchain in smoke pipeline by @jgarciao in #502

Misc

• Adding memory and cpu resource by @tarukumar in #441

Other Changes

• Revert "chnage default gpu node" by @tarukumar in #498
• Change python code in Pep8 format by @mwaykole in #485
• Remove false negative test by @lugi0 in #504

Full Changelog: 1.14.0...1.15.0

1.14.0

What's Changed

New Tests

• Add TC to Verify external links in Quick Starts are not broken by @mwaykole in #446
• [Test] User should not see No Components Found in RHODS Dashboard by @mwaykole in #458
• [Test] RHODS user should not see No Components Found in RHODS Dashboard after configmap change by @tarukumar in #464
• Check if rhods dashborad pods doesn't restart by @tarukumar in #465
• Add tensorboard test for tensorflow/pytorch images by @lugi0 in #470
• Verify rhods_aggregated_availability Detects Downtime In Jupyterhub And Dashboard by @pablofelix in #475

Enhancements

• Added support for other RHODS supported ISV in Performance test by @tarukumar in #449
• Fix test "Verify That MT-SRE Are Not Paged For Alerts In Clusters Used For Development Or Testing" (ODS-1058) by @jgarciao in #456
• Spawn Notebook With Arguments: fail if the retry count is exhausted by @kpouget in #457
• Fix timing for test "Wait Until Operator Reverts "Grafana" To "Prometheus" In Rhods-Monitor-Federation" by @jgarciao in #460
• Fix test checking Active_Users metrics not to skip when active_users > 0 by @jgarciao in #459
• Move ISVs test cases from Sanity to Tier2 by @bdattoma in #463
• Fix RHOSAK teardown by @bdattoma in #466
• Check aggregate availability in "RHOSi Setup" and "RHOSi Teardown" by @jgarciao in #444
• Fix service account token fetching in ODS-CI for compatibility issue with OCP 4.11 by @bdattoma in #468
• Fix compatibility issue with OSD 4.11 in installing ISV from UI by @bdattoma in #467

Enhancements in scripts and CI/CD

• [Lib] Script to create openshift cluster on aws using openshift-install by @aloganat in #461
• Added support to install rhods on PSI with git repo by @tarukumar in #474

Misc

• moving PVC size verification TCs out of smoke by @tarukumar in #455
• Spawn Notebook With Arguments: initialize ${spawn_fail} variable by @kpouget in #469
• Spawn Notebook With Arguments: correctly initialize ${spawn_fail} variable by @kpouget in #472

Other Changes

• [TestFix] Add sanity tag by @mwaykole in #462

Full Changelog: 1.13.0...1.14.0