Add KFTO pytorch multi-node multi-gpu tests for GPUs with AMD ROCm an…

…d NVIDIA Cuda

ods_ci/tests/Tests/0600__distributed_workloads/0602__training/test-run-training-stack-tests.robot

@@ -75,3 +75,15 @@ Run Training operator KFTO_MNIST multi-node test with AMD ROCm image
     ...     Training
     ...     TrainingOperator
     Run Training Operator KFTO Test    TestPyTorchJobMnistMultiNodeWithROCm    ${ROCM_TRAINING_IMAGE}
+
+Run Training operator KFTO_MNIST multi-node multi-gpu test with NVIDIA CUDA image
+    [Documentation]    Run Go KFTO_MNIST multi-node multi-gpu test for Training operator using PyTorch job with NVIDIA CUDA image - It requires 2 cluster-nodes with 2 GPUs each
+    [Tags]  Kfto-MultiNodeMultiGpu
+    ...     Training
+    Run Training Operator KFTO Test    TestPyTorchJobMnistMultiNodeMultiGpuWithCuda    ${CUDA_TRAINING_IMAGE}
+
+Run Training operator KFTO_MNIST multi-node multi-gpu test with AMD ROCm image
+    [Documentation]    Run Go KFTO_MNIST multi-node multi-gpu test for Training operator using PyTorch job with AMD ROCm image  - It requires 2 cluster-nodes with 2 GPUs each
+    [Tags]  Kfto-MultiNodeMultiGpu
+    ...     Training
+    Run Training Operator KFTO Test    TestPyTorchJobMnistMultiNodeMultiGpuWithROCm    ${ROCM_TRAINING_IMAGE}