~NGC release testing

~NGC release testing #177

Sign in to view logs

Manually triggered January 15, 2025 00:51

nvjax

25.01-devel

Status Failure

Total duration 8h 3m 14s

Artifacts 27

ngc-release-testing.yaml

on: workflow_dispatch

Matrix: test-maxtext / maxtext-multinode

Matrix: test-maxtext / single-process-multi-device

Matrix: test-jax / run-unit-test

Matrix: test-rosetta-pax / rosetta-pax-multi-node-te

Matrix: test-rosetta-pax / rosetta-pax-multi-node

Matrix: test-rosetta-pax / rosetta-pax-single-node-dropout-te

Matrix: test-rosetta-pax / single-process-evaluation-te

Matrix: test-rosetta-pax / single-process-multi-device-te

test-jax / ... / launch-slurm-runner

test-nccl / ... / build-mpi-operator-compatible-base

test-maxtext / test-maxtext-summary

test-maxtext / test-maxtext-metrics

test-rosetta-pax / test-pax-rosetta-summary

test-rosetta-pax / test-pax-rosetta-metrics

Matrix: test-nccl / nccl-test

test-maxtext / ... / sitrep

test-rosetta-pax / ... / sitrep

test-maxtext / test-maxtext-outcome

test-rosetta-pax / test-pax-rosetta-outcome

finalize / workflow-badge

finalize / report

finalize / upload-badge

finalize / publish-badge

Annotations

8 errors

test-rosetta-pax / rosetta-pax-multi-node (4, 2, 1, 2)

The job running on runner jumpbox-vc69x-h46xx has exceeded the maximum execution time of 360 minutes.

test-rosetta-pax / rosetta-pax-multi-node (4, 2, 1, 2)

The operation was canceled.

test-rosetta-pax / rosetta-pax-multi-node-te (16DP1FSDP1TP1PP_TE, 1, 16, 1, 1, 4)

The job running on runner jumpbox-vc69x-2rz9h has exceeded the maximum execution time of 360 minutes.

test-rosetta-pax / rosetta-pax-multi-node-te (16DP1FSDP1TP1PP_TE, 1, 16, 1, 1, 4)

The operation was canceled.

test-maxtext / maxtext-multinode (1, 4, 2, 2)

The job running on runner jumpbox-vc69x-w7tl6 has exceeded the maximum execution time of 360 minutes.

test-maxtext / maxtext-multinode (1, 4, 2, 2)

The operation was canceled.

test-maxtext / test-maxtext-outcome

Process completed with exit code 1.

test-rosetta-pax / test-pax-rosetta-outcome

Process completed with exit code 1.

Artifacts

Produced during runtime

Name	Size
artifact-final-report	2.03 KB
artifact-maxtext-test	653 Bytes
artifact-mpi-operator-compatible-base-build-amd64	639 Bytes
artifact-rosetta-pax-mgmn-test	724 Bytes
artifact-workflow-metadata	268 Bytes
jax-unit-test-A100	21.2 KB
jax-unit-test-V100	26.3 KB
rosetta-pax-12779237461-1DP1FSDP1TP1PP_TE	1.42 KB
rosetta-pax-12779237461-1DP2FSDP4TP1PP_single_process_TE	1.59 KB
rosetta-pax-12779237461-1DP8FSDP1TP1PP_TE	1.45 KB
rosetta-pax-12779237461-2DP1FSDP1TP4PP	1.42 KB
rosetta-pax-12779237461-4DP1FSDP2TP1PP	1.42 KB
rosetta-pax-12779237461-4DP1FSDP2TP1PP_TE	1.44 KB
rosetta-pax-12779237461-5B_fused_attn_0	1.43 KB
rosetta-pax-12779237461-5B_fused_attn_1	1.43 KB
rosetta-pax-12779237461-8DP1FSDP1TP1PP	1.41 KB
rosetta-pax-12779237461-8DP1FSDP1TP1PP_TE	1.45 KB
rosetta-pax-12779237461-8DP1FSDP1TP1PP_eval_TE	1.51 KB
rosetta-pax-12779237461-8DP1FSDP1TP1PP_single_process_TE	1.59 KB
rosetta-pax-12779237461-8DP_TE_dropout	1.46 KB
rosetta-pax-12779237461-LLaMA_eval_TE	1.42 KB
upstream-maxtext-12779237461-1DP1FSDP1TP1PP	876 Bytes
upstream-maxtext-12779237461-1DP1FSDP8TP1PP	900 Bytes
upstream-maxtext-12779237461-1DP2FSDP4TP1PP_single_process	936 Bytes
upstream-maxtext-12779237461-1DP4FSDP2TP1PP	905 Bytes
upstream-maxtext-12779237461-1DP8FSDP1TP1PP	906 Bytes
upstream-maxtext-12779237461-2DP2FSDP2TP1PP	899 Bytes