Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[BUG]: UniversalPackages@0 upload fails with misleading error message #20803

Open
4 of 7 tasks
sheetalarkadam opened this issue Jan 22, 2025 · 0 comments
Open
4 of 7 tasks

Comments

@sheetalarkadam
Copy link

New issue checklist

Task name

UniversalPackages

Task version

0.248.1

Issue Description

Intermittent failure in universalPackages upload task and the logs show the the issue is with the name but a rerun with the same name solves the issue. The task is part of a daily pipeline, so the package name length and characters are fixed. I added a verbose log to get more clues but did not find anything useful.
package name : torch_sccl_pip_2.7.0.dev20250117_py3.10_cu124

Environment type (Please select at least one enviroment where you face this issue)

  • Self-Hosted
  • Microsoft Hosted
  • VMSS Pool
  • Container

Azure DevOps Server type

dev.azure.com (formerly visualstudio.com)

Azure DevOps Server Version (if applicable)

No response

Operation system

Ubuntu 20.04

Relevant log output

{"@t":"2025-01-17T16:41:32.3297354Z","@m":"The package name provided is invalid. Universal package names must be one or more lowercase alphanumeric segments separated by a dash, dot or underscore. The package name must be under 256 characters.","@i":"69c271d4","@l":"Error","SourceContext":"ArtifactTool.Program","UtcTimestamp":"2025-01-17 16:41:32.329Z"}

##[error]Error: An unexpected error occurred while trying to push the package. Exit code(20) and error({"@t":"2025-01-17T16:41:06.2214302Z","@m":"ApplicationInsightsTelemetrySender will correlate events with X-TFS-Session 901da1a1-06be-48e8-8fa4-6ffddd392ed6","@i":"e48699c7","SourceContext":"ArtifactTool.Commands.UPackPublishCommand","UtcTimestamp":"2025-01-17 16:41:06.221Z"}

Full task logs with system.debug enabled

{"@t":"2025-01-17T16:41:31.6197508Z","@m":"Uploading 1 files from directory /mnt/vss/_work/1/s/builder/conda/package.","@i":"1653465c","SourceContext":"ArtifactTool.Commands.UPackPublishCommand","UtcTimestamp":"2025-01-17 16:41:31.619Z"}
{"@t":"2025-01-17T16:41:31.6198312Z","@m":"Uploaded 1,471,793,662 out of 2,901,106,550 bytes.","@i":"225234f8","SourceContext":"ArtifactTool.Commands.UPackPublishCommand","UtcTimestamp":"2025-01-17 16:41:31.619Z"}
{"@t":"2025-01-17T16:41:31.9057628Z","@m":"Uploaded 1,471,793,894 out of 2,901,106,782 bytes","@i":"7445f143","SourceContext":"ArtifactTool.Commands.UPackPublishCommand","UtcTimestamp":"2025-01-17 16:41:31.905Z"}
{"@t":"2025-01-17T16:41:31.9058371Z","@m":"Content upload is done!","@i":"3fa1b25b","SourceContext":"ArtifactTool.Commands.UPackPublishCommand","UtcTimestamp":"2025-01-17 16:41:31.905Z"}
{"@t":"2025-01-17T16:41:31.9071565Z","@m":"\nContent upload statistics:\nTotal Content: 5,802.2 MB\nPhysical Content Uploaded: 1,470.2 MB\nLogical Content Uploaded: 1,471.8 MB\nCompression Saved: 1.6 MB\nDeduplication Saved: 4,330.4 MB\nNumber of Chunks Uploaded: 18,990\nTotal Number of Chunks: 149,610\n","@i":"53cd626a","SourceContext":"ArtifactTool.Commands.UPackPublishCommand","UtcTimestamp":"2025-01-17 16:41:31.907Z"}
{"@t":"2025-01-17T16:41:31.9202003Z","@m":"Content pushed","@i":"a2f90a5e","SourceContext":"ArtifactTool.Commands.UPackPublishCommand","UtcTimestamp":"2025-01-17 16:41:31.920Z"}
{"@t":"2025-01-17T16:41:31.9203594Z","@m":"Manifest ID: 4A5A33B0AF21156317991D829139FB76F8CA1DA7F04BED3EFD41ECAB876F22B501 SuperRoot ID: E490166A295338CD6AB962FCAE68EA6BC6989C736F6EAEB8E081775CB1ADA43602","@i":"b0923088","@l":"Debug","SourceContext":"ArtifactTool.Commands.UPackPublishCommand","UtcTimestamp":"2025-01-17 16:41:31.920Z"}
{"@t":"2025-01-17T16:41:31.9204818Z","@m":"Proof nodes: System.Linq.Enumerable+SelectEnumerableIterator2[BuildXL.Cache.ContentStore.Hashing.DedupNode,System.String]","@i":"072f9eaa","@l":"Debug","SourceContext":"ArtifactTool.Commands.UPackPublishCommand","UtcTimestamp":"2025-01-17 16:41:31.920Z"} {"@t":"2025-01-17T16:41:31.9218906Z","@m":"Adding package...","@i":"183e7e34","SourceContext":"ArtifactTool.Commands.UPackPublishCommand","UtcTimestamp":"2025-01-17 16:41:31.921Z"} {"@t":"2025-01-17T16:41:32.3288963Z","@m":"ApplicationInsightsTelemetrySender correlated 1 events with X-TFS-Session 901da1a1-06be-48e8-8fa4-6ffddd392ed6","@i":"c1c608bd","SourceContext":"ArtifactTool.Commands.UPackPublishCommand","UtcTimestamp":"2025-01-17 16:41:32.328Z"} {"@t":"2025-01-17T16:41:32.3297354Z","@m":"The package name provided is invalid. Universal package names must be one or more lowercase alphanumeric segments separated by a dash, dot or underscore. The package name must be under 256 characters.","@i":"69c271d4","@l":"Error","SourceContext":"ArtifactTool.Program","UtcTimestamp":"2025-01-17 16:41:32.329Z"} ##[error]Error: An unexpected error occurred while trying to push the package. Exit code(20) and error({"@t":"2025-01-17T16:41:06.2214302Z","@m":"ApplicationInsightsTelemetrySender will correlate events with X-TFS-Session 901da1a1-06be-48e8-8fa4-6ffddd392ed6","@i":"e48699c7","SourceContext":"ArtifactTool.Commands.UPackPublishCommand","UtcTimestamp":"2025-01-17 16:41:06.221Z"} {"@t":"2025-01-17T16:41:06.4615146Z","@m":"Ensuring that the package does not yet exist...","@i":"40e01e14","SourceContext":"ArtifactTool.Commands.UPackPublishCommand","UtcTimestamp":"2025-01-17 16:41:06.461Z"} {"@t":"2025-01-17T16:41:06.5947480Z","@m":"Package does not yet exist","@i":"c781eca5","SourceContext":"ArtifactTool.Commands.UPackPublishCommand","UtcTimestamp":"2025-01-17 16:41:06.594Z"} {"@t":"2025-01-17T16:41:06.5958823Z","@m":"Pushing content...","@i":"3aa40378","SourceContext":"ArtifactTool.Commands.UPackPublishCommand","UtcTimestamp":"2025-01-17 16:41:06.595Z"} {"@t":"2025-01-17T16:41:06.6103972Z","@m":"DedupManifestArtifactClient will correlate http requests with X-TFS-Session 901da1a1-06be-48e8-8fa4-6ffddd392ed6","@i":"946a896d","SourceContext":"ArtifactTool.Commands.UPackPublishCommand","UtcTimestamp":"2025-01-17 16:41:06.610Z"} {"@t":"2025-01-17T16:41:18.5471987Z","@m":"1 files processed.","@i":"6ecf0030","SourceContext":"ArtifactTool.Commands.UPackPublishCommand","UtcTimestamp":"2025-01-17 16:41:18.547Z"} {"@t":"2025-01-17T16:41:18.5482351Z","@m":"Processed 1 files from /mnt/vss/_work/1/s/builder/conda/package successfully.","@i":"0a5e2700","SourceContext":"ArtifactTool.Commands.UPackPublishCommand","UtcTimestamp":"2025-01-17 16:41:18.548Z"} {"@t":"2025-01-17T16:41:21.6177840Z","@m":"Uploading 1 files from directory /mnt/vss/_work/1/s/builder/conda/package.","@i":"1653465c","SourceContext":"ArtifactTool.Commands.UPackPublishCommand","UtcTimestamp":"2025-01-17 16:41:21.617Z"} {"@t":"2025-01-17T16:41:21.6180525Z","@m":"Uploaded 2,727,142 out of 2,901,106,550 bytes.","@i":"d2fc4342","SourceContext":"ArtifactTool.Commands.UPackPublishCommand","UtcTimestamp":"2025-01-17 16:41:21.618Z"} {"@t":"2025-01-17T16:41:26.6193616Z","@m":"Uploading 1 files from directory /mnt/vss/_work/1/s/builder/conda/package.","@i":"1653465c","SourceContext":"ArtifactTool.Commands.UPackPublishCommand","UtcTimestamp":"2025-01-17 16:41:26.619Z"} {"@t":"2025-01-17T16:41:26.6194889Z","@m":"Uploaded 953,645,529 out of 2,901,106,550 bytes.","@i":"bca14617","SourceContext":"ArtifactTool.Commands.UPackPublishCommand","UtcTimestamp":"2025-01-17 16:41:26.619Z"} {"@t":"2025-01-17T16:41:31.6197508Z","@m":"Uploading 1 files from directory /mnt/vss/_work/1/s/builder/conda/package.","@i":"1653465c","SourceContext":"ArtifactTool.Commands.UPackPublishCommand","UtcTimestamp":"2025-01-17 16:41:31.619Z"} {"@t":"2025-01-17T16:41:31.6198312Z","@m":"Uploaded 1,471,793,662 out of 2,901,106,550 bytes.","@i":"225234f8","SourceContext":"ArtifactTool.Commands.UPackPublishCommand","UtcTimestamp":"2025-01-17 16:41:31.619Z"} {"@t":"2025-01-17T16:41:31.9057628Z","@m":"Uploaded 1,471,793,894 out of 2,901,106,782 bytes","@i":"7445f143","SourceContext":"ArtifactTool.Commands.UPackPublishCommand","UtcTimestamp":"2025-01-17 16:41:31.905Z"} {"@t":"2025-01-17T16:41:31.9058371Z","@m":"Content upload is done!","@i":"3fa1b25b","SourceContext":"ArtifactTool.Commands.UPackPublishCommand","UtcTimestamp":"2025-01-17 16:41:31.905Z"} {"@t":"2025-01-17T16:41:31.9071565Z","@m":"\nContent upload statistics:\nTotal Content: 5,802.2 MB\nPhysical Content Uploaded: 1,470.2 MB\nLogical Content Uploaded: 1,471.8 MB\nCompression Saved: 1.6 MB\nDeduplication Saved: 4,330.4 MB\nNumber of Chunks Uploaded: 18,990\nTotal Number of Chunks: 149,610\n","@i":"53cd626a","SourceContext":"ArtifactTool.Commands.UPackPublishCommand","UtcTimestamp":"2025-01-17 16:41:31.907Z"} {"@t":"2025-01-17T16:41:31.9202003Z","@m":"Content pushed","@i":"a2f90a5e","SourceContext":"ArtifactTool.Commands.UPackPublishCommand","UtcTimestamp":"2025-01-17 16:41:31.920Z"} {"@t":"2025-01-17T16:41:31.9203594Z","@m":"Manifest ID: 4A5A33B0AF21156317991D829139FB76F8CA1DA7F04BED3EFD41ECAB876F22B501 SuperRoot ID: E490166A295338CD6AB962FCAE68EA6BC6989C736F6EAEB8E081775CB1ADA43602","@i":"b0923088","@l":"Debug","SourceContext":"ArtifactTool.Commands.UPackPublishCommand","UtcTimestamp":"2025-01-17 16:41:31.920Z"} {"@t":"2025-01-17T16:41:31.9204818Z","@m":"Proof nodes: System.Linq.Enumerable+SelectEnumerableIterator2[BuildXL.Cache.ContentStore.Hashing.DedupNode,System.String]","@i":"072f9eaa","@l":"Debug","SourceContext":"ArtifactTool.Commands.UPackPublishCommand","UtcTimestamp":"2025-01-17 16:41:31.920Z"}
{"@t":"2025-01-17T16:41:31.9218906Z","@m":"Adding package...","@i":"183e7e34","SourceContext":"ArtifactTool.Commands.UPackPublishCommand","UtcTimestamp":"2025-01-17 16:41:31.921Z"}
{"@t":"2025-01-17T16:41:32.3288963Z","@m":"ApplicationInsightsTelemetrySender correlated 1 events with X-TFS-Session 901da1a1-06be-48e8-8fa4-6ffddd392ed6","@i":"c1c608bd","SourceContext":"ArtifactTool.Commands.UPackPublishCommand","UtcTimestamp":"2025-01-17 16:41:32.328Z"}
{"@t":"2025-01-17T16:41:32.3297354Z","@m":"The package name provided is invalid. Universal package names must be one or more lowercase alphanumeric segments separated by a dash, dot or underscore. The package name must be under 256 characters.","@i":"69c271d4","@l":"Error","SourceContext":"ArtifactTool.Program","UtcTimestamp":"2025-01-17 16:41:32.329Z"})
##[error]Packages failed to publish
Finishing: Upload PyTorch SCCL package into azure artifacts

Repro steps

- task: UniversalPackages@0
    displayName: 'Upload PyTorch SCCL package into azure artifacts'
    inputs:
      command: 'publish'
      publishDirectory: '$(System.DefaultWorkingDirectory)/builder/conda/package'
      feedsToUsePublish: 'internal'
      vstsFeedPublish: $(ANY_FEED)
      vstsFeedPackagePublish: 'torch_sccl_pip_2.7.0.dev20250117_py3.10_cu124'
      packagePublishDescription: 'Pytorch package with SCCL integrated'
      vstsPackageVersion: $(TORCH_PACKAGE_VERSION)
      verbosity: Debug
    continueOnError: true
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

1 participant