Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

🧪 Conda managed environment #10

Closed
wants to merge 5 commits into from
Closed

🧪 Conda managed environment #10

wants to merge 5 commits into from

Conversation

jacobwoffenden
Copy link
Member

@jacobwoffenden jacobwoffenden commented Aug 27, 2024

Caution

This code is experimental

This pull request:

  • Is an example of using Conda for managing Python environment

The output of example-project/src/opt/analytical-platform/run.py when running on a Codespace is

$ docker run -it --rm docker.io/library/example                 
2024-08-27 18:28:12.956191: E external/local_xla/xla/stream_executor/cuda/cuda_dnn.cc:9261] Unable to register cuDNN factory: Attempting to register factory for plugin cuDNN when one has already been registered
2024-08-27 18:28:12.957218: E external/local_xla/xla/stream_executor/cuda/cuda_fft.cc:607] Unable to register cuFFT factory: Attempting to register factory for plugin cuFFT when one has already been registered
2024-08-27 18:28:12.972548: E external/local_xla/xla/stream_executor/cuda/cuda_blas.cc:1515] Unable to register cuBLAS factory: Attempting to register factory for plugin cuBLAS when one has already been registered
2024-08-27 18:28:12.999092: I tensorflow/core/platform/cpu_feature_guard.cc:182] This TensorFlow binary is optimized to use available CPU instructions in performance-critical operations.
To enable the following instructions: AVX2 FMA, in other operations, rebuild TensorFlow with the appropriate compiler flags.
2024-08-27 18:28:13.876882: W tensorflow/compiler/tf2tensorrt/utils/py_utils.cc:38] TF-TRT Warning: Could not find TensorRT
Python version: 3.9.19 (main, May  6 2024, 19:43:03) 
[GCC 11.2.0]
TensorFlow devices: [PhysicalDevice(name='/physical_device:CPU:0', device_type='CPU')]

Running from GPU VS Code

$ python run.py 
2024-08-27 18:40:48.845358: E external/local_xla/xla/stream_executor/cuda/cuda_dnn.cc:9261] Unable to register cuDNN factory: Attempting to register factory for plugin cuDNN when one has already been registered
2024-08-27 18:40:48.845412: E external/local_xla/xla/stream_executor/cuda/cuda_fft.cc:607] Unable to register cuFFT factory: Attempting to register factory for plugin cuFFT when one has already been registered
2024-08-27 18:40:48.846594: E external/local_xla/xla/stream_executor/cuda/cuda_blas.cc:1515] Unable to register cuBLAS factory: Attempting to register factory for plugin cuBLAS when one has already been registered
2024-08-27 18:40:48.853077: I tensorflow/core/platform/cpu_feature_guard.cc:182] This TensorFlow binary is optimized to use available CPU instructions in performance-critical operations.
To enable the following instructions: AVX2 FMA, in other operations, rebuild TensorFlow with the appropriate compiler flags.
2024-08-27 18:40:49.563964: W tensorflow/compiler/tf2tensorrt/utils/py_utils.cc:38] TF-TRT Warning: Could not find TensorRT
Python version: 3.9.19 (main, May  6 2024, 19:43:03) 
[GCC 11.2.0]
2024-08-27 18:40:50.108816: I external/local_xla/xla/stream_executor/cuda/cuda_executor.cc:901] successful NUMA node read from SysFS had negative value (-1), but there must be at least one NUMA node, so returning NUMA node zero. See more at https://github.com/torvalds/linux/blob/v6.0/Documentation/ABI/testing/sysfs-bus-pci#L344-L355
2024-08-27 18:40:50.109516: W tensorflow/core/common_runtime/gpu/gpu_device.cc:2256] Cannot dlopen some GPU libraries. Please make sure the missing libraries mentioned above are installed properly if you would like to use GPU. Follow the guide at https://www.tensorflow.org/install/gpu for how to download and setup the required libraries for your platform.
Skipping registering GPU devices...
TensorFlow devices: [PhysicalDevice(name='/physical_device:CPU:0', device_type='CPU')]

Jacob Woffenden added 5 commits August 22, 2024 17:45
Add Miniconda
Signed-off-by: GitHub <noreply@github.com>
@jacobwoffenden jacobwoffenden requested a review from a team as a code owner August 27, 2024 18:31
@jacobwoffenden jacobwoffenden deleted the conda-example branch December 4, 2024 19:21
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant