From 34ffc39141652ea529b449eccda83d9c76dc1b63 Mon Sep 17 00:00:00 2001 From: Wladislav Radchenko <56233697+wladradchenko@users.noreply.github.com> Date: Mon, 4 Nov 2024 23:26:50 +0300 Subject: [PATCH] Updated How to use the GPU in the application (markdown) --- How-to-use-the-GPU-in-the-application.md | 10 +++++++++- 1 file changed, 9 insertions(+), 1 deletion(-) diff --git a/How-to-use-the-GPU-in-the-application.md b/How-to-use-the-GPU-in-the-application.md index e25eb70..f9df528 100644 --- a/How-to-use-the-GPU-in-the-application.md +++ b/How-to-use-the-GPU-in-the-application.md @@ -149,4 +149,12 @@ The Ubuntu application is naturally compatible with GPU libraries. Open the appl #### macOS -Due to the lack of driver support on macOS, you are limited to using the CPU. However, you can modify the application for use with OpenCL alternatives. \ No newline at end of file +Due to the lack of driver support on macOS, you are limited to using the CPU. However, you can modify the application for use with OpenCL alternatives. + +#### Additional + +For last versions CUDA12.x, cuDNN9.x, xformers, torch, torchaudio and torchvision, you can install flash-attn to improve performance. + +``` +MAX_JOBS=4 pip install flash-attn +``` \ No newline at end of file