Updated How to use the GPU in the application (markdown)

aibolem · Nov 4, 2024 · 34ffc39 · 34ffc39
1 parent dd63f54
commit 34ffc39
Showing 1 changed file with 9 additions and 1 deletion.
diff --git a/How-to-use-the-GPU-in-the-application.md b/How-to-use-the-GPU-in-the-application.md
@@ -149,4 +149,12 @@ The Ubuntu application is naturally compatible with GPU libraries. Open the appl
 
 #### macOS
 
-Due to the lack of driver support on macOS, you are limited to using the CPU. However, you can modify the application for use with OpenCL alternatives.
+Due to the lack of driver support on macOS, you are limited to using the CPU. However, you can modify the application for use with OpenCL alternatives.
+
+#### Additional
+
+For last versions CUDA12.x, cuDNN9.x, xformers, torch, torchaudio and torchvision, you can install flash-attn to improve performance.
+
+```
+MAX_JOBS=4 pip install flash-attn
+```