Home

SystemFabricWorks/fio adds support for GPUDirect Storage to fio via the new libcufile I/O engine.

The libcufile I/O engine uses the GPUDirect Storage (GDS) cuFile API to perform I/O directly against GPU buffers via nvidia-fs and a GDS-supported filesystem.

Prerequisites

GPUDirect Storage (GDS) is obtained from here: https://developer.nvidia.com/gpudirect-storage

GDS requires a Tesla or better GPU, x86_64 CPU, Ubuntu OS 18 or 20, MOFED 5.1 and Mellanox HCA >= ConnectX-5.

Configuration

As of GPUDirect Storage 0.9.0, the configure invocation is:

$ CFLAGS="-I/usr/local/cuda/include -I/usr/local/cuda/lib64" LDFLAGS="-L/usr/local/cuda/lib64" ./configure --enable-libcufile

Usage

Refer to HOWTO and fio.1. Example job configurations are examples/libcufile-cufile and examples/libcufile-posix.