Why does my GPU memory usage always stay at 2064MB?

[Kaye-Sum]

I've noticed that regardless of the batch size I set or the changes I make, the memory usage on my GPU stays fixed at 2064MB. I use a 4090. It couldn't be a GPU limitation. Could this be due to a specific setting or limitation in the model or framework I'm using? Any insights would be appreciated!