I have a very specific problem in which I have to use large images (resolution 2k x 3k) and relatively large batches (16-32), I’m totally CPU bottlenecked (it’s either transfer to GPU or image loading)
Images are stored in uint8 PNG format, I’m thinking about converting them to JPEG and use NVIDIA DALI library for loading/decoding using GPU, in my past it gave good speed-ups, however this library is so clumsy, is there an easier solution? I want fully utilize my GPU, it’s mostly idle now
Machine specs:
Ryzen 9 5950x (16 cores, multithreading)
128Gb RAM
NVME m2 SSD
4090 gpu