How to check torch gpu compatibility without initializing CUDA?

It seems like you are correct assuming:

Since the answer here might not be very torch-related and instead implicate usage of e.g. nvidia specific tools

According to this comment there is a relationship between the CUDA version and the deprecated compute capabilities you won’t be able to use. You can check the CUDA 10.2 Toolkit Docs where it says which compute capabilities are deprecated.