As replied on the github issues, an easy way is:
next(model.parameters()).is_cuda # returns a boolean