Not able to include cusolverDn.h

Yes, the THC namespace is dead as described in this topic so you would need to update your code to use the new ATen API.