Hi,
In general it is not I’m afraid.
But for versions that are very close, it might work 
Unfortunately, you won’t get a nice error message. So if you get weird cuda errors, this is most likely due to this mismatch.
Note that when you install cuda in conda, it installs a brand new cuda and won’t use your system wide one. So here you’re safe and you won’t get any issue.