It seems like cuDNN is provided by the cog utility provided by Replicate. I just found out that they had issue with that in the past → RuntimeError: cuDNN version incompatibility · Issue #815 · replicate/cog · GitHub
I don’t really know how I could install a different version of cuDNN since it seems to be part of the base image they provide but I’ll look into it. At least this gives me a good clue to follow. Thanks!