This might be related to this issue.
I’m not sure, if there is a better way (torchvision-nightly?), but it seems if you would like to use the PyTorch nightly binaries, you should build torchvision from source (or use a stable PyTorch binary).
The mentioned package was maintained by @stas and, if I’m not mistaken, wasn’t updated anymore, so you would have to wait for the next official torchvision-nightly release or build from source.