Unable to import torch.distributed.HashStore

windows
1 
import torch
import torch.distributed as dist

print("Is dist available: ", dist.is_available())
print("Pytorch version: ", torch.__version__)

store = dist.HashStore()
# store can be used from other threads
# Use any of the store methods after initialization
store.set("first_key", "first_value")

Output

Is dist available:  True
Pytorch version:  2.4.1+cu124
---------------------------------------------------------------------------
AttributeError                            Traceback (most recent call last)
Cell In[12], line 7
      4 print("Is dist available: ", dist.is_available())
      5 print("Pytorch version: ", torch.__version__)
----> 7 store = dist.HashStore()
      8 # store can be used from other threads
      9 # Use any of the store methods after initialization
     10 store.set("first_key", "first_value")

AttributeError: module 'torch.distributed' has no attribute 'HashStore'
2

Looks like HashStore doesnt support windows

    if sys.platform != "win32":
        from torch._C._distributed_c10d import (
            HashStore,
            _round_robin_process_groups,
        )

RIP