Failed to initialize process group: Error initializing torch.distributed using env:// rendezvous: environment variable RANK expected, but not set, falling back to single GPU

[ibrahim737701]

Even after adding environment variables like:-

os.environ['RANK'] = '0'
os.environ['WORLD_SIZE'] = '4'
os.environ['MASTER_ADDR'] = 'localhost'
os.environ['MASTER_PORT'] = '12345'

the mode itself is not loading.

[lmxyy]

Seems to be some PyTorch environment issues. What PyTorch version are you using?