For torch>=2.0.1
, use torch.distributed.run
:
{
"name": "train",
"type": "debugpy",
"request": "launch",
"module": "torch.distributed.run",
"args": [
"--nnodes=1",
"--nproc_per_node=8",
"train.py"
],
"console": "integratedTerminal"
}