Yep, DistributedDataParallel (DDP) can utilize multiple GPUs on the same node, but it works differently than DataParallel (DP). DDP uses multiple processes, one process per GPU, while DP is single-process multi-thread.
See this page for the comparison between the two: https://pytorch.org/tutorials/beginner/dist_overview.html#data-parallel-training 131
and this to get started with DDP: https://pytorch.org/docs/stable/notes/ddp.html 174