Hi,
Yes is mainly focussed on improving multimachine via DistributedDataParallel.
All the relevant improvements have also been added to the DataParallel module.
So multi-gpu (split on data) should still be done with DataParallel on the same machine !