It sounds like what you want is Data Parallelism. Where you have the model replicated on each GPU and they each work on different data. This works if you can do a batch size > 1 on a single one of your GPUs.
NVLINK provides a faster interconnect compared to PCIe. This allows faster GPU<>GPU communication for either data or model parallelism.