You do have several GPUs to make this worthwile, right?
Given the asynchronous nature of of GPU computation, you can just move one network and inputs to the second GPU. Then it will be queued serially, but executed in parallel. Just be sure to not introduce sync points.
Or you could look at the multiprocessing best practices 3 for advice.
Best regards
Thomas