Sounds logical, but note that you won’t gain any performance gains when your model is built in a sequential manner like in your example. The GPUs will have to wait for each other, since they cannot start working without the preceding data.
In that case, you might follow @voxmenthe 's suggestion of using DataParallel.