Hi Ranahanocka,
Thanks for your reply.
I actually read that thread on github before asking that question, so My first question was asked just to confirm that I understand everything right.
Main question is second one, which could be reasked that way

What is profit of using multiGPU if we can emulate same(or even better) training process with single GPU?
Only training speed?