(probably too late to be useful…)
Is the GPU being used for all of the sections?  (Maybe your researcher only put the middle section on GPU.)
Does the run-model step actually train and update the model, or does it just calculate answers for the data you entered?