I think that the computation required for the fully connected layers is so small, that the overhead of the parallelization makes it slower if you parallelize.
Parallelization is only usefull if you have heavily waiting for computations to be performed.