Speed up depends on a lot of factors, including number of model parameters, data shape, and GPU bus interconnect latency.  For example, I get -10% (negative) speedup for MNIST models, and 100% speedup for more complex models.
50% sounds like you are leaving some performance on the table.  Try bigger models or bigger batch sizes and see if you can get better speed up.