Hi,
What is the size of the input you give to your conv14? It looks like it has many channels.
Also remember that during a forward pass, not only the net needs to be on the GPU but many intermediary results needed to compute the gradients need to be kept around,
How much memory does the net uses on CPU?