You might be overfitting the training data using that many amount of layers, try smaller networks and increase progressively their capacity. Always check the gap between train and validation losses during training