Thanks for the reply.
Yes I’ve thought of this and I’ve tried adding dropout layers set to drop even 50% of neurons, still no much improvement
The dropout layers just prevent the training process from converging faster than usual
I’ll check out the other regularization means