Augmentation helps but it’s not magic.
I would count the parameters and try with a smaller network. But still, try to measure the performance with any other mertric than the loss. All the networks (moreover the 3D CNN ones) may overfit.