I am afraid that I am not very useful to your problem, you seem to have tried a lot of things, and clearly I am out of my depth here. If you tried different architectures and the same problem persists, could it be possible that you cannot learn from your dataset? I wish you the best of lucks!