Solved by Hmrishav_Bandyopadhy in post #4 
              
              
                Does the problem persist in both training and testing accuracy? 
I do notice you have made a typo in 

That might be the case?