Solved by Debayon in post #4 
              
              
                I’m sorry, It wasn’t really “not terminating”. 
It was actually going through all the epochs. 
I was passing the “Validation_data” set to the train loader and so numbers were not making sense to me. 
Thank you for all the support. 
Since the problem was a mistake on my own side, should I keep the po…