@googlebot i have figured out a bug in my error metric function and hence it was showing higher error rate . the method seems to converge without any need of scheduling the learning rate . thanks a lot for your help