Play around with hyperparameters. (learning rate, weight decay, optimizers (SGD with momentum, Adam, RMSProp), number of channels in layers etc)
For example, if you change the learning rate to 0.001, the error starts reducing.