The network is too simple.
Try some complex and successful networks such as vgg and resnet.
Or make your network deeper.
And larger epochs(e,g epochs:100) must should be taken.
Actually, there are lots of things you can do to improve accuracy.