I played around with different settings today. In the end, the CNN learns stable with a momentum of 0.7 and reaches the “target” accuracy in 15 instead of 20 epochs. This is perfectly within the bounds for me, so I’ll leave it at that for now. Thanks again for your help!