I removed the background from the mammography images and start training again.
Here 1 you can find the results after 20 epochs. I just updated logs.txt too. Unfortunately, nothing has changed, results on the test set are very bad.