Solved by Ivan_A in post #11 
              
              
                1-The model started to increase the accuracy with increasing the  batch_size = 32. 
2-It is necessary to be careful with the use of the GPU, when it is not running, it is necessary to disconnect from the GPU, to avoid this type of limitation. 
3-The model is ResNet152(pretrained=True).