Solved by Ofri_Masad in post #2 
              
              
                Hi. 
The answer to your question is very complex. You are assuming that there is a layer which is the bottleneck of your model, but in fact many different factors can affect your training. here are just a few examples: 

Data - your dataset may hide a limit on the success of your model. if your data…