Hi,
Go deeper basically means add more layers. But in order to do it in a smart way you can have a look at this article:

  
      
      Medium – 16 Nov 17
  
  
    

CNN Architectures: LeNet, AlexNet, VGG, GoogLeNet, ResNet and more …. 285

A Convolutional Neural Network (CNN, or ConvNet) are a special kind of multi-layer neural networks, designed to recognize visual patterns…

  Reading time: 5 min read
    

  
  
    
    
  
  


Where are listed the state of the art CNN architectures for ImageNet over the years. Maybe you can learn from that evolution over the years and design something adapted to your problem later. But anyway increasing the amount of layers or the amount of filters per layer increase the amount of parameters of your model so, at first, should improve the performances of your classifier.