Please be more specific about where you want to add more layers. In general, you need to modify and add more layers in the init method of a class, and do not forget to use those layers in the forward method of the same class.