That seems like a special case of hyperparameter tuning, just instead of playing around with learning rates etc. you are adjusting layers.  I’ve used tune 1 and it should be able to do what you are looking to do, you would just need to fill out the config to whatever parameters you want to search over (in your case the layer information that you want to play around with) and then you can do a grid search over those.  You can then use those values in your network instantiation.
For something more advanced than a plain grid search especially if there are computation constraints you can use something like hyperopt 1 with tune which should be better than a blind grid search.