Thanks for your link.
Does it seem that the speed issue is in depthwise_conv2d?
But I tried to build straight up and down model stack 50 layers, one with normal conv2d and another with depthwise_conv2d, and the depthone’s average inference time is a little lower than the normal one.
What about the first question mentioned above, should we pass real images or random_tensor to the network for speed testing.