I refer this paper 7, which performs the image registration. I’m trying to the convolution to each feature map using the estimated dynamic filters as

캡처.PNG738×376 23.2 KB

In this figure, N is the number of input images (in my case, input frames) and F is the number of feature maps to each input image.
Besides, I found the TensorFlow code released by the authors and I’m implementing the registration part 1 using Pytorch. In this code, they performed the convolution to the misaligned feature maps using tf.nn.depthwise_conv2d function (Since Tensorflow doesn’t have a function for the 3D depthwise convolution.)
Compared to the authors’ code, I’m not sure my approach is right or not.
Thank you.