I would like to ask if it is possible to do something I have in my mind. I have cifar10 dataset, say (x:images,y:labels). I use an encoder for x, which last layer is a Conv2d(1024, 1024, kernel_size=(1, 1), stride=(1, 1), bias=False) and batchnorm. Can I use the new x from the encoder and original y, to run for example a resnet50 model for classification. How should I modify the first layers of resnet ? I would be very grateful, is someone explain me the process or even how to search for this, for example if there is a keyword that I should look for.
Thanks !