If you are removing the conv layers in the ResNet implementation, I guess you would like to create a fully connected model with some skip connections?
If so, you could have a look at the current implementation of BasicBlock 73 and BottleNeck 22 and try to adapt these modules to your code.