First you have to calculate it’s model space(sum of input size, forward and backward size, params size ) The you have to change the input size or batch size to see if your model space fits your gpu or not(<12 gb for your case). If it fits then it’s good to go. You can use torchsummary package to calculate the model size.