mowolf:

I assume you then have a layer with two outputs that classify your image? I think your resnet output does not need to match locally to the regions of your image.


The classifier is made as follow:
resnet.fc = nn.Sequential(
             nn.Linear(resnet.fc.in_features, 512),
             nn.ReLU(),
             nn.Dropout(p=0.5),
             nn.Linear(512, 2)
        )

I have a lot of synthetic images with more view angles and bolts position. I cannot generate more but I ha lots of data to play with. The only problem is that maybe it is difficult to retrieve images with the exactly same background with and without bolts.
Right now I’m proceeding by little steps. Adding some similar images at time and see if something happens. Consider that I trained the model with a training set composed by 250 images and a validation set of 150 images.



 mowolf:

Also are both classes equaly distributed in your training and validation data?


Do you mean in relation to the dataset or to the specific batch?