Depending on the use case you could create some image features using classical image processing (e.g. HOG features) and create a small random forest classifier. You could of course add augmentation, if that helps, but you would need to split the data to get some signal for validation.