Answers.Body: <p>Most pre-trained ResNet are pretty capable of returning a rather informative feature representation, even without fine-tuning. This, surprisingly, seems to be the case also for image datasets that do not resemble ImageNet. For example, I've used the feature representation of ResNet18 (the most basic ResNet, if you will) of the MVTec dataset, and the representations were pretty impressive (in terms of how well they were classified later on in my pipeline).</p>
  <p>Of course, one can usually expect better results when finetuned to a specific problem, but I would start off with the representation vectors as is, and see how they perform.</p>
  
Answers.ContentLicense: CC BY-SA 4.0
Answers.CreationDate: 2022-12-15T07:20:07.213Z
Answers.LastActivityDate: 2022-12-15T07:20:07.213Z
Answers.UserDisplayName: Hadar Sharvit
Body: <p>I have a dataset with the following info</p>
  <p>Image1 x1 x2 x3 y</p>
  <p>Image2 x1 x2 x3 y
  ...</p>
  <p>Where x1, x2 &amp; x3 are categorical features. My goal is to extract features from the images and use those features combined with x1 x2 and x3 as an input to another model to classify y.</p>
  <p>My question is the following. Assuming I use a pre-trained resnet model, should I retrain the last layer using my images and y's to fit the resnet better to my problem or should I directly use the features extracted from the resnet as an input to my other model without retraining resnet?</p>
  
Tags: <convolutional-neural-networks><feature-extraction>
Title: How to use image feature extraction as input to another model?
UserDisplayName: Tibo Geysen
ThreadText: # How to use image feature extraction as input to another model?
  
  (Asked by: username_0 on 2022-12-15)
  
  I have a dataset with the following info
  
  Image1 x1 x2 x3 y
  
  Image2 x1 x2 x3 y
  ...
  
  Where x1, x2 & x3 are categorical features. My goal is to extract features from the images and use those features combined with x1 x2 and x3 as an input to another model to classify y.
  
  My question is the following. Assuming I use a pre-trained resnet model, should I retrain the last layer using my images and y's to fit the resnet better to my problem or should I directly use the features extracted from the resnet as an input to my other model without retraining resnet?
  
  **Tags:** convolutional-neural-networks, feature-extraction
  
  ---
  
  ## 1 answers
  
  ### Answer by username_1 on 2022-12-15. Score: 1
  
  Most pre-trained ResNet are pretty capable of returning a rather informative feature representation, even without fine-tuning. This, surprisingly, seems to be the case also for image datasets that do not resemble ImageNet. For example, I've used the feature representation of ResNet18 (the most basic ResNet, if you will) of the MVTec dataset, and the representations were pretty impressive (in terms of how well they were classified later on in my pipeline).
  
  Of course, one can usually expect better results when finetuned to a specific problem, but I would start off with the representation vectors as is, and see how they perform.
  
  
  ---
  
  