Answers.Body: <p>The task name is &quot;Image captioning&quot;. That is the keyword for paper searching. Dataset, evaluation methods, and the state-of-the-art are all aggregated on the forum: <a href="https://paperswithcode.com/task/image-captioning" rel="nofollow noreferrer">paperwithcode</a>.</p>
  
Answers.ContentLicense: CC BY-SA 4.0
Answers.CreationDate: 2022-07-12T13:30:35.520Z
Answers.Text: Can I use these image caption generator models to generate multi captions from my image?
Answers.UserDisplayName: albert
Answers.ContentLicense: CC BY-SA 4.0
Answers.CreationDate: 2022-07-13T01:40:26.820Z
Answers.Text: I'm sorry, that's not my field. However, I think it's possible since we have multi-label classifying, the captioning could also return multiple outputs. Or you can just use two models (in some cases, it's work).
Answers.UserDisplayName: CuCaRot
Answers.ContentLicense: CC BY-SA 4.0
Answers.CreationDate: 2022-07-12T09:05:52.597Z
Answers.LastActivityDate: 2022-07-12T09:05:52.597Z
Answers.UserDisplayName: CuCaRot
Body: <p>I have experience with image classification models such as CNN and Vision Transformers but this time I want to try a new thing (For me).</p>
  <p>First please check the below image to understand what I want</p>
  <p><a href="https://i.sstatic.net/0SLJH.jpg" rel="nofollow noreferrer"><img src="https://i.sstatic.net/0SLJH.jpg" alt="enter image description here" /></a></p>
  <p>In this picture I want to feed an image along with it's label (which is a string) and then I want to predict same string from my model.</p>
  <p>In some cases there can be multiple strings with one image as we call multi class problem.</p>
  <p>First I want to know if it's possible? Second which state of art CNN/Transformer model will be good for this model, Third has anyone worked on this before?</p>
  
Comments.ContentLicense: CC BY-SA 4.0
Comments.CreationDate: 2022-07-10T13:44:47.073Z
Comments.Text: Can you please put your **main specific question** in the title? "Image classifier model which predicts string type labels" is not formulated as a question, so I would recommend you do that. Having said that, it seems that you want to predict one or more locations in the image and then you want to describe what is in those locations with more than one word, possibly. Is that correct?
Comments.UserDisplayName: nbro
Comments.ContentLicense: CC BY-SA 4.0
Comments.CreationDate: 2022-07-10T20:09:22.123Z
Comments.Text: Yes Sir, You truly understood my question. I want to predict information from specific locations which is the disease type and the surrounding information in an image.
Comments.UserDisplayName: albert
Comments.ContentLicense: CC BY-SA 4.0
Comments.CreationDate: 2022-07-10T20:11:38.043Z
Comments.Text: And as You said sometimes there can be multiple locations (2 or 3) in an image and the model should describe these locations with more than one word.
Comments.UserDisplayName: albert
Comments.ContentLicense: CC BY-SA 4.0
Comments.CreationDate: 2022-07-20T07:29:17.067Z
Comments.Text: @nbro Sir is it possible?  Is there any model developed before for this type of problem?
Comments.UserDisplayName: albert
Tags: <deep-learning><computer-vision><algorithm-request><model-request>
Title: Image classifier model which predicts objects and it's relevant areas with a combination of words
UserDisplayName: albert
ThreadText: # Image classifier model which predicts objects and it's relevant areas with a combination of words
  
  (Asked by: username_0 on 2022-07-09)
  
  I have experience with image classification models such as CNN and Vision Transformers but this time I want to try a new thing (For me).
  
  First please check the below image to understand what I want
  
  [![enter image description here](https://i.sstatic.net/0SLJH.jpg)](https://i.sstatic.net/0SLJH.jpg)
  
  In this picture I want to feed an image along with it's label (which is a string) and then I want to predict same string from my model.
  
  In some cases there can be multiple strings with one image as we call multi class problem.
  
  First I want to know if it's possible? Second which state of art CNN/Transformer model will be good for this model, Third has anyone worked on this before?
  
  **Tags:** deep-learning, computer-vision, algorithm-request, model-request
  > **Comments:**
  > **username_1**: Can you please put your **main specific question** in the title? "Image classifier model which predicts string type labels" is not formulated as a question, so I would recommend you do that. Having said that, it seems that you want to predict one or more locations in the image and then you want to describe what is in those locations with more than one word, possibly. Is that correct?  
  > **username_0**: Yes Sir, You truly understood my question. I want to predict information from specific locations which is the disease type and the surrounding information in an image.  
  > **username_0**: And as You said sometimes there can be multiple locations (2 or 3) in an image and the model should describe these locations with more than one word.  
  > **username_0**: @nbro Sir is it possible?  Is there any model developed before for this type of problem?  
  
  ---
  
  ## 1 answers
  
  ### Answer by username_2 on 2022-07-12. Score: 0 | Accepted answer
  
  The task name is "Image captioning". That is the keyword for paper searching. Dataset, evaluation methods, and the state-of-the-art are all aggregated on the forum: [paperwithcode](https://paperswithcode.com/task/image-captioning).
  
  > **Comments:**
  > **username_0**: Can I use these image caption generator models to generate multi captions from my image?  
  > **username_2**: I'm sorry, that's not my field. However, I think it's possible since we have multi-label classifying, the captioning could also return multiple outputs. Or you can just use two models (in some cases, it's work).  
  
  ---
  
  