Answers.Body: <p>There is a good project you can research to find information on this specific task, it is Google <a href="https://quickdraw.withgoogle.com/data" rel="nofollow noreferrer">quickdraw</a>. It has 50 million drawings across 345 categories and it was used in Google autoDraw. AutoDraw guesses what you’re trying to draw.</p>
  
  <p>You can use quickdraw dataset to train a neural network (Sequence-to-Sequence Variational Autoencoder) in order to get draws from your Sketches. for more info on this read <a href="https://arxiv.org/pdf/1704.03477.pdf" rel="nofollow noreferrer">this papper</a></p>
  
  <p>Classified Sketches into categories is a difficult task because Sketches are a high-level representation that does not always convey enough information to distinguish between different categories.</p>
  
  <p>The the best approach will depend on your specific needs</p>
  
Answers.ContentLicense: CC BY-SA 3.0
Answers.CreationDate: 2017-07-13T06:49:41.260Z
Answers.Text: Hi Jony, Thanks for your response. I've a unique problem in image classification. I've updated my question with more information. In my case, I am trying to identify the product based on the user's hand art. So there is only one image for a product from which the ML agent can learn
Answers.UserDisplayName: codetiger
Answers.ContentLicense: CC BY-SA 3.0
Answers.CreationDate: 2017-07-13T16:00:47.757Z
Answers.Text: in that case, you are not going to get a good performance with natural photos classification algorithm, take a look at Sketch-a-Net [arXiv:1501.07873v3](https://arxiv.org/abs/1501.07873v3)  This architecture Beats Humans and can help with your problem.
Answers.UserDisplayName: Jony Raverta
Answers.ContentLicense: CC BY-SA 3.0
Answers.CreationDate: 2017-07-12T19:29:26.877Z
Answers.LastActivityDate: 2017-07-12T19:29:26.877Z
Answers.UserDisplayName: Jony Raverta
Body: <p>I am trying to build a ML Agent to find the closest matching image from a given set. The user will draw something and the agent should list the closest matching images. </p>
  
  <p>Very similar to these examples</p>
  
  <ol>
  <li><a href="https://sketchx.eecs.qmul.ac.uk/" rel="nofollow noreferrer">https://sketchx.eecs.qmul.ac.uk/</a></li>
  <li>Emoji search in Android keyboard</li>
  </ol>
  
  <p>One unique problem I've is, each image will represent a category. Imagine we have product images and user will draw something and we have to find the products close to the drawing. So category in my case will be product Id. </p>
  
  <p><a href="https://i.sstatic.net/hHwig.jpg" rel="nofollow noreferrer"><img src="https://i.sstatic.net/hHwig.jpg" alt="enter image description here"></a></p>
  
  <p>I would like to evaluate the approach before trying out. </p>
  
  <p>There are lot of examples to classify images, however if I use the item identifier instead of category it should work. But am trying to find the best approach for this problem. </p>
  
Tags: <machine-learning><deep-learning>
Title: Building ML to finding the closest matching image based on users drawing
UserDisplayName: codetiger
ThreadText: # Building ML to finding the closest matching image based on users drawing
  
  (Asked by: username_0 on 2017-07-10)
  
  I am trying to build a ML Agent to find the closest matching image from a given set. The user will draw something and the agent should list the closest matching images.
  
  Very similar to these examples
  
  1. <https://sketchx.eecs.qmul.ac.uk/>
  2. Emoji search in Android keyboard
  
  One unique problem I've is, each image will represent a category. Imagine we have product images and user will draw something and we have to find the products close to the drawing. So category in my case will be product Id.
  
  [![enter image description here](https://i.sstatic.net/hHwig.jpg)](https://i.sstatic.net/hHwig.jpg)
  
  I would like to evaluate the approach before trying out.
  
  There are lot of examples to classify images, however if I use the item identifier instead of category it should work. But am trying to find the best approach for this problem.
  
  **Tags:** machine-learning, deep-learning
  
  ---
  
  ## 1 answers
  
  ### Answer by username_1 on 2017-07-12. Score: 2 | Accepted answer
  
  There is a good project you can research to find information on this specific task, it is Google [quickdraw](https://quickdraw.withgoogle.com/data). It has 50 million drawings across 345 categories and it was used in Google autoDraw. AutoDraw guesses what you’re trying to draw.
  
  You can use quickdraw dataset to train a neural network (Sequence-to-Sequence Variational Autoencoder) in order to get draws from your Sketches. for more info on this read [this papper](https://arxiv.org/pdf/1704.03477.pdf)
  
  Classified Sketches into categories is a difficult task because Sketches are a high-level representation that does not always convey enough information to distinguish between different categories.
  
  The the best approach will depend on your specific needs
  
  > **Comments:**
  > **username_0**: Hi Jony, Thanks for your response. I've a unique problem in image classification. I've updated my question with more information. In my case, I am trying to identify the product based on the user's hand art. So there is only one image for a product from which the ML agent can learn  
  > **username_1**: in that case, you are not going to get a good performance with natural photos classification algorithm, take a look at Sketch-a-Net [arXiv:1501.07873v3](https://arxiv.org/abs/1501.07873v3)  This architecture Beats Humans and can help with your problem.  
  
  ---
  
  