Answers.Body: <p>Have you looked at <a href="https://arxiv.org/abs/2010.04159" rel="nofollow noreferrer">Deformable DETR</a>? These Transformer models are extremely good at detecting big objects because of the Global Attention mechanism.</p>
  
Answers.ContentLicense: CC BY-SA 4.0
Answers.CreationDate: 2023-02-16T07:27:27.063Z
Answers.Text: Thanks, I will have a look later to see if this could improve my results
Answers.UserDisplayName: Julian
Answers.ContentLicense: CC BY-SA 4.0
Answers.CreationDate: 2023-02-16T03:51:29.277Z
Answers.LastActivityDate: 2023-02-16T03:51:29.277Z
Answers.UserDisplayName: Minh-Long Luu
Body: <p>I have a document digitalization task where I want to detect technical drawings from images. These Images mostly consist of objects made up of combination of shapes like lines, circles and rectangles. See this example: <a href="https://i.sstatic.net/lWeMr.png" rel="nofollow noreferrer"><img src="https://i.sstatic.net/lWeMr.png" alt="Example Drawing" /></a>.</p>
  <p>What I want as the result is a detection of all &quot;objects&quot; in this image like e.g. switches, wirings and devices that are present.</p>
  <p>I already tried multiple network architectures like:</p>
  <ul>
  <li>YOLO</li>
  <li>DeepLab</li>
  <li>UNet (for Pixel based classification)</li>
  </ul>
  <p>Generally I observe that all these approaches work well for small objects but have big problems with &quot;bigger&quot; objects due to their &quot;sparsity&quot;. I guess thats not surprising if you consider the nature of CNNs.</p>
  <p>One one hand my task seems simple due to things like</p>
  <ul>
  <li>high contrast</li>
  <li>limited set of shapes (or &quot;poses&quot;) for the different objects</li>
  </ul>
  <p>But I think CNNs all have problems with the &quot;sparseness&quot; of the objects as its only the boundary that is detectable and the inner is often empty.</p>
  <p>Has anyone here an Idea which architectures to try or links to papers to read for these kinds of problems?
  Ideally I would like to get the list of objects as output but I am unsure how to encode this in the NN as e.g. YOLO does this by an approach that would not work in my scenario, I think (merging all &quot;inner&quot; boxes that show the same object).</p>
  <p>Thanks already!</p>
  
Tags: <neural-networks><convolutional-neural-networks><object-detection><object-recognition><yolo>
Title: NN Architecture for the detection of "sparse" Objects
UserDisplayName: Julian
ThreadText: # NN Architecture for the detection of "sparse" Objects
  
  (Asked by: username_0 on 2023-02-15)
  
  I have a document digitalization task where I want to detect technical drawings from images. These Images mostly consist of objects made up of combination of shapes like lines, circles and rectangles. See this example: [![Example Drawing](https://i.sstatic.net/lWeMr.png)](https://i.sstatic.net/lWeMr.png).
  
  What I want as the result is a detection of all "objects" in this image like e.g. switches, wirings and devices that are present.
  
  I already tried multiple network architectures like:
  
  * YOLO
  * DeepLab
  * UNet (for Pixel based classification)
  
  Generally I observe that all these approaches work well for small objects but have big problems with "bigger" objects due to their "sparsity". I guess thats not surprising if you consider the nature of CNNs.
  
  One one hand my task seems simple due to things like
  
  * high contrast
  * limited set of shapes (or "poses") for the different objects
  
  But I think CNNs all have problems with the "sparseness" of the objects as its only the boundary that is detectable and the inner is often empty.
  
  Has anyone here an Idea which architectures to try or links to papers to read for these kinds of problems?
  Ideally I would like to get the list of objects as output but I am unsure how to encode this in the NN as e.g. YOLO does this by an approach that would not work in my scenario, I think (merging all "inner" boxes that show the same object).
  
  Thanks already!
  
  **Tags:** neural-networks, convolutional-neural-networks, object-detection, object-recognition, yolo
  
  
  ---
  
  ## 1 answers
  
  ### Answer by username_1 on 2023-02-16. Score: 0
  
  Have you looked at [Deformable DETR](https://arxiv.org/abs/2010.04159)? These Transformer models are extremely good at detecting big objects because of the Global Attention mechanism.
  
  > **Comments:**
  > **username_0**: Thanks, I will have a look later to see if this could improve my results  
  
  ---
  
  