Body: <p>I have a list of rectangles, they are in a certain order in 2D at the beginning. The task is to move them to get the boundary (rectangular) of the minimal area. It's OK to push off the dotted border as long as the area is minimal.</p>
  <p>The starting state may look similar to this (top view):</p>
  <p><a href="https://i.sstatic.net/ScJiK.png" rel="nofollow noreferrer"><img src="https://i.sstatic.net/ScJiK.png" alt="enter image description here" /></a></p>
  <p>Any reinforcement learning approaches to this problem? I'm thinking of some actions called 'rotate 90 degs', 'push east', 'push west', 'push south', 'push north', but these actions are still not clear how to be applied, which to push, how far to push.</p>
  <p>The 2D state can be mapped to a grid of zeros (free) and ones (occupied) to utilize conv2D layers. Before feeding to conv2D, all rectangle coords should be translated to make the (<span class="math-container">$x_{min}$</span>,<span class="math-container">$y_{min}$</span>) be at the origin.</p>
  
Comments.ContentLicense: CC BY-SA 4.0
Comments.CreationDate: 2021-04-14T08:09:35.337Z
Comments.Text: Why do you need to use reinforcement learning and CNNs specifically for this? This is the 2D stock cutting problem with rectangles, which can be solved using metaheuristics and an objective function (to minimise) that is proportional to the maximum height of the structure.
Comments.UserDisplayName: Mike NZ
Comments.ContentLicense: CC BY-SA 4.0
Comments.CreationDate: 2021-04-14T08:18:36.083Z
Comments.Text: i know it can be solved near perfect with regular algorithms, just wanna try RL for this problem
Comments.UserDisplayName: Dan D.
Tags: <machine-learning><reinforcement-learning><convolutional-neural-networks><ai-design><optimization>
Title: Any RL approaches for this 2D space optimization problem?
UserDisplayName: Dan D.
ThreadText: # Any RL approaches for this 2D space optimization problem?
  
  (Asked by: username_0 on 2021-04-14)
  
  I have a list of rectangles, they are in a certain order in 2D at the beginning. The task is to move them to get the boundary (rectangular) of the minimal area. It's OK to push off the dotted border as long as the area is minimal.
  
  The starting state may look similar to this (top view):
  
  [![enter image description here](https://i.sstatic.net/ScJiK.png)](https://i.sstatic.net/ScJiK.png)
  
  Any reinforcement learning approaches to this problem? I'm thinking of some actions called 'rotate 90 degs', 'push east', 'push west', 'push south', 'push north', but these actions are still not clear how to be applied, which to push, how far to push.
  
  The 2D state can be mapped to a grid of zeros (free) and ones (occupied) to utilize conv2D layers. Before feeding to conv2D, all rectangle coords should be translated to make the ($x\_{min}$,$y\_{min}$) be at the origin.
  
  **Tags:** machine-learning, reinforcement-learning, convolutional-neural-networks, ai-design, optimization
  
  > **Comments:**
  > **username_1**: Why do you need to use reinforcement learning and CNNs specifically for this? This is the 2D stock cutting problem with rectangles, which can be solved using metaheuristics and an objective function (to minimise) that is proportional to the maximum height of the structure.  
  > **username_0**: i know it can be solved near perfect with regular algorithms, just wanna try RL for this problem  
  
  ---
  
  ## 0 answers
  
  