Answers.Body: <p>I will agree with malioboro, maybe RL is an overkill for such a task. Even though with the trend of autonomous driving research lately, papers dealing with lane changing almost certainly exist, you should check them out for more details. </p>
  
  <p>As stated in <a href="https://arxiv.org/pdf/1904.00231.pdf" rel="nofollow noreferrer">Lane Change Decision-making through DeepReinforcement Learning with Rule-basedConstraints</a> , "When the states are discrete and finite, the Q-function canbe easily formulated in a tabular form. But in many practical applications, for example, lane change decision-making task,the state space of them is very large or even continuous,using the Q-learning algorithm will lead to dimension disaster. Therefore, tabular Q-learning algorithm does not applicable to
  the learning problem of continuous state space and continuousaction space"</p>
  
  <p>So, i would recommend using image processing techniques, or Deep-Q-Learning. Q-Learning is not capable of dealing with continuous problems like lane changing or lane tracking.</p>
  
Answers.ContentLicense: CC BY-SA 4.0
Answers.CreationDate: 2020-02-02T16:19:43.857Z
Answers.LastActivityDate: 2020-02-02T16:19:43.857Z
Answers.UserDisplayName: pedagil
Body: <p>I'm quite new to reinforcement learning and my project will consist of detecting lanes with RL. </p>
  
  <p>I'm using q-learning and I'm having a hard time thinking how my q table should look like, I mean - what could represent a state. My main idea is to feed the machine with a frame that contains a road picture, which the edge detection function is being applied to (and by thus getting lots of lines that exits in the frame). And train the machine which lines are the correct lane line. I already have a deterministic function that already recognizes the lanes and it will be the function that will teach the machine. I already organized some lane parameters such as (lane length, lane cords, lane color (white or yellow have a better probability to be a lane), lane diameter and the lane incline). </p>
  
  <p>Now, my only issue is how should I construct the Q-table. Basically, what could represent a state and which lanes or decisions I should reward.</p>
  
Comments.ContentLicense: CC BY-SA 4.0
Comments.CreationDate: 2020-02-02T13:52:13.350Z
Comments.Text: I'm not sure RL suits for this task, why don't you use computervision algorithms?
Comments.UserDisplayName: malioboro
Comments.ContentLicense: CC BY-SA 4.0
Comments.CreationDate: 2020-10-30T15:06:39.617Z
Comments.Text: A Q-table is probably not the right tool for this problem. I would look at other RL algorithms at [Spinning Up](https://spinningup.openai.com).
Comments.UserDisplayName: S2673
Comments.ContentLicense: CC BY-SA 4.0
Comments.CreationDate: 2020-02-03T11:34:10.983Z
Comments.Text: RL has been used for lane keeping, which may require lane detection. Maybe have a look at the literature.
Comments.UserDisplayName: nbro
Tags: <reinforcement-learning><applications>
Title: How can I perform lane detection with reinforcement learning?
UserDisplayName: alex14501
ThreadText: # How can I perform lane detection with reinforcement learning?
  
  (Asked by: username_0 on 2020-02-02)
  
  I'm quite new to reinforcement learning and my project will consist of detecting lanes with RL.
  
  I'm using q-learning and I'm having a hard time thinking how my q table should look like, I mean - what could represent a state. My main idea is to feed the machine with a frame that contains a road picture, which the edge detection function is being applied to (and by thus getting lots of lines that exits in the frame). And train the machine which lines are the correct lane line. I already have a deterministic function that already recognizes the lanes and it will be the function that will teach the machine. I already organized some lane parameters such as (lane length, lane cords, lane color (white or yellow have a better probability to be a lane), lane diameter and the lane incline).
  
  Now, my only issue is how should I construct the Q-table. Basically, what could represent a state and which lanes or decisions I should reward.
  
  **Tags:** reinforcement-learning, applications
  
  > **Comments:**
  > **username_1**: I'm not sure RL suits for this task, why don't you use computervision algorithms?  
  > **username_3**: RL has been used for lane keeping, which may require lane detection. Maybe have a look at the literature.  
  > **username_2**: A Q-table is probably not the right tool for this problem. I would look at other RL algorithms at [Spinning Up](https://spinningup.openai.com).  
  
  ---
  
  ## 1 answers
  
  ### Answer by username_4 on 2020-02-02. Score: 2
  
  I will agree with username_1, maybe RL is an overkill for such a task. Even though with the trend of autonomous driving research lately, papers dealing with lane changing almost certainly exist, you should check them out for more details.
  
  As stated in [Lane Change Decision-making through DeepReinforcement Learning with Rule-basedConstraints](https://arxiv.org/pdf/1904.00231.pdf) , "When the states are discrete and finite, the Q-function canbe easily formulated in a tabular form. But in many practical applications, for example, lane change decision-making task,the state space of them is very large or even continuous,using the Q-learning algorithm will lead to dimension disaster. Therefore, tabular Q-learning algorithm does not applicable to
  the learning problem of continuous state space and continuousaction space"
  
  So, i would recommend using image processing techniques, or Deep-Q-Learning. Q-Learning is not capable of dealing with continuous problems like lane changing or lane tracking.
  
  
  ---
  
  