Based on this sample of possible training sets, what is the estimated error, due to this for the input value of 2? Be sure to show your work and explain your algorithm’s bias, answer. Problem 3 Reinforcement Learning (20 points) – Consider the The numbers on deterministic reinforcement environment drawn below (let γ=0.5). the arcs indicate the immediate rewards. Once the agent reaches the state the current ‘end’ episode ends and the agent is magically transported to the The probability of an ‘start’ state. exploration step is 0.02. A one-step, Q-table learner follows the path On the graph below, show the Q start b end. values that have changed, and show your work to the right of the graph. Assume that for all legal actions, the initial values in the Q table are 6. Starting with the Q table you produced in Part a, again follow the path and show start b end the Q values below that have changed. Show your work to the right.
Based on this sample of possible training sets, what is the estimated error, due to this algorithm’s bias, for the input value of 2? Be sure to show your work and explain your answer. Problem 3 – Reinforcement Learning (20 points) Consider the deterministic reinforcement environment drawn below (let γ=0.5). The numbers on the arcs indicate the immediate rewards. Once the agent reaches the ‘end’ state the current episode ends and the agent is magically transported to the ‘start’ state. The probability of an exploration step is 0.02. A one-step, Q-table learner follows the path start b end. On the graph below, show the Q values that have changed, and show your work to the right of the graph. Assume that for all legal actions, the initial values in the Q table are 6. Starting with the Q table you produced in Part a, again follow the path start b end and show the Q values below that have changed. Show your work to the right.
examSpring10.docx