Transition in the behavioural regime of the agents with Nh = 64. We show the behaviour of two individual agents with different values of β for the Mountain Car (A–C) and Acrobot (D–F) embodiments. We observe that β = 1 is a transition point between two modes of behaviour in both agents.