27

Perception from Neural NetsMeaningful Objects from Tool LibrarySensory DataNotable Objects from CoT. ReasoningTrajectory from Motion PlanningSensory DataPerception from Neural NetsMeaningful Objects from Tool LibraryNotable Objects from CoT. ReasoningTrajectory from Motion PlanningFigure 13. Driving video of Agent-Driver.

28

Figure 14. Driving video of Agent-Driver.

29

Figure 15. Driving video of Agent-Driver.

30

Figure 16. Failure cases in Agent-Driver.

31

Failure Case 1:Inaccurate heading estimations for large objects, such as buses, result in a moreconservative turning trajectory.Failure Case 2:Inaccurate heading estimations for large objects, such as buses, result in different driving behaviors from deceleration to acceleration.Inaccurate object heading estimation Inaccurate object heading estimation
ALanguageAgentforAutonomousDriving