The invention relates to systems and methods for predicting sensor information. Systems and method are provided for controlling a vehicle. In one embodiment, a method of predicting sensor informationof an autonomous vehicle includes: receiving point cloud data sensed from an environment associated with the vehicle; processing, by a processor, point cloud data with a convolutional neural network (CNN) to produce a set of segmentations stored in a set of memory cells; processing, by the processor, the set of segmentations of the CNN with a recurrent neural network (RNN) to predict future pointcloud data; processing, by the processor, the future point cloud data to determine an action; and controlling the vehicle based on the action.
Systems and methods for predicting sensor information