A method of tracking an object across a stream of images comprises passing an initial frame of the stream through a first neural network comprising a plurality of convolutional layers. A feature map output from the first neural network is provided to a second multiclassifier neural network comprising at least one fully-connected layer to determine a region of interest (ROI) bounding an object of a given class in the initial frame. A feature map output from a first convolutional layer of the first neural network corresponding to the ROI is stored as weights for at least a first layer of neurons of a third multi-layer neural network. A subsequent frame from the stream is acquired and the frame is scanned ROI by ROI using the first neural network to produce respective feature maps from the first convolutional layer for each ROI. The feature maps are provided to the third multi-layer neural network to provide an output proportional to the level of match between the feature map values used for the weights of the first layer of neurons and the feature map values provided for a candidate ROI to identify a candidate ROI having a feature map best matching the stored feature map. The stored feature map weights are updated with weights from the best matching candidate ROI.
A METHOD AND SYSTEM FOR TRACKING AN OBJECT