A system for managing consumer packaged goods (CPGs) is disclosed. The system includes a front end and a back end. The front end includes a mobile, airborne platform equipped with a digital image capturing device, and a wireless communications device. The backend is in communication with the front end via the wireless communications device, and includes a combinational convolutional neural network which derives models based on input data, a convolutional neural network which generates perception scoring utilizing input put from said combinational convolutional neural network, and a recurrent neural network which makes behavior predictions based on input from said convolutional neural network. The front end captures images of CPGs on a shelf, wherein the CPGs are subject to depletion over time, and wherein the backend generates predictions regarding the depletion state of the CPGs on the shelf as a function of time.
RECOGNITION AND PREDICTION OF SEMANTIC EVENTS LEARNED THROUGH REPEATED OBSERVATION