A system for computer vision driven applications in an environment includes an imaging system configured to collect image data within an environment; a processing engine configured to maintain an environmental object graph from the image data, wherein the environmental object graph is a data representation of classified objects in space and time across the environment, the environmental object graph comprising at least a subset of objects having probabilistic object associations; and the processing engine further configured to: classify objects in the image data and store corresponding object instances in the environmental object graph, track object locations and establish an association of object instances in an object path, detect interaction events and, for event instances of a subset of detected interaction events, generate an object association of at least two object instances involved in the interaction event, and update the environmental object graph and propagate change in at least one object instance across object associations.
System for computer vision driven applications within environment