Described is a system for automated event summarization. A multi-layer network representing a multimodal data set is generated, where nodes within a given layer represent information tokens in a given modality. A topically diverse set of nodes is ranked and selected from each layer to represent temporal event highlights. Temporal event highlights are linked into storylines. Using the storylines, the system monitors a progression of an event or opinions regarding a topic. A temporal summary of the progression of the event or the opinions regarding the topic is generated.
Cross-modal event summarization system based on network of networks representations