form of Open Geospatial Consortium web features or standard geospatial files (shape files, KML) 15 1. Much real-time 1. Analytics: Near 1. Tolerance of 1. Geospatial 1. Protection of 1. Data provenance -- Intelligence data with Real (NRT) unreliable overlays (GIS) data against (e.g. tracking of all Data processing at alerts based on networks to and network unauthorized transfers and Processing near-real time (at patterns and warfighter and diagrams access or transformations) and Analysis worst) baseline changes remote sensors (primary disclosure and over the life of the 2. Data in 2. Up to hundreds visualizations) tampering data disparate silos, of petabytes of must be data supported by accessible modest to large through a clusters and semantically clouds integrated data 3. Hadoop, space Accumulo (Big 3. Diverse data: Table), Solr, NLP text files, raw (several variants), media, imagery, Puppet (for video, audio, deployment and electronic data, security), Storm, human-generated custom data applications, visualization tools 16 1. 1. A 1. Hadoop, Hive, 1. Results of 1. Data 1. Standardize, 1. Security EMR Data Heterogeneous, comprehensive R. Unix-based analytics consumer aggregate, and across mobile high-volume, and consistent 2. Cray provided for direct access to normalize data from devices diverse data view of data across supercomputer use by data data as well as disparate sources
form of Open Geospatial Consortium web features or standard geospatial files (shape files, KML) 15 Intelligence Data Processing and Analysis 1. Much real-time data with processing at near-real time (at worst) 2. Data in disparate silos, must be accessible through a semantically integrated data space 3. Diverse data: text files, raw media, imagery, video, audio, electronic data, human-generated data 1. Analytics: Near Real (NRT) alerts based on patterns and baseline changes 1. Tolerance of unreliable networks to warfighter and remote sensors 2. Up to hundreds of petabytes of data supported by modest to large clusters and clouds 3. Hadoop, Accumulo (Big Table), Solr, NLP (several variants), Puppet (for deployment and security), Storm, custom applications, visualization tools 1. Geospatial overlays (GIS) and network diagrams (primary visualizations) 1. Protection of data against unauthorized access or disclosure and tampering 1. Data provenance (e.g. tracking of all transfers and transformations) over the life of the data -- 16 EMR Data 1. Heterogeneous, high-volume, diverse data 1. A comprehensive and consistent view of data across 1. Hadoop, Hive, R. Unix-based 2. Cray supercomputer 1. Results of analytics provided for use by data 1. Data consumer direct access to data as well as 1. Standardize, aggregate, and normalize data from disparate sources 1. Security across mobile devices