Big Data Specific High throughput of data for reduction into higher levels. Challenges (Gaps) Discovery of meaningful insights from low-value-density data needs new approaches to the deep, complex analysis e.g., using machine learning, statistical modelling, graph algorithms etc. which go beyond traditional approaches to the space physics. Big Data Specific Is not likely in mobile platforms Challenges in Mobility Security & Privacy Lower level of data has restrictions for 1 year within the associate Requirements countries. All data open after 3 years. Highlight issues for EISCAT 3D data e-Infrastructure shares similar architectural generalizing this use characteristics with other ISR radars, and many existing big data case (e.g. for ref. systems, such as LOFAR, LHC, and SKA architecture) More Information (URLs) Note: <additional comments> Big Data) Requirements WG Use Case Template NBD(NIST Use Case Title Big Data Archival: Census 2010 and 2000 Title 13 Big Data – Vertical (area) Digital Archives Author/Company/Email Vivek Navale & Quyen Nguyen (NARA) Actors/Stakeholders and NARA’s Archivists their roles and Public users (after 75 years) responsibilities Goals Preserve data for a long term in order to provide access and perform analytics after 75 years. Use Case Description Maintain data “as-is”. No access and no data analytics for 75 years. Preserve the data at the bit-level. Perform curation, which includes format transformation if necessary. Provide access and analytics after nearly 75 years. Current Compute(System) Linux servers Solutions Storage NetApps, Magnetic tapes. Networking Software Big Data Data Source Centralized storage. Characteristics (distributed/centralized) Volume (size) 380 Terabytes. Velocity Static. (e.g. real time) Variety Scanned documents (multiple datasets, mashup)
Big Data Specific Challenges (Gaps) High throughput of data for reduction into higher levels. Discovery of meaningful insights from low-value-density data needs new approaches to the deep, complex analysis e.g., using machine learning, statistical modelling, graph algorithms etc. which go beyond traditional approaches to the space physics. Big Data Specific Challenges in Mobility Is not likely in mobile platforms Security & Privacy Requirements Lower level of data has restrictions for 1 year within the associate countries. All data open after 3 years. Highlight issues for generalizing this use case (e.g. for ref. architecture) EISCAT 3D data e-Infrastructure shares similar architectural characteristics with other ISR radars, and many existing big data systems, such as LOFAR, LHC, and SKA More Information (URLs) Note: <additional comments> NBD(NIST Big Data) Requirements WG Use Case Template Use Case Title Big Data Archival: Census 2010 and 2000 – Title 13 Big Data Vertical (area) Digital Archives Author/Company/Email Vivek Navale & Quyen Nguyen (NARA) Actors/Stakeholders and their roles and responsibilities NARA’s Archivists Public users (after 75 years) Goals Preserve data for a long term in order to provide access and perform analytics after 75 years. Use Case Description Maintain data “as-is”. No access and no data analytics for 75 years. Preserve the data at the bit-level. Perform curation, which includes format transformation if necessary. Provide access and analytics after nearly 75 years. Current Solutions Compute(System) Linux servers Storage NetApps, Magnetic tapes. Networking Software Big Data Characteristics Data Source (distributed/centralized) Centralized storage. Volume (size) 380 Terabytes. Velocity (e.g. real time) Static. Variety (multiple datasets, mashup) Scanned documents