Commercial: Mendeley Big Data) Requirements WG Use Case Template Aug 11 2013 NBD(NIST Use Case Title Mendeley An International Network of Research – Vertical (area) Commercial Cloud Consumer Services Author/Company/Email William Gunn / Mendeley / william.gunn@mendeley.com Actors/Stakeholders and Researchers, librarians, publishers, and funding organizations. their roles and responsibilities Goals To promote more rapid advancement in scientific research by enabling researchers to efficiently collaborate, librarians to understand researcher needs, publishers to distribute research findings more quickly and broadly, and funding organizations to better understand the impact of the projects they fund. Use Case Description Mendeley has built a database of research documents and facilitates the creation of shared bibliographies. Mendeley uses the information collected about research reading patterns and other activities conducted via the software to build more efficient literature discovery and analysis tools. Text mining and classification systems enables automatic recommendation of relevant research, improving the cost and performance of research teams, particularly those engaged in curation of literature on a particular subject, such as the Mouse Genome Informatics group at Jackson Labs, which has a large team of manual curators who scan the literature. Other use cases include enabling publishers to more rapidly disseminate publications, facilitating research institutions and librarians with data management plan compliance, and enabling funders to better understand the impact of the work they fund via real-time data on the access and use of funded research. Current Compute(System) Amazon EC2 Solutions Storage HDFS Amazon S3 Networking Client-server connections between Mendeley and end user machines, connections between Mendeley offices and Amazon services. Software Hadoop, Scribe, Hive, Mahout, Python Big Data Data Source Distributed and centralized Characteristics (distributed/centralized) Volume (size) 15TB presently, growing about 1 TB/month Velocity Currently Hadoop batch jobs are scheduled daily, but (e.g. real time) work has begun on real-time recommendation Variety PDF documents and log files of social network and (multiple datasets, client activities mashup)
Commercial: Mendeley NBD(NIST Big Data) Requirements WG Use Case Template Aug 11 2013 Use Case Title Mendeley – An International Network of Research Vertical (area) Commercial Cloud Consumer Services Author/Company/Email William Gunn / Mendeley / william.gunn@mendeley.com Actors/Stakeholders and their roles and responsibilities Researchers, librarians, publishers, and funding organizations. Goals To promote more rapid advancement in scientific research by enabling researchers to efficiently collaborate, librarians to understand researcher needs, publishers to distribute research findings more quickly and broadly, and funding organizations to better understand the impact of the projects they fund. Use Case Description Mendeley has built a database of research documents and facilitates the creation of shared bibliographies. Mendeley uses the information collected about research reading patterns and other activities conducted via the software to build more efficient literature discovery and analysis tools. Text mining and classification systems enables automatic recommendation of relevant research, improving the cost and performance of research teams, particularly those engaged in curation of literature on a particular subject, such as the Mouse Genome Informatics group at Jackson Labs, which has a large team of manual curators who scan the literature. Other use cases include enabling publishers to more rapidly disseminate publications, facilitating research institutions and librarians with data management plan compliance, and enabling funders to better understand the impact of the work they fund via real-time data on the access and use of funded research. Current Solutions Compute(System) Amazon EC2 Storage HDFS Amazon S3 Networking Client-server connections between Mendeley and end user machines, connections between Mendeley offices and Amazon services. Software Hadoop, Scribe, Hive, Mahout, Python Big Data Characteristics Data Source (distributed/centralized) Distributed and centralized Volume (size) 15TB presently, growing about 1 TB/month Velocity (e.g. real time) Currently Hadoop batch jobs are scheduled daily, but work has begun on real-time recommendation Variety (multiple datasets, mashup) PDF documents and log files of social network and client activities