speed. UR_8050 Users shall not need to know anything about the inner 1 of the system in order to use it. UR_8060 The system shall properly handle failures by terminating the 1 query and providing the user with the cause of failure. Failures may be triggered by invalid queries, insufficient data, or some broken component. A.4 Software Requirements Software requirements are prefixed with an label to distinguish them from user “SR” requirements. As with user requirements, a priority level is assigned to each software requirement as a number between 1 and 5, with 1 representing the highest priority. The software requirements for the Common Crawl Mining system are listed in . Table 5. Software Requirements ID Associated Description Priority User Requirement SR_0010 N/A The Common Crawl Mining system shall analyze 1 web crawl data retrieved from Common Crawl. SR_0020 N/A The system shall store analysis results in a NoSQL 2 database. SR_0030 UR_0050 If only a search term is provided as part of a query, 1 the system shall compute relevance scores of each matching page in the range from 0 to 1 as the ratio of search term elements that are present in the page. Search term elements include a multi-token search term and zero or more associated chemical names. SR_0040 UR_0060 If a search term and chemical are provided as part 1 of a query, the system shall compute the relevance score of each matching page in the range from 0 to 1 as the sum of 0.3 (if the queried chemical is
speed. UR_8050 Users shall not need to know anything about the inner of the system in order to use it. 1 UR_8060 The system shall properly handle failures by terminating the query and providing the user with the cause of failure. Failures may be triggered by invalid queries, insufficient data, or some broken component. 1 A.4 Software Requirements Software requirements are prefixed with an “SR” label to distinguish them from user requirements. As with user requirements, a priority level is assigned to each software requirement as a number between 1 and 5, with 1 representing the highest priority. The software requirements for the Common Crawl Mining system are listed in . Table 5. Software Requirements ID Associated User Requirement Description Priority SR_0010 N/A The Common Crawl Mining system shall analyze web crawl data retrieved from Common Crawl. 1 SR_0020 N/A The system shall store analysis results in a NoSQL database. 2 SR_0030 UR_0050 If only a search term is provided as part of a query, the system shall compute relevance scores of each matching page in the range from 0 to 1 as the ratio of search term elements that are present in the page. Search term elements include a multi-token search term and zero or more associated chemical names. 1 SR_0040 UR_0060 If a search term and chemical are provided as part of a query, the system shall compute the relevance score of each matching page in the range from 0 to 1 as the sum of 0.3 (if the queried chemical is 1
ccm_final_report.docx