server to the script, were removed. Additionally, a much simpler way was found to execute the SQL creation and load queries in the SQL file. The line-by-line parsing function was removed. Afterward, the bash script looked like Figure 7 with the exception of the presence of the testing portion. USDA Spreadsheets These source spreadsheets were only used to generate the TSV files. That is, the import queries of the SQL file only make use of the TSV files. Their inclusion in the import package only serves to take up space. Therefore, they were all deleted from the package. Once these changes were made, the structure of the import package transformed into the one as depicted in Figure 10. Web Server Initial Refinement The web server was refined in numerous ways, in order to streamline it and make it more stable. One of the most significant changes that was made was that there is only one current web server on which everything runs. This not only lessens the number of servers involved, it also reduces the overhead. For example: The back end has no longer to keep track of which user asked for what data, as a web server can maintain a single session. Less data has to be passed through another web server, which reduces latency. Using fewer web servers also reduces the potential attack vector of our system. We also included the use of the MySQL database, as opposed to hard coding values into the web server application. This was a great boon, as we no longer had to deal with static values. We could dynamically gather the values we wished, and made the implementation abstract. And so, any database could be hooked up to our system with little modification.
server to the script, were removed. Additionally, a much simpler way was found to execute the SQL creation and load queries in the SQL file. The line-by-line parsing function was removed. Afterward, the bash script looked like Figure 7 with the exception of the presence of the testing portion. USDA Spreadsheets These source spreadsheets were only used to generate the TSV files. That is, the import queries of the SQL file only make use of the TSV files. Their inclusion in the import package only serves to take up space. Therefore, they were all deleted from the package. Once these changes were made, the structure of the import package transformed into the one as depicted in Figure 10. Web Server Initial Refinement The web server was refined in numerous ways, in order to streamline it and make it more stable. One of the most significant changes that was made was that there is only one current web server on which everything runs. This not only lessens the number of servers involved, it also reduces the overhead. For example: The back end has no longer to keep track of which user asked for what data, as a web server can maintain a single session. Less data has to be passed through another web server, which reduces latency. Using fewer web servers also reduces the potential attack vector of our system. We also included the use of the MySQL database, as opposed to hard coding values into the web server application. This was a great boon, as we no longer had to deal with static values. We could dynamically gather the values we wished, and made the implementation abstract. And so, any database could be hooked up to our system with little modification.