Journal of Computer Science

Proposing the new Algorithm and Technique Development for Integrating Web Table Extraction and Building a Mashup

Rudy A.G. Gultom, Riri Fitri Sari and Bagio Budiardjo

DOI : 10.3844/jcssp.2011.129.142

Journal of Computer Science

Volume 7, Issue 2

Pages 129-142

Abstract

Problem statement: Nowadays, various types of data in web table can be easily extracted from the Internet, although not all of web tables are relevant to the users. As we may know, most web pages are in unstructured HTML format, making web table extraction process very time consuming and costly. HTML format only focuses on the presentation, not based on the database system. Therefore, users need a tool in dealing with that process. Approach: This research proposed an approach for implementing web table extraction and making a Mashup from HTML web pages using Xtractorz application. It is also discussed on how to collaborate and integrate a web table extraction process in the stage of building a Mashup, i.e., Data Retrieval, Data Source Modeling, Data Cleaning/ Filtering, Data Integration and Data Visualization. The main issue lies in stage of data modeling creation, in which Xtractorz must be able to automatically render Document Object Model (DOM) tree in accordance to HTML tag or code of the web page from which the table is extracted. To overcome that, the Xtractorz is equipped with algorithm and rules so it can enable to specifically analyze the HTML tags and to extract the data into a new table format. The algorithm is created by using recursive technique within a user-friendly GUI of Xtractorz. Results: The approach was evaluated by conducting experiment using Xtractorz and other similar applications, such as RoboMaker and Karma. The result of experiment showed that Xtractorz is more efficient in completing the experiment tasks, since Xtractorz has fewer steps to complete the whole tasks. Conclusion: Xtractorz can give a positive contribution in terms of algorithm technique and a new approach method to web table extraction process and making a Mashup, where the core algorithm can extracts web data tables using recursive technique while rendering the DOM tree model automatically.

Copyright

© 2011 Rudy A.G. Gultom, Riri Fitri Sari and Bagio Budiardjo. This is an open access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.
{"cc_re__cc_re__cc_by_4_0": ["ion\r\nprocess and making a Mashup, where the core algorithm can extracts web data tables using recursive\r\ntechnique while rendering the DOM tree model automatically.\"/>    \n<meta name=\"dc.source\" content=\"Journal of Computer Science 2011, Vol. 7, Page 129\"/>\n<meta name=\"dc.date\" content=\"2011/02/25\"/>    \n<meta name=\"dcterms.issued\" content=\"2011/02/25\"/>        \n<meta name=\"dc.identifier\" content=\"doi:10.3844/jcssp.2011.129.142\"/>    \n<meta name=\"dc.publisher\" content=\"Science Publications\"/>  \n<meta name=\"dc.rights\" content=\"http://creativecommons.org/licenses/by/4.0/\">\n<meta name=\"dc.format\" content=\"application/pdf\">    \n<meta name=\"dc.format\" content=\"text/html\">        \n<meta name=\"dc.language\" content=\"en\">\n<meta name=\"dc.subject\" content=\"Web table extraction\"/>\n<meta name=\"dc.subject\" content=\"mashup stages\"/>\n<meta name=\"dc.subject\" content=\"recursive algorithm\"/>\n<meta name=\"dc.subject\" content=\"Document Object Model (DOM)\"/>\n<meta name=\"dc.subject\" content=\"HTML format\"/>\n<meta name=\"dc.subject\" content=\"Integrated Development Environment (IDE)\"/>\n<m", "ve\r\ncontribution in terms of algorithm technique and a new approach method to web table extraction\r\nprocess and making a Mashup, where the core algorithm can extracts web data tables using recursive\r\ntechnique while rendering the DOM tree model automatically.</p>\n\n<h3 class=\"block-title sub-title\" style=\"text-align:justify\">\n<strong>Copyright</strong>\n</h3>\n<p>\n &copy; 2011 Rudy A.G. Gultom, Riri Fitri Sari and Bagio Budiardjo. This is an open access article distributed under the terms of the \n <a rel=\"license\" href=\"http://creativecommons.org/licenses/by/4.0/\">Creative Commons Attribution License</a>, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.\n</p>\n</div>\n\n<br>\n<br>\n            \n            \n\n          </div>\n          \n          <!-- sidebar -->\n          \n          <div class=\"span4 sidebar sidebar-right\">\n            <div class=\"inner\">\n<div class=\"block\">\n  <table style=\"table-layout : fixed;\">\n    <tr>\n      <td rowspan=\"3\" style=\"width:150px\"><img src=\"http:"], "copyright__copyright__copyright": [" method to web table extraction process and making a Mashup, where the core algorithm can extracts web data tables using recursive technique while rendering the DOM tree model automatically.\n\nCopyright\n\n\u00a9 2011 Rudy A.G. Gultom, Riri Fitri Sari and Bagio Budiardjo. This is an open access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.", " method to web table extraction process and making a Mashup, where the core algorithm can extracts web data tables using recursive technique while rendering the DOM tree model automatically.\n\nCopyright\n\n\u00a9 2011 Rudy A.G. Gultom, Riri Fitri Sari and Bagio Budiardjo. This is an open access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited."]}