One important use case for the Semantic Web is the inte- gration of data across many heterogeneous ontologies. However, most Semantic Web Knowledge Bases are evaluated using the single ontology benchmark such as LUBM and UOBM. Therefore, there is a require- ment to develop a benchmark system that is able to evaluate not only single but also federated ontology systems for difierent uses with difier- ent conflgurations of ontologies. To support such a need, based on our earlier work, we present a multi-ontology synthetic benchmark system that takes a two-level proflle as input to generate user-customized on- tologies together with related mappings and data sources. Meanwhile, a graph-based query generation algorithm and an owl:sameAs generation mechanism are also proposed. By using this benchmark, the Semantic Web systems can be evaluated against complex ontology conflgurations using the standard metrics of loading time, repository size, query re- sponse time and query completeness and soundness.
['Yingjie Li', 'Yang Yu', 'Jeff Heflin']
A Multi-ontology Synthetic Benchmark for the Semantic Web