This paper reports the rst eort into integrating OAEI and SEALS evaluation campaigns. OAEI is an annual evaluation cam- paign for ontology matching systems. The 2010 campaign includes a new modality in coordination with the SEALS project. This project aims at providing standardized resources (software components and data sets) for automatically executing evaluations of typical semantic web tools, including ontology matching tools. A rst version of the software infras- tructure is based on a web service interface wrapping the functionality of the matching tool to be evaluated. In this setting, the evaluation results can be visualized and manipulated immediately in a direct feedback cy- cle. We describe how parts of the OAEI 2010 evaluation campaign have been integrated into the SEALS software infrastructure. In particular, we discuss technical and organizational aspects related to the use of the new technology for both participants and organizers of the OAEI.
['Cássia Trojahn dos Santos', 'Christian Meilicke', 'Jérôme Euzenat', 'Heiner Stuckenschmidt']
Automating OAEI campaigns (first report).