Overview

SyGENiA (Synthetic GENerator of instance Axioms) is a prototypical tool for the automatic generation of ontology parts for the purposes of testing and evaluating Semantic Web reasoners. Given an ontology (in OWL or RDF(S)) and a query, SyGENiA can generate a set of test data (instance axioms/facts/ABoxes) which together with the ontology and query can be used to test Semantic Web query answering systems. Moreover, given only an ontology, SyGENiA can also generate a set of (test) queries. These test queries can then be used to generate testing data.

The goal of SyGENiA is to enable application developers to automatically generate testing data in order to evaluate Semantic Web reasoning systems over their applications. The data and queries generated by SyGENiA are are not random but for the input ontology (and query), they provide an actual reasoning test over the tested/evaluated system.

Finally, SyGENiA is able to combine and duplicate the generated data and create arbitrary large datasets. These datasets can be used for performance evaluation.

Publications

The theory behind the data generation techniques can be found in the following papers:

• Giorgos Stoilos‚ Bernardo Cuenca Grau, and Ian Horrocks. How Incomplete is your Semantic Web Reasoner? In Proceedings of the Twenty−Fourth AAAI Conference on Artificial Intelligence (AAAI 2010). Pages 1431−1436. AAAI Press. 2010. link.

• Giorgos Stoilos‚ Bernardo Cuenca Grau, and Ian Horrocks. Completeness Guarantees for Incomplete Reasoners. In Proceedings of the Ninth International Semantic Web Conference (ISWC 2010). Springer. 2010. link

• Bernardo Cuenca Grau, Boris Motik, Giorgos Stoilos‚ and Ian Horrocks. Completeness Guarantees for Incomplete Ontology Reasoners: Theory and Practice. Journal of Artificial Intelligence Research, v.43, p.419-476, 2012. link

The theory behind the query generation techniques can be found in the following papers:

• Martha Imprialou, Giorgos Stoilos, and Bernardo Cuenca Grau. Benchmarking Ontology-based Query Rewriting Systems. In Proceedings of the 26th AAAI Conference on Artificial Intelligence (AAAI 2012). 2012. link

• Bernardo Cuenca Grau and Giorgos Stoilos. What to ask to an incomplete Semantic Web reasoner? In Proceedings of the 22nd International Joint Conference on Artificial Intelligence (IJCAI−2011). Pages 2226−2231. 2011. link

Authors

SyGENiA is mainly developed by Giorgos Stoilos. Large part of the query generation code has been developed by Martha Imprialou.