Article accepted at Datenbank Spektrum

The article „Using the Semantic Web as a Source of Training Data“ by Christian Bizer, Anna Primpeli, Ralph Peeters has been accpeted for the upcoming special issue on “Data and Repeatability” of Datenbank Spektrum.


Deep neural networks are increasingly used for tasks such as entity resolution, sentiment analysis, and information extraction. As the methods are rather training data hungry, it is necessary to use large training sets in order to enable the methods to play their strengths. Millions of websites have started to annotate structured data within HTML pages using the vocabulary. Popular types of entities that are annotated are products, reviews, events, people, hotels, and other local businesses. These semantic annotations are used by all major search engines to display rich snippets in search results. This is also the main driver behind the wide-scale adoption of the annotation techniques.

This article explores the potential of using semantic annotations from large numbers of websites as training data for supervised entity resolution, sentiment analysis, and information extraction methods. After giving an overview of the types of structured data that are available on the Semantic Web, we focus on the task of product matching in e-commerce and explain how semantic annotations can be used to gather a large training dataset for product matching. The dataset consists of more than 20 million pairs of offers referring to the same products. The offers were extracted from 43 thousand e-shops, that provide annotations including some form of product identifiers, such as manufacturer part numbers (MPNs), global trade item numbers (GTINs), or stock keeping units (SKUs). The dataset, which we offer for public download, is ordersof magnitude larger than the Walmart-Amazon, Amazon-Google, and Abt-Buy datasets that are widely used to evaluate product matching methods. We verify the utility of the dataset as training data by using it to replicate the recent result of Mugdal et al. stating that embeddings and RNNs outperform traditional symbolic matching methods on tasks involving less structured data. After the case study on product data matching, we focus on sentiment analysis and information extraction and discuss how semantic annotations from the Web can be used as training data within both tasks.

Link to the Article

Using the Semantic Web as a Source of Training Data

Related Dataset:

Web Data Commons – Training Dataset and Gold Standard for Large-Scale Product Matching


Datenbank Spektrum