F. Niu, C. Zhang, C. Re & J. Shavlik (2012).
DeepDive: Web-scale Knowledge-base Construction using Statistical Learning and Inference. Workshop on Very Large Data Search.

This publication is available in PDF.

Abstract:

We present an end-to-end (live) demonstration system called DeepDive that performs knowledge-base construction (KBC) from hundreds of millions of web pages. DeepDive employs statistical learning and inference to combine diverse data resources and best-of-breed algorithms. A key challenge of this approach is scalability, i.e., how to deal with terabytes of imperfect data efficiently. We describe how we address the scalability challenges to achieve web-scale KBC and the lessons we have learned from building DeepDive.

Return to the publications of the Univ. of Wisconsin Machine Learning Research Group.