Growing a list

Journal Article

It is easy to find expert knowledge on the Internet on almost any topic, but obtaining a complete overview of a given topic is not always easy: information can be scattered across many sources and must be aggregated to be useful. We introduce a method for intelligently growing a list of relevant items, starting from a small seed of examples. Our algorithm takes advantage of the wisdom of the crowd, in the sense that there are many experts who post lists of things on the Internet. We use a collection of simple machine learning components to find these experts and aggregate their lists to produce a single complete and meaningful list. We use experiments with gold standards and open-ended experiments without gold standards to show that our method significantly outperforms the state of the art. Our method uses the ranking algorithm Bayesian Sets even when its underlying independence assumption is violated, and we provide a theoretical generalization bound to motivate its use. © 2013 The Author(s).

Full Text

Duke Authors

Cited Authors

  • Letham, B; Rudin, C; Heller, KA

Published Date

  • 2013

Published In

Volume / Issue

  • 27 / 3

Start / End Page

  • 372 - 395

International Standard Serial Number (ISSN)

  • 1384-5810

Digital Object Identifier (DOI)

  • 10.1007/s10618-013-0329-7