Reducing noise in labels and features for a real world dataset: Application of NLP corpus annotation methods

Conference Paper

This paper illustrates how a combination of information extraction, machine learning, and NLP corpus annotation practice was applied to a problem of ranking vulnerability of structures (service boxes, manholes) in the Manhattan electrical grid. By adapting NLP corpus annotation methods to the task of knowledge transfer from domain experts, we compensated for the lack of operational definitions of components of the model, such as serious event. The machine learning depended on the ticket classes, but it was not the end goal. Rather, our rule-based document classification determines both the labels of examples and their feature representations. Changes in our classification of events led to improvements in our model, as reflected in the AUC scores for the full ranked list of over 51K structures. The improvements for the very top of the ranked list, which is of most importance for prioritizing work on the electrical grid, affected one in every four or five structures. © Springer-Verlag Berlin Heidelberg 2009.

Full Text

Duke Authors

Cited Authors

  • Passonneau, RJ; Rudin, C; Radeva, A; Liu, ZA

Published Date

  • July 21, 2009

Published In

Volume / Issue

  • 5449 LNCS /

Start / End Page

  • 86 - 97

Electronic International Standard Serial Number (EISSN)

  • 1611-3349

International Standard Serial Number (ISSN)

  • 0302-9743

International Standard Book Number 10 (ISBN-10)

  • 3642003818

International Standard Book Number 13 (ISBN-13)

  • 9783642003813

Digital Object Identifier (DOI)

  • 10.1007/978-3-642-00382-0_7

Citation Source

  • Scopus