Skip to main content

Fa: A system for automating failure diagnosis

Publication ,  Conference
Duan, S; Babu, S; Munagala, K
Published in: Proceedings - International Conference on Data Engineering
July 8, 2009

Failures of Internet services and enterprise systems lead to user dissatisfaction and considerable loss of revenue. Since manual diagnosis is often laborious and slow, there is considerable interest in tools that can diagnose the cause of failures quickly and automatically from system-monitoring data. This paper identifies two key data-mining problems arising in a platform for automated diagnosis called Fa. Fa uses monitoring data to construct a database of failure signatures against which data from undiagnosed failures can be matched. Two novel challenges we address are to make signatures robust to the noisy monitoring data in production systems, and to generate reliable confidence estimates for matches. Fa uses a new technique called anomalybased clustering when the signature database has no highconfidence match for an undiagnosed failure. This technique clusters monitoring data based on how it differs from the failure data, and pinpoints attributes linked to the failure. We show the effectiveness of Fa through a comprehensive experimental evaluation based on failures from a production setting, a variety of failures injected in a testbed, and synthetic data. © 2009 IEEE.

Duke Scholars

Published In

Proceedings - International Conference on Data Engineering

DOI

ISSN

1084-4627

ISBN

9780769535456

Publication Date

July 8, 2009

Start / End Page

1012 / 1023
 

Citation

APA
Chicago
ICMJE
MLA
NLM
Duan, S., Babu, S., & Munagala, K. (2009). Fa: A system for automating failure diagnosis. In Proceedings - International Conference on Data Engineering (pp. 1012–1023). https://doi.org/10.1109/ICDE.2009.115
Duan, S., S. Babu, and K. Munagala. “Fa: A system for automating failure diagnosis.” In Proceedings - International Conference on Data Engineering, 1012–23, 2009. https://doi.org/10.1109/ICDE.2009.115.
Duan S, Babu S, Munagala K. Fa: A system for automating failure diagnosis. In: Proceedings - International Conference on Data Engineering. 2009. p. 1012–23.
Duan, S., et al. “Fa: A system for automating failure diagnosis.” Proceedings - International Conference on Data Engineering, 2009, pp. 1012–23. Scopus, doi:10.1109/ICDE.2009.115.
Duan S, Babu S, Munagala K. Fa: A system for automating failure diagnosis. Proceedings - International Conference on Data Engineering. 2009. p. 1012–1023.

Published In

Proceedings - International Conference on Data Engineering

DOI

ISSN

1084-4627

ISBN

9780769535456

Publication Date

July 8, 2009

Start / End Page

1012 / 1023