Published Articles >> Table of Contents >> Abstract

2004 International Conference on Dependable Systems and Networks (DSN'04)   p. 772
Failure Data Analysis of a Large-Scale Heterogeneous Server Environment
Ramendra K. Sahoo, IBM Thomas J. Watson Research Center, Yorktown Heights, NY
Anand Sivasubramaniam, Pennsylvania State University, University Park, PA
Mark S. Squillante, IBM Thomas J. Watson Research Center, Yorktown Heights, NY
Yanyong Zhang, Rutgers University, Piscataway, NJ

Full Article Text:

DOI Bookmark: http://doi.ieeecomputersociety.org/10.1109/DSN.2004.1311948
Send link to a friend

Abstract
The growing complexity of hardware and software mandates the recognition of fault occurrence in system deployment and management. While there are several techniques to prevent and/or handle faults, there continues to be a growing need for an in-depth understanding of system errors and failures and their empirical and statistical properties. This understanding can help evaluate the effectiveness of different techniques for improving system availability, in addition to developing new solutions. In this paper, we analyze the empirical and statistical properties of system errors and failures from a network of nearly 400 heterogeneous servers running a diverse workload over a year. While improvements in system robustness continue to limit the number of actual failures to a very small fraction of the recorded errors, the failure rates are significant and highly variable. Our results also show that the system error and failure patterns are comprised of time-varying behavior containing long stationary intervals. These stationary intervals exhibit various strong correlation structures and periodic patterns, which impact performance but also can be exploited to address such performance issues.
Back to Top Additional Information
Citation:  Ramendra K. Sahoo, Anand Sivasubramaniam, Mark S. Squillante, Yanyong Zhang, "Failure Data Analysis of a Large-Scale Heterogeneous Server Environment," dsn, p. 772,  2004 International Conference on Dependable Systems and Networks (DSN'04),  2004