Checkpointing for Peta-scale systems: A look into the future of practical rollback-recovery

Elmootazbellah Elnozahy*, James S. Plank

*Corresponding author for this work

Research output: Contribution to journalArticlepeer-review

146 Scopus citations

Abstract

Over the past two decades, rollback-recovery via checkpoint-restart has been used with reasonable success for long-running applications, such as scientific workloads that take from few hours to few months to complete. Currently, several commercial systems and publicly available libraries exist to support various flavors of checkpointing. Programmers typically use these systems if they are satisfactory or otherwise embed checkpointing support themselves within the application. In this paper, we project the performance and functionality of checkpointing algorithms and systems as we know them today into the future. We start by surveying the current technology roadmap and particularly how Peta-Flop capable systems may be plausibly constructed in the next few years. We consider how rollback-recovery as practiced today will fare when systems may have to be constructed out of thousands of nodes. Our projections predict that, unlike current practice, the effect of rollback-recovery may play a more prominent role in how systems may be configured to reach the desired performance level. System planners may have to devote additional resources to enable rollback-recovery and the current practice of using "cheap commodity" systems to form large-scale clusters may face serious obstacles. We suggest new avenues for research to react to these trends.

Original languageEnglish (US)
Pages (from-to)97-108
Number of pages12
JournalIEEE Transactions on Dependable and Secure Computing
Volume1
Issue number2
DOIs
StatePublished - Apr 1 2004

Keywords

  • Availability
  • Distributed applications
  • Distributed systems
  • Evaluation
  • Fault tolerance
  • Measurement
  • Modeling
  • Modeling techniques
  • Performance of systems
  • Reliability
  • Serviceability
  • Simulation of multiple-processor systems

ASJC Scopus subject areas

  • Electrical and Electronic Engineering

Fingerprint Dive into the research topics of 'Checkpointing for Peta-scale systems: A look into the future of practical rollback-recovery'. Together they form a unique fingerprint.

Cite this