Distributed resource management across process boundaries

Lalith Suresh, Peter Bodik, Ishai Menache, Marco Canini, Florin Ciucu

Research output: Chapter in Book/Report/Conference proceedingConference contribution

15 Scopus citations

Abstract

Multi-tenant distributed systems composed of small services, such as Service-oriented Architectures (SOAs) and Micro-services, raise new challenges in attaining high performance and efficient resource utilization. In these systems, a request execution spans tens to thousands of processes, and the execution paths and resource demands on different services are generally not known when a request first enters the system. In this paper, we highlight the fundamental challenges of regulating load and scheduling in SOAs while meeting end-to-end performance objectives on metrics of concern to both tenants and operators. We design Wisp, a framework for building SOAs that transparently adapts rate limiters and request schedulers system-wide according to operator policies to satisfy end-to-end goals while responding to changing system conditions. In evaluations against production as well as synthetic workloads, Wisp successfully enforces a range of end-to-end performance objectives, such as reducing average latencies, meeting deadlines, providing fairness and isolation, and avoiding system overload.
Original languageEnglish (US)
Title of host publicationProceedings of the 2017 Symposium on Cloud Computing - SoCC '17
PublisherAssociation for Computing Machinery (ACM)
Pages611-623
Number of pages13
ISBN (Print)9781450350280
DOIs
StatePublished - Sep 27 2017

Fingerprint Dive into the research topics of 'Distributed resource management across process boundaries'. Together they form a unique fingerprint.

Cite this