Incorporating historic knowledge into a communication library for self-optimizing high performance computing applications

Saber Feki*, Edgar Gabriel

*Corresponding author for this work

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

2 Scopus citations

Abstract

Emerging computing systems have a wide variety of hardware and software components influencing the performance of parallel applications, presenting end-users with a (nearly) unique execution environment on each parallel machine. One of the big challenges of High Performance Computing is therefore to develop portable and efficient codes for any execution environment. The Abstract Data and Communication Library (ADCL) is a self-optimizing runtime communication library aiming at providing the highest possible performance for application level communication operations. The library provides for a given communication pattern a large number of implementations and incorporates a runtime selection logic. This selection aims at adaptively choosing the best performing implementation on the current platform and for the given problem. In this paper, we present a recent enhancement to the library which introduces the capability of utilizing information from previous executions in order to minimize the overhead of the runtime selection logic which mainly stems from testing underperforming implementations. We introduce the notion of similar problems by using a proximity measure for a given operation. The approach is evaluated for the n-dimensional neighborhood communication for two different network interconnects and for a large range of different problems.

Original languageEnglish (US)
Title of host publicationProceedings - 2nd IEEE International Conference on Self-Adaptive and Self-Organizing Systems, SASO 2008
Pages265-274
Number of pages10
DOIs
StatePublished - 2008
Externally publishedYes
Event2nd IEEE International Conference on Self-Adaptive and Self-Organizing Systems, SASO 2008 - Venice, Italy
Duration: Oct 20 2008Oct 24 2008

Other

Other2nd IEEE International Conference on Self-Adaptive and Self-Organizing Systems, SASO 2008
CountryItaly
CityVenice
Period10/20/0810/24/08

Keywords

  • Historic learning
  • Proximity measures
  • Self-optimizing communication libraries

ASJC Scopus subject areas

  • Computer Networks and Communications
  • Hardware and Architecture
  • Control and Systems Engineering

Fingerprint Dive into the research topics of 'Incorporating historic knowledge into a communication library for self-optimizing high performance computing applications'. Together they form a unique fingerprint.

Cite this