We're sorry but this page doesn't work properly without JavaScript enabled. Please enable it to continue.
Feedback

How the Spack package manager tames the stat storm

Formale Metadaten

Titel
How the Spack package manager tames the stat storm
Serientitel
Anzahl der Teile
542
Autor
Mitwirkende
Lizenz
CC-Namensnennung 2.0 Belgien:
Sie dürfen das Werk bzw. den Inhalt zu jedem legalen Zweck nutzen, verändern und in unveränderter oder veränderter Form vervielfältigen, verbreiten und öffentlich zugänglich machen, sofern Sie den Namen des Autors/Rechteinhabers in der von ihm festgelegten Weise nennen.
Identifikatoren
Herausgeber
Erscheinungsjahr
Sprache

Inhaltliche Metadaten

Fachgebiet
Genre
Abstract
In high performance computing, package managers like Nix, Guix, Gentoo Prefix, and Spack are used to install applications and their dependencies. They allow multiple variants and flavors of the same package to coexist, by installing every package into a unique prefix directory that embeds a hash derived from the dependency graph. This non-standard directory structure can result in increased startup time of executables, as the dynamic linker has to search through many directories to locate all required libraries. This is especially problematic in the context of HPC and shared filesystems, since many instances of the same executable may start in parallel, causing a "stat storm" on the typically slow filesystem. This talk explores benefits and drawbacks of different solutions, and shows in particular how the Spack package manager solves this problem.