Research trends in high performance Parallel Input/Output for cluster environments

• Date: 2004
• ISSN: 1727-4907
• Main Author: Ludwig, T.
• Format: Article
• Language: English
• Published: Інститут програмних систем НАН України 2004
• Subjects: Параллельное программирование; Распределенные системы и сети
• Online Access: https://nasplib.isofts.kiev.ua/handle/123456789/1866
• Journal Title: Digital Library of Periodicals of National Academy of Sciences of Ukraine
• Cite this: Research trends in high performance Parallel Input/Output for cluster environments / T. Ludwig // Проблеми програмування. — 2004. — N 2,3. — С. 274-281. — Бібліогр.: 39 назв. — англ.

Parallel input/output in high performance computing is a field of increasing
 importance. In particular with compute clusters we see the concept of replicated
 resources being transferred to I/O issues. Consequently, we find research questions
 like e.g. how to map data structures to files, which resources to actually use, and
 how to deal with failures in the environment. The paper will introduce the problem
 of massive I/O from the user´s point of view and illustrate available programming
 interfaces. After a short description of some available parallel file systems we will
 concentrate on the research directions in that field. Besides other questions,
 efficiency is the main issue. It depends on an appropriate mapping of data
 structures onto file segments which in turn are spread over physical disks. Our own
 work concentrates on measuring the performance of individual mappings and to
 change them dynamically to increase performance and control the sharing of
 resources.