High Throughput Tertiary Storage in HPC Environments

Klaus Birkelund Jensen

doi:10.1145/3009925.3009934

High Throughput Tertiary Storage in HPC Environments

Klaus Birkelund Jensen

eScience

Abstract

Magnetic tape in High Performance Computing (HPC) environments has traditionally been used as a tertiary layer in a Hierarchical Storage Management (HSM) system. We propose that tape be given a more central role in the HPC data centre with direct involvement of the batch scheduler. To this end, we have begun development of a purpose-built tape storage system called Tapr. The write strategy used by Tapr allows the system to provide precise estimates on transfer time of data from tertiary storage to primary fast parallel storage.

Original language	Danish
Title of host publication	Proceedings of the Doctoral Symposium of the 17th International Middleware Conference
Number of pages	2
Place of Publication	New York, USA
Publisher	Association for Computing Machinery
Publication date	12 Dec 2016
Article number	9
ISBN (Electronic)	978-1-4503-4665-8
DOIs	https://doi.org/10.1145/3009925.3009934
Publication status	Published - 12 Dec 2016

Access to Document

10.1145/3009925.3009934

a9-jensenFinal published version, 578 KB

Cite this

@inproceedings{0114346a43794b129ec9ba0c483297e6,

title = "High Throughput Tertiary Storage in HPC Environments",

abstract = "Magnetic tape in High Performance Computing (HPC) environments has traditionally been used as a tertiary layer in a Hierarchical Storage Management (HSM) system. We propose that tape be given a more central role in the HPC data centre with direct involvement of the batch scheduler. To this end, we have begun development of a purpose-built tape storage system called Tapr. The write strategy used by Tapr allows the system to provide precise estimates on transfer time of data from tertiary storage to primary fast parallel storage.",

author = "Jensen, {Klaus Birkelund}",

year = "2016",

month = dec,

day = "12",

doi = "10.1145/3009925.3009934",

language = "Dansk",

booktitle = "Proceedings of the Doctoral Symposium of the 17th International Middleware Conference",

publisher = "Association for Computing Machinery",

}

TY - GEN

T1 - High Throughput Tertiary Storage in HPC Environments

AU - Jensen, Klaus Birkelund

PY - 2016/12/12

Y1 - 2016/12/12

N2 - Magnetic tape in High Performance Computing (HPC) environments has traditionally been used as a tertiary layer in a Hierarchical Storage Management (HSM) system. We propose that tape be given a more central role in the HPC data centre with direct involvement of the batch scheduler. To this end, we have begun development of a purpose-built tape storage system called Tapr. The write strategy used by Tapr allows the system to provide precise estimates on transfer time of data from tertiary storage to primary fast parallel storage.

AB - Magnetic tape in High Performance Computing (HPC) environments has traditionally been used as a tertiary layer in a Hierarchical Storage Management (HSM) system. We propose that tape be given a more central role in the HPC data centre with direct involvement of the batch scheduler. To this end, we have begun development of a purpose-built tape storage system called Tapr. The write strategy used by Tapr allows the system to provide precise estimates on transfer time of data from tertiary storage to primary fast parallel storage.

U2 - 10.1145/3009925.3009934

DO - 10.1145/3009925.3009934

M3 - Konferencebidrag i proceedings

BT - Proceedings of the Doctoral Symposium of the 17th International Middleware Conference

PB - Association for Computing Machinery

CY - New York, USA

ER -