High Throughput Tertiary Storage in HPC Environments

Klaus Birkelund Jensen

doi:10.1145/3009925.3009934

High Throughput Tertiary Storage in HPC Environments

Klaus Birkelund Jensen

eScience

Abstract

Magnetic tape in High Performance Computing (HPC) environments has traditionally been used as a tertiary layer in a Hierarchical Storage Management (HSM) system. We propose that tape be given a more central role in the HPC data centre with direct involvement of the batch scheduler. To this end, we have begun development of a purpose-built tape storage system called Tapr. The write strategy used by Tapr allows the system to provide precise estimates on transfer time of data from tertiary storage to primary fast parallel storage.

Originalsprog	Dansk
Titel	Proceedings of the Doctoral Symposium of the 17th International Middleware Conference
Antal sider	2
Udgivelsessted	New York, USA
Forlag	Association for Computing Machinery
Publikationsdato	12 dec. 2016
Artikelnummer	9
ISBN (Elektronisk)	978-1-4503-4665-8
DOI	https://doi.org/10.1145/3009925.3009934
Status	Udgivet - 12 dec. 2016

Adgang til dokumentet

10.1145/3009925.3009934

a9-jensenForlagets udgivne version, 578 KB

Citationsformater

@inproceedings{0114346a43794b129ec9ba0c483297e6,

title = "High Throughput Tertiary Storage in HPC Environments",

abstract = "Magnetic tape in High Performance Computing (HPC) environments has traditionally been used as a tertiary layer in a Hierarchical Storage Management (HSM) system. We propose that tape be given a more central role in the HPC data centre with direct involvement of the batch scheduler. To this end, we have begun development of a purpose-built tape storage system called Tapr. The write strategy used by Tapr allows the system to provide precise estimates on transfer time of data from tertiary storage to primary fast parallel storage.",

author = "Jensen, {Klaus Birkelund}",

year = "2016",

month = dec,

day = "12",

doi = "10.1145/3009925.3009934",

language = "Dansk",

booktitle = "Proceedings of the Doctoral Symposium of the 17th International Middleware Conference",

publisher = "Association for Computing Machinery",

}

TY - GEN

T1 - High Throughput Tertiary Storage in HPC Environments

AU - Jensen, Klaus Birkelund

PY - 2016/12/12

Y1 - 2016/12/12

N2 - Magnetic tape in High Performance Computing (HPC) environments has traditionally been used as a tertiary layer in a Hierarchical Storage Management (HSM) system. We propose that tape be given a more central role in the HPC data centre with direct involvement of the batch scheduler. To this end, we have begun development of a purpose-built tape storage system called Tapr. The write strategy used by Tapr allows the system to provide precise estimates on transfer time of data from tertiary storage to primary fast parallel storage.

AB - Magnetic tape in High Performance Computing (HPC) environments has traditionally been used as a tertiary layer in a Hierarchical Storage Management (HSM) system. We propose that tape be given a more central role in the HPC data centre with direct involvement of the batch scheduler. To this end, we have begun development of a purpose-built tape storage system called Tapr. The write strategy used by Tapr allows the system to provide precise estimates on transfer time of data from tertiary storage to primary fast parallel storage.

U2 - 10.1145/3009925.3009934

DO - 10.1145/3009925.3009934

M3 - Konferencebidrag i proceedings

BT - Proceedings of the Doctoral Symposium of the 17th International Middleware Conference

PB - Association for Computing Machinery

CY - New York, USA

ER -