Exploring and analyzing the real impact of modern on-package memory on HPC scientific kernels

TY - CHAP

T1 - Exploring and analyzing the real impact of modern on-package memory on HPC scientific kernels

AU - Li, Ang

AU - Liu, Weifeng

AU - Kristensen, Mads RB

AU - Vinter, Brian

AU - Wang, Hao

AU - Hou, Kaixi

AU - Marquez, Andres

AU - Song, Shuaiwen Leon

PY - 2017/11/12

Y1 - 2017/11/12

N2 - High-bandwidth On-Package Memory (OPM) innovates the conventional memory hierarchy by augmenting a new on-package layer between classic on-chip cache and off-chip DRAM. Due to its relative location and capacity, OPM is often used as a new type of LLC. Despite the adaptation in modern processors, the performance and power impact of OPM on HPC applications, especially scientific kernels, is still unknown. In this paper, we fill this gap by conducting a comprehensive evaluation for a wide spectrum of scientific kernels with a large amount of representative inputs, including dense, sparse and medium, on two Intel OPMs: eDRAM on multicore Broadwell and MCDRAM on manycore Knights Landing. Guided by our general optimization models, we demonstrate OPM's effectiveness for easing programmers' tuning efforts to reach ideal throughput for both compute-bound and memory-bound applications.

AB - High-bandwidth On-Package Memory (OPM) innovates the conventional memory hierarchy by augmenting a new on-package layer between classic on-chip cache and off-chip DRAM. Due to its relative location and capacity, OPM is often used as a new type of LLC. Despite the adaptation in modern processors, the performance and power impact of OPM on HPC applications, especially scientific kernels, is still unknown. In this paper, we fill this gap by conducting a comprehensive evaluation for a wide spectrum of scientific kernels with a large amount of representative inputs, including dense, sparse and medium, on two Intel OPMs: eDRAM on multicore Broadwell and MCDRAM on manycore Knights Landing. Guided by our general optimization models, we demonstrate OPM's effectiveness for easing programmers' tuning efforts to reach ideal throughput for both compute-bound and memory-bound applications.

U2 - 10.1145/3126908.3126931

DO - 10.1145/3126908.3126931

M3 - Book chapter

SN - 978-145035114-0/17/11

VL - 17

BT - Proceedings of the International Conference for High Performance Computing, Networking, Storage and Analysis, SC

CY - Denver, USA

ER -