International Journal of Networked and Distributed Computing

Volume 1, Issue 4, November 2013, Pages 213 - 225

Performance Characteristics of Hybrid MPI/OpenMP Scientific Applications on a Largescale Multithreaded BlueGene/Q Supercomputer

Authors
Xingfu Wu, Valerie Taylor
Corresponding Author
Xingfu Wu
Available Online 1 November 2013.
DOI
https://doi.org/10.2991/ijndc.2013.1.4.3How to use a DOI?
Keywords
Performance analysis, hybrid MPI/OpenMP, multithreaded, BlueGene/Q
Abstract
Many/multi-core supercomputers provide a natural programming paradigm for hybrid MPI/OpenMP scientific applications. In this paper, we investigate the performance characteristics of five hybrid MPI/OpenMP scientific applications (two NAS Parallel benchmarks Multi-Zone SP-MZ and BT-MZ, an earthquake simulation PEQdyna, an aerospace application PMLB and a 3D particle-in-cell application GTC) on a large-scale multithreaded BlueGene/Q supercomputer at Argonne National laboratory, and quantify the performance gap resulting from using different number of threads per node. We use performance tools and MPI profile and trace libraries available on the supercomputer to analyze and compare the performance of these hybrid scientific applications with increasing the number OpenMP threads per node, and find that increasing the number of threads to some extent saturates or worsens performance of these hybrid applications. For the strong-scaling hybrid scientific applications such as SP-MZ, BT-MZ, PEQdyna and PLMB, using 32 threads per node results in much better application efficiency than using 64 threads per node, and as increasing the number of threads per node, the FPU percentage decreases, and the MPI percentage (except PMLB) and IPC per core (except BT-MZ) increase. For the weak-scaling hybrid scientific application such as GTC, the performance trend (relative speedup) is very similar with increasing number of threads per node no matter how many nodes (32, 128, 512) are used.
Open Access
This is an open access article distributed under the CC BY-NC license.

Download article (PDF)

Journal
International Journal of Networked and Distributed Computing
Volume-Issue
1 - 4
Pages
213 - 225
Publication Date
2013/11
ISSN (Online)
2211-7946
ISSN (Print)
2211-7938
DOI
https://doi.org/10.2991/ijndc.2013.1.4.3How to use a DOI?
Open Access
This is an open access article distributed under the CC BY-NC license.

Cite this article

TY  - JOUR
AU  - Xingfu Wu
AU  - Valerie Taylor
PY  - 2013
DA  - 2013/11
TI  - Performance Characteristics of Hybrid MPI/OpenMP Scientific Applications on a Largescale Multithreaded BlueGene/Q Supercomputer
JO  - International Journal of Networked and Distributed Computing
SP  - 213
EP  - 225
VL  - 1
IS  - 4
SN  - 2211-7946
UR  - https://doi.org/10.2991/ijndc.2013.1.4.3
DO  - https://doi.org/10.2991/ijndc.2013.1.4.3
ID  - Wu2013
ER  -