the Creative Commons Attribution 4.0 License.
the Creative Commons Attribution 4.0 License.
Enhancing the advection module performance in the EPICC-Model V1.6.0 via GPU-HADVPPM4HIP V1.0 coupling and GPU-optimized strategies
Abstract. The rapid development of Graphics Processing Units (GPUs) has established new computational paradigms for enhancing air quality modeling efficiency. In this study, the heterogeneous-compute interface for portability (HIP) was implemented to parallel computing of the piecewise parabolic method (PPM) advection solver (HADVPPM) on China’s domestic GPU-like accelerators (GPU-like), resulting in a GPU-accelerated version denoted as GPU-HADVPPM4HIP V1.0. Computational performance was enhanced through three strategic optimizations: reducing the central processing unit (CPU) and GPU (CPU-GPU) data transfer frequency, thread-block coordinated indexing, and the Message Passing Interface (MPI) and HIP (“MPI+HIP”) hybrid parallelization across heterogeneous computing clusters. Following validation of the GPU-HADVPPM4HIP V1.0 program’s offline computational consistency and the pollutant simulation performance of the Emission and atmospheric Processes Integrated and Coupled Community version 1.6.0 (EPICC-Model V1.6.0) on the Earth System Numerical Simulation Facility (EarthLab), comprehensive performance testing was conducted. Offline benchmark results demonstrated that GPU-HADVPPM4HIP V1.0 achieved a maximum speedup of 556.5x on a GPU-like using the compiler optimization option compared to the Fortran HADVPPM baseline compiled option for a data size of 108. Integrating GPU-HADVPPM4HIP V1.0 into EPICC-Model V1.6.0 yielded three distinct versions: the initial HIP-based version (HIP-Ori), a version optimized for CPU and GPU communication frequency (HIP‑Opt1), and a further-optimized version employing a thread‑block coordinated indexing strategy (HIP‑Opt2). Compared to the HIP‑Ori version, HIP‑Opt1 achieved a model‑level computational efficiency improvement of 17.0x. Building upon HIP‑Opt1, HIP‑Opt2 delivered an additional 1.5x enhancement in computational efficiency. At the module level, including CPU and GPU data transfer overhead, the GPU implementation improves computational efficiency of the advection module by 39.3 %; when communication cost is excluded, the advection module attains a 20.5× acceleration relative to its CPU counterpart. This coupling establishes a foundational framework for adapting air quality models to GPU-like architectures and identifies critical optimization pathways. Moreover, the methodology provides essential technical support for achieving full-model GPU implementation of the EPICC-Model, addressing both current computational constraints and future demands for high-resolution air quality simulations.
- Preprint
(7151 KB) - Metadata XML
-
Supplement
(74 KB) - BibTeX
- EndNote
Status: open (until 24 Aug 2026)
-
RC1: 'Comment on egusphere-2026-3368', Anonymous Referee #1, 21 Jul 2026
reply
-
AC1: 'Reply on RC1', Qizhong Wu, 07 Aug 2026
reply
We sincerely thank the referee for the positive and encouraging assessment of our work. We also appreciate the referee’s constructive comments, which have helped us improve the clarity and technical completeness of the manuscript. Our point-by-point responses are provided in the attached supplement.
-
AC1: 'Reply on RC1', Qizhong Wu, 07 Aug 2026
reply
-
RC2: 'Comment on egusphere-2026-3368', Anonymous Referee #2, 02 Aug 2026
reply
The authors have addressed all of my major comments from the original submission. The revised manuscript shows significant improvements. I believe that GPU-accelerated computing will be important in the future if the data transfer bottleneck between the host and device can be resolved. Future generations of accelerated devices and CPUs are expected to be more tightly integrated.
Figures 6 and 7 have not been referenced or discussed in the main text.
Figure 6, the caption should be expanded to describe the left, middle, and right panels. Specify the units of color bar (ppbV, ugm-3, %). Reduce the color bar scale to see the difference between the two models. Include O3 in your evaluation because it is an important air pollutant.
Tables 5 and 6, include the normalized mean bias, as it is an important metric. Since each species has different concentration range. For example, the mean concentration of O3 is about 30 ppbV, while HONO is around 1 ppbV.
Provide the definition of GPU-like accelerator.
Citation: https://doi.org/10.5194/egusphere-2026-3368-RC2
Viewed
| HTML | XML | Total | Supplement | BibTeX | EndNote | |
|---|---|---|---|---|---|---|
| 116 | 33 | 15 | 164 | 13 | 12 | 8 |
- HTML: 116
- PDF: 33
- XML: 15
- Total: 164
- Supplement: 13
- BibTeX: 12
- EndNote: 8
Viewed (geographical distribution)
| Country | # | Views | % |
|---|
| Total: | 0 |
| HTML: | 0 |
| PDF: | 0 |
| XML: | 0 |
- 1
General Comments
The authors present a hardware-accelerated implementation of the EPICC air quality model’s horizontal advection scheme, demonstrating impressive computational performance improvements achieved through clever and careful source code translation and refactoring, although these improvements are offset by data transfer overhead. The authors couple the accelerated advection module back into the full model and demonstrate that this heterogeneous model implementation retains code integrity to produce reasonable simulation results. Moreover, the authors present a thorough performance analysis. Taken together, this is a comprehensive and impressive effort that may offer an impetus for the air quality modeling community to collectively modernize model codebases towards enabling the kind of ultra-high-resolution simulations that are necessary to characterize urban- and neighborhood-scale pollution, the scales at which communities experience harmful exposures. My comments and brief and minor.
Specific comments
Line 130: Please include, along with brief term definitions, the species continuity equation explicitly.
Line 217, 599-600: Considering the substantial CPU-GPU data transfer overhead, could a cluster deploying EPICC with GPU-HADVPPM4HIP V1.0 on a cluster with PCIe 5.0 buses, offering double the bandwidth of PCIe 4.0, expect to see additional efficiency improvements? Please include a brief discussion of hardware outlook. Regardless, I commend the authors’ focus on software optimization rather than relying purely on hardware capabilities, so that the model is maximally performant across diverse hardware and not only the latest generation.
Technical corrections
Line 45: “Air pollution, a source of…” may be better worded as “Air pollution, including…”
Line 83: Please define “HPL score”.
Line 92: Reword “enabling automated generates…” to “enabling automated generation of…”.
Line 108: “Air quality models-the advection module…” may be scan better with a comma instead of a hyphen.
Line 127: “Air pollution complex in China” maybe is meant to be “complex air pollution in China”?
Line 133: Change “developed using Fortran program language…” to include “the: between “using” and “Fortran”.
Figure 1: Wet scavenging typo for RADM; aqueous-phase chemistry seems to reference the vertical diffusion schemes.
Line 216: Change “two China’s domestic CPU…” to “two of China’s domestic CPU…”