Preprints
https://doi.org/10.5194/egusphere-2023-3045
https://doi.org/10.5194/egusphere-2023-3045
26 Mar 2024
 | 26 Mar 2024

Enabling High Performance Cloud Computing for the Community Multiscale Air Quality Model (CMAQ) version 5.3.3: Performance Evaluation and Benefits for the User Community

Christos I. Efstathiou, Elizabeth Adams, Carlie J. Coats, Robert Zelt, Mark Reed, John McGee, Kristen M. Foley, Fahim I. Sidi, David C. Wong, Steven Fine, and Saravanan Arunachalam

Abstract. The Community Multiscale Air Quality (CMAQ) Model is a local-to-hemispheric scale numerical air quality modeling system developed by the U.S. Environmental Protection Agency (USEPA) and supported by the Center for Community Modeling and Analysis System (CMAS). CMAQ is used for regulatory purposes by the USEPA program offices and state and local air agencies, and is also widely used by the broader global research community to simulate and understand complex air quality processes and for computational environmental fate and transport, and climate and health impact studies. Leveraging state-of-the-science cloud computing resources for high performance computing (HPC) applications, CMAQ is now available as a fully tested, publicly available technology stack (HPC cluster and software stack) for two major cloud service providers (CSPs). Specifically, CMAQ configurations and supporting materials have been developed for use on their HPC clusters, including extensive online documentation, tutorials, and guidelines to scale and optimize air quality simulations using their services. These resources allow modelers to rapidly bring together CMAQ, cloud-hosted datasets, and visualization and evaluation tools on ephemeral clusters that can be deployed quickly and reliably worldwide. Described here are considerations in CMAQ v5.3.3 cloud use and the supported resources for each CSP, presented through a benchmark application suite that was developed as an example of typical simulation for testing and verifying components of the modeling system. The outcomes of this effort are to provide findings from performing CMAQ simulations on the cloud using popular vendor provided resources, to enable the user community to adapt this for their own needs and identify specific areas of potential optimization with respect to storage and compute architectures.

Publisher's note: Copernicus Publications remains neutral with regard to jurisdictional claims made in the text, published maps, institutional affiliations, or any other geographical representation in this preprint. The responsibility to include appropriate place names lies with the authors.

Journal article(s) based on this preprint

19 Sep 2024
Enabling high-performance cloud computing for the Community Multiscale Air Quality Model (CMAQ) version 5.3.3: performance evaluation and benefits for the user community
Christos I. Efstathiou, Elizabeth Adams, Carlie J. Coats, Robert Zelt, Mark Reed, John McGee, Kristen M. Foley, Fahim I. Sidi, David C. Wong, Steven Fine, and Saravanan Arunachalam
Geosci. Model Dev., 17, 7001–7027, https://doi.org/10.5194/gmd-17-7001-2024,https://doi.org/10.5194/gmd-17-7001-2024, 2024
Short summary
Christos I. Efstathiou, Elizabeth Adams, Carlie J. Coats, Robert Zelt, Mark Reed, John McGee, Kristen M. Foley, Fahim I. Sidi, David C. Wong, Steven Fine, and Saravanan Arunachalam

Interactive discussion

Status: closed

Comment types: AC – author | RC – referee | CC – community | EC – editor | CEC – chief editor | : Report abuse
  • RC1: 'Comment on egusphere-2023-3045', Anonymous Referee #1, 21 Apr 2024
  • RC2: 'Comment on egusphere-2023-3045', Anonymous Referee #2, 23 Apr 2024

Interactive discussion

Status: closed

Comment types: AC – author | RC – referee | CC – community | EC – editor | CEC – chief editor | : Report abuse
  • RC1: 'Comment on egusphere-2023-3045', Anonymous Referee #1, 21 Apr 2024
  • RC2: 'Comment on egusphere-2023-3045', Anonymous Referee #2, 23 Apr 2024

Peer review completion

AR: Author's response | RR: Referee report | ED: Editor decision | EF: Editorial file upload
AR by Saravanan Arunachalam on behalf of the Authors (20 Jun 2024)  Author's response   Author's tracked changes   Manuscript 
ED: Publish subject to minor revisions (review by editor) (01 Jul 2024) by Xiaomeng Huang
ED: Publish as is (02 Jul 2024) by Xiaomeng Huang
AR by Saravanan Arunachalam on behalf of the Authors (13 Jul 2024)

Journal article(s) based on this preprint

19 Sep 2024
Enabling high-performance cloud computing for the Community Multiscale Air Quality Model (CMAQ) version 5.3.3: performance evaluation and benefits for the user community
Christos I. Efstathiou, Elizabeth Adams, Carlie J. Coats, Robert Zelt, Mark Reed, John McGee, Kristen M. Foley, Fahim I. Sidi, David C. Wong, Steven Fine, and Saravanan Arunachalam
Geosci. Model Dev., 17, 7001–7027, https://doi.org/10.5194/gmd-17-7001-2024,https://doi.org/10.5194/gmd-17-7001-2024, 2024
Short summary
Christos I. Efstathiou, Elizabeth Adams, Carlie J. Coats, Robert Zelt, Mark Reed, John McGee, Kristen M. Foley, Fahim I. Sidi, David C. Wong, Steven Fine, and Saravanan Arunachalam
Christos I. Efstathiou, Elizabeth Adams, Carlie J. Coats, Robert Zelt, Mark Reed, John McGee, Kristen M. Foley, Fahim I. Sidi, David C. Wong, Steven Fine, and Saravanan Arunachalam

Viewed

Total article views: 457 (including HTML, PDF, and XML)
HTML PDF XML Total BibTeX EndNote
329 102 26 457 14 17
  • HTML: 329
  • PDF: 102
  • XML: 26
  • Total: 457
  • BibTeX: 14
  • EndNote: 17
Views and downloads (calculated since 26 Mar 2024)
Cumulative views and downloads (calculated since 26 Mar 2024)

Viewed (geographical distribution)

Total article views: 461 (including HTML, PDF, and XML) Thereof 461 with geography defined and 0 with unknown origin.
Country # Views %
  • 1
1
 
 
 
 
Latest update: 19 Sep 2024
Download

The requested preprint has a corresponding peer-reviewed final revised paper. You are encouraged to refer to the final revised version.

Short summary
We present a summary of enabling high performance computing of CMAQ – a state-of-the-science regional-scale air quality model – on two popular cloud computing platforms, through documenting the technologies, model performance, scaling and relative merits. We anticipate that this may be a new paradigm for computationally intense future model applications in space and time. We initiated this work due to a growing need to leverage cloud computing advances and to ease learning curve for new users.