Preprints
https://doi.org/10.5194/egusphere-2022-1221
https://doi.org/10.5194/egusphere-2022-1221
20 Dec 2022
 | 20 Dec 2022

Positive Matrix Factorization of Large Aerosol Mass Spectrometry Datasets Using Error-Weighted Randomized Hierarchical Alternating Least Squares

Benjamin Sapper, Daven Henze, Manjula Canagaratna, and Harald Stark

Abstract. Weighted positive matrix factorization (PMF) has been used by scientists to find small sets of underlying factors in environmental data. However, as the size of the data has grown, increasing computational costs have made it impractical to use traditional methods for this factorization. In this paper, we present a new weighting method to dramatically decrease computational costs for these traditional algorithms. We then apply this weighting method with the Randomized Hierarchical Alternating Least Squares (RHALS) algorithm to a large environmental dataset, where we show that interpretable factors can be reproduced using these methods. We show this algorithm results in a computational speedup of 38, 67, and 634 compared to the Multiplicative Update (MU), deterministic Hierarchical Alternating Least Squares (HALS), and non-negative Alternating Least Squares (ALS) algorithms, respectively. We also investigate rotational ambiguity in the solution, and present a simple “pulling” method to rotate a set of factors. This method is shown to find alternative solutions, and in some cases, lower the weighted residual error of the algorithm.

Publisher's note: Copernicus Publications remains neutral with regard to jurisdictional claims made in the text, published maps, institutional affiliations, or any other geographical representation in this preprint. The responsibility to include appropriate place names lies with the authors.
Benjamin Sapper, Daven Henze, Manjula Canagaratna, and Harald Stark

Status: final response (author comments only)

Comment types: AC – author | RC – referee | CC – community | EC – editor | CEC – chief editor | : Report abuse
  • RC1: 'Comment on egusphere-2022-1221', Anonymous Referee #1, 11 Apr 2023
  • RC2: 'Comment on egusphere-2022-1221', Anonymous Referee #2, 20 Apr 2023
Benjamin Sapper, Daven Henze, Manjula Canagaratna, and Harald Stark
Benjamin Sapper, Daven Henze, Manjula Canagaratna, and Harald Stark

Viewed

Total article views: 914 (including HTML, PDF, and XML)
HTML PDF XML Total BibTeX EndNote
604 267 43 914 29 36
  • HTML: 604
  • PDF: 267
  • XML: 43
  • Total: 914
  • BibTeX: 29
  • EndNote: 36
Views and downloads (calculated since 20 Dec 2022)
Cumulative views and downloads (calculated since 20 Dec 2022)

Viewed (geographical distribution)

Total article views: 883 (including HTML, PDF, and XML) Thereof 883 with geography defined and 0 with unknown origin.
Country # Views %
  • 1
1
 
 
 
 
Latest update: 22 Nov 2024
Download
Short summary
Positive Matrix Factorization (PMF) has been used by atmospheric scientists to extract underlying factors present in large datasets. This paper presents a new technique for weighted PMF that drastically reduces the computational costs of previously developed algorithms. We use this technique to deliver interpretative factors and solution diagnostics from an atmospheric chemistry dataset.