<?xml version="1.0" encoding="UTF-8"?>
<!DOCTYPE article PUBLIC "-//NLM//DTD Journal Publishing DTD v3.0 20080202//EN" "https://jats.nlm.nih.gov/nlm-dtd/publishing/3.0/journalpublishing3.dtd">
<article xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink" article-type="research-article" specific-use="SMUR" dtd-version="3.0" xml:lang="en">
<front>
<journal-meta>
<journal-id journal-id-type="publisher">EGUsphere</journal-id>
<journal-title-group>
<journal-title>EGUsphere</journal-title>
<abbrev-journal-title abbrev-type="publisher">EGUsphere</abbrev-journal-title>
<abbrev-journal-title abbrev-type="nlm-ta">EGUsphere</abbrev-journal-title>
</journal-title-group>
<publisher><publisher-name>Copernicus Publications</publisher-name>
<publisher-loc>Göttingen, Germany</publisher-loc>
</publisher>
</journal-meta>
<article-meta>
<article-id pub-id-type="doi">10.5194/egusphere-2026-4514</article-id>
<title-group>
<article-title>Lossy compression by dimension reduction &amp;ndash; Evaluation of methods applied to 2-d meteorological fields for data-based modeling</article-title>
</title-group>
<contrib-group><contrib contrib-type="author" xlink:type="simple"><name name-style="western"><surname>Ehret</surname>
<given-names>Uwe</given-names>
<ext-link>https://orcid.org/0000-0003-3454-8755</ext-link>
</name>
<xref ref-type="aff" rid="aff1">
<sup>1</sup>
</xref>
</contrib>
<contrib contrib-type="author" xlink:type="simple"><name name-style="western"><surname>Chen</surname>
<given-names>Jieyu</given-names>
<ext-link>https://orcid.org/0000-0002-8151-5916</ext-link>
</name>
<xref ref-type="aff" rid="aff2">
<sup>2</sup>
</xref>
</contrib>
<contrib contrib-type="author" xlink:type="simple"><name name-style="western"><surname>Scholz</surname>
<given-names>Fedor</given-names>
<ext-link>https://orcid.org/0000-0001-8201-5924</ext-link>
</name>
<xref ref-type="aff" rid="aff3">
<sup>3</sup>
</xref>
</contrib>
<contrib contrib-type="author" xlink:type="simple"><name name-style="western"><surname>Allen</surname>
<given-names>Sam</given-names>
</name>
<xref ref-type="aff" rid="aff4">
<sup>4</sup>
</xref>
</contrib>
<contrib contrib-type="author" xlink:type="simple"><name name-style="western"><surname>Lerch</surname>
<given-names>Sebastian</given-names>
<ext-link>https://orcid.org/0000-0002-3467-4375</ext-link>
</name>
<xref ref-type="aff" rid="aff5">
<sup>5</sup>
</xref>
</contrib>
</contrib-group><aff id="aff1">
<label>1</label>
<addr-line>Institute of Water and Environment, Karlsruhe Institute of Technology (KIT), Karlsruhe, Germany</addr-line>
</aff>
<aff id="aff2">
<label>2</label>
<addr-line>Institute of Statistics, Nanjing University of Information Science and Technology, Nanjing, China</addr-line>
</aff>
<aff id="aff3">
<label>3</label>
<addr-line>Stuttgart Center for Simulation Science, Cluster of Excellence EXC 2075, University of Stuttgart, Stuttgart, Germany</addr-line>
</aff>
<aff id="aff4">
<label>4</label>
<addr-line>Institute of Statistics, Karlsruhe Institute of Technology (KIT), Karlsruhe, Germany</addr-line>
</aff>
<aff id="aff5">
<label>5</label>
<addr-line>Department of Mathematics and Computer Science, Marburg University, Marburg, Germany</addr-line>
</aff>
<pub-date pub-type="epub">
<day>08</day>
<month>10</month>
<year>2026</year>
</pub-date>
<volume>2026</volume>
<fpage>1</fpage>
<lpage>25</lpage>
<permissions>
<copyright-statement>Copyright: &#x000a9; 2026 Uwe Ehret et al.</copyright-statement>
<copyright-year>2026</copyright-year>
<license license-type="open-access">
<license-p>This work is licensed under the Creative Commons Attribution 4.0 International License. To view a copy of this licence, visit <ext-link ext-link-type="uri"  xlink:href="https://creativecommons.org/licenses/by/4.0/">https://creativecommons.org/licenses/by/4.0/</ext-link></license-p>
</license>
</permissions>
<self-uri xlink:href="https://egusphere.copernicus.org/preprints/2026/egusphere-2026-4514/">This article is available from https://egusphere.copernicus.org/preprints/2026/egusphere-2026-4514/</self-uri>
<self-uri xlink:href="https://egusphere.copernicus.org/preprints/2026/egusphere-2026-4514/egusphere-2026-4514.pdf">The full text article is available as a PDF file from https://egusphere.copernicus.org/preprints/2026/egusphere-2026-4514/egusphere-2026-4514.pdf</self-uri>
<abstract>
<p>Data sets in the geosciences continue to grow in size, and data compression methods can facilitate efficient data storage, transfer, and utilization. Related workflows in geoscience modelling typically involve data generation (e.g. via weather forecasting), followed by compression, transfer, decompression, extraction of local subsets, and integrations into downstream tasks such as hydrological modelling. Recently, data-driven models have been introduced into geoscientific workflows with great success, allowing input data sources and types to be used in much more flexible ways than in classical numerical models, e.g. by directly using the compressed data. In this study, we therefore address the questions on 1) how various lossy compression algorithms compare in terms of general properties such as computational effort and their ability to extract spatial subsets directly from the compressed representation, and 2) how they compare in terms of compression efficiency and reproduction error. We focus on dimension reduction methods, as the resulting low-dimensional representations require fewer input channels in downstream data-driven models, thereby reducing computational costs and the risk of overfitting. We compare several dimension reduction methods in an application to five years of hourly air temperature and rainfall data, in the form of 2-d gridded spatial fields spanning a 100,000 km&amp;sup2; domain in central Germany. The methods we compare are: Block Averaging, Principal Component Analysis, an Autoencoder, and the Ramer-Douglas-Peucker algorithm. We measure compression by the number of distinguishable objects in the compressed representation, rather than by file size, keeping in mind the potential use of the compressed data as input to data-driven models. This approach directly relates dimension reduction/compression to the number of input channels of a data-driven model, which is typically limited to avoid overfitting. Our results indicate that the methods differ substantially in terms of training and computational overhead, preservation of field-scale statistics, and the possibility to extract spatial subsets directly from the compressed representation. All methods demonstrated very good compression efficiency, with low reconstruction errors even for 99 % compression. For the spatially smooth temperature fields, Principal Component Analysis performed best, followed by the Autoencoder. For the spatially heterogeneous rainfall fields, the Autoencoder and the Ramer-Douglas-Peucker algorithm were most effective. The choice of the best method therefore depends on the specific application. This study provides a step towards a more efficient use of geoscientific data in downstream applications, either by directly using compressed data as input to data-driven models, or by efficiently extracting spatial subsets from compressed data, and using these subsets as input to local numerical models.</p>
</abstract>
<counts><page-count count="25"/></counts>
<funding-group>
<award-group id="gs1">
<funding-source>Vector Stiftung</funding-source>
<award-id>Young Investigator Group Artificial Intelligence for Probabilistic Weather Forecasting</award-id>
<award-id>Project Zukunftsfähige Modellierung für die Geowissenschaften</award-id>
</award-group>
<award-group id="gs2">
<funding-source>Deutsche Forschungsgemeinschaft</funding-source>
<award-id>SFB/TRR 165 Waves to Weather</award-id>
</award-group>
</funding-group>
</article-meta>
</front>
<body/>
<back>
</back>
</article>