Preprints
https://doi.org/10.5194/egusphere-2024-1469
https://doi.org/10.5194/egusphere-2024-1469
10 Jun 2024
 | 10 Jun 2024
Status: this preprint is open for discussion.

Modular approach to near-time data management for multi-city atmospheric environmental observation campaigns

Matthias Zeeman, Andreas Christen, Sue Grimmond, Daniel Fenner, William Morrison, Gregor Feigel, Markus Sulzer, and Nektarios Chrysoulakis

Abstract. Urban observation networks are becoming denser, more diverse, and more mobile, while being required to provide results in near-time. The Synergy Grant urbisphere funded by the European Research Council (ERC) has multiple simultaneous field campaigns in cities of different sizes collecting data, for improving weather and climate models and services, including assessing the impact of cities on the atmosphere (e.g., heat, moisture, pollutant and aerosol emissions) and people's exposure to extremes (e.g., heat waves, heavy precipitation, air pollution episodes). Here, a solution to this challenge for facilitating diverse data streams, from multiple sources, scales (e.g., indoors, regional-scale atmospheric boundary layer) and cities is presented.

For model development and evaluation in heterogeneous urban environments, we need meshed networks of in situ observations with ground-based and airborne (remote-)sensing platforms. In this contribution we describe challenges, approaches and solutions for data management, data infrastructure, and data governance to handle the variety of data streams from primarily novel modular observation networks deployed in multiple cities, in combination with existing data collected by partners, ranging in scale from indoor sensor deployments to regional-scale boundary layer observations.

A metadata system documents: (1) sensors/instruments, (2) location and configuration of deployed components, and (3) maintenance and events. This metadata system provides the backbone for converting instrument records to calibrated, location-aware, convention-aligned and quality-assured data products, according to FAIR (Findable, Accessible, Interoperable and Reusable) principles. The data management infrastructure provides services (via, e.g., APIs, Apps, ICEs) for data inspection and subsequent calculations by campaign participants. Some near real-time distributions are made to international networks (e.g., AERONET, Phenocam) or local agencies (e.g., GovDATA) with appropriate attribution. The data documentation conventions, used to ensure structured data sets, in this case are used to improve the delivery of integrated urban services, such as to research and operational agencies, across many cities.

Publisher's note: Copernicus Publications remains neutral with regard to jurisdictional claims made in the text, published maps, institutional affiliations, or any other geographical representation in this preprint. The responsibility to include appropriate place names lies with the authors.
Matthias Zeeman, Andreas Christen, Sue Grimmond, Daniel Fenner, William Morrison, Gregor Feigel, Markus Sulzer, and Nektarios Chrysoulakis

Status: open (until 18 Jul 2024)

Comment types: AC – author | RC – referee | CC – community | EC – editor | CEC – chief editor | : Report abuse
Matthias Zeeman, Andreas Christen, Sue Grimmond, Daniel Fenner, William Morrison, Gregor Feigel, Markus Sulzer, and Nektarios Chrysoulakis
Matthias Zeeman, Andreas Christen, Sue Grimmond, Daniel Fenner, William Morrison, Gregor Feigel, Markus Sulzer, and Nektarios Chrysoulakis

Viewed

Total article views: 167 (including HTML, PDF, and XML)
HTML PDF XML Total BibTeX EndNote
117 41 9 167 6 5
  • HTML: 117
  • PDF: 41
  • XML: 9
  • Total: 167
  • BibTeX: 6
  • EndNote: 5
Views and downloads (calculated since 10 Jun 2024)
Cumulative views and downloads (calculated since 10 Jun 2024)

Viewed (geographical distribution)

Total article views: 164 (including HTML, PDF, and XML) Thereof 164 with geography defined and 0 with unknown origin.
Country # Views %
  • 1
1
 
 
 
 
Latest update: 22 Jun 2024
Download
Short summary
Overview of a data system for documenting, processing, managing and publishing data streams from research networks of atmospheric/environmental sensors of varying complexity in urban environments. Our solutions aim to deliver resilient, near-time data using freely-available software.