Category: PublicationsRA2

Coupled data assimilation for climate prediction: a focus on ocean-atmosphere coupling (PhD thesis)

Lilian Carolina Garcia Oliva (2024-10-17): Coupled data assimilation for climate prediction: a focus on ocean-atmosphere coupling. PhD thesis, University of Bergen, Bergen, Norway. https://hdl.handle.net/11250/3157446

Summary: Seasonal-to-Decadal (S2D) climate predictions can provide decision-making information for diverse sectors, such as food security, energy and climate adaptation. The initial condition of the ocean is fundamental for providing skilful S2D predictions. A method to estimate the ocean’s initial condition is by merging the model and observations through a process called Coupled Data Assimilation (CDA). Ocean observations have demonstrated their potential to achieve skilful prediction. The Norwegian Climate Prediction Model (NorCPM) features an advanced Ocean Data Assimilation (ODA) scheme based on an ensemble method. This thesis outlines our efforts to improve S2D predictions within the NorCPM using atmospheric observations.

Link to publication. You are most welcome to contact us or the corresponding author(s) directly, if you have questions.

Hybrid covariance super-resolution data assimilation

Barthélémy, S., Counillon, F., Brajard, J., Bertino, L. 2024: Hybrid covariance super-resolution data assimilation. Ocean Dynamics. https://doi.org/10.1007/s10236-024-01643-6

Summary: The super-resolution data assimilation (SRDA) enhances a low-resolution (LR) model with a Neural Network (NN) that has learned the differences between high and low-resolution models offline and performs data assimilation in high-resolution (HR). The method enhances the accuracy of the EnKF-LR system for a minor computational overhead. However, performance quickly saturates when the ensemble size is increased due to the error introduced by the NN. We therefore combine the SRDA with the mixed-resolution data assimilation method (MRDA) into a method called “Hybrid covariance super-resolution data assimilation” (Hybrid SRDA). The forecast step runs an ensemble at two resolutions (high and low). The assimilation is done in the HR space by performing super-resolution on the LR members with the NN. The assimilation uses the hybrid covariance that combines the emulated and dynamical HR members. The scheme is extensively tested with a quasi-geostrophic model in twin experiments, with the LR grid being twice coarser than the HR. The Hybrid SRDA outperforms the SRDA, the MRDA, and the EnKF-HR at a given computational cost. The benefit is the largest compared to the EnKF-HR for small ensembles. However, even with larger computational resources, using a mix of high and low-resolution members is worth it. Besides, the Hybrid SRDA, the EnKF-HR, and the SRDA, unlike the MRDA, prevent the smoothing of dynamical structures of the background error covariance matrix. The Hybrid SRDA method is also attractive because it is customizable to available resources.

Link to publication. You are most welcome to contact us or the corresponding author(s) directly, if you have questions.

Earth System Reanalysis in Support of Climate Model Improvements

Stammer, D., Amrhein, D.E., Alonso Balmaseda, M., Bertino, L., Bonavita, M., Buontempo, C., Caltabiano, N., Counillon, F., Fenty, I., Ferrari, R., Fujii, Y., et al. 2024: Earth System Reanalysis in Support of Climate Model Improvements. Bull. Amer. Meteor. Soc.. https://doi.org/10.1175/BAMS-D-24-0110.1

Summary: A 3-day workshop took place from 12 to 14 June 2023, at the Massachusetts Institute of Technology (MIT), Cambridge, Massachusetts, focusing on data assimilation (DA) and machine learning (ML) in the context of Earth system reanalysis and climate model improvements.
The workshop, organized 25 years after the inception of the Estimating the Circulation and Climate of the Ocean (ECCO), was an effort to lay out the roadmap for future development of DA in support of climate modeling and climate knowledge improvements, or “climate DA.” The following is a summary of the workshop outcomes and recommendations arising to move the field of DA forward in the context of climate modeling.
Recent climate model developments, established through increased model resolution, have led to substantial improvements in model simulations of the time-evolving, coupled Earth system and its subcomponents. However, regardless of resolution, climate models will always produce climate features and variability that differ from the real world and will be prone to biases. This is due to many remaining uncertainties, such as in parametric and structural model uncertainty, in the initial conditions prescribed, and in the prescribed (scenario) forcing which varies on decadal to centennial time scales.
Further model improvements are expected to arise specifically from the improved representation of physical processes realized through model–data fusion. This will create an unprecedented opportunity to better exploit a large array of Earth observations, from in situ measurements to weather radars and satellite observations, as the resolved scales of the models approach those of the observations. For this, climate DA will be the central tool to bring models and observations into consistency, by improving initial conditions, inferring uncertain model parameters and structure, and quantifying uncertainty. Generally, there will be advantages and complementarities of adjoint-based smoother approaches, ensemble-based filter approaches, or new ML-inspired approaches. Yet the ever-increasing model resolution will present growing challenges arising from computational cost, calling for new ways of performing data assimilation and model optimization. Using the complementarity in a hybrid approach, blending tools and concepts from variational, ensemble, and ML methods might be what is required in the future. In this context, ML could be important to handle nonlinear responses and to better approximate non-Gaussian distributions.

Link to publication. You are most welcome to contact us or the corresponding author(s) directly, if you have questions.

Predicting September Arctic Sea Ice: A Multimodel Seasonal Skill Comparison

Bushuk, M., Ali, S., Bailey, D.A., Bao, Q., Batté, L., Bhatt, U.S., Blanchard-Wrigglesworth, E., Blockley, E., Cawley, G., Chi, J., Counillon, F., et al. 2024: Predicting September Arctic Sea Ice: A Multimodel Seasonal Skill Comparison. Bull. Amer. Meteor. Soc.. https://doi.org/10.1175/BAMS-D-23-0163.1

Summary: This study quantifies the state of the art in the rapidly growing field of seasonal Arctic sea ice prediction. A novel multimodel dataset of retrospective seasonal predictions of September Arctic sea ice is created and analyzed, consisting of community contributions from 17 statistical models and 17 dynamical models. Prediction skill is compared over the period 2001–20 for predictions of pan-Arctic sea ice extent (SIE), regional SIE, and local sea ice concentration (SIC) initialized on 1 June, 1 July, 1 August, and 1 September. This diverse set of statistical and dynamical models can individually predict linearly detrended pan-Arctic SIE anomalies with skill, and a multimodel median prediction has correlation coefficients of 0.79, 0.86, 0.92, and 0.99 at these respective initialization times. Regional SIE predictions have similar skill to pan-Arctic predictions in the Alaskan and Siberian regions, whereas regional skill is lower in the Canadian, Atlantic, and central Arctic sectors. The skill of dynamical and statistical models is generally comparable for pan-Arctic SIE, whereas dynamical models outperform their statistical counterparts for regional and local predictions. The prediction systems are found to provide the most value added relative to basic reference forecasts in the extreme SIE years of 1996, 2007, and 2012. SIE prediction errors do not show clear trends over time, suggesting that there has been minimal change in inherent sea ice predictability over the satellite era. Overall, this study demonstrates that there are bright prospects for skillful operational predictions of September sea ice at least 3 months in advance.

Link to publication. You are most welcome to contact us or the corresponding author(s) directly, if you have questions.

Adaptive Covariance Hybridization for the Assimilation of SST Observations Within a Coupled Earth System Reanalysis

Barthélémy, S., Counillon, F., Wang, Y. 2024: Adaptive Covariance Hybridization for the Assimilation of SST Observations Within a Coupled Earth System Reanalysis. JAMES. https://doi.org/10.1029/2023MS003888

Summary: Data assimilation is a statistical method that reduces uncertainty in a model, based on observations. Because of their ease of implementation, the ensemble data assimilation methods, that rely on the statistics of a finite ensemble of realizations of the model, are popular for climate reanalysis and prediction. However, observations are sparse—mostly near the surface—and the sampling error from data assimilation method introduces a deterioration in the deep ocean. We use a method that complements this ensemble with a pre-existing database of model states to reduce sampling error. We show that the approach substantially reduces error at the intermediate and deep ocean. The method typically requires the tunning of a parameter, but we show that it can be estimated online, achieving the best performance.

Link to publication. You are most welcome to contact us or the corresponding author(s) directly, if you have questions.

Probabilistic models for harmful algae: application to the Norwegian coast

Silva, E., Brajard, J., Counillon, F., Pettersson, L.H., Naustvoll, L. 2024: Probabilistic models for harmful algae: application to the Norwegian coast. Environmental Data Science. https://doi.org/10.1017/eds.2024.11

Summary: We have developed probabilistic models to estimate the likelihood of harmful algae presence and outbreaks along the Norwegian coast, which can help optimization of the national monitoring program and the planning of mitigation actions. We employ support vector machines to calibrate probabilistic models for estimating the presence and harmful abundance (HA) of eight toxic algae found along the Norwegian coast, including Alexandrium spp., Alexandrium tamarense, Dinophysis acuta, Dinophysis acuminata, Dinophysis norvegica, Pseudo-nitzschia spp., Protoceratium reticulatum, and Azadinium spinosum. The inputs are sea surface temperature, photosynthetically active radiation, mixed layer depth, and sea surface salinity. The probabilistic models are trained with data from 2006 to 2013 and tested with data from 2014 to 2019. The presence models demonstrate good statistical performance across all taxa, with R (observed presence frequency vs. predicted probability) ranging from 0.69 to 0.98 and root mean squared error ranging from 0.84% to 7.84%. Predicting the probability of HA is more challenging, and the HA models only reach skill with four taxa (Alexandrium spp., A. tamarense, D. acuta, and A. spinosum). There are large differences in seasonal and geographical variability and sensitivity to the model input of different taxa, which are presented and discussed. The models estimate geographical regions and periods with relatively higher risk of toxic species presence and HA, and might optimize the harmful algae monitoring. The method can be extended to other regions as it relies only on remote sensing and model data as input and running national programs of toxic algae monitoring.

Link to publication. You are most welcome to contact us or the corresponding author(s) directly, if you have questions.

A simple statistical post-processing scheme for enhancing the skill of seasonal SST predictions in the tropics

Richter, I., Ratnam, J.V., Martineau, P., Oettli, P., Doi, T., Ogata, T., Kataoka, T., Counillon, F. 2024: A simple statistical post-processing scheme for enhancing the skill of seasonal SST predictions in the tropics. Monthly Weather Review. https://doi.org/10.1175/MWR-D-23-0266.1

Summary: The prediction of year-to-year climate variability patterns, such as El Niño, offers potential benefits to society by aiding mitigation and adaptation efforts. Current prediction systems, however, may still have substantial room for improvement due to systematic model errors and due to imperfect initialization of the oceanic state at the start of predictions. Here we develop a statistical correction scheme to improve prediction skill after forecasts have been completed. The scheme shows some moderate success in improving the skill for predicting El Niño and similar climate patterns in seven prediction systems. Our results not only indicate a potential for improving prediction skill after the fact but also point to the importance of improving the way prediction systems are initialized.

Link to publication. You are most welcome to contact us or the corresponding author(s) directly, if you have questions.

Intercomparison of initialization methods for Seasonal-to-Decadal Climate Predictions with the NorCPM

Garcia-Oliva, L., Counillon, F., Bethke, I., Keenlyside, N. 2024: Intercomparison of initialization methods for Seasonal-to-Decadal Climate Predictions with the NorCPM. Clim Dyn. https://doi.org/10.1007/s00382-024-07170-w

Summary: Initialization is essential for accurate seasonal-to-decadal (S2D) climate predictions. The initialization schemes used differ on the component initialized, the Data Assimilation method, or the technique. We compare five popular schemes within NorCPM following the same experimental protocol: reanalysis from 1980 to 2010 and seasonal and decadal predictions initialized from the reanalysis. We compare atmospheric initialization—Newtonian relaxation (nudging)—against ocean initialization—Ensemble Kalman Filter—(ODA). On the atmosphere, we explore the benefit of full-field (NudF-UVT) or anomaly (NudA-UVT) nudging of horizontal winds and temperature (U, V, and T) observations. The scheme NudA-UV nudges horizontal winds to disentangle the role of wind-driven variability. The ODA+NudA-UV scheme is a first attempt at joint initialization of ocean and atmospheric components in NorCPM. During the reanalysis, atmospheric nudging improves the synchronization of the atmosphere and land components with the observed data. Conversely, ODA is more effective at synchronizing the ocean component with observations. The atmospheric nudging schemes are better at reproducing specific events, such as the rapid North Atlantic subpolar gyre shift. An abrupt climatological change using the NudA-UV scheme demonstrates that energy conservation is crucial when only assimilating winds. ODA outperforms atmospheric-initialized versions for S2D global predictions, while atmospheric nudging is preferable for accurately initializing phenomena in specific regions, with the technique’s benefit depending on the prediction’s temporal scale. For instance, atmospheric full-field initialization benefits the tropical Atlantic Niño at 1-month lead time, and atmospheric anomaly initialization benefits longer lead times, reducing hindcast drift. Combining atmosphere and ocean initialization yields sub-optimal results, as sustaining the ensemble’s reliability—required for ODA’s performance—is challenging with atmospheric nudging.

Link to publication. You are most welcome to contact us or the corresponding author(s) directly, if you have questions.

Initialization shock in the ocean circulation reduces skill in decadal predictions of the North Atlantic subpolar gyre

Polkova, I, Swingedouw, D., Hermanson, L., Köhl, A., Stammer, D., Smith, D., Kröger, J., Bethke, I., Yang, X., Zhang, L., Nicolì, D., Athanasiadis, P., Karami, P., Pankatz, K., Pohlmann, H., Wu, B., Bilbao, R., Ortega, P., Yang, S., Sospedra-Alfonso, R., Merryfield, W., Kataoka, T., Tatebe, H., Imada, Y., Ishii, M., Matear, R. 2023: Initialization shock in the ocean circulation reduces skill in decadal predictions of the North Atlantic subpolar gyre. Front Clim. doi: https://doi.org/10.3389/fclim.2023.1273770

Summary: Due to large northward heat transport, the Atlantic meridional overturning circulation (AMOC) strongly affects the climate of various regions. Its internal variability has been shown to be predictable decades ahead within climate models, providing the hope that synchronizing ocean circulation with observations can improve decadal predictions, notably of the North Atlantic subpolar gyre (SPG). Climate predictions require a starting point which is a reconstruction of the past climate. This is usually performed with data assimilation methods that blend available observations and climate model states together. There is no unique method to derive the initial conditions. Moreover, this can be performed using full-field observations or their anomalies superimposed on the model’s climatology to avoid strong drifts in predictions. How critical ocean circulation drifts are for prediction skill has not been assessed yet. We analyze this possible connection using the dataset of 12 decadal prediction systems from the World Meteorological Organization Lead Centre for Annual-to-Decadal Climate Prediction. We find a variety of initial AMOC errors within the predictions related to a dynamically imbalanced ocean states leading to strongly displaced or multiple maxima in the overturning structures. This likely results in a blend of what is known as model drift and initial shock. We identify that the AMOC initialization influences the quality of the SPG predictions. When predictions show a large initial error in their AMOC, they usually have low skill for predicting internal variability of the SPG for a time horizon of 6-10 years. Full-field initialized predictions with low AMOC drift show better SPG skill than those with a large AMOC drift. Nevertheless, while the anomaly-initialized predictions do not experience large drifts, they show low SPG skill when skill also present in historical runs is removed using a residual correlation metric. Thus, reducing initial shock and model biases for the ocean circulation in prediction systems might help to improve their prediction for the SPG beyond 5 years. Climate predictions could also benefit from quality-check procedure for assimilation/initialization because currently the research groups only reveal the problems in initialization once the set of predictions has been completed, which is an expensive effort.

Link to publication. You are most welcome to contact us or the corresponding author(s) directly, if you have questions.

Supermodeling: improving predictions with an ensemble of interacting models

Schevenhoven , F., Keenlyside, N., Counillon, F., Carrassi, A., Chapman, W.E., Devilliers, M., Gupta, A., Koseki, S., Selten, F., Shen, M.L., Wang, S. 2023: Supermodeling: improving predictions with an ensemble of interacting models. BAMS. https://doi.org/10.1175/BAMS-D-22-0070.1

Summary: The modeling of weather and climate has been a success story. The skill of forecasts continues to improve and model biases continue to decrease. Combining the output of multiple models has further improved forecast skill and reduced biases. But are we exploiting the full capacity of state-of-the-art models in making forecasts and projections? Supermodeling is a recent step forward in the multimodel ensemble approach. Instead of combining model output after the simulations are completed, in a supermodel individual models exchange state information as they run, influencing each other’s behavior. By learning the optimal parameters that determine how models influence each other based on past observations, model errors are reduced at an early stage before they propagate into larger scales and affect other regions and variables. The models synchronize on a common solution that through learning remains closer to the observed evolution. Effectively a new dynamical system has been created, a supermodel, that optimally combines the strengths of the constituent models. The supermodel approach has the potential to rapidly improve current state-of-the-art weather forecasts and climate predictions. In this paper we introduce supermodeling, demonstrate its potential in examples of various complexity, and discuss learning strategies. We conclude with a discussion of remaining challenges for a successful application of supermodeling in the context of state-of-the-art models. The supermodeling approach is not limited to the modeling of weather and climate, but can be applied to improve the prediction capabilities of any complex system, for which a set of different models exists.

Link to publication. You are most welcome to contact us or the corresponding author(s) directly, if you have questions.