Given the significant heterogeneity and complexity of the land surface, there are significant barriers to fully exploiting the information content of remote sensing datasets. While there has been significant progress in the use of land data assimilation methods, majority of them still rely on the use of retrieval products to incorporate them within land surface models. The reliance on retrieval model products, which have their own associated biases and uncertainties has been limiting. In soil moisture data assimilation instances, for example, remote sensing retrievals are often rescaled to match the climatology of the model because of the large scale systematic differences between the model and remote sensing retrieval estimates. These rescaling approaches lead to loss of information and are inadequate in handling dynamic changes in bias characteristics, and when unmodeled processes are present. The use of optimization tools to reduce the systematic errors in the model, therefore, is desirable. The traditional calibration approaches, however, are computationally expensive, limiting their application over large/fine spatial scales. Here we demonstrate the use of advanced machine learning tools for the effective reduction of systematic errors in a computationally efficient manner. The presentation will also discuss how the use of machine learning is impactful in improving the information content of retrieval products. For example, though there has been a long legacy of passive microwave radiometry for snow mass estimation, most of the retrievals are fraught with issues of limited skill over mountains and forests and insufficient interannual variability. The use of advanced machine learning tools is more effective in exploiting the relative sensitivities in radiance measurements for improving these limitations. The presentation will also describe how the machine learning applications provide inferences on improving model representations.

Our current ability to parameterize plant water dynamics in land surface model (LSM) constrains our capacity to understand of land-atmosphere processes, and our ability to represent the response of ecosystems to drought (Powell et al., 2013). Microwave remote sensing datasets contain valuable information about plant water content variations from sub-daily scale to interannual scales under saturation or water stress (Konings et al., 2017; Steele-Dunne et al., 2019) and can be assimilated to constrain plant water dynamics in LSMs. Recent research has shown that the backscatter-incidence angle relationship of the Advanced Scatterometer (ASCAT) data varies in response to changes in vegetation water content and phenology. In this study, we are working towards assimilating these data to constrain water dynamics in a LSM. Firstly, we addressed the challenge about how to reconcile the states and parameters of the LSM with the satellite observations. A Deep Neural Network (DNN) was trained to link the ASCAT observables to the soil moisture in different layers and the vegetation-related states. Secondly, we assimilated ASCAT dynamic vegetation parameters into land surface model ISBA-A-gs. In a study over France from 2007 to 2019, the DNN is used to simulate the normalized backscatter as well as the slope and curvature of the backscatter-incidence angle relationship. Results show that the DNN has a near zero bias for normalized backscatter and slope. A sensitivity analysis shows that ASCAT observables are sensitive to variations in not only surface soil moisture and LAI, but also root zone soil moisture because of the dependency of plant water content on soil moisture in deeper layers. Further, assimilation results show improvement of estimates of soil moisture and LAI. Furthermore, this method is highly transferable and lends itself to multi-observation assimilation. This paves the way to constrain vegetation water processes in LSMs using all available satellite data.

In the context of climate warming, the frequency and the intensity of extreme events such as droughts is increasing and better modeling of the response of vegetation to climate is needed. Monitoring the impact of extreme events on terrestrial surfaces involves a number of variables of the soil-plant system such as surface albedo, the soil water content and the vegetation leaf area index (LAI). These variables can be monitored by either using the unprecedented amount of data from the Earth observation satellite fleet, or using land surface models. Another solution consists in combining all available sources of information by assimilating satellite observations into models. In this work, C-band Advanced SCATterometer (ASCAT) Radar backscatter (sigma0), L-band Soil Moisture and Ocean Salinity (SMOS) Vertical and Horizontal brightness Temperatures (V and H BT) satellite products are assimilated in the ISBA land surface model of Meteo-France using the LDAS-Monde tool. First, observation operators are built using machine learning. Neural networks (NNs) are trained using the modeled surface soil moisture (SSM), soil temperature, rainwater interception by leaves, and satellite-derived LAI observations from Copernicus as inputs. The NNs are then used to find the statistical relationship between the input data and the satellite products, making LDAS-Monde capable of assimilating the satellite observations. It is shown that the assimilation of level 1 data alone is able to markedly improve the simulated LAI and SSM.

For more than 10 years, different approaches have been developed by the international scientific community to optimize the parameters of biosphere models by assimilating different types of observations. These are essentially based on a Bayesian formalism with the minimisation of a cost function that takes into account all the errors associated with the model (structural errors and errors associated with the parameters) as well as the observations and our a priori knowledge of the parameters (assuming also Gaussian error distributions). Key examples include variational approaches (i.e., using a gradient method which requires the calculation of the sensitivity of the cost function to the parameters), Monte Carlo approaches (genetic algorithms, Markov chains, etc.) or “filter” approaches (i.e. Kalman filter, particle filter, etc.). Within the framework of the optimisation of the global continental surface model, ORCHIDEE, we have developed an assimilation system (ORCHIDAS) and tested mainly 2 methods (gradient method and genetic algorithm): see https://orchidas.lsce.ipsl.fr/. However, recent developments have highlighted alternative methods, based on ensemble filters or using physical model emulators, which offer advantages, particularly with regard to i) the numerical speed of the optimisation and ii) the ease of assimilating a set of observations of various natures. In this presentation, we look in particular at History Matching – a method based on emulation techniques developed by the uncertainty quantification community for the calibration of model parameters and successfully applied to climate models. We discuss the advantage of this technique (with respect to the gradient method and a genetic algorithm) and test the potential of this new approach in calibrating ORCHIDEE. The test case will consist in assimilating in situ data of water and carbon flux measurements (about 100 sites) and satellite proxies of vegetation activity (solar-induced fluorescence – SIF) to evaluate the respective performances of the different methods: level of fit to the observations, sensitivity to local minima of the cost function, computation time, etc.

Precipitation is one of the most important variables in hydrological studies because it provides the ultimate source of water resources, and occasionally causes severe disasters. Therefore, estimating spatio-temporal distributions of precipitation has been a key challenge in hydrological studies. Rain gauge stations provide essential ground truth data that is used to calibrate satellite/ground radar observations and numerical weather prediction models. However, there have been few studies that have explored optimization methods of rain gauge locations. For the rain gauge placement in this study, we use the data-driven sparse sensor placement (SSP) method, which has been developed in informatics science. This method determines the optimal sensor locations so that the selected sensors effectively determine coefficients of proper orthogonal decomposition (POD) modes. The original SSP method reconstructs the spatial patterns of data from the selected sensors by solving a linear inverse problem using the POD modes. This study extends the existing SSP method for the problem of rain gauge placements by incorporating singular values of POD in addition to the POD modes. We also introduce two to reconstruct spatial patterns of precipitation. One is the data assimilation approach that can estimate the spatial patterns better than the simple linear inverse problem owing to Tikhonov regularization. The other implementation is the localization for eliminating erroneous sampling noise and increasing the rank of background error covariance. We applied the proposed method for the placements of rain gauge observations over Hokkaido Island in Japan. Here we used 14-day accumulated precipitation of radar observations from 2006 to 2016 as training data. Based on the POD modes of the training data, observation locations were determined. We estimate spatial patterns of precipitation from selected points of precipitation by data assimilation, and compared with reference radar data for 2017-2018. The optimized locations of rain gauge stations by SSP method reconstruct more accurate spatial patterns of precipitation than the fields reconstructed with operationally distributed rain gauge locations.

Over the past decade, application of data assimilation – DA – techniques has become a key component of land surface modelling. DA does not only enable improving the parameterization of terrestrial biosphere models (TBMs) but can also help pinpointing some of their deficiencies. When earlier DA works mostly assimilated only one data-stream, the benefit and challenges of assimilating multiple datasets had to be explored. Indeed, a greater number and diversity of observations should provide stronger constraints on model parameters, including a wider range of processes,hence further reducing model uncertainty. However, a major challenge in the joint assimilation of multiple data-streams concerns the inconsistencies between observations and model outputs, which are usually not accounted for in common “”bias-blind”” Bayesian DA systems relying on the hypothesis of Gaussian errors. The likely impact of model-data biases on the parameter optimization is a degraded model performance as well as an illusory decrease in the estimated model uncertainty.

In this study, we illustrate the challenges of assimilating simultaneous multiple datasets related to the carbon cycle within the ORCHIDAS assimilation system associated with the ORCHIDEE TBM: net ecosystem carbon exchange and latent heat fluxes measured at eddy covariance sites across different ecosystems, satellite derived Normalised Difference Vegetation Index and monthly atmospheric CO2 concentration data measured at surface stations. To address the question of the compatibility between the data-streams, we conducted diverse assimilation experiments in which the different data-streams were assimilated alone or together. Hindcasts performed with these different calibrated models enabled us to quantify the relative model improvement with respect to each data-stream, and to identify whether a given dataset complements or contradicts the other data within the DA system and the ORCHIDEE model structure. We also present statistical diagnostics that were applied to check the consistency of the prior errors on model parameters and observations, and the information content brought by each individual data stream within the joint assimilation framework.

Earth system models (ESMs) generate great uncertainty partly because ESMs use constant parameters. More and more evidence show that model parameter values must vary over time and space to realistically simulate ecosystem dynamics well. Indeed, parameter values that are estimated using data assimilation vary with sites and treatments in global change experiments. Varying parameters are to account for both processes at unresolved scales and changing properties of evolving systems. A model, no matter how complex it is, could not represent all the processes of one system at resolved scales. Interactions of processes at unresolved scales with those at resolved scales should be reflected in model parameters. Meanwhile, it is pervasively observed that properties of ecosystems change over time, space, and environmental conditions. Parameters, which represent properties of a system under study, should change as well. Data assimilation estimates parameter values at individual sites. The site-level estimates of parameters have to be upscaled by a deep learning model to predict spatially heterogeneous parameters at regional and global scales so that modelled and observed ecosystem dynamics are maximally matched.

The Amazon River basin contains a substantial amount of carbon stored within terrestrial ecosystems. The unknown fate of this this carbon remains a substantial source of uncertainty in projections of the Earth system. While increasing atmospheric carbon dioxide concentrations could potentially enhance photosynthetic carbon uptake and/or reduce transpiration, increasing vapor pressure deficits have the potential to act with the opposite sign on both of these fluxes. Here, we investigate these competing factors at a process level, using the Carbon Data Modeling Framework (CARDAMOM), a data assimilation system in which we constrain a parsimonious ecosystem model with observations from river runoff gauging stations, gravimetric water storage anomalies, and solar-induced chlorophyll fluorescence. Several incremental advances to CARDAMOM have enabled the use of watershed-scale constraints, which allows us to produce observationally consistent reanalyses of the coupled carbon and water cycles in 14 watersheds across the Amazon basin. We find that the response to trends in atmospheric carbon dioxide concentrations and meteorological drivers varies across a hydroclimatic gradient within the Amazon, with implications for how carbon and water cycling could be expected to change subject to future biogeochemical and climatic trends.

High latitude wetlands are key stores of organic carbon (C), and play a major role in the greenhouse gas balance of high-latitude ecosystems. The carbon-climate feedback potential of high latitude wetlands remains poorly understood, not least due to uncertainty on competing temperature and precipitation controls on CO2 and CH4 carbon-dioxide (CO2) uptake, and decomposition of soil C into CO2 and methane (CH4) fluxes. In particular, while CH4 fluxes typically account for a smaller component of the C balance, the climatic impact of CH4 outweighs CO2, given its 28-34 times larger Global Warming Potential (GWP) on a 100 years scale, highlighting the need to jointly resolve the climatic sensitivities of both CO2 and CH4. To quantitatively assess the carbon-climate feedback potential of wetland ecosystems, we developed a simple Joint-CO2-CH4-Respiration scheme (JCR) in a terrestrial biosphere model (DALEC) and used a data-model integration approach (CARbon Data Model fraMework, CARDAMOM) to produce a data-constrained analysis of environmental controls of carbon exchange and its sensitivity to inter-annual variations and trends in climate change at seven high-latitude wetland eddy covariance sites. The observation-optimized model accurately represents seasonal and inter-annual variability of CH4 and CO2 fluxes. Based on observation-constrained model processes, we perturb meteorological forcings to quantify the sensitivity of CH4 and CO2 fluxes to potential inter-annual variations and trends in precipitation and temperature. Overall, we find that (i) precipitation, rather than temperature, dominates the NEE and CH4 sensitivities to climate through soil moisture, and (ii) the sign of the GWP response reversed depending on precipitation levels in warming scenarios. A warmer and drier climate may decrease total GWP by 0.01 ± 0.02 gCO2/m2/day, and a warmer and wetter climate increase GWP by 0.05 ± 0.03 gCO2/m2/day in these high-latitude wetland ecosystems. We demonstrate joint observational constraints on CO2 and CH4, which is the key to understanding high-latitude ecosystem responses in the coming decades, and highlights the need to reduce uncertainty on both (a) CO2 and CH4 biogeochemistry, (b) climatic changes in coming decades, to improve assessment of wetland carbon-climate feedback potential.

The ensemble Kalman filter (EnKF) is an advanced data assimilation method using the flow-dependent forecast error covariance estimated by an ensemble of model forecasts. Among various kinds of EnKFs, the ensemble transform Kalman filter (ETKF; Bishop et al 2001; Hunt et al 2007) is an efficient method for parallel computations, and has been widely used for Earth system models such as for atmosphere, ocean, and land surface models. Our group has been developing an ETKF-based data assimilation algorithm (https://github.com/skotsuki/speedy-lpf). In addition to the classical ETKF, this algorithm incorporates a local particle filter and its Gaussian Mixture extension (Kotsuki et al. 2022), and hybrid background error covariance model (Kotsuki and Bishop 2022) as the form of ETKF. We have been developing this ETKF-based algorithm for the global atmospheric data assimilation system known as NEXRA, which is currently running operationally on the JAXA’s third-generation supercomputing system. The ETKF-based algorithm has an additional advantage in representing weakly-coupled or strongly-coupled land-atmosphere data assimilation easily by regulating the ensemble transform matrix for land and atmospheric components. This talk introduces our ensemble data assimilation algorithm and its developmental concept. We also show its applications to global atmospheric and land-atmospheric data assimilation experiments. For example, we are exploring the optimal coupled land-atmosphere data assimilation method in the NEXRA for improving weather and hydrological forecasts by assimilating soil moisture data. We found that updating atmospheric variables by assimilating soil moisture data improves soil moisture analysis and forecasts and mitigates a warm temperature bias in the lower troposphere where a dry soil moisture bias exists. However, updating soil moisture by assimilating atmospheric observations has detrimental impacts on soil moisture analysis and forecasts. This talk also introduces our recent work on land data assimilation of satellite-sensed land surface temperature for a Japanese land surface model SiBUC.

The paper introduces STEMMUS (i.e. the model considering coupled liquid, vapor, dry air and heat transport in soil) together with a data assimilation platform, to check how different model complexities can affect the model performance in estimating soil moisture and soil temperature in an arid environment, for a sub-weekly time period. The different model complexities were achieved by including or excluding different coupling mechanisms in the STEMMUS, for example, the diffusion-based mechanism (DM), the coupled moisture and heat transport mechanism through the inclusion of vapor flow (DMV) and the comprehensively coupled mechanism including dry airflow (DMVA). The results show that the model physics does not play a great role in affecting soil moisture estimations, when the soil moisture observation is dense. Even for sparse soil moisture observation (>6hr observational interval), there is no obvious advantage of either complex or simple model in estimating soil moisture in the data assimilation system. However, the designing of the observation interval, at which the observed soil moisture data will be assimilated, is deemed important in affecting the data assimilation result of soil moisture, especially when the soil experiences wetting-drying cycles. The earlier assimilation of the soil moisture responses to such cycle will lead to better estimations. For soil temperature, different model complexities do play a role in affecting the data assimilation results. The complex model performs better than the simple model in estimating soil temperature. The simple model cannot constrain the soil temperature dynamics at deeper layer when the observation of soil temperature is limited.

Atmospheric inversions require prior flux estimates. Land data assimilation systems can provide these prior flux estimates. What are some of the features that could be provided by the land DA community that would make the operators of atmospheric inversion systems smile? I will provide a review of our group’s efforts at land DA aimed toward improving prior flux estimates for atmospheric inversions. I will also present a “wish list” from the atmospheric inversion community. My aim is to open a discussion that will increase collaboration between the land DA and atmospheric inversion communities.

Current approaches to bottom-up disturbance monitoring rely heavily on the detection of land-use, land-use change, and forestry (LULUCF) through remote sensing, but often account for ecosystem impacts using simple look-up tables. By contrast, process models are frequently used to analyze and predict disturbance dynamics in greater detail. Once observations are available, however, we need to update predictions, especially for stochastic processes such as disturbance. State data assimilation (SDA) is designed specifically to update predictions, nudging modeled states back toward reality in proportion to the uncertainties in the model and the data, but current SDA algorithms are designed to update continuous states, not discrete disturbances. Here we develop a new Bayesian SDA algorithm that combines a discrete Multinomial state-and-transition framework with conventional ensemble filtering SDA approaches. To demonstrate the potential for assimilating disturbance, we applied the Multinomial SDA to the Very Simple Ecosystem Model (VSEM), performing both simulated data experiments with known disturbances and testing the algorithm against real-world disturbances detected in the LandTrender data product for central Oregon. With simulated disturbance we demonstrate the ability to not only detect discrete disturbance events but also avoid false positives. We also demonstrated the ability to fuse multiple data types to successfully distinguish different disturbance types, and to probabilistically capture vegetation type ‘switching’ events within the assimilation and ensemble forecast. To apply this to real-world data we calibrated VSEM against eddy-covariance and ancillary data from the Ameriflux US-Me2 tower. We then selected 356 conifer forest sites for testing, using the Landtrendr disturbance product to stratify by four disturbance types (cut, burn, pest, and other). We then assimilated the 30m Landtrendr annual aboveground biomass product from 1990-2017 and assessed the rate of disturbance detection. Assimilating just AGB, our assimilation was sensitive to disturbances that reduced biomass by 1.5 kg/m2 but underpredicted defoliation disturbances, which we expect would be improved by also assimilating LAI. Moving forward, the SDA framework provides an exciting opportunity to fuse multiple data sources to holistically improve real-time disturbance detection, impact assessment (e.g. carbon sequestration), and forecasts of both disturbance events and post-disturbance recovery within a single integrated system.

This presentation will review aspects related to the generation of ensembles for ensemble-based land data assimilation, for both offline and coupled land/atmosphere systems, using examples drawn from the development of a new land data assimilation system for the NOAA National Centers for Environmental Prediction (NCEP) global data assimilation and numerical weather prediction (NWP) system. Several different schemes for perturbing the soil (moisture and temperature) states in NCEP’s cycling NWP / data assimilation system have been tested, starting with the approaches used in offline land data assimilation systems. Offline systems typically account for model uncertainty in ensembles by perturbing a selection of atmospheric forcing and model state variables. In most cases, the perturbed atmospheric forcing is generated by adding statistically-generated perturbations to a single atmospheric realization (say from a model forecast or observations, or a combination of both). However, most atmospheric reanalysis and NWP systems are now ensemble-based, and ensembles of forecasts from different atmospheric realizations are now available. While the atmospheric fields used to force land models are generally under-dispersed in these ensembles, it is beneficial to use these fields in place of perturbing a single atmospheric realization, since this ensures internal consistency between the atmospheric variables in each ensemble member, while also providing more accurate spatial variation in the model forcing uncertainty. It is also shown that adding perturbations to the soil moisture states, as is often done in offline systems, generates unrealistic spatial patterns in the resulting ensemble spread. By contrast, perturbing the land model parameters, in this case vegetation fraction, generates a more realistic distribution in the ensemble spread, while also inducing perturbations in the land and atmosphere that are consistent with errors in the land/atmosphere fluxes. The latter is important since it leads to ensemble error cross-covariances that reflect the uncertainty the fluxes that determine the land/atmosphere coupling. By contrast, perturbation methods that target only one component (say adding perturbations to either the atmospheric or land states) will lead to overestimated ensemble error covariances where that component is driving the coupling between the components, and underestimated covariances where the other component is driving the coupling.