Near-Cloud Aerosol Retrieval Using Machine Learning Techniques, and Implied Direct Radiative Effects.

There is a lack of satellite-based aerosol retrievals in the vicinity of low-topped clouds, mainly because reflectance from aerosols is overwhelmed by three-dimensional cloud radiative effects. To account for cloud radiative effects on reflectance observations, we develop a Convolutional Neural Network and retrieve aerosol optical depth (AOD) with 100-500 m horizontal resolution for all cloud-free regions regardless of their distances to clouds. The retrieval uncertainty is 0.01 + 5%AOD, and the mean bias is approximately -2%. In an application to satellite observations, aerosol hygroscopic growth due to humidification near clouds enhances AOD by 100% in regions within 1 km of cloud edges. The humidification effect leads to an overall 55% increase in the clear-sky aerosol direct radiative effect. Although this increase is based on a case study, it highlights the importance of aerosol retrievals in near-cloud regions, and the need to incorporate the humidification effect in radiative forcing estimates.

Approximate Entropy and Sample Entropy: A Comprehensive Tutorial.

Approximate Entropy and Sample Entropy are two algorithms for determining the regularity of series of data based on the existence of patterns. Despite their similarities, the theoretical ideas behind those techniques are different but usually ignored. This paper aims to be a complete guideline of the theory and application of the algorithms, intended to explain their characteristics in detail to researchers from different fields. While initially developed for physiological applications, both algorithms have been used in other fields such as medicine, telecommunications, economics or Earth sciences. In this paper, we explain the theoretical aspects involving Information Theory and Chaos Theory, provide simple source codes for their computation, and illustrate the techniques with a step by step example of how to use the algorithms properly. This paper is not intended to be an exhaustive review of all previous applications of the algorithms but rather a comprehensive tutorial where no previous knowledge is required to understand the methodology.

Remote Sensing of Droplet Number Concentration in Warm Clouds: A Review of the Current State of Knowledge and Perspectives.

The cloud droplet number concentration (N d) is of central interest to improve the understanding of cloud physics and for quantifying the effective radiative forcing by aerosol-cloud interactions. Current standard satellite retrievals do not operationally provide N d, but it can be inferred from retrievals of cloud optical depth (τ c) cloud droplet effective radius (r e) and cloud top temperature. This review summarizes issues with this approach and quantifies uncertainties. A total relative uncertainty of 78% is inferred for pixel-level retrievals for relatively homogeneous, optically thick and unobscured stratiform clouds with favorable viewing geometry. The uncertainty is even greater if these conditions are not met. For averages over 1° ×1° regions the uncertainty is reduced to 54% assuming random errors for instrument uncertainties. In contrast, the few evaluation studies against reference in situ observations suggest much better accuracy with little variability in the bias. More such studies are required for a better error characterization. N d uncertainty is dominated by errors in r e, and therefore, improvements in r e retrievals would greatly improve the quality of the N d retrievals. Recommendations are made for how this might be achieved. Some existing N d data sets are compared and discussed, and best practices for the use of N d data from current passive instruments (e.g., filtering criteria) are recommended. Emerging alternative N d estimates are also considered. First, new ideas to use additional information from existing and upcoming spaceborne instruments are discussed, and second, approaches using high-quality ground-based observations are examined.

Passive remote sensing of altitude and optical depth of dust plumes using the oxygen A and B bands: first results from EPIC/DSCOVR at Lagrange-1 point.

We presented an algorithm for inferring aerosol layer height (ALH) and optical depth (AOD) over ocean surface from radiances in oxygen A and B bands measured by the Earth Polychromatic Imaging Camera (EPIC) on the Deep Space Climate Observatory orbiting at Lagrangian-1 point. The algorithm was applied to EPIC imagery of a two-day dust outbreak over the North Atlantic Ocean. Retrieved ALHs and AODs were evaluated against counterparts observed by Cloud-Aerosol Lidar with Orthogonal Polarization (CALIOP), Moderate Resolution Imaging Spectroradiometer (MODIS), and Aerosol Robotic Network. The comparisons showed 71.5% of EPIC-retrieved ALHs were within ±0.5 km of those determined from CALIOP and 74.4% of EPIC AOD retrievals fell within a ±(0.1+10%) envelope of MODIS retrievals. This study demonstrates the potential of EPIC measurements for retrieving global aerosol height multiple times daily, which are essential for evaluating aerosol profile simulated in climate models and for better estimating aerosol radiative effects.

The spectral invariant approximation within canopy radiative transfer to support the use of the EPIC/DSCOVR oxygen B-band for monitoring vegetation.

EPIC (Earth Polychromatic Imaging Camera) is a 10-channel spectroradiometer onboard DSCOVR (Deep Space Climate Observatory) spacecraft. In addition to the near-infrared (NIR, 780 nm) and the 'red' (680 nm) channels, EPIC also has the O2 A-band (764±0.2 nm) and B-band (687.75±0.2 nm). The EPIC Normalized Difference Vegetation Index (NDVI) is defined as the difference between NIR and 'red' channels normalized to their sum. However, the use of the O2 B-band instead of the 'red' channel mitigates the effect of atmosphere on remote sensing of surface reflectance because O2 reduces contribution from the radiation scattered by the atmosphere. Applying the radiative transfer theory and the spectral invariant approximation to EPIC observations, the paper provides supportive arguments for using the O2 band instead of the red channel for monitoring vegetation dynamics. Our results suggest that the use of the O2 B-band enhances the sensitivity of the top-of-atmosphere NDVI to the presence of vegetation.

Snow Grain Size Retrieval over the Polar Ice Sheets with the Ice, Cloud, and land Elevation Satellite (ICESat) Observations.

Snow grain size is an important parameter for cryosphere studies. As a proof of concept, this paper presents an approach to retrieve this parameter over Greenland, East and West Antarctica ice sheets from surface reflectances observed with the Geoscience Laser Altimeter System (GLAS) onboard the Ice, Cloud, and land Elevation Satellite (ICESat) at 1064 nm. Spaceborne lidar observations overcome many of the disadvantages in passive remote sensing, including difficulties in cloud screening and low sun angle limitations; hence tend to provide more accurate and stable retrievals. Results from the GLAS L2A campaign, which began on 25 September and lasted until 19 November, 2003, show that the mode of the grain size distribution over Greenland is the largest (~300 µm) among the three, West Antarctica is the second (~220 µm) and East Antarctica is the smallest (~190 µm). Snow grain sizes are larger over the coastal regions compared to inland the ice sheets. These results are consistent with previous studies. Applying the broadband snow surface albedo parameterization scheme developed by Garder and Sharp (2010) to the retrieved snow grain size, ice sheet surface albedo is also derived. In the future, more accurate retrievals can be achieved with multiple wavelengths lidar observations.

Hyperspectral remote sensing of foliar nitrogen content.

A strong positive correlation between vegetation canopy bidirectional reflectance factor (BRF) in the near infrared (NIR) spectral region and foliar mass-based nitrogen concentration (%N) has been reported in some temperate and boreal forests. This relationship, if true, would indicate an additional role for nitrogen in the climate system via its influence on surface albedo and may offer a simple approach for monitoring foliar nitrogen using satellite data. We report, however, that the previously reported correlation is an artifact--it is a consequence of variations in canopy structure, rather than of %N. The data underlying this relationship were collected at sites with varying proportions of foliar nitrogen-poor needleleaf and nitrogen-rich broadleaf species, whose canopy structure differs considerably. When the BRF data are corrected for canopy-structure effects, the residual reflectance variations are negatively related to %N at all wavelengths in the interval 423-855 nm. This suggests that the observed positive correlation between BRF and %N conveys no information about %N. We find that to infer leaf biochemical constituents, e.g., N content, from remotely sensed data, BRF spectra in the interval 710-790 nm provide critical information for correction of structural influences. Our analysis also suggests that surface characteristics of leaves impact remote sensing of its internal constituents. This further decreases the ability to remotely sense canopy foliar nitrogen. Finally, the analysis presented here is generic to the problem of remote sensing of leaf-tissue constituents and is therefore not a specific critique of articles espousing remote sensing of foliar %N.

Analyzing changes in the complexity of climate in the last four decades using MERRA-2 radiation data.

The energy balance of the Earth is controlled by the shortwave and longwave radiation emitted to space. Changes in the thermodynamic state of the system over time affect climate and are noticeable when viewing the system as a whole. In this paper, we study the changes in the complexity of climate in the last four decades using data from the Modern-Era Retrospective analysis for Research and Applications, Version 2 (MERRA-2). First, we study the complexity of the shortwave and longwave radiation fields independently using Approximate Entropy and Sample Entropy, observing that the rate of complexity change is faster for shortwave radiation. Then, we study the causality of those changes using Transfer Entropy to capture the non-linear dynamics of climate, showing that the changes are mainly driven by the variations in shortwave radiation. The observed behavior of climatic complexity could be explained by the changes in cloud amount, and we research that possibility by investigating its evolution from a complexity perspective using data from the International Satellite Cloud Climatology Project (ISCCP).

Exploring aerosols near clouds with high-spatial-resolution aircraft remote sensing during SEAC4RS.

Since aerosols are important to our climate system, we seek to observe the variability of aerosol properties within cloud systems. When applied to the satellite-borne Moderate-resolution Imaging Spectroradiometer (MODIS), the Dark Target (DT) retrieval algorithm provides global aerosol optical depth (AOD at 0.55 µm) in cloud-free scenes. Since MODIS' resolution (500 m pixels, 3 km or 10 km product) is too coarse for studying near-cloud aerosol, we ported the DT algorithm to the high-resolution (~50 m pixels) enhanced-MODIS Airborne Simulator (eMAS), which flew on the high-altitude ER-2 during the Studies of Emissions, Atmospheric Composition, Clouds and Climate Coupling by Regional Surveys (SEAC4RS) Airborne Science Campaign over the U.S. in 2013. We find that even with aggressive cloud screening, the ~0.5 km eMAS retrievals show enhanced AOD, especially within 6 km of a detected cloud. To determine the cause of the enhanced AOD, we analyze additional eMAS products (cloud retrievals and degraded-resolution AOD), co-registered Cloud Physics Lidar (CPL) profiles, MODIS aerosol retrievals, and ground-based Aerosol Robotic Network (AERONET) observations. We also define spatial metrics to indicate local cloud distributions near each retrieval, and then separate into near-cloud and far-from-cloud environments. The comparisons show that low cloud masking is robust, and unscreened thin cirrus would have only a small impact on retrieved AOD. Some of the enhancement is consistent with clear-cloud transition zone microphysics such as aerosol swelling. However, 3D radiation interaction between clouds and the surrounding clear air appears to be the primary cause of the high AOD near clouds.

Cloud Products from the Earth Polychromatic Imaging Camera (EPIC): Algorithms and Initial Evaluation.

This paper presents the physical basis of the EPIC cloud product algorithms and an initial evaluation of their performance. Since June 2015, EPIC has been providing observations of the sunlit side of the Earth with its 10 spectral channels ranging from the UV to the near-IR. A suite of algorithms has been developed to generate the standard EPIC Level 2 Cloud Products that include cloud mask, cloud effective pressure/height, and cloud optical thickness. The EPIC cloud mask adopts the threshold method and utilizes multichannel observations and ratios as tests. Cloud effective pressure/height is derived with observations from the O2 A-band (780 nm and 764 nm), and B-band (680 nm and 688 nm) pairs. The EPIC cloud optical thickness retrieval adopts a single channel approach where the 780 nm and 680 nm channels are used for retrievals over ocean and over land, respectively. Comparison with co-located cloud retrievals from geosynchronous earth orbit (GEO) and low earth orbit (LEO) satellites shows that the EPIC cloud product algorithms are performing well and are consistent with theoretical expectations. These products are publicly available at the Atmospheric Science Data Center at the NASA Langley Research Center for climate studies and for generating other geophysical products that require cloud properties as input.

Calibration of the DSCOVR EPIC visible and NIR channels using MODIS Terra and Aqua data and EPIC lunar observations.

The unique position of the Deep Space Climate Observatory (DSCOVR) Earth Polychromatic Imaging Camera (EPIC) at the Lagrange 1 point makes an important addition to the data from currently operating low orbit Earth observing instruments. EPIC instrument does not have an onboard calibration facility. One approach to its calibration is to compare EPIC observations to the measurements from polar orbiting radiometers. Moderate Resolution Imaging Spectroradiometer (MODIS) is a natural choice for such comparison due to its well-established calibration record and wide use in remote sensing. We use MODIS Aqua and Terra L1B 1km reflectances to infer calibration coefficients for four EPIC visible and NIR channels: 443 nm, 551 nm, 680 nm and 780 nm. MODIS and EPIC measurements made between June 2015 and June 2016 are employed for comparison. We first identify favorable MODIS pixels with scattering angle matching temporarily collocated EPIC observations. Each EPIC pixel is then spatially collocated to a subset of the favorable MODIS pixels within 25 km radius. Standard deviation of the selected MODIS pixels as well as of the adjacent EPIC pixels is used to find the most homogeneous scenes. These scenes are then used to determine calibration coefficients using a linear regression between EPIC counts/sec and reflectances in the close MODIS spectral channels. We present thus inferred EPIC calibration coefficients and discuss sources of uncertainties. The Lunar EPIC observations are used to calibrate EPIC O2 absorbing channels (688 nm and 764 nm) assuming that there is a small difference between moon reflectances separated by ~10 nm in wavelength provided the calibration factors of the red (680 nm) and near-IR (780 nm) are known from comparison between EPIC and MODIS.

EPIC Spectral Observations of Variability in Earth's Global Reflectance.

NASA's Earth Polychromatic Imaging Camera (EPIC) onboard NOAA's Deep Space Climate Observatory (DSCOVR) satellite observes the entire sunlit Earth every 65 to 110 min from the Sun-Earth Lagrangian L1 point. This paper presents initial EPIC shortwave spectral observations of the sunlit Earth reflectance and analyses of its diurnal and seasonal variations. The results show that the reflectance depends mostly on (1) the ratio between land and ocean areas exposed to the Sun and (2) cloud spatial and temporal distributions over the sunlit side of Earth. In particular, the paper shows that (a) diurnal variations of the Earth's reflectance are determined mostly by periodic changes in the land-ocean fraction of its the sunlit side; (b) the daily reflectance displays clear seasonal variations that are significant even without including the contributions from snow and ice in the polar regions (which can enhance daily mean reflectances by up to 2 to 6% in winter and up to 1 to 4% in summer); (c) the seasonal variations of the sunlit Earth reflectance are mostly determined by the latitudinal distribution of oceanic clouds.

Earth Observations from DSCOVR/EPIC Instrument.

The NOAA Deep Space Climate Observatory (DSCOVR) spacecraft was launched on February 11, 2015, and in June 2015 achieved its orbit at the first Lagrange point or L1, 1.5 million km from Earth towards the Sun. There are two NASA Earth observing instruments onboard: the Earth Polychromatic Imaging Camera (EPIC) and the National Institute of Standards and Technology Advanced Radiometer (NISTAR). The purpose of this paper is to describe various capabilities of the DSCOVR/EPIC instrument. EPIC views the entire sunlit Earth from sunrise to sunset at the backscattering direction (scattering angles between 168.5° and 175.5°) with 10 narrowband filters: 317, 325, 340, 388, 443, 552, 680, 688, 764 and 779 nm. We discuss a number of pre-processingsteps necessary for EPIC calibration including the geolocation algorithm and the radiometric calibration for each wavelength channel in terms of EPIC counts/second for conversion to reflectance units. The principal EPIC products are total ozone O3amount, scene reflectivity, erythemal irradiance, UV aerosol properties, sulfur dioxide SO2 for volcanic eruptions, surface spectral reflectance, vegetation properties, and cloud products including cloud height. Finally, we describe the observation of horizontally oriented ice crystals in clouds and the unexpected use of the O2 B-band absorption for vegetation properties.

Testing the Two-Layer Model for Correcting Near Cloud Reflectance Enhancement Using LES/SHDOM Simulated Radiances.

A transition zone exists between cloudy skies and clear sky, such that clouds scatter solar radiation into clear sky regions. From a satellite perspective, it appears that clouds enhance the radiation nearby. We seek a simple method to estimate this enhancement, since it is so computationally expensive to account for all 3-dimensional (3D) scattering processes. In previous studies, we developed a simple two-layer model (2LM) that estimated the radiation scattered via cloud-molecular interactions. Here we have developed a new model to accounts for cloud-surface interaction (CSI). We test the models by comparing to calculations provided by full 3D radiative transfer simulations of realistic cloud scenes. For these scenes, the MODIS-like radiance fields were computed from the Spherical Harmonic Discrete Ordinate Method (SHDOM), based on a large number of cumulus fields simulated by the UCLA Large Eddy Simulation (LES) model. We find that the original 2LM model that estimates cloud-air molecule interactions accounts for 64% of the total reflectance enhancement, and the new model (2LM+CSI) that also includes cloud-surface interactions accounts for nearly 80%. We discuss the possibility of accounting for cloud-aerosol radiative interactions in 3D cloud induced reflectance enhancement, which may explain the remaining 20% of enhancements. Because these are simple models, these corrections can be applied to global satellite observations (e.g. MODIS) and help to reduce biases in aerosol and other clear-sky retrievals.

New Statistical Model for Variability of Aerosol Optical Thickness: Theory and Application to MODIS Data over Ocean.

A novel model for the variability in aerosol optical thickness (AOT) is presented. This model is based on the consideration of AOT fields as realizations of a stochastic process, that is the exponent of an underlying Gaussian process with a specific autocorrelation function. In this approach AOT fields have lognormal PDFs and structure functions having the correct asymptotic behavior at large scales. The latter is an advantage compared with fractal (scale-invariant) approaches. The simple analytical form of the structure function in the proposed model facilitates its use for the parameterization of AOT statistics derived from remote sensing data. The new approach is illustrated using a year-long global MODIS AOT dataset (over ocean) with 10 km resolution. It was used to compute AOT statistics for sample cells forming a grid with 5° spacing. The observed shapes of the structure functions indicated that in a large number of cases the AOT variability is split into two regimes that exhibit different patterns of behavior: small-scale stationary processes and trends reflecting variations at larger scales. The small-scale patterns are suggested to be generated by local aerosols within the marine boundary layer, while the large-scale trends are indicative of elevated aerosols transported from remote continental sources. This assumption is evaluated by comparison of the geographical distributions of these patterns derived from MODIS data with those obtained from the GISS GCM. This study shows considerable potential to enhance comparisons between remote sensing datasets and climate models beyond regional mean AOTs.