{
"cells": [
{
"cell_type": "markdown",
"id": "117d1e97-381d-4771-953a-30573739c4e9",
"metadata": {},
"source": [
"# Blending Observations from TRACER using Py-ART\n",
"\n",
"The TRacking Aerosol Convection Interactions (TRACER) field experiment was a U.S. Department of Energy IOP with the goal of studying the lifecycle of convection over Houston as well as potential aerosol impacts on this lifecycle. Houston is uniquely suited for this kind of field experiment where seabreeze convection forms off of the coast of Houston in cleaner air conditions and then approaches the more polluted Houston region. For more information about the TRACER field experiment, click [here](https://www.arm.gov/research/campaigns/amf2021tracer).\n",
"\n",
"This post will show how to plot overlays of Texas A&M University Lightning Mapping Array data over GOES and ARM CSAPR2 data for a case of wildfire smoke entraining into developing convection sampled during July 12 and 13, 2022. In addition, we highlight a case that was tracked by CSAPR2 for 90 minutes on June 17, 2022. "
]
},
{
"cell_type": "markdown",
"id": "429ee2c4-ddcd-4f8c-aae5-2041345d2264",
"metadata": {},
"source": [
"## Imports"
]
},
{
"cell_type": "code",
"execution_count": 87,
"id": "4f5b03b8-ff33-4124-824a-eb1df07b6972",
"metadata": {},
"outputs": [],
"source": [
"import pyart\n",
"import act\n",
"import matplotlib.pyplot as plt\n",
"import xarray as xr\n",
"import numpy as np\n",
"import s3fs\n",
"import cartopy.crs as ccrs\n",
"import pandas as pd\n",
"\n",
"from scipy.spatial import KDTree\n",
"\n",
"%matplotlib inline"
]
},
{
"cell_type": "markdown",
"id": "3adeb7e8-0138-4f3a-9d48-06300b397323",
"metadata": {},
"source": [
"# GOES data access\n",
"\n",
"All of the NOAA GOES satellite data are available on Amazon Web Services for download. Therefore, you can use the s3fs tool to download the required data. We will download band 13, which is the longwave infrared band of GOES. In order to only download the band 13 files, we will ensure that there is a \"C13\" in the filename as this denotes the band number for each file."
]
},
{
"cell_type": "code",
"execution_count": 15,
"id": "9d9e7920-e4d3-4403-8203-036d14ff0f67",
"metadata": {},
"outputs": [
{
"name": "stdout",
"output_type": "stream",
"text": [
"Downloading noaa-goes16/ABI-L1b-RadC/2022/168/20/OR_ABI-L1b-RadC-M6C13_G16_s20221682001178_e20221682003562_c20221682004026.nc\n",
"Downloading noaa-goes16/ABI-L1b-RadC/2022/168/20/OR_ABI-L1b-RadC-M6C13_G16_s20221682006178_e20221682008562_c20221682009028.nc\n",
"Downloading noaa-goes16/ABI-L1b-RadC/2022/168/20/OR_ABI-L1b-RadC-M6C13_G16_s20221682011178_e20221682013562_c20221682014023.nc\n",
"Downloading noaa-goes16/ABI-L1b-RadC/2022/168/20/OR_ABI-L1b-RadC-M6C13_G16_s20221682016178_e20221682018562_c20221682019019.nc\n",
"Downloading noaa-goes16/ABI-L1b-RadC/2022/168/20/OR_ABI-L1b-RadC-M6C13_G16_s20221682021178_e20221682023563_c20221682024031.nc\n",
"Downloading noaa-goes16/ABI-L1b-RadC/2022/168/20/OR_ABI-L1b-RadC-M6C13_G16_s20221682026178_e20221682028562_c20221682029025.nc\n",
"Downloading noaa-goes16/ABI-L1b-RadC/2022/168/20/OR_ABI-L1b-RadC-M6C13_G16_s20221682031178_e20221682033562_c20221682034018.nc\n",
"Downloading noaa-goes16/ABI-L1b-RadC/2022/168/20/OR_ABI-L1b-RadC-M6C13_G16_s20221682036178_e20221682038562_c20221682039022.nc\n",
"Downloading noaa-goes16/ABI-L1b-RadC/2022/168/20/OR_ABI-L1b-RadC-M6C13_G16_s20221682041178_e20221682043562_c20221682044024.nc\n",
"Downloading noaa-goes16/ABI-L1b-RadC/2022/168/20/OR_ABI-L1b-RadC-M6C13_G16_s20221682046178_e20221682048562_c20221682049023.nc\n",
"Downloading noaa-goes16/ABI-L1b-RadC/2022/168/20/OR_ABI-L1b-RadC-M6C13_G16_s20221682051178_e20221682053562_c20221682054018.nc\n",
"Downloading noaa-goes16/ABI-L1b-RadC/2022/168/20/OR_ABI-L1b-RadC-M6C13_G16_s20221682056178_e20221682058562_c20221682059029.nc\n"
]
}
],
"source": [
"# Use the anonymous credentials to access public data\n",
"fs = s3fs.S3FileSystem(anon=True)\n",
"\n",
"day_no = 168 # Day number of year (here is June 17th, 16th on leap year)\n",
"year = 2022\n",
"hour = 20\n",
"files = np.array(fs.ls(\"noaa-goes16/ABI-L1b-RadC/%d/%d/%02d/\" % (year, day_no, hour)))\n",
"band = \"13\"\n",
"for fi in files:\n",
" if \"C13\" in fi:\n",
" print(\"Downloading %s\" % fi)\n",
" fs.get(fi, \"../data/\" + fi.split(\"/\")[-1])"
]
},
{
"cell_type": "code",
"execution_count": 81,
"id": "a49275e2-2a6f-4af3-8ad9-fbc39208617e",
"metadata": {},
"outputs": [
{
"data": {
"text/html": [
"
Flag indicating the spacecraft is operating in yaw flip configuration
valid_range :
[0 1]
units :
1
flag_values :
[0 1]
flag_meanings :
false true
array(0.)
esun
()
float32
...
long_name :
bandpass-weighted solar irradiance at the mean Earth-Sun distance
standard_name :
toa_shortwave_irradiance_per_unit_wavelength
units :
W m-2 um-1
cell_methods :
t: mean
array(nan)
kappa0
()
float32
...
long_name :
Inverse of the incoming top of atmosphere radiance at current earth-sun distance (PI d2 esun-1)-1, where d is the ratio of instantaneous Earth-Sun distance divided by the mean Earth-Sun distance, esun is the bandpass-weighted solar irradiance and PI is a standard constant used to convert ABI L1b radiance to reflectance
units :
(W m-2 um-1)-1
cell_methods :
t: mean
array(nan)
planck_fk1
()
float32
...
long_name :
wavenumber-dependent coefficient (2 h c2/ nu3) used in the ABI emissive band monochromatic brightness temperature computation, where nu =central wavenumber and h and c are standard constants
units :
W m-1
array(10803.299805)
planck_fk2
()
float32
...
long_name :
wavenumber-dependent coefficient (h c nu/b) used in the ABI emissive band monochromatic brightness temperature computation, where nu = central wavenumber and h, c, and b are standard constants
units :
K
array(1392.73999)
planck_bc1
()
float32
...
long_name :
spectral bandpass correction offset for brightness temperature (B(nu) - bc_1)/bc_2 where B()=planck_function() and nu=wavenumber
units :
K
array(0.0755)
planck_bc2
()
float32
...
long_name :
spectral bandpass correction scale factor for brightness temperature (B(nu) - bc_1)/bc_2 where B()=planck_function() and nu=wavenumber
units :
1
array(0.99975)
valid_pixel_count
()
float64
...
long_name :
number of good and conditionally usable pixels
units :
count
grid_mapping :
goes_imager_projection
cell_methods :
t: sum area: sum (interval: 0.000056 rad comment: good and conditionally usable quality pixels only)
array(3702838.)
missing_pixel_count
()
float64
...
long_name :
number of missing pixels
units :
count
grid_mapping :
goes_imager_projection
cell_methods :
t: sum area: sum (interval: 0.000056 rad comment: missing ABI fixed grid pixels only)
array(0.)
saturated_pixel_count
()
float64
...
long_name :
number of saturated pixels
units :
count
grid_mapping :
goes_imager_projection
cell_methods :
t: sum area: sum (interval: 0.000056 rad comment: radiometrically saturated geolocated/not missing pixels only)
array(0.)
undersaturated_pixel_count
()
float64
...
long_name :
number of undersaturated pixels
units :
count
grid_mapping :
goes_imager_projection
cell_methods :
t: sum area: sum (interval: 0.000056 rad comment: radiometrically undersaturated geolocated/not missing pixels only)
array(0.)
focal_plane_temperature_threshold_exceeded_count
()
float64
...
long_name :
number of pixels whose temperatures exceeded the threshold
units :
count
grid_mapping :
goes_imager_projection
cell_methods :
t: sum area: sum (interval: 0.000056 rad comment: temperature exceeded pixels only)
array(0.)
min_radiance_value_of_valid_pixels
()
float32
...
long_name :
minimum radiance value of pixels
standard_name :
toa_outgoing_radiance_per_unit_wavenumber
valid_range :
[ -1.6443 185.5699]
units :
mW m-2 sr-1 (cm-1)-1
grid_mapping :
goes_imager_projection
cell_methods :
t: sum area: minimum (interval: 0.000056 rad comment: good and conditionally usable quality pixels only)
array(8.849287)
max_radiance_value_of_valid_pixels
()
float32
...
long_name :
maximum radiance value of pixels
standard_name :
toa_outgoing_radiance_per_unit_wavenumber
valid_range :
[ -1.6443 185.5699]
units :
mW m-2 sr-1 (cm-1)-1
grid_mapping :
goes_imager_projection
cell_methods :
t: sum area: maximum (interval: 0.000056 rad comment: good and conditionally usable quality pixels only)
array(154.23053)
mean_radiance_value_of_valid_pixels
()
float32
...
long_name :
mean radiance value of pixels
standard_name :
toa_outgoing_radiance_per_unit_wavenumber
valid_range :
[ -1.6443 185.5699]
units :
mW m-2 sr-1 (cm-1)-1
grid_mapping :
goes_imager_projection
cell_methods :
t: sum area: mean (interval: 0.000056 rad comment: good and conditionally usable quality pixels only)
array(85.197975)
std_dev_radiance_value_of_valid_pixels
()
float32
...
long_name :
standard deviation of radiance values of pixels
standard_name :
toa_outgoing_radiance_per_unit_wavenumber
units :
mW m-2 sr-1 (cm-1)-1
grid_mapping :
goes_imager_projection
cell_methods :
t: sum area: standard_deviation (interval: 0.000056 rad comment: good and conditionally usable quality pixels only)
array(24.985853)
maximum_focal_plane_temperature
()
float32
...
long_name :
maximum focal plane temperature value
valid_range :
[ 0. 999.]
units :
K
array(59.951939)
focal_plane_temperature_threshold_increasing
()
float32
...
long_name :
focal plane temperature threshold increasing bounds value
valid_range :
[ 0. 999.]
units :
K
array(81.)
focal_plane_temperature_threshold_decreasing
()
float32
...
long_name :
focal plane temperature threshold decreasing bounds value
valid_range :
[ 0. 999.]
units :
K
array(81.)
percent_uncorrectable_L0_errors
()
float32
...
long_name :
percent data lost due to uncorrectable L0 errors
valid_range :
[0. 1.]
units :
percent
grid_mapping :
goes_imager_projection
cell_methods :
t: sum area: sum (uncorrectable L0 errors only)
array(0.)
earth_sun_distance_anomaly_in_AU
()
float32
...
long_name :
earth sun distance anomaly in astronomical units
units :
ua
cell_methods :
t: mean
array(1.016543)
algorithm_dynamic_input_data_container
()
int32
...
long_name :
container for filenames of dynamic algorithm input data
Channel-dependent Channel Integration Time, as defined in the VNIR or IR Channel Configuration Table Telemetry
units :
count
array(336.)
channel_gain_field
()
float64
...
long_name :
Channel-dependent Gain Field, as defined in the VNIR or IR Channel Configuration Table Telemetry
units :
1
array(0.)
naming_authority :
gov.nesdis.noaa
Conventions :
CF-1.7
standard_name_vocabulary :
CF Standard Name Table (v35, 20 July 2016)
institution :
DOC/NOAA/NESDIS > U.S. Department of Commerce, National Oceanic and Atmospheric Administration, National Environmental Satellite, Data, and Information Services
project :
GOES
production_site :
WCDAS
production_environment :
OE
spatial_resolution :
2km at nadir
Metadata_Conventions :
Unidata Dataset Discovery v1.0
orbital_slot :
GOES-East
platform_ID :
G16
instrument_type :
GOES-R Series Advanced Baseline Imager (ABI)
scene_id :
CONUS
instrument_ID :
FM1
title :
ABI L1b Radiances
summary :
Single emissive band ABI L1b Radiance Products are digital maps of outgoing radiance values at the top of the atmosphere for IR bands.