AMSR-E DATA MANAGEMENT PLAN
AUGUST 2001

 

1     INTRODUCTION.. 3

1.1      Scope of the document 3

2     Documentation.. 4

2.1      Science Team.. 4

2.2      TLSCF. 4

2.3      SIPS. 4

2.4      DAAC.. 5

3     Data Management Team Organization.. 7

3.1      Data Management Team Head. 7

3.2      Management Team Components and Tasks. 7

3.2.1       Science Team.. 7

3.2.2       Team Leader Science Computing Facility (TLSCF) 7

3.2.3       Science Investigator-led Processing System (SIPS) 7

3.2.4       National Snow and Ice Data Center (NSIDC) 8

4     SCIENCE MISSION OVERVIEW... 9

5     Data Products. 12

5.1      Science data flow.. 12

5.2      Requirements and Sources for Input Data and Algorithms. 12

5.2.1       AMSR-E Data. 12

5.2.1.1     Level 1A Data. 14

5.2.1.2     Level 2A Data. 15

5.2.1.3     Level 2B and Level 3. 16

5.2.2       Auxiliary Science Data. 18

5.2.3       Processing Algorithms. 18

5.2.4       Input Data for Algorithms. 18

5.2.5       Simulated data. 19

6     Processing at SIPS. 20

6.1      Routine Operations. 20

6.1.1       Reprocessing. 21

6.1.1.1     Routine Reprocessing. 21

6.1.1.2     Replacement of Erroneous Data. 22

6.2      Contingency Plans. 22

6.2.1       Equipment Failures. 22

6.2.2       Return to Service. 22

6.2.3       Inconsistent Data Flow.. 22

6.3      Availability. 22

6.4      Storage and Retention Requirements of Temporary Files. 23

6.5      Operational Quality Assessment 23

6.6      Configuration Management of Algorithms. 23

6.6.1       Science Algorithms Updating Guidelines. 23

7     Data INGEST, Archival AND Distribution – NSIDC DAAC.. 24

7.1      Ingest and Archival of Science Data. 24

7.1.1       AMSR-E Level 0 Products. 24

7.1.2       Level 1A product 24

7.1.3       Level 2 and 3 Products. 25

7.2      Distribution. 25

7.2.1       Distribution to NASDA/EOC.. 27

7.2.2       Distribution to AMSR-E Science Team Members. 27

7.2.3       Distribution to the General Science Community. 27

7.2.4       AMSR-E Science Software. 27

7.3      Ingest and Archival of Other Data. 27

7.3.1       Validation data. 27

7.3.2       Browse data. 28

7.3.3       Research data products. 28

7.4      Data Configuration Management (at NSIDC) 28

8     Implementation Schedule. 30

9     Acronyms. 31

10       Appendix I 34

10.1     Joint AMSR Science Team Members. 34

11       Appendix II 35

 


1         INTRODUCTION

 

The Advanced Microwave Scanning Radiometer - EOS  (AMSR-E) is being built by NAtional Space Development Agency (NASDA) of Japan, to fly on the National Aeronautics and Space Administration’s (NASA) Aqua Platform in early 2002.  AMSR-E improves upon the window frequency radiometer heritage of the Scanning Multichannel Microwave Radiometer (SMMR), Special Sensor Microwave/Imager (SSM/I) and Tropical Rainfall Measuring Mission (TRMM) Microwave Instrument (TMI) instruments.  Major improvements over those instruments include channels spanning the 6.9 GHz to 89 GHz frequency range, and higher spatial resolution from a 1.6 m reflector. 

NASA funds an AMSR-E Science Team to provide algorithms for the routine production of a number of standard geophysical products.  These products will be generated by the AMSR-E Science Investigator-led Processing System (SIPS) at the Global Hydrology and Climatology Center (GHCC) in Huntsville, Alabama.  The U.S. Team’s standard products will be archived at the National Snow and Ice Data Center (NSIDC), in Boulder, Colorado.  Further information about AMSR-E can be obtained at http://www.ghcc.msfc.nasa.gov/AMSR.

 

1.1        Scope of the document

 

This document will allow the user to understand what happens to all AMSR-E data: space science data, validation data, browse images and research products.   The organization of the data management team is described in section 3; an overview of the hardware and its estimated requirements is described in section 4; the data flow with details on the volumes, type of files and ancillary files used in processing is described in section 5.  Section 6 gives details of the data processing at the SIPS, and section 7 describes the data distribution and archival at NSIDC,.  The implementation schedule is in section 8. 

 

 

 

 

 

 


2         Documentation

 

2.1        Science Team

 

Algorithm Theoretical Basis Document (ATBD), AMSR Level 2A Algorithm, Peter Ashcroft and Frank J. Wentz, Remote Sensing Systems

 

Algorithm Theoretical Basis Document (ATBD), Version 2, AMSR Ocean algorithm, Principal Investigator: Frank J. Wentz, Co-Investigator: Thomas Meissner, Remote Sensing Systems

 

EOS/AMSR Rainfall, Algorithm Theoretical Basis Document (ATBD), Thomas Wilheit, Christian Kummerow, Ralph Ferraro

 

Algorithm Theoretical Basis Document (ATBD) for the AMSR-E Snow Water Equivalent algorithm, Alfred T.C. Chang/Code 974, NASA/GSFC, Albert Rango/ Hydrology laboratory, USDA/ARS, Version 3.0

 

Algorithm Theoretical Basis Document (ATBD) for the AMSR-E Sea Ice algorithm, Donald J. Cavalieri and Josefino C. Comiso, Laboratory for Hydrospheric Processes, NASA Goddard Space Flight Center

 

Algorithm Theoretical Basis Document, AMSR Land Surface parameters, Version 3.0, Eni G. Njoku, Jet Propulsion Laboratory

 

Advanced Microwave Scanning Radiometer for EOS (AMSR-E), Science data Validation Plan, Version 2

 

All the above documents can be found at: http://eospso.gsfc.nasa.gov/atbd/amsrtables.html

 

2.2        TLSCF

Advanced Microwave Scanning Radiometer (AMSR) Team Science Computing facility (SCF) Plan

 

Software Management Plan for the Earth Observing System PM-1 Advanced Microwave Scanning Radiometer (AMSR-E), January 1998

 

Data Catalog

 

Q/A Plan

 

2.3        SIPS

 

SIPS Processing Plan

SIPS Configuration Management Plan

2.4        DAAC

422-12-17-04        AMSR-E Project Implementation Plan Volume II (Science Team, Algorithm Development, and Data Processing)

423-41-02           Functional and Performance Requirements Specification for the Earth

                         Observing System Data and Information System (EOSDIS) Core System

 

423-41-01            EOSDIS Core System (ECS) Statement of Work             

 

423-10-01-0          Earth Science Data and Information System (ESDIS) Project Level-2 Requirements, Volume 0: Overall EOS Ground System (EGS)

 

423-10-01-5          Earth Science Data and Information System (ESDIS) Project Level-2 Requirements, Volume 5: EOSDIS Version 0

 

305-CD-600-001   Release 6A Segment/Design Specification for the ECS Project, March 2001

 

313-CD-600-001   Release 6A ECS Internal Interface Control Document for the ECS Project, March 2001

 

420-TP-022          Release 6A Implementation Earth Science Data Model

 

230-TP-002-003    Interface Control Document Between the ECS and Product Distribution System Information Server (PDSIS), April 2001

 

230-WP-001-003   Machine-to-Machine Search and Order Gateway Interface for the ECS Project, June 2000

 

423-41-57                                            Interface Control Document  Between ECS and the Science Investigator-Led Processing Systems (SIPS) Volume 0 Interface Mechanisms

 

423-41-57-7                   Interface Control Document Between the EOSDIS Core System (ECS) and the Science Investigator-Led Processing System (SIPS). Volume 7: AMSR-E Science Investigator-Led Processing system Data Flows

 

423-42-03                      Interface Responsibilities for Standard Product Generation Using Science Investigator-Led Processing Systems (SIPS)

 

423-41-57-9                                      Interface Control Document between the EOSDIS Core System (ECS) and the Science Investigator-led Processing System (SIPS) Volume 9: Machine-to-Machine Search and Order Gateway, March 2000

 

505-41-11                                            Interface Requirements Document between the Earth Observing System Data and Information System (EOSDIS) Core System (ECS) and Version 0 System, August 1997

 

505-41-33                      Interface Control Document Between EOSDIS Core System (ECS) and Science Computing Facilities (SCF), December 1999.

 

423-41-45                      Interface Control Document between EOSDIS Core System (ECS) and the National Snow and Ice Data Center (NSIDC) DAAC

 

NPG 2810.1                  NASA Procedures and Guidelines, Security of Information Technology

 

NPD 2810.1                   NASA Policy Directive, Security of Information Technology

 

Office of Management and Budget (OMB) Circular No. A-130, Appendix III

 

            608-CD-001-006 EOSDIS Core System (ECS) Science Operations Plan

 

423-ICD-EDOS/EGS      Interface Control Document Between the Earth Observing System (EOS) Data and Operations System (EDOS) and the EOS Ground System (EGS) Elements

 

                                    The Earth Observing System (EOS) Reference Handbook, A Guide to NASA’s Earth Science Enterprise and the Earth Observing System. 1999.

 

Operations Agreement Between Global Hydrology & Climate Center (GHCC) and The National Snow and Ice Data Center (NSIDC) Distributed Active Archive Center (DAAC)) for Transfer of Advanced Microwave Scanning Radiometer-EOS (AMSR-E) Level 2 and Level 3 Data Products

 

Operations Agreement Between The National Space Development Agency (NASDA) Earth Observation Center (EOC) and the National Snow and Ice Data Center (DAAC) Distributed Active Archive Center (DAAC) for Transfer of Aqua AMSR-E Level 1A Processing Software

 

Operations Agreement Between The National Space Development Agency (NASDA) Earth Observation Center (EOC) and the National Snow and Ice Data Center (DAAC) Distributed Active Archive Center (DAAC) For Exchange of AMSR-E Level 0 Science and Ground Based Attitude Determination (GBAD) Data

 

 


3         Data Management Team Organization

 

3.1        Data Management Team Head

Roy Spencer, AMSR-E Science Team Leader, is also the Data Management Team head.  As the Project matures some of Dr. Spencer’s responsibilities change.  During the early phases of the AMSR-E Project his full attention was on his responsibilities as a Science Team Leader.  Once Aqua is launched, some of the Science Team Leader responsibilities change to responsibilities of the Data Management Team Head.

3.2        Management Team Components and Tasks

3.2.1       Science Team

All the Science Team members are also members of the Data Management Team.  As with Roy Spencer, the AMSR-E Science Team members’ responsibilities change once Aqua is launched.  The responsibilities of the Data Management Team are:

a)       Verify the science data quality

b)       Verify the quality of the products processed with their algorithms; update the algorithms when necessary

c)       Validate their algorithms

d)       Be available for data anomalies resolution; this task lasts for at least 5 years after launch

3.2.2       Team Leader Science Computing Facility (TLSCF)

 

Dawn Conway of University of Alabama in Huntsville (UAH) is the TLSCF lead software engineer and is supported by Don Moss, also of UAH.  Ms. Conway oversees the AMSR-E software integration and test at the TLSCF, interfaces with GHCC-SIPS and NSIDC, the science team, and ECS to ensure all requirements and software standards are met.  She is also responsible for AMSR-E software documentation, reviewing and editing AMSR-E EOSDIS guide documents (user’s guides prepared by NSIDC), defining AMSR-E metadata elements, and coordinating the ESDT development and AMSR-E specific applications with ECS.  Mr. Moss readies the software for operational integration and testing at the GHCC-SIPS, reviews and enhances the browse software, and writes the metadata subroutines.   

3.2.3       Science Investigator-led Processing System (SIPS)

 

Dr. Spencer is the AMSR-E Science Investigator-led Processing System principal investigator and Michael Goodman / NASA GHCC is the Project Manager of the AMSR-E SIPS.  The manager is responsible for the implementation, integration of processing and system software and the daily operations of the SIPS.  The SIPS is tasked to produce daily AMSR-E standard data products.  The SIPS is primarily composed of two organizations (1) Remote Sensing Systems (RSS) in Santa Rosa, California and (2) Global Hydrology and Climate Center (GHCC) in Huntsville, Alabama.  Frank Wentz manages the RSS component of the SIPS.  RSS is responsible for the generation of Level 2A AMSR-E brightness temperature data set and their delivery to the GHCC.  The GHCC is responsible for the processing and generation of the AMSR-E Level 2B and Level 3 standard products, and their subsequent distribution to NSIDC DAAC. 

 

 

3.2.4       National Snow and Ice Data Center (NSIDC)

 

The National Snow and Ice Data Center (NSIDC) Distributed Active Archive Center (DAAC) provides data and related services for polar and cryospheric research and education. NSIDC DAAC data sets are a source of information about cryospheric and polar processes. With the launch of EOS Aqua in early 2002, the NSIDC DAAC will ingest AMSR-E Level 0 Science and Ground Based Attitude Determination (GBAD) products, Level 1A, Level 2 and Level 3 products. The NSIDC DAAC will archive these products in the Earth Observing System Data Information System (EOSDIS) Core System (ECS Release Drop 6A) and distribute them in accordance with NASA’s EOS Data and Information Policy (1999 EOS Reference Handbook). A high-level architecture for the ECS Release 6A is depicted in Figure 3.1

 

 


 

 

 


Figure 3.1. High-level architecture for the ECS Release 6A


4         SCIENCE MISSION OVERVIEW

 

The AMSR-E is similar to the SSM/I in conceptual design, with an offset parabolic reflector and radiometer drum assembly rotating about a vertical axis, conically scanning across the Earth.  From the 705 km altitude orbit of the Aqua Platform, the AMSR-E 47.4o view angle results in an Earth incidence angle of 55.0o, and its +/- 61o active scan angle provides a data swath width of 1445 km.  Once during each scan a cold sky subreflector occults the feedhorn array’s view of the Earth to provide a cold calibration measurements from the cosmic background.  Similarly, a warm calibration target also occults the feedhorns to provide warm calibration measurements from a temperature-controlled high-emissivity target.  Other characteristics of the AMSR-E sampling are contained in Table 4.1.  Also listed are the spatial resolutions attained at each frequency from the 705 km orbital altitude of the Aqua Platform.

 

 

Table 4.1.  AMSR-E characteristics from the 705 km orbital altitude of the Aqua Platform.

 

Center Frequencies (GHz)

6.925

 10.65

18.7

23.8

36.5

89.0

Bandwidth (MHz)

350

 100

200

400

1000

3000

Sensitivity (K)

0.3

 0.6

0.6

0.6

0.6

1.1

Instantaneous FOV (Km x km)

75x43

 48x27

27x16

31x18

14x8

6x4

Sampling Interval (Km x km)

10x10

 10x10

10x10   

10x10        

10x10

5x5

Integration Time (msec)

2.6

2.6

2.6

2.6

2.6

1.3

Main Beam Efficiency (%)

95.3

95.0

96.3

96.4

95.3

96.0

Beamwidth (half-power, degrees)

2.2

1.4

0.8

0.9

0.4

0.18

 

The AMSR-E products follow the heritage of the SMMR and SSM/I instruments and their products.  In many cases the algorithms are expected to provide improved products owing to more available channels, higher spatial resolution, and more stable calibration.

NASDA, as the instrument provider, will process the Level 0 data into Level 1, and provided to the AMSR-E SIPS.  SIPS-RSS will ingest the level 1 data and after processing them into Level 2A, will provide them to SIPS-GHCC. (more details in the next section)

Table 4.2 summarizes the Level 2 (swath) products that will be routinely generated.  The newer capabilities in Table 4.2 are SST and surface soil moisture.  The SST capability of passive microwave observations at 10.7 GHz has been recently demonstrated by F. Wentz with TRMM Microwave Imager (TMI) data.  AMSR-E will allow SST retrievals to be done separately at 6.9 GHz and 10.65 GHz.  The soil moisture retrievals are built upon the SMMR experience, as well as field experiments utilizing airborne microwave radiometers.

Level 3 (space- and/or time-averaged) products are listed in Table 4.3.  Note the addition of sea ice parameters and snow cover parameters, which have no Level 2 counterparts.  Also note the newer product, sea ice is now possible with the 6.9 GHz channels of AMSR-E.

Validation of the standard products will involve a combination of aircraft measurements during field experiments, comparisons to other spaceborne microwave radiometer products (from SSM/I, TMI, SSMIS, AVHRR), radar, in-situ data from buoys, radiosondes, etc.  These validation activities are being coordinated with NASDA through the Joint AMSR Science Team.  (See Appendix I for the members of the Joint AMSR Science Team)

In addition to the standard products, several of the Team investigators will be producing and evaluating “research” products.  These products could form the basis for future standard products.

 

Table 4.2.  Standard Level 2 (swath) products from AMSR-E.

 

PARAMETER

TARGET ACCURACY

SPATIAL RESOLUTION

INVESTIGATORS

Brightness Temperature (Tb)

0.2 o – 0.7 o C

5-56 km

NASDA (Level 1A);

F. Wentz (RSS, Level 2A)

Oceanic surface wind speed

1.0m/s

38 and 21 km

F. Wentz (RSS)

Oceanic integrated water vapor

1.0 mm 0.1 g/cm2

21 km

F. Wentz (RSS)

Oceanic cloud liquid water

0.02 mm or 2 mg/cm2

12 km

F. Wentz (RSS)

Sea Surface Temperature (SST)

0.5 o C

56 and 38 km

F. Wentz (RSS)

Surface soil  moisture

0.06 g/cm3 (low vegetation)

56 km

E. Njoku (JPL)

Global Rainfall

Ocean: 1 mm/hr or 20%, whichever is greater

Land: 2 mm/hr or 40%, whichever is greater

10 km

C. Kummerow (CSU)

R. Ferraro (NOAA/NESDIS)

Rain Type (convection fraction)

N/A

10 km

C. Kummerow (CSU)

Table 4.3.  Standard Level 3 (gridded) products from AMSR-E.

 

PARAMETER

TARGET ACCURACY

GRID SPACING*

INVESTIGATORS

89 GHz Tb

(daily, daily asc., daily desc.)

 

6.25 km

D. Cavalieri (GSFC)

J. Comiso (GSFC)

18.7, 23.8, 36.5, and 89 GHz Tb

(daily, daily asc., daily desc.)

 

12.5 km

D. Cavalieri (GSFC)

J. Comiso (GSFC)

6.925, 18.7, 23.8, 36.5, and 89 GHz Tb

(daily, daily asc., daily desc.)

 

25 km

D. Cavalieri (GSFC)

J. Comiso (GSFC)

Oceanic surface wind speed

(daily, weekly, monthly)

0.9 m/s (daily)

0.25o x 0.25 o grid

F. Wentz (RSS)

Oceanic integrated water vapor

(daily, weekly, monthly)

0.2 g/cm2

0.25o x 0.25 o grid

F. Wentz (RSS)

Oceanic cloud liquid water

(daily, weekly, monthly)

3 mg/cm2

0.25o x 0.25 o grid

F. Wentz (RSS)

Sea Surface Temperature (SST)

(daily, weekly, monthly)

0.5 o C

0.25 o x 0.25 o grid

F. Wentz (RSS)

Surface soil moisture (daily asc., daily desc.)

0.06 g/cm3 (low vegetation)

25 km

E. Njoku (JPL)

Global Rainfall (monthly)

Ocean: 10%

Land: 20%

5 o x 5 o grid

T. Wilheit (TAMU)

 

Snow water equivalent

(daily, 5-day, monthly)

10 mm or 20%

25 km (EASE grid)

A. Chang (GSFC)

Sea Ice Concentration

(daily, daily asc., daily desc.)

< 5%

6.25, 12.5, 25 km

(polar stereographic grid)

D. Cavalieri (GSFC)

J. Comiso (GSFC)

Snow Depth over sea ice (5-day)

< 5 cm

12.5 km

(polar stereographic grid)

D. Cavalieri (GSFC)

J. Comiso (GSFC)

Sea Ice Temperature

(daily, daily asc., daily desc.)

< 4 o C

25 km

(polar stereographic grid)

D. Cavalieri (GSFC)

J. Comiso (GSFC)

* The grid spacing is different from the inherent spatial resolution of the observations


5         Data Products

5.1        Science data flow

 

The Level 1A AMSR-E antenna temperatures generated by NASDA will be ingested by RSS-SIPS via the Jet Propulsion Laboratory’s Physical Oceanography DAAC (PO.DAAC).  Level 1A data set consists of 28 half-orbit files.  The JPL PO.DAAC will serve as a routing center (Level 1A data will also be stored for 90 days) for the AMSR-E data as they are sent from Japan to the United States.  The JPL PO.DAAC is being utilized as the routing center due to its previously defined role as the data processing center for AMSR (AMSR-E’s sister instrument) on the ADEOS-II satellite manifest. 

 

RSS-SIPS will generate the Level 2A brightness temperatures from the NASDA Level 1A data set.  The Level 2A data set will consist of half-orbit files produced on a continuous basis, as each half-orbit file is ingested.  Upon generation of each half-orbit Level 2A product, the files will be sent to the AMSR-E SIPS facility at the GHCC for higher order processing (see Section 6.0).

The science data flow is illustrated in figure 5.1 below.

 

5.2        Requirements and Sources for Input Data and Algorithms

 

This section discusses the content and format of the AMSR-E EOS Level 2A, Level 2B, and Level 3 standard products, metadata files, and browse files with a short overview of the AMSR-E Level 1A product. 

 

5.2.1       AMSR-E Data

 

Each AMSR-E EOS Level 2A, Level 2B, and Level 3 standard product has a defined Earth Science Data Type (ESDT) within the ECS system.  An ESDT must be defined for every data collection managed by the ECS. The ESDT defines collection level metadata, granule level metadata, and the services that can be performed on granules in the collection.  A granule is the smallest amount of data processed in a file and it is the data collected over half orbit (from pole to pole).  Collection level metadata define the characteristics of the data collection to which a granule belongs. Granule level metadata define the characteristics that are unique to that granule. Services define what ECS can do with the granule. Standard services include Insert (inserting the granule into the Data Server) and Acquire (getting the granule back from the Data Server).  The AMSR-E SCF is responsible for defining and updating the AMSR-E Level 2A, Level 2B, and Level 3 ESDTs.  The ECS is responsible for the implementation and configuration management of these ESDTs.

 

Each AMSR-E standard product is in the HDF-EOS format and contains granule level metadata of two types, structural and inventory.  The structural metadata are written by HDF-EOS and describe the file structure.  The inventory metadata are compliant with the ECS B.0 model and mandatory attributes are stored in the PVL format as an HDF-EOS global attribute.  The inventory metadata are also supplied to the ECS system in an independent .met file. 

 

The ESDT, metadata, science source code, scripts, and ancillary files for each AMSR-E EOS Level 2A, Level 2B, and Level 3 standard product are discussed in detail in the following sections.  Table 5.2 lists the AMSR-E Level 2A, Level 2B, and Level 3 standard products by ESDT short name, ESDT long name, and affiliated science team members.

 


 


 

Figure 5.1.  Science data flow from Aqua to the users

 

Table 5.2 AMSR-E ESDT short names, long names, and affiliated science team member

 

Short Name

Long Name

Science Team Member

AE_L2A

AMSR-E/Aqua L2A Global Swath Spatially-Resampled Brightness Temperatures

Frank Wentz

Peter Ashcroft

AE_Ocean

AMSR-E/ Aqua L2B Global Swath Ocean Products derived from Wentz Algorithm

Frank Wentz

AE_Land

AMSR-E/ Aqua L2B Surface Soil Moisture

Eni Njoku

AE_Rain

AMSR-E/ Aqua L2B Global Swath Rain Rate/Type GPROF algorithm

Robert Adler

Ralph Ferraro

Chris Kummerow

AE_RnGd

AMSR-E/ Aqua Monthly L3 5x5 deg Rainfall Accumulations

Thomas Wilheit

AE_DyOcn

AMSR-E/Aqua Daily L3 Global Ascending/Descending  .25x.25 deg Ocean Grids

Frank Wentz

AE_WkOcn

AMSR-E/Aqua Weekly L3 Global Ascending/Descending  .25x.25 deg Ocean Grids

Frank Wentz

AE_MoOcn

AMSR-E/Aqua Monthly L3 Global Ascending/Descending  .25x.25 deg Ocean Grids

Frank Wentz

AE_DySno

AMSR-E/Aqua Daily L3 Global Snow Water Equivalent EASE-Grids

Alfred T.C. Chang

AE_5DSno

AMSR-E/Aqua 5-Day L3 Global Snow Water Equivalent EASE-Grids

Alfred T.C. Chang

AE_MoSno

AMSR-E/Aqua Monthly L3 Global Snow Water Equivalent  EASE-Grids

Alfred T.C. Chang

AE_SI6

AMSR-E/Aqua Daily L3 6.25 km 89 GHz Brightness Temperature (Tb) Polar Grids

Donald Cavalieri

Josefino Comiso

AE_SI12

AMSR-E/Aqua Daily L3 12.5 km Tb, Sea Ice Conc., & Snow Depth Polar Grids

Donald Cavalieri

Josefino Comiso

AE_SI25

AMSR-E/Aqua Daily L3 25 km Tb, Sea Ice Temperature, & Sea Ice Conc. Polar Grids

Donald Cavalieri

Josefino Comiso

AE_Land3

AMSR-E/Aqua Daily L3 Surface Soil Moisture, Global EASE-Grids

Eni Njoku

 

5.2.1.1     Level 1A Data

 

The AMSR-E Level 1A granule is defined as one-half of one orbit, the division being at the poles, so that a granule is descending (North Pole to South Pole).  The granule contains chronological antenna temperature count data accompanied by related ancillary data.  The AMSR-E scan time is 1.5 seconds and the Aqua orbit period is 100 minutes, resulting in approximately 2000 data scans per granule. The approximate size of the Level 1A granule is 42 MB.

The AMSR-E Level 1A granule is stored in the Hierarchical Data Format (HDF).  Each granule consists of core metadata, product metadata, and data.  The core metadata are compliant with the ECS B.0 mandatory attributes and are stored as global attributes.   The core metadata contain such things as the data set short name, the product generation executable name, associated version numbers, input file names, beginning and ending times of the granule, processing center, contact information, and quality assurance flags.  The product metadata are also stored as HDF global attributes and include satellite orbit parameters, instrument scan geometry, thermistor conversion tables, and antenna pattern coefficients.  The Level 1A data include time, latitude, longitude, antenna temperature counts, slopes and offsets for calculating TAs, various calibration temperature counts, land/ocean flags, and navigation information.

The AMSR-E Level 1A data are generated at NASDA Earth Observations Center (EOC) in Hatoyama, Japan.  These data are automatically transferred to the JPL PO.DAAC.  The data are then forwarded to RSS-SIPS for Level 2A processing.    For details, see the Operations Agreement Between the PO.DAAC and the AMSR-E RSS-SIPS. 

5.2.1.2     Level 2A Data

 

The AMSR-E Level 2A granule definition is one half orbit, the same as that for Level 1A.  The Level 2A granule contains chronological resampled Brightness Temperatures (TBs).   The Level 2A resampled TBs and associated data are stored using the HDF-EOS swath interface.  The data are divided into 3 swaths: a low resolution swath, a high resolution A-scan swath, and a high resolution B-scan swath.  Each swath has the associated geolocation fields of time, latitude, and longitude.  The contents of each scan are described in Appendix II, Table 1.  A list of the inventory level metadata items is given in Table 5.3.  Level 2A granules are made up of approximately 2000 scans (this variable number of scans will be called NS).  

Additional parameters are written as global HDF-EOS swath attributes.  These are items extracted from the AMSR-E Level 1A granule that may be of interest to the user, but are not necessarily needed by the ECS system to perform data archival, search, or retrieval.  The items include start orbit number, stop orbit number, longitude of ascending node, ascending node date, ascending node time, orbit direction, number of scans, orbit semi major axis, orbit eccentricity, orbit argument of perigee, orbit inclination, orbit period, ellipsoid names, semi major axis of earth, flattening ratio of earth, and telemetry conversion tables.

The ancillary files used in processing Level 2A data are listed in Appendix II, Table 2.

 

 

Table 5.3 AMSR-E Level-2A Brightness Temperature inventory metadata

 

Name

Description

LocalGranuleID

Filename

ProductionDateTime

Date and time of granule production

AutomaticQualityFlag

Automated QA indicator of granule

AutomaticQualityFlagExplanation

Definition of the usage of automatic QA flag

OperationalQualityFlag

Processing diagnostics

OperationalQualityFlagExplanation

Definition of the usage of the operational QA flag

ScienceQualityFlag

Science data content

ScienceQualityFlagExplanation

Definition of the usage of the science QA flag

QAPercentMissingData

Percent missing data in the granule

QAPercentOutofBoundsData

Percent out-of-bounds data in the granule

OrbitModelName

Orbit model used to calculate satellite position vectors

StartOrbitNumber

Start orbit number of granule

StopOrbitNumber

Stop orbit number of granule

EquatorCrossingLongitude

The descending equator crossing longitude of the granule

EquatorCrossingTime

Time of the equator crossing: hh:;mm:ss.sssZ

EquatorCrossingDate

YYYY-MM-DD

Short Name

ECS ESDT short name associated with this granule

InputPointer

Input file name

Version ID

ESDT VersionID

GringPointLatitude

An array of latitudes and longitudes that define the polygon outlining the granule data swath

GringPointLongitudes

GringPoint SequenceNo

An array of digits defining the sequence of the latitudes and longitudes used to define the polygon

RangeBeginningDate

YYYY-MM-DD

RangeBeginningTime

Hh:mm:ss.sssZ

RangeEndingDate

YYYY-MM-DD

RangeEndingTime

Hh:mm:ss.sssZ

PGEVersion

Product Generation Executable Version

NominalPassIndex

(AMSR-E PSA)

The nominal pass index number for the pass that best describes the spatial location of the granule, where the pass is either the ascending of descending portion of an orbit.

StartPolygonNumber

(AMSR-E PSA)

The index number for the first polygon associated with the nominal pass number in the granule.

StopPolygonNumber

(AMSR-E PSA)

The index number for the last polygon associated with the nominal pass number in the granule.

Ascending/Descending flag

 

 

5.2.1.3     Level 2B and Level 3

 

Level 2B Ocean Products

 

Each AMSR-E Level 2B ocean products granule includes Sea Surface Temperature (SST), wind speed over ocean, water vapor over ocean, and cloud liquid water over ocean measurements.  Each AMSR-E Level 2B granule is stored in HDF-EOS using the swath interface.  The AMSR-E level 2B ocean products granule contents are described in Appendix II, Table 3.  The inventory level metadata for the AMSR-E Level 2B ocean products are listed in Table 5.3, above.

 

The ancillary files used in processing the standard ocean products are listed in Appendix II, Table 4.

 

Level 2B Surface Soil Moisture Product

 

Each AMSR-E Level 2B surface soil moisture granule consists of surface soil moisture measurements and a number of ancillary parameters including surface type, vegetation water content, surface temperature, and quality assurance flags. These data are re-mapped to a 25-km EASE grid.  Each granule is stored in HDF-EOS using the point interface.

The Level 2B surface soil moisture granule includes two geolocation fields, “Latitude” and “Longitude”.  “Time” is not included as a geolocation field because the time array is sequenced spatially, not chronologically, after gridding.  The physical file format is described in Appendix II, Table 5.  The inventory level metadata for the AMSR-E Level 2B surface soil moisture are listed in Table 5.3.

The ancillary files used in the processing the standard surface soil moisture product are listed in Appendix II, Table 6.  Some of these files are updated periodically via ftp.

 

Level 2B Rainfall Products

 

Each AMSR-E Level 2B rainfall granule includes rain rate and rain type.  Each granule is stored in HDF-EOS using the swath interface.   The Level 2B rainfall products granule contents are described in Appendix II, Table 7.  The inventory metadata for the Level 2B Rainfall products are listed in Table 5.3. A number of ancillary files are used in the processing the standard rainfall products.  A description of these files is given in Appendix II, Table 8. 

 

Level 3 Ocean Products 

 

The AMSR-E Level 3 ocean products are daily, weekly and monthly ascending / descending .25 x .25 grids of the six Level 2B ocean products.  The six products are sea surface temperature at 56 km and 38 km resolution, ocean wind speed at 38 km and 24 km resolution, water vapor over ocean at 24 km resolution and cloud liquid water at 12 km resolution.  The AMSR-E Level 3 ocean granules are stored in HDF-EOS using the grid interface and the US Geological Survey General Coordinate Transformation Package (GCTP)-Geographic projection. 

The Level 3 daily ocean products granule contents are described in Appendix II, Table 9.  The Level 3 weekly and monthly products are identical in format to the daily product except they will not include “time”.  The inventory level metadata for the AMSR-E Level 3 ocean products are listed in Table 5.3.

No ancillary files are used in the creation of the Level 3 Ocean Products.

 

Level 3 Snow Product

 

The AMSR-E Level 3 snow products are daily, 5-day, and monthly Lambert Azimuthal Equal Area grids.  The snow products are snow water equivalent, snow depth, and quality assurance flags.  The AMSR-E Level 3 snow granules are stored in HDF-EOS using the grid interface.

The Level 3 daily snow products granule contents are described in Appendix II, Table 10.  The formats for the 5-day, and monthly products are identical to the daily product format.  The inventory level metadata for the AMSR-E Level 3 snow products are listed in Table 5.3.

A number of ancillary files are used in the processing of the standard snow product. These files are listed in Appendix II, Table 11.

 

 

Level 3 Sea Ice Products

 

The AMSR-E Level 3 sea ice products are polar stereographic grids at three spatial resolutions: 6.25 km, 12.5 km, and 25 km.   The 6.25 km products are 89.0 GHz TBs.  The 12.5 km products are sea ice concentration, snow depth over ice, and TBs for the 18.7, 23.8, 36.5, and 89.0 GHz channels.  The 25.0 km products are sea ice concentration, sea ice temperature, and TBs for the 6.925, 10.65, 18.7, 23.8, 36.5, and 89.0 GHz channels.  The AMSR-E Level 3 sea ice granules are stored in HDF-EOS using the grid interface.

The Level 3 6.25 km, 12.5 km, and 25.0 km sea ice products granule contents are described in Appendix II, Table 12, 13, and 14, respectively.  The structural metadata include the projection parameters.  The inventory metadata for the AMSR-E Level 3 sea ice products are listed in Table 5.3.

The ancillary files used in the sea ice standard products processing are listed in Appendix II, Table 15.

 

 

Level 3 Rainfall Products

 

The AMSR-E Level 3 rain products are processed on 2 separate grids of monthly rainfall accumulation: one over ocean and one over land.   The grids are 5 degree by 5 degree, created using the HDF-EOS grid interface and the GCTP-Geographic projection.  The data over land uses the Level 2B land rainfall products derived with the Goddard Profiling (GPROF) algorithm as input.  The Texas A&M University (TAMU) processes ocean rainfall and uses the Level 2A TBs as input. As a check, the GPROF algorithm results are further processed to obtain a monthly average (Level 3) data set. The format of the AMSR-E Level 3 rain products is described in Appendix II, Table 16.

The structural metadata include the projection parameters.  The inventory metadata for the AMSR-E Level 3 rainfall products are listed in Table 5.3.

The ancillary files used in processing of the Level 3 rainfall products are listed in Appendix II, Table 17.

 

 

Level 3 Surface Soil Moisture Product

 

Each AMSR-E Level 3 EASE-grid surface soil moisture granule consists of daily global 25-km EASE-grids of brightness temperatures, surface soil moisture, and other ancillary parameters including vegetation water content, surface temperature, and quality control flags.  Each granule is stored in HDF-EOS using the grid interface and the GCTP-Behrmann Cylindrical Equal-Area projection (25 km EASE-grids, true at 30 degrees north or south). 

The Level 3 surface soil moisture product contents are described in Appendix II, Table 18.  The inventory level metadata for the AMSR-E Level 3 surface soil moisture are local granule ID, short name, version ID, input pointer(s), west bounding coordinate, north bounding coordinate, east bounding coordinate, south bounding coordinate, range beginning date, range beginning time, range ending date, range ending time, and PGE version.

No ancillary files are used in the processing of the surface soil moisture product.

 

5.2.2       Auxiliary Science Data

 

The initial browse products will be generated by the TLSCF with the aid of the science team members.  Integration and test of the browse software, as well as the configuration management of the software, will be performed in the same manner as the science software.  These products, in png format, along with meta data identifying the browse/data relationship will be sent to NSIDC for archiving.  NSIDC will convert the browse products to HDF raster images of less than 1 MB to conform to EOS standards.

A number of ancillary files are used in the processing.  A description of these files for all products can be found in Appendix II. 

5.2.3       Processing Algorithms

 

There are four components of each AMSR-E science software Product Generation Executable (PGE): the input read routine, the science software routines, granule level metadata generation software, and the output routine.  The science software and output routine for each AMSR-E EOS Level 2A, Level 2B, and Level 3 standard product is produced by the AMSR-E EOS science team member affiliated with the product.  The Level 1A read routine is part of the Level 2A science software delivered to the TLSCF by RSS.  The Level 2A read routine and the granule level metadata generation routines are created and maintained by the TLSCF.  The software is then integrated and tested by the TLSCF software team, with input from the science team members as needed.  Upon completion of integration and test, the software, all required ancillary files, and software release documentation are delivered to the RSS-SIPS (Level 2A) or the GHCC-SIPS (Level 2B and Level 3).  The GHCC-SIPS is responsible for configuration management of all source code, scripts, ancillary files, and release documentation.

 

5.2.4       Input Data for Algorithms

 

The AMSR-E Level 2B and Level 3 products are generated at the GHCC-SIPS.  The AMSR-E Level 2A data are used as input for all Level 2B, Level 3 Rainfall, Level 3 Snow, and Level 3 Sea Ice products.  The Level 3 ocean products and Level 3 land products use their respective Level 2B products as input.  The AMSR-E Level 2A, Level 2B, and Level 3 file naming conventions are given in 5.4.  The conventions are compliant with ECS requirements.

 

 

 

Table 5.4.  AMSR-E Level 2 and Level 3 file naming conventions

 

AMSR-E Short Name

File Naming Convention

AE_L2A

AMSR_E_L2A_BrightnessTemperatures_yyyymmddhhmm.hdf

AE_Ocean

AMSR_E_L2_Ocean_yyyymmddhhmm.hdf

AE_Land

AMSR_E_L2_Land_yyyymmddhhmm.hdf

AE_Rain

AMSR_E_L2_Rain_yyyymmddhhmm.hdf

AE_RnGd

AMSR_E_L3_RainGrid_yyyymmddhhmm.hdf

AE_DyOcn

AMSR_E_L3_DailyOcean_yyyymmddhhmm.hdf

AE_WkOcn

AMSR_E_L3_WeeklyOcean_yyyymmddhhmm.hdf

AE_MoOcn

AMSR_E_L3_MonthlyOcean_yyyymmddhhmm.hdf

AE_DySno

AMSR_E_L3_DailySnow_yyyymmddhhmm.hdf

AE_5Dsno

AMSR_E_L3_5DaySnow_yyyymmddhhmm.hdf

AE_MoSno

AMSR_E_L3_MonthlySnow_yyyymmddhhmm.hdf

AE_SI6

AMSR_E_L3_SeaIce6km_yyyymmddhhmm.hdf

AE_SI12

AMSR_E_L3_SeaIce12km_yyyymmddhhmm.hdf

AE_SI25

AMSR_E_L3_SeaIce25km_yyyymmddhhmm.hdf

AE_Land3

AMSR_E_L3_DailyLand_yyyymmddhhmm.hdf

 

The values are yyyy for year, mm for month, dd for day, hh for hour, and mm for minutes and are associated with the first scan of the granule.

5.2.5       Simulated data

 

Simulated Level 1A and Level 2A files have been produced as part of processing system development.  These files are authentic in that they have the correct HDF structure for the Level 1A, and HDF-EOS structure for the Level 2A.  Simulated observations over oceans are derived from global NCEP maps (one degree spatial resolution).

The Level 1A files are available to investigators for the purpose of algorithm development, and file transfer testing.  The level of authenticity incorporated into the simulations was sufficient for anticipated uses, but particular elements can be further enhanced in response to particular user needs if necessary.  These simulated files will not be used after instrument launch when actual data become available.

 


6         Processing at SIPS

 

The AMSR-E SIPS is built on a distributed architecture, with processing occurring at both Remote Sensing Systems (RSS) in Santa Rosa, California and at the Global Hydrology & Climate Center (GHCC) in Huntsville, Alabama.  "Eight by five" and on-call operations support will be provided by a core team of personnel, specializing in system administration, archive management, software development, and system engineering.  As interfacing documents are developed and baselined, the existing GHCC data management procedures will be modified and tailored for the SIPS operations.

 

6.1        Routine Operations

 

Under normal operating conditions, the RSS AMSR-E SIPS receives Level 1A data from NASDA via the NASA Jet Propulsion Laboratory PO.DAAC, processes it into a Level 2A product, and transmits it via FTP to the GHCC AMSR-E SIPS.  (See Figure 6.1) 

The AMSR-E SIPS team processes the Level 2A data first into Level 2B swath products and then into Level 3 daily, 5-day, weekly and monthly gridded products.  The Level 2A, Level 2B, and Level 3 products, associated metadata, production history, QA files, ancillary files, and delivery algorithm packages (DAPs), are transferred to the National Snow and Ice Data Center (NSIDC) DAAC for archival and distribution to end users.  Details of these routine operations are described in Interface Control Documents (ICDs) and Operations Agreements (OAs) between the interfacing data centers, as listed in Figure 6.2.

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 


Figure 6.1.  AMSR-E Processing and data flow.

 

 

 

 

 

 


Figure 6.2.  ICDs and OAs between SIPS and interfacing data centers

 


All processing flows within the GHCC SIPS are automated to run without operator intervention, under nominal conditions.  A processing "Master Script" coordinates the software execution, message logging, and handoff of each step in the processing stream from daily ingest of the Level 2A data from the RSS SIPS through generation of all the standard products, metadata, and production histories; to staging data for science QA and distribution to the archive DAAC.  This Master Script is written in distinct modules to display meaningful log messages and exit gracefully if problems in the data or the processing system are detected.  A "Reprocessing" Master Script can be used to manually repeat any or all steps of the automated master script, in the event that errors are encountered anywhere in the processing flow.  The reprocessing script will also be used to regenerate the full suite of data products required by new versions of the processing algorithms.

  

6.1.1       Reprocessing

6.1.1.1     Routine Reprocessing

 

Updates to a science algorithm after L+3 months will necessitate reprocessing of that data product and any downstream products.  New versions of all affected products will be generated.  Current data products are generated in the new version as soon as the updated algorithm is integrated into the operational processing environment.  Previously processed data will be reprocessed beginning with earliest data and working forward.

 

 

 

6.1.1.2     Replacement of Erroneous Data

 

Infrequently, small amounts of data may need to be reprocessed due to improper processing, hardware failure, or human error.  In this case, erroneous data in the processing stream or archive will be replaced with the corrected data files.

6.2        Contingency Plans

6.2.1       Equipment Failures

 

All GHCC operational servers are covered by a vendor maintenance contract, which has typically provided Return To Service (RTS) support within 2-3 hours for soft failures and 24 hours for hard failures.  In the event of a hard failure where downtime is expected to exceed 24 hours, the SIPS will notify appropriate point-of-contact (POC), as listed in the operations agreements between data centers, describing the problem and the expected RTS time.

 

Electric power is supplied by a commercial power source and the operational server is connected to an Uninterruptible Power Supply (UPS).  The UPS supplying the primary GHCC operational hosts, including the AMSR-E SIPS server, and their peripherals will last approximately one hour.  In the event a power outage is approaching the one-hour duration limit, UPS software will automatically shut down the primary hosts.  Once power is resumed, the UPS will automatically restart the hosts.

 

6.2.2       Return to Service                             

 

After Return To Service, the SIPS will attempt to resume normal operations of near real time data ingest, processing, and distribution, while at the same time ingesting, processing, and distributing data that were missed, or not captured in near real time.   

6.2.3       Inconsistent Data Flow

 

In the event that data are received out of time sequence, the SIPS policy will be to maintain the nominal real time processing and at the same time, process previously unprocessed data, starting with the oldest data and working forward in time until all unprocessed data are processed.

6.3        Availability

 

As described in Section 6.1, the Level 1A data orbit files will be routinely transferred from NASDA to JPL PO.DAAC and subsequently routed to RSS.  The JPL PO.DAAC does not process the data and will routinely redistribute the Level 1A data to RSS.  The JPL PO.DAAC will push the Level 1A data to RSS without invoking a specific hold period (using FastCopy).  Upon ingestion by RSS the Level 1A data will be processed into Level 2A data and pulled by GHCC, again without any specific hold period (using FastCopy).  As Level 2A data are ingested by GHCC from SIPS RSS, they will become available for the Level 2B and Level 3 processing software.  Level 2A, Level 2B and Level 3 data will be placed on the FTP server for retrieval by the NSIDC DAAC.  The AMSR-E standard data products will also be placed in a password protected directory for pickup by the AMSR-E Science Team.  The Science Team has requested access to the products for science quality assessment.  Only trusted IP addresses will have access to the AMSR-E data and products through the SIPS-GHCC firewall.  All other private or public access to the data products must be obtained through the NSIDC DAAC.

 

6.4        Storage and Retention Requirements of Temporary Files

 

After the products are generated, they will be placed onto a short term holding area for Science team access. This holding area will be sized to keep 45 days of Level 2A, Level 2B and Level 3 daily products, and 6 months of weekly, 5-day products and Level 3 monthly products.  Existing age of scripts will be modified to delete files older than the specified 45-days and 6-months.

6.5        Operational Quality Assessment

 

Operational Quality Assessment will be performed by the SIPS team as part of the ingest and production processing.  The ingest processing software will include a post-transfer comparison between the RSS SIPS L2A source file and the file received at the GHCC SIPS, done automatically by the ftp software package FastCopy.  Scripts used to write the L2A files to the storage device will use a read after write and compare routine to ensure that the archive process completed successfully.  Insertion of in-line science QA described earlier in this document will be accomplished during production processing, after which the products will be transferred to the archive DAAC using the ECS-required Product Delivery Record Server (PDRS).  The PDRS uses Product Delivery Record (PDR) notices to announce files available for transfer, and a corresponding Product Acceptance Notification (PAN) or Product Delivery Record Discrepancy (PDRD) notice to confirm successful or unsuccessful receipt of files.

 

 

6.6        Configuration Management of Algorithms

 

Configuration Management of science algorithms and automation scripts is the responsibility of the GHCC SIPS.  After passing integration tests in the SCF SSI&T environment, working algorithms are migrated to the SIPS integration and test environment.  The algorithms are then compiled, integrated with processing master scripts, executed, and verified to produce expected results according to SCF-provided test plans.  After these steps are successfully completed, the executables are installed, by the system administrators, into the SIPS operational environment, the algorithm source code is entered into the UNIX-based Concurrent Versions System(CVS), and a Delivered Algorithm Package (DAP) is created and shipped to the archive DAAC, via the PDRS.  Each new version of every algorithm will go through these steps:  SSI&T, SIPS I&T, installation, source code CM, and DAP transferred to DAAC.  This procedure provides multiple levels of quality assurance and safeguards:  operational software is protected from unauthorized or unintended modification; any version of operational software (first, latest, next to last, etc.) may be checked out of the CVS library of algorithms; and simple traceability of change authorization.

 

6.6.1       Science Algorithms Updating Guidelines

 

At launch the algorithms will be version 00. 

During the first 3 months after launch the data and the products will only be distributed to the AMSR Science team members.  The algorithm developers will be able to change the science modules as often as they feel it is necessary.  The process for implementing these changes is the same as the one used during the original implementation of the algorithms at the TLSCF.  The algorithms used at L+3 months will be version 01.  The algorithms will then be updated every 3 months in the first year after launch, and 6 months thereafter, if necessary.

   In case of a critical change (one needed in order to process the data correctly) the algorithm will be updated as soon as possible.


7         Data INGEST, Archival AND Distribution – NSIDC DAAC

 

7.1        Ingest and Archival of Science Data

7.1.1       AMSR-E Level 0 Products

 

The NSIDC DAAC intends to use the ECS to ingest and to archive AMSR-E Level 0 production data sets (PDS) and GBAD data sets provided by the NASA EDOS. The Level 0 products the NSIDC DAAC receives from EDOS are listed in Table 7.1. The NSIDC DAAC is responsible for the maintenance of ESDTs and any other information required to incorporate AMSR-E Level 0 data into the NSIDC DAAC ECS archive. The NSIDC DAAC monitors the receipt and reports on the insertion of the AMSR-E Level 0 data into the archive.

The NSIDC DAAC will ingest Level 0 data into the ECS archive using interfaces defined in the Interface Control Document between the Earth Observing System (EOS) and the EOS Ground System (EGS) Elements. EDOS transfers the AMSR-E Science and GBAD PDS and related metadata files to the ECS ingest server at the DAAC. NSIDC will archive the Level 0 products in the format provided by EDOS. The file naming convention used by EDOS for the PDS and GBAD data will be retained in the NSIDC archive. Each file contains any data collected by the EDOS during a two-hour period. The DAAC expects to receive these data from EDOS every two hours.

 

Table 7.1.  ESDT Short Names and Descriptions for data obtained from EDOS

 

ESDT Short Name

ESDT Description

PM1GBAD1     

Ground-Based Attitude Determination Data for EOS Aqua in 1 second intervals

PM1GBAD4

Ground-Based Attitude Determination Data for EOS Aqua in 4 second intervals

PM1GBAD8

Ground-Based Attitude Determination Data for EOS Aqua in 8 second intervals

AE_PMSCI

AMSR-E Science and Engineering Data

 

After the data have been successfully transferred to the ECS, the metadata file that accompanies the data granule is parsed and the information describing the data granule is stored in a database residing on the Science Data Server.  The data granule is archived on D3 tape media.

 

7.1.2       Level 1A product

 

The AMSR-E Level 1A product will be generated at the National Space Development Agency (NASDA) Earth Observation Center located in Japan. The Level 1A product contains sensor counts and coefficients needed to compute antenna temperatures and, subsequently, surface brightness temperatures. The Level 1A product will be produced using the National Center for Supercomputing Applications (NCSA) Hierarchical Data Format (HDF). The volume of each file is estimated to be 35 megabytes. The data files will be transferred about once every 50 minutes from the NASDA/EOC to the Physical Oceanography DAAC (PO.DAAC) located at the Jet Propulsion Laboratory in Pasadena, California. Once the data have been received by the PO.DAAC the data are then transmitted over the network to the NSIDC DAAC and to Remote Sensing Systems, Inc.

 

The JPL PO.DAAC will transfer the AMSR-E L1A data files to a non-ECS file server at the NSIDC DAAC.  The data will be transmitted using FastCopy, a commercial file transfer software package. Upon receipt of each L1A file a script will be activated that extracts metadata fields from the L1A file. The metadata fields will be used to produce a granule-level metadata file. The ECS Ingest Server requires a PVL-formatted metadata file for each data granule inserted into the archive.

 

After the metadata file has been generated, a Product Delivery Record (PDR) is produced. The PDR contains information needed by the ECS Ingest Polling Server. The PDR interface is described in the ICD between the ECS and the SIPS (document reference). The ECS ingest server at the NSIDC DAAC polls the PDR directory on the non-ECS server at NSIDC in an attempt to discover whether additional L1A data have been made available for insertion into the ECS archive.

 

After the data have been successfully transferred to the ECS, the metadata file that accompanies the data granule is parsed and the information describing the data granule is stored into a database residing on the Science Data Server. 

 

7.1.3       Level 2 and 3 Products

 

The AMSR-E Level 2 and Level 3 products will be generated at the AMSR-E SIPS located at Remote Sensing Systems, Santa Rosa, CA, and Global Hydrology and Climate Center, Marshall Space Flight Center, Huntsville, AL. These products will be produced using algorithms developed by the United States AMSR-E Science Team members. The products will be generated in HDF-EOS file format. A description of the AMSR-E Level 2 and Level 3 data collections and their respective volumes are listed in Table 7.2.

 

 The GHCC SIPS delivers standard science data products via the co-located AMSR-E SIPS PDR Server. The PDR interface is described in the ICD between the ECS and the SIPS (ESDIS document no, 423-41-57-7 or ???). The ECS ingest server at the NSIDC DAAC polls the PDR directory at the AMSR-E SIPS in an attempt to discover whether additional Level 2 and Level 3 data have been made available for insertion into the ECS archive. Production History, and metadata files will accompany the data granule. The operations agreement between the AMSR-E SIPS and the NSIDC DAAC defines the number of granules identified in a single PDR (usually less than 30)

 

   After the data have been successfully transferred to the ECS, the metadata file that accompanies the data granule is parsed and the information describing the data granule is stored into a database residing on the Science Data Server.  The data granules and files containing the production history are archived on media residing in the near-line digital library.

 

7.2        Distribution

 

The NSIDC DAAC will establish and maintain distribution services for AMSR-E products using the EOSDIS Core System.  It will also establish and maintain inventories, catalogs, and indices that facilitate the search and order of AMSR-E data sets.  AMSR-E data providers will support this work by providing the necessary information (metadata) for its data sets.

Table 7.2.  Level 2 and 3 data collections and their volumes.

 

Short Name

Data Level

Collection Description

Delivery Frequency

Data Volume uncompressed

AE_L2A

Level 2A

AMSR-E/Aqua global swath brightness temperatures are resampled at resolutions of 56 km, 38 km, 21 km, 12 km, and 5.4 km.

~28 half-orbits / day

2.5 GB/day

AE_Ocean

Level 2B

AMSR-E/Aqua global swath ocean wind speed at 38 and 21 km res., water vapor over ocean at 21 km res., cloud liquid water at 12 km res., and sea surface temperature at 56 and 38 km res. are generated using the Wentz Algorithm and Level 2A product.

~28 half-orbits /day

277.2 MB/day

AE_Land

Level 2B

AMSR-E/Aqua global swath surface soil moisture and ancillary parameters including surface type, vegetation water content, surface temp., and QC parms are generated from Level 2A AMSR-E Tb’s spatially resampled to a nominal 25-km equal area earth grid.

~28 half-orbits /day

15.0 MB/day

AE_Rain

Level 2B

AMSR-E/Aqua global swath rain rate and rain type products are generated using the Level 2A spatially resampled Tb’s  and the Goddard Profiling Algorithm (GPROF).

~28 half-orbits /day

501.0 MB/day

AE_RnGd

Level 3

AMSR-E/Aqua monthly rainfall accumulations are on two 5 x 5 degree grids, separate for land & ocean.  The ocean product uses Level 2A brightness temperatures as input; the land product uses GPROF Level 2B rainfall as input.  

1 / month

0.02 MB/month

AE_DyOcn

Level 3

AMSR-E/Aqua global ocean Level 3 daily products are on .25 x .25 degree ascending and descending grids.  Products are generated using the Level 2B ocean products as input.

1 / day

14.5 MB/day

AE_WkOcn

Level 3

AMSR-E/Aqua global ocean Level 3 weekly products are on .25 x .25 degree ascending and descending grids.  Products are generated using the Level 2B ocean products as input.

1 / week

12.4 MB/week

AE_MoOcn

Level 3

AMSR-E/Aqua global ocean Level 3 monthly products are on .25 x .25 degree ascending and descending grids.  Products are generated using the Level 2B ocean products as input.

1 / month

12.4 MB/month

AE_DySno

Level 3

AMSR-E/Aqua Level 3 daily products are of global snow water equivalent on EASE-Grids.

1 / day

2.1 MB/day

AE_5DSno

Level 3

AMSR-E/Aqua Level 3 5-day product is a 5-day running mean of global snow water equivalent on EASE-Grids.

1 / day

2.1 MB/ 5-day

AE_MoSno

Level 3

AMSR-E/Aqua Level 3 product is of monthly global snow water equivalent on EASE-Grids.

1 / month

2.1 MB/ month

AE_SI6

Level 3

AMSR-E/Aqua Level 3 products at 6.25 km are of 89.0 GHz brightness temperatures on polar stereographic grids.  Tb’s are daily averages, daily ascending averages, and daily descending averages.

1 / day

46.3 MB/day

AE_SI12

Level 3

AMSR-E/Aqua Level 3 products at 12.5 km are of sea ice concentration, snow depth over ice, & 18 - 89.0 GHz Tb’s on polar stereo grids.  The sea ice con and Tb’s are daily averages, daily asc. & desc. Averages; snow depth over sea ice is a 5-day average.

1 / day

53.0 MB/day

AE_SI25

Level 3

AMSR-E/Aqua Level 3 products at 25 km are of sea ice concentration, sea ice temperature, 6.9 - 89.0 GHz Tb’s on polar stereographic grids. Sea ice con, sea ice temp, and Tb’s are daily averages, daily ascending averages, and daily descending averages.

1 / day

19.5 MB/day

AE_Land3

Level 3

AMSR-E/Aqua Level 3 global daily surface soil moisture with vegetation water content, surface temp., & Tb’s are  generated on a nominal 25-km equal area earth grid by time-compositing the Level 2B parameters  separately for ascending and descending passes.

1 / day

64.8 MB/day

 

 

7.2.1       Distribution to NASDA/EOC

 

The NSIDC DAAC will distribute Level 0 data sets to the NASDA/EOC (for production and/or reprocessing) to the extent consistent with the NSIDC DAAC ECS resource limitations. NSIDC will distribute all AMSR-E Level 0 Science and GBAD data to NASDA/EOC for the first ninety (90) days of the Aqua mission; afterwards, the DAAC will provide these products only as a backup to the bit rate buffered Level 0 data. The bit rate buffered data is the primary source for L1A production at the NASDA/EOC.  Details pertaining to ordering procedures and transfer media for the Level 0 data exchange with NASDA/EOC can be found in the Operations Agreement Between NSIDC DAAC and the NASDA/EOC for the exchange of AMSR-E data.

7.2.2       Distribution to AMSR-E Science Team Members

 

The NSIDC DAAC will distribute data sets to the AMSR-E SCF as required to perform science quality assurance or for science investigations to the extent consistent with the NSIDC DAAC ECS resource limitations. AMSR-E Team members may order the data products from the NSIDC User Services Office and acquire the data via ftp or physical media (CD or DVD). Alternatively, team members may establish a subscription on the data and have the data automatically sent to a host computer via ftp.

7.2.3       Distribution to the General Science Community

 

As per the current NASA ESDIS Project policy for Aqua data, the NSIDC DAAC will distribute AMSR-E products on a non-discriminatory basis to all users at no charge.  If policy changes eventually are implemented, prices will reflect the cost of media, postage, and materials only.  The priority for distribution will be on a first-in first-out basis. Data orders will be accepted through the NASA EOSDIS Data Gateway, or by traditional means such as E-mail, telephone, facsimile or the NSIDC AMSR-E web site.

 

7.2.4       AMSR-E Science Software

 

Upon user request the NSIDC DAAC will distribute a Delivered Algorithm Package (DAP) of AMSR-E software needed to create an executable that produces one of the AMSR-E data sets on one of the approved system configurations (computing equipment, operating system, compiler, Toolkits, HDF, etc). 

7.3        Ingest and Archival of Other Data

7.3.1       Validation data

The AMSR-E Validation data will be archived at NSIDC.  In order to make these data available to the public NSIDC will create a web site where all data taken for AMSR-E validation will be listed with pointers to where the data reside and the contact person responsible for that set of data.  Most of the time, the scientists involved in taking the data will have them at his/her facility at least a year after the campaign has been completed.  During that period (a year after a validation campaign) the Validation web site will note the procedure for obtaining the data set in question.

 

 

7.3.2       Browse data

 

AMSR-E browse images will be generated at the TLSCF.  They will be available to the general public on the AMSR-E web site, after the scientists are satisfied that the images are correct (about six months after launch).  These images will then be ingested and archived at the NSIDC for distribution.

7.3.3       Research data products

 

Some of the AMSR-E Science team members will produce research products at their own SCF.  For these products the public is invited to contact the individual scientist directly.  These data will not be archived at NSIDC.  Table 7.3 lists these research products.

 

Table 7.3.  AMSR-E Research products

 

AMSR-E group

Product

Contact point

Sea Ice

Ice Type

J. Comiso

Snow

Snow depth

A. Chang

Soil Moisture

Surface type, vegetation water content and surface temperature

E. Njoku

Precipitation

Monthly rainfall from the accumulated L2 product

T. Wilheit

 

7.4        Data Configuration Management (at NSIDC)

 

Configuration management of the AMSR-E standard data products is the joint responsibility of the SIPS and the NSIDC DAAC. Standard AMSR-E data products are produced at GHCC-SIPS and transmitted to the EOSDIS Core System (ECS) at the NSIDC DAAC for archival. Each data collection archived in the ECS is described as an Earth Science Data Type (ESDT). An ESDT is uniquely defined by a set of attributes contained in an ESDT descriptor file. The NSIDC DAAC and the SIPS agree on the contents of the collection descriptor file prior to establishing a baseline or operational version of the ESDT.

The metadata that uniquely defines an ESDT contains an attribute that provides a version identifier of the ESDT collection. Normally, the version identifier of the baseline version of the data collection is set to one (1). The version identifier can be used to distinguish collections of the same ESDT that were produced using different algorithms, resulting in a collection of reprocessed granules. In time, the data provider or the DAAC may wish to make changes to the mandatory metadata attributes that define the ESDT; significant changes to the ESDT descriptor may result in the definition of a new version of the ESDT. Usually, the DAAC advertises only the most recent version of an ESDT collection. Prior versions are deleted from the archive, as governed by the NASA EOS Data and Information Policy.

The NSIDC DAAC will collaborate with the SIPS prior to making a change to the metadata elements that describes an ESDT. No changes to an ESDT are implemented within the ECS installed at the NSIDC DAAC until both the DAAC management and the SIPS agree to the proposed changes. Procedures for negotiating a change to the ESDT definition are described in the operations agreement between the NSIDC DAAC and SIPS. Changes to an ESDT that introduces a new version of the data collection will be published in the applicable Data Set Guide document.

The latest version of the AMSR-E standard data products are maintained in the ECS archive installed at the NSIDC DAAC for the duration of the AMSR-E mission. The NSIDC DAAC maintains the archive until the collections have been migrated to a Long-term Archive (LTA) facility.

 

 

 


8         Implementation Schedule

 

This document describes what happens to the AMSR-E data after the launch of Aqua.  In that respect this is a “living” document, especially this section.  Listed below are the major milestones for updating the science algorithms and subsequently reprocessing the data.  At this point, these processes are envisioned to proceed in a well-organized fashion, as follows.

 

Milestones

 

Launch (L): early 2002

Continuous data from Japan: L + 9 months

 

Science Algorithms

 

At launch: version 0

Updates: every 3 months during the first year after launch

              Every 6 months during the second year after launch

              Yearly starting with the third year after launch

 

Processing at SIPS

 

Continuous processing: once continuous data are received

Re-processing: after every algorithm update


9         Acronyms

 

AMSR-E         Advanced Microwave Scanning Radiometer – EOS

asc                   ascending

AVHRR           Advanced Very High Resolution Radiometer

CD-R               Compact Disk-Re-writable

CM                  Configuration Management

CSU                Colorado State University

CVS                Concurrent Versions System

DAAC             Distributed Active Archive Center

DAP                Delivered Algorithm Package

desc                 descending

DVD                Digital Video Disk

ECS                 EOSDIS Core System

EDOS              EOS Data and Operations System

EGS                 EOS Ground System

EOC                Earth Observation Center

EORC              Earth Observations Resource Center

EOS                 Earth Observing System

EOSDIS          EOS Data Information System

ESDIS             Earth Science Data Information System (Project)

ESDT               Earth Science Data Type

ESE                 Earth Science Enterprise

FTP                 File Transfer Protocol

GB/day            Gigabyte/day

GBAD             Ground Based Attitude Determination

GCTP              General Coordinate Transformation Package

GHCC             Global Hydrology and Climate Center

GHRC             Global Hydrology Resource Center

GHz                 Giga Hertz

GPROF           Goddard PROFiling algorithm

GSFC              Goddard Space Flight Center

HDF                Hierarchical Data Format

ICD                 Interface Control Document

ICESat             Ice, Cloud and land Elevation Satellite

IDL                  Interactive Display Language

IT                     Instrument Team

JPL                  Jet Propulsion Laboratory

Km                  Kilometer

LTA                 Long Term Archive

MHz                Mega Hertz

MODIS           MODerate-resolution Imaging Spectraradiometer

MODAPS        MODIS Data Processing System

MSFC             Marshall Space Flight Center

MTMGW       

NASA             National Aeronautics and Space Administration

NASDA           National Space Development Agency (of Japan)

NCSA             National Center for Supercomputing Applications

NESDIS              National Environmental Satellite, Data, and Information Service

 

NOAA             National Oceanic and Atmospheric Administration

NHP                number of pixels/scan for 89 GHz channels

NP                   number of pixels/scan

NS                   number of scans

NSIDC            National Snow and Ice Data Center

OA                  Operations Agreement

ODL                Object Data Language

PAN                Product Acceptance Notification

PI                     Principal Investigator

PDRD              Product Delivery Record Discrepancy

PDR                 Product Delivery Record

PDRS              Product Delivery Record Server

PDS                 Production Data Sets

PGE                 Product Generation Executable

POC                Point Of Contact

PO.DAAC       Physical Oceanography DAAC

QA                  Quality Assurance

RSS                 Remote Sensing Systems

RTS                 Return To Service

SIPS                Science Investigator-led Processing System

SCF                 Science Computing Facility

SMMR            Scanning Multichannel Microwave Radiometer

SSH

SSI&T             Science Software Integration & Test

SSM/I              Special Sensor Microwave/Imager

SSMIS             Special Sensor Microwave Imager Sounder

SST                 Sea Surface Temperature

TAMU             Texas A&M University

TBD                 To Be Determined

TBW                To Be Written

Tb                    Brightness Temperature

TLSCF            Team Lead Science Computing Facility

TMI                 TRMM Microwave Imager

TRMM            Tropical Rainfall Measurement Mission

UAH                University of Alabama in Huntsville

UPS                 Uninterruptible Power Supply


10    Appendix I

 

10.1    Joint AMSR Science Team Members

 

Dr. Robert Adler, Global Precipitation GSFC, adler@agnes.gsfc.nasa.gov 301-614-6290

 

Dr. Kazumasa Aonashi, Global precipitation, Meteorological Research Institute, Japan, aonashi@mri-jma,go.jp +81-29-853-8635

 

Dr. Donald Cavalieri, Sea Ice, the Arctic, GSFC, don@cavalieri.gsfc.nasa.gov 301-614-5901

 

Dr. Alfred T.C. Chang, Snow Water Equivalent GSFC, achang@rainfall.gsfc.nasa.gov 301-614-5766

 

Dr. Josefino Comiso, Sea Ice, the Antarctic, GSFC, comiso@joey.gsfc.nasa.gov 301-614-5708

 

Mr. Ralph Ferraro*, Global Precipitation, Land NOAA/NESDIS, rferraro@nesdis.noaa.gov 301-763-8251 ext.147

 

Dr. Hayasaka hayasaka@mail.cc.tohoku.ac.jp

 

Dr. T. Koike, Land surface soil moisture & Snow Water Equivalent, University of Tokyo, Japan, tkoike@hydra.t.u-tokyo.ac.jp

 

Dr. Christian Kummerow*, Global Precipitation, Ocean, Colorado State University, kummerow@atmos.colostate.edu (970) 491-8449

 

Dr. Fumihiko Nishio, Sea Ice, Chiba University, Center for Environmental Research, Japan, fnishio@ceres.cr.chiba-u.ac.jp +81-43-290-3836

 

Dr. Eni Njoku, Land surface soil moisture, JPL, eni.g.njoku@jpl.jpl.nasa.gov 818-354-3693

 

Dr. Akira Shibata, NASDA Science Team Leader, Sea surface temperature and winds, Meteorological Research Institute, Japan, ashibata@mri-jma.go.jp

 

Dr. Roy Spencer, US Science Team Leader, MSFC, roy.spencer@msfc.nasa.gov  256-961-7960

 

Mr. Frank Wentz, Level 2A Resampled Brightness Temperatures &Ocean Parameters Suite (Wind Speed, SST, Water Vapor, Cloud Liquid Water) Remote Sensing System wentz@remss.com 707-545-2904 ext 16

 

Dr. Thomas Wilheit, Global Precipitation, Texas A&M University, wilheit@tamu.edu 409-845-0176

 

                                                                    

 

                                                                                                  

 

 

 

                                                                                    

* Not officially chosen members


11    Appendix II

Table 1  AMSR-E Level 2A granule contents

 

Parameter

Data Type

Dimensions

Description

Low_Res_Swath

 

 

 

Swath Attributes

 

 

 

OrbitSemiMajorAxis

Character

 

 

OrbitEccentricity

Character

 

 

OrbitArgumentPerigee

Character

 

 

OrbitInclination

Character

 

 

OrbitPeriod

Character

 

 

EllipsoidName

Character

 

 

SemiMajorAxisofEarth

Character

 

 

FlatteningRatioofEarth

Character

 

 

Platinum#1CountRangeWx

Character

 

 

Platinum#1ConversionTableWa

Character

 

 

Platinum#1ConversionTableWb

Character

 

 

Platinum#1ConversionTableWc

Character

 

 

Platinum#1ConversionTableWd

Character

 

 

CoefficientAvv

Character

 

 

CoefficientAhv

Character

 

 

CoefficientAov

Character

 

 

CoefficientAhh

Character

 

 

CoefficientAvh

Character

 

 

CoefficientAoh

Character

 

 

Level1A_Channel_Sequence

Character

 

 

Resampled_Channel_Sequence

Character

 

 

StartOrbitNumber

Float

 

 

StopOrbitNumber

Float

 

 

EquatorCrossing

Character

 

 

EquatorCrossingDate

Character

 

 

EquatorCrossingTime

Character

 

 

OrbitDirection

Character

 

 

NumberofScans

Int32

 

 

SoftwareRevisionDate

Character

 

 

SoftwareBuildNumber

Int32

 

 

PGE_Version

INT32

 

 

RangeBeginningTime

Char8

 

 

RangeBeginningDate

Char8

 

 

RangeEndingTime

Char8

 

 

TangeEndingDate

Char8

 

 

InputPointer

Char8

 

 

 

 

 

 

 

 

 

 

Table 1  AMSR-E Level 2A granule contents (cont)

 

 

 

 

Geolocation fields

 

 

 

   Time

FLOAT64

NS

Scan start time in TAI93

   Latitude

FLOAT32

NS x  NHP

Latitude (-90.0 to 90.0)

   Longitude

FLOAT32

NS x  NHP

Longitude( -180.0 to 180.0)

Low_Res Swath

 

 

 

Data Fields

 

 

 

   Position_in_Orbit

FLOAT32

NS

Fractional orbit position of current scan

   Navigation_Data

FLOAT32

NS x 6

x,y,z,vx,vy,vz (km, km/sec)

   Attitude_Data

FLOAT32

NS x 3

Roll, pitch, and yaw measured from nominal position

   SPC_Temperature_Count

UINT16

NS x 20

(In NASDA documentation)

   SPS_Temperature_Count

UINT16

NS x 32

(In NASDA Documentation)

   RX_Offset_Gain_Count

UINT16

NS x 32

 

   Data_Quality

FLOAT32

NS x 128

Level 1A data quality flags

   Observation Supplement

UINT16

NS x 27

(In NASDA Documentation)

    Land_Ocean_Flag

UINT8

NS x NO x 6

Level 1A land/ocean flags stored as percent of land in pixel

   Earth_Incidence

INT8

NS x  NP

Earth incidence angle

   Earth_Azimuth

INT16

NS x  NP

Earth azimuth angle

   Sun_Elevation

INT16

NS x  NP

Sun elevation angle

   Sun_Azimuth

INT16

 

Sun azimuth angle

NASDA_LowRes_Antenna_Temp_Coefficients

FLOAT32

NS x 10 x 2

 

RSS_LowRes_Antenna_Temp_Coefficients

FLOAT32

NS x 10 x 2

 

   Hot_Load_Count_6_to_37

UINT16

NS x 16 x 10

Hot load calibration counts for the low resolution channels

   Cold_Sky_Mirror_Count_6_to_37

UINT16

NS x 16 x 10

Cold sky calibration counts for the low resolution channels

Scan_Quality_Flag

INT32

NS

Overall scan quality flag

Level1A_Scan_Chan_Quality_Flag

INT16

NS x 10

Quality flags for each Level 1A scan and channel

Resampled_Scan_Chan_Quality_Flag

INT16

NS x 30

Quality flag for each resampled scan and channel

Sun_Glint_Angle

INT16

NS x NP

 

 

Table 1  AMSR-E Level 2A granule contents (cont)

 

 

 

 

Parameter

Data Type

Dimensions

Description

6.9V_Res.1_TB_(Level1B)

INT16

NS x  NP

 

6.9H_Res.1_TB_(Level1B)

INT16

NS x  NP

 

10.7V_Res.2_TB_(Level1B)

INT16

NS x  NP

 

10.7H_Res.2_TB_(Level1B)

INT16

NS x  NP

 

18.7V_Res.3_TB_(Level1B)

INT16

NS x  NP

 

18.7H_Res.3_TB_(Level1B)

INT16

NS x  NP

 

23.8V_Approx._Res.3_TB_(Level1B)

INT16

NS x  NP

 

23.8H_Approx._Res.3_TB_(Level1B)

INT16

NS x  NP

 

36.5V_Res.4_TB_(Level1B)

INT16

NS x  NP

 

36.5H_Res.4_TB_(Level1B)

INT16

NS x  NP

 

6.9V_Res.1_TB

INT16

NS x  NP

Resolution 1   6.9V Channel TBs

6.9H_Res.1_TB

INT16

NS x  NP

Resolution 1   6.9H Channel TBs

10.7V_Res.1_TB

INT16

NS x  NP

Resolution 1 10.7V Channel TBs

10.7V_Res.2_TB

INT16

NS x NP

Resolution 2 10.7V Channel TBs

10.7H_Res.1_TB

INT16

NS x  NP

Resolution 1 10.7H Channel TBs

10.7H_Res.2_TB

INT16

NS x  NP

Resolution 2 10.7H Channel TBs

18.7V_Res.1_TB

INT16

NS x  NP

Resolution 1 18.7V Channel TBs

18.7V_Res.2_TB

INT16

NS x  NP

Resolution 2 18.7V Channel TBs

18.7H_Res.1_TB

INT16

NS x  NP

Resolution 1 18.7H Channel TBs

18.7H_Res.2_TB

INT16

NS x  NP

Resolution 2 18.7H Channel TBs

23.8V_Res.1_TB

INT16

NS x  NP

Resolution 1 23.8V Channel TBs

23.8V_Res.2_TB

INT16

NS x  NP

Resolution 2 23.8V Channel TBs

23.8V_Res.3_TB

INT16

NS x  NP

Resolution 3 23.8V Channel TBs, not resampled

23.8H_Res.1_TB

INT16

NS x  NP

Resolution 1 23.8H Channel TBs

23.8H_Res.2_TB

INT16

NS x  NP

Resolution 2 23.8H Channel TBs

23.8H_Res.3_TB

INT16

NS x  NP

Resolution 3 23.8H Channel TBs, not resampled

36.5V_Res.1_TB

INT16

NS x  NP

Resolution 1 36.5V Channel TBs

36.5V_Res.2_TB

INT16

NS x  NP

Resolution 2 36.5V Channel TBs

36.5V_Res.3_TB

INT16

NS x  NP

Resolution 3 36.5V Channel TBs

36.5H_Res.1_TB

INT16

NS x  NP

Resolution 1 36.5H Channel TBs

36.5H_Res.2_TB

INT16

NS x  NP

Resolution 2 36.5H Channel TBs

36.5H_Res.3_TB

INT16

NS x  NP

Resolution 3 36.5H Channel TBs

89.0V_Res.1_TB

INT16

NS x  NP

Resolution 1 89.0V Channel TBs

89.0V_Res.2_TB

INT16

NS x  NP

Resolution 2 89.0V Channel TBs

89.0V_Res.3_TB

INT16

NS x  NP

Resolution 3 89.0V Channel TBs

89.0V_Res.4_TB

INT16

NS x  NP

Resolution 4 89.0V Channel TBs

89.0H_Res.1_TB

INT16

NS x  NP

Resolution 1 89.0H Channel TBs

89.0H_Res.2_TB

INT16

NS x  NP

Resolution 2 89.0H Channel TBs

89.0H_Res.3_TB

INT16

NS x  NP

Resolution 3 89.0H Channel TBs

89.0H_Res.4_TB

INT16

NS x  NP

Resolution 4 89.0H Channel TBs

Res1_Surf

UINT8

NS x  NP

Resolution 1 Surface Types

Res2_Surf

UINT8

NS x  NP

Resolution 2 Surface Types

Res3_Surf

UINT8

NS x  NP

Resolution 3 Surface Types

Res4_Surf

UINT8

NS x  NP

Resolution 4 Surface Types

 

Table 1 AMSR-E Level 2A granule contents (cont.)

Parameter

Data Type

Dimensions

Description

High_Res_A Swath

 

 

 

Swath Attributes

 

 

 

OrbitSemiMajorAxis

Character

 

 

OrbitEccentricity

Character

 

 

OrbitArgumentPerigee

Character

 

 

OrbitIncination

Character

 

 

OrbitPeriod

Character

 

 

EllipsoidName

Character

 

 

DemiMajorAxisofEarth

Character

 

 

FlatteningRatioofEarth

Character

 

 

Platinum#1CountRangeWx

Character

 

 

Platinum#1ConversionTableWa

Character

 

 

Platinum#1ConversionTableWb

Character

 

 

Platinum#1ConversionTableWc

Character

 

 

Platinum#1ConversionTableWd

Character

 

 

CoefficientAvv

Character

 

 

CoefficientAhv

Character

 

 

CoefficientAov

Character

 

 

CoefficientAhh

Character

 

 

CoefficientAvh

Character

 

 

CoefficientAoh

Character

 

 

Level1A_Channel_Sequence

Character

 

 

Resampled_Channel_Sequence

Character

 

 

StartOrbitNumber

Float

 

 

StopOrbitNumber

Float

 

 

EquatorCrossing

Character

 

 

EquatorCrossingDate

Character

 

 

EquatorCrossingTime

Character

 

 

OrbitDirection

Character

 

 

NumberofScans

INT32

 

 

SoftwareRevisionDate

Character

 

 

SoftwareBuildNumber

INT32

 

 

Geolocation fields

 

 

 

   Time

FLOAT64

NS

Scan start time in TAI93

   Latitude

FLOAT32

NS x  NHP

Latitude (-90.0 to 90.0)

   Longitude

FLOAT32

NS x  NHP

Longitude( -180.0 to 180.0)

Data Fields

 

 

 

NASDA_HighRes_Antenna_Temp_Coefficients

FLOAT32

NS x 2 x 2

Antenna temperature coefficients for the high resolution channels

RSS_HighRes_Antenna_Temp_Coefficients

FLOAT32

NS x 2 x 2

Antenna temperature coefficients for the high resolution channels

   AscanCold_Sky_Mirror_Count_89

UINT16

NS x 32 x 2

Cold sky calibration counts for the 89 GHz A scans

   AscanHot_Load_Count_89

UINT16

NS x 32 x 2

Hot load calibration counts for the 89 GHz A scans

Scan_Quality_Flag

INT32

NS

Overall scan quality flag

Level1A_89Ascan_Chan_Quality_Flag

INT16

NS x 2

Quality flag for each Level 1A scan and channel

   89.0V_Res.5A_TB_(Level1B)  

INT16

NS x  NHP

Brightness Temperatures for the 89 GHz vertical channel A scans

   89.0H_Res.5A_TB_(Level1B)

INT16

NS x  NHP

Brightness Temperatures for the 89 GHz horizontal channel A scans

   Res5A_Surf

UINT8

NS x  NHP

Surface tags for the 89 GHz A scans

 

 

 

Table 1 AMSR-E Level 2A granule contents (cont.)

 

Parameter

Data Type

Dimensions

Description

High_Res_B Swath

 

 

 

Swath Attributes

 

 

 

OrbitSemiMajorAxis

Character

 

 

OrbitEccentricity

Character

 

 

OrbitArgumentPerigee

Character

 

 

OrbitIncination

Character

 

 

OrbitPeriod

Character

 

 

EllipsoidName

Character

 

 

DemiMajorAxisofEarth

Character

 

 

FlatteningRatioofEarth

Character

 

 

Platinum#1CountRangeWx

Character

 

 

Platinum#1ConversionTableWa

Character

 

 

Platinum#1ConversionTableWb

Character

 

 

Platinum#1ConversionTableWc

Character

 

 

Platinum#1ConversionTableWd

Character

 

 

CoefficientAvv

Character

 

 

CoefficientAhv

Character

 

 

CoefficientAov

Character

 

 

CoefficientAhh

Character

 

 

CoefficientAvh

Character

 

 

CoefficientAoh

Character

 

 

Level1A_Channel_Sequence

Character

 

 

Resampled_Channel_Sequence

Character

 

 

StartOrbitNumber

Float

 

 

StopOrbitNumber

Float

 

 

EquatorCrossing

Character

 

 

EquatorCrossingDate

Character

 

 

EquatorCrossingTime

Character

 

 

OrbitDirection

Character

 

 

NumberofScans

INT32

 

 

SoftwareRevisionDate

Character

 

 

SoftwareBuildNumber

INT32

 

 

Geolocation fields

 

 

 

   Time

FLOAT64

NS

Scan start time in TAI93

   Latitude

FLOAT32

NS x  NHP

Latitude (-90.0 to 90.0)

   Longitude

FLOAT32

NS x  NHP

Longitude (-180.0 to 180.0)

Data Fields

 

 

 

NASDA_HighRes_Antenna_Temp_Coefficients

FLOAT32

NS x 2 x 2

Antenna temperature coefficients for the high resolution channels

RSS_HighRes_Antenna_Temp_Coefficients

FLOAT32

NS x 2 x 2

Antenna temperature coefficients for the high resolution channels

   BscanCold_Sky_Mirror_Count_89

UINT16

NS x 32 x 2

Cold sky calibration counts for the 89 GHz A scans

   BscanHot_Load_Count_89

UINT16

NS x 32 x 2

Hot load calibration counts for the 89 GHz A scans

Scan_Quality_Flag

INT32

NS

Overall scan quality flag

Level1A_89Ascan_Chan_Quality_Flag

INT16

NS x 2

Quality flag for each Level 1A scan and channel

   89.0V_Res.5B_TB_(Level1B)  

UINT16

NS x  NHP

Brightness Temperatures for the 89 GHz vertical channel A scans

   89.0H_Res.5B_TB_(Level1B)

UINT16

NS x  NHP

Brightness Temperatures for the 89 GHz horizontal channel A scans

   Res5B_Surf

UINT8

NS x  NHP

Surface tags for the 89 GHz A scans

 

Where NS Is the number of scans (nominally 2000), NP is the number of pixels per scan for low channels (nominally 243) and NHP is the number of pixels per scan for 89 GHz channels (2 * NP).

 

Table 2 Level 2A Ancillary files

 

File Name

Description

Type

Source

Volume (MB)

WT files

weighting coefficients

Static

RSS

17

Land mask

 

Static

RSS

 

 

 

 

 

 

 

 

 

Table 3 AMSR-E Level 2B Ocean Products granule contents

 

Parameter

Data Type

Dimensions

Description

Swath 1

 

 

 

Geolocation Fields

 

 

 

Time

FLOAT64

NS

Scan start time in TAI93

Latitude

FLOAT32

NS x NP

Latitude (-90.0 to 90.0)

Longitude

FLOAT32

NS x NP

Longitude (-180.0 to 180.0)

Data Fields

 

 

 

Scan_summary_flag

INT32

NS

Overall quality flag

Ocean_summary_quality_flag

INT8

NS

TBD

Ocean_products_quality_flag

INT8

NS x NP x 4

TBD

Very_low_res_sst

INT16

NS  x NP

SST at the resolution of the 6.9 GHz footprint (56 km)

Low_res_sst

INT16

NS  x NP

SST at the resolution of the 10.7 GHz footprint (38 km)

Low_res_wind

INT16

NS  x NP

Wind speed at the resolution of the 10.7 GHz footprint (38 km)

Med_res_wind

INT16

NS  x NP

Wind speed at the resolution of the 18.9 GHz footprint (21 km)

Med_res_vapor

INT16

NS  x NP

Water vapor at the resolution of the 18.9 GHz footprint (21 km)

High_res_cloud

INT16

NS  x NP

Cloud water at the resolution of the 36.5 GHz footprint (12 km)

 

 

 

 

 

 

 

 

 

Table 4 Level 2B Ocean Products Ancillary files.

 

File Name

Description

Type

Source

Volume

(MB)

Mergwin_vap_v2.txt

climate mask

Static

RSS

6.3

reynolds_clim.txt

sea surface temperature mask

Static

RSS

3.1

tables_amsr.lis

geophysical constants

Static

RSS

0.1

tb_coefs_amsr_lores.lis

Coefficients in series expansion for low resolution products

Static

RSS

1.6

tb_coefs_amsr_mdres.lis

Coefficients in series expansion for medium resolution products

Static

RSS

0.7

tb_coefs_amsr_vlres.list

Coefficients in series expansion for very low resolution products

Static

RSS

2.0

 

 

Table 5 Level 2B Surface Soil Moisture granule contents

 

Parameter

Data Type

Dimension

Description

Geolocation Fields

 

 

 

   Time

FLOAT64

NLAND

Scan start time in TAI 93

   Latitude

FLOAT32

NLAND

Latitude (-90.0 to 90.0)

   Longitude

FLOAT32

NLAND

Longitude (-180.0 to 180.0)

Data Fields

 

 

 

   Row_Index

INT16

NLAND

EASE grid row index

   Column_Index

INT16

NLAND

EASE grid column index

   TB_QC_Flag

INT16

NLAND

TB quality control flag

   Heterogeneity_Index

INT16

NLAND

Subpixel variability index

   Surface_Type

INT16

NLAND

Surface type flag

   Soil_Moisture

INT16

NLAND

Soil moisture at 6.9 GHz resolution

   Veg_Water_Content

INT16

NLAND

Vegetation water content at 6.9 GHz resolution

   Land_Surface_Temp

INT16

NLAND

Land surface temperature at 6.9 GHz resolution

  Inversion_QC_Flag_1

INT16

NLAND

Inversion quality control flag

  Inversion_QC_Flag_2

INT16

NLAND

Number of iterations (if applicable)

  Inversion_QC_Flag_3

INT16

NLAND

c2 of iterations (if applicable)

 

Where NLAND is the number of EASE-gridded land observations in the granule.  Note that NLAND will vary, with an average of ~14000 observations per granule.

 

 

 

 

 

 

 

 

 

 

 

 

Table 6 AMSR-E Level 2B Surface Soil Moisture Ancillary Files

 

File Name

Description

Type

Source

Update

Frequency

Update

Method

Volume

(MB)

ldwat1.dat

Water cover database

Static

JPL/Njoku

N/A

N/A

0.8

texture1.dat

Soil texture database

Static

JPL/Njoku

N/A

N/A

1.6

snowimp1.dat

Snow/ice-sheet database

Static

JPL/Njoku

N/A

N/A

0.8

topo1.dat

Topography database

Static

JPL/Njoku

N/A

N/A

3.2

veg1.dat

Vegetation database

Static

JPL/Njoku

N/A

N/A

1.6

prgprms.dat

Program parameters

Static

JPL/Njoku

 

 

(140 bytes)

invprms.dat

Inversion parameters