Data Table | Data: | https://pasta-s.lternet.edu/package/data/eml/knb-lter-jrn/210437034/1/8d777f385d3dfec8815d20f7496026dc | Name: | data | Description: | Main data table from Jornada LTER NPP G-BASN meteorological station: 1-hour summary data | Number of Columns: | 39 | | Methods and protocols used in the collection of this data package |
---|
Description: |
Data processing using the GCE Data Toolbox for MATLAB
| Software: | Title: | GCE Data Toolbox for MATLAB | Author(s): | Organization: | Georgia Coastal Ecosystems LTER | Email Address: | |
| Abstract: |
The GCE Data Toolbox is a comprehensive library of functions for metadata-based analysis quality
control, transformation and management of ecological data sets. The toolbox is based on the GCE
Data Structure, a MATLAB specification for storing tabular data along with all information required
to interpret the data and generate formatted metadata (documentation). Metadata fields in the
structure are queried by toolbox functions for all operations, allowing functions to process and
format values appropriately based on the type of information they represent. This semantic
processing approach supports highly automated and intelligent data analysis and ensures data set
validity throughout all processing steps.
| Implementation Info: | Distribution: | | Url: | https://gce-svn.marsci.uga.edu/trac/GCE_Toolbox | Version Number: | Toolbox Version 3.9.9 (07-Jan-2019) |
| | Substep 1 | | Description: |
01-Mar-2019 10:34:22: new GCE Data Structure 1.1 created ('newstruct')
|
|
| | Substep 2 | | Description: |
01-Mar-2019 10:34:22: 29832 rows imported from ASCII data file
'npp_cr1000_g-basn_data_table_1_hour.dat' ('imp_ascii')
|
|
| | Substep 3 | | Description: |
01-Mar-2019 10:34:22: 4 metadata fields in file header parsed ('parse_header')
|
|
| | Substep 4 | | Description: |
01-Mar-2019 10:34:22: data descriptor metadata updated based on the template
'npp_CR1000_G-BASN_Data_Table_1_Hour' ('meta_template')
|
|
| | Substep 5 | | Description: |
01-Mar-2019 10:34:22: data structure validated ('gce_valid')
|
|
| | Substep 6 | | Description: |
01-Mar-2019 10:34:23: Q/C flagging criteria applied, 'flags' field updated ('dataflag')
|
|
| | Substep 7 | | Description: |
01-Mar-2019 10:34:26: automatically assigned study date metadata descriptors based on the range of
date values in date/time columns (add_studydates)
|
|
| | Substep 8 | | Description: |
01-Mar-2019 10:34:26: converted dates in column(s) Date to format MATLAB serial date
|
|
| | Substep 9 | | Description: |
01-Mar-2019 10:34:27: sorted by column Date(ascending) ('sortdata')
|
|
| | Substep 10 | | Description: |
01-Mar-2019 10:34:27: removed 2 row(s) with duplicate values in the column(s) Date ('cleardupes')
|
|
| | Substep 11 | | Description: |
01-Mar-2019 10:34:27: documented flagged and missing values in columns Ptemp_C_Avg, Air_TempC_Avg,
Air_TempC_Max, Air_TempC_Min and Relative_Humidity_Avg as data set anomalies in the metadata
('add_anomalies')
|
|
| | Substep 12 | | Description: |
01-Mar-2019 10:34:27: inserted 5779 new records with date/time values and NaN/null data values
(replicating common values in the non-data columns Sitename) to fill in date/time interval gaps in
the data series ('pad_date_gaps')
|
|
| | Substep 13 | | Description: |
01-Mar-2019 10:34:27: sorted by column Date(ascending) ('sortdata')
|
|
| | Substep 14 | | Description: |
01-Mar-2019 10:34:27: added calculated Year, YearDay and Hours columns based on date/time
information in the data structure ('add_year_yearday_hours')
|
|
| | Substep 15 | | Description: |
01-Mar-2019 10:34:28: converted dates in column(s) Date to format dd-mmm-yyyy HH:MM:SS
|
|
| | Substep 16 | | Description: |
01-Mar-2019 12:36:25: Flag for column Ptemp_C_Avg, at row 11951 (18-Jun-2016 15:00:00) was changed
from Q to <No flag>
|
|
| | Substep 17 | | Description: |
01-Mar-2019 12:36:33: Flags for columns Ptemp_C_Avg, at rows 12600, 12816, 20807, 20808, 20831,
20832, 20833, 27164, were changed to <No flag>
|
|
| | Substep 18 | | Description: |
01-Mar-2019 12:40:01: Data approved from row 1 () to 35609 (01-Mar-2019 09:00:00)
|
|
| | Substep 19 | | Description: |
01-Mar-2019 12:48:38: flags for columns RECORD, Ptemp_C_Avg, Air_TempC_Avg, Air_TempC_Max,
Air_TempC_Min, Relative_Humidity_Avg, Ppt_mm_Tot, Ws_Mean_300cm, Ws_mean_Resultant_300cm,
WinDir_mean_Resultant, WinDir_Std_Dev, WS_ms_75cm_Avg, WS_ms_150cm_Avg, WS_ms_300cm_Avg,
WS_ms_75cm_Max, WS_ms_150cm_Max and WS_ms_300cm_Max converted to data columns, flag codes updated
in metadata ('flags2cols')
|
|
| | Substep 20 | | Description: |
01-Mar-2019 12:48:38: deleted columns Flag_RECORD, Flag_Ptemp_C_Avg, Flag_Air_TempC_Avg,
Flag_Air_TempC_Max, Flag_Air_TempC_Min, Flag_Relative_Humidity_Avg, Flag_Ppt_mm_Tot,
Flag_Ws_Mean_300cm, Flag_Ws_mean_Resultant_300cm, Flag_WinDir_mean_Resultant, Flag_WinDir_Std_Dev,
Flag_WS_ms_75cm_Avg, Flag_WS_ms_150cm_Avg, Flag_WS_ms_300cm_Avg, Flag_WS_ms_75cm_Max,
Flag_WS_ms_150cm_Max and Flag_WS_ms_300cm_Max from the structure ('deletecols')
|
|
| | Substep 21 | | Description: |
01-Mar-2019 12:48:39: flags for columns RECORD, Ptemp_C_Avg, Air_TempC_Avg, Air_TempC_Max,
Air_TempC_Min, Relative_Humidity_Avg, Ppt_mm_Tot, Ws_Mean_300cm, Ws_mean_Resultant_300cm,
WinDir_mean_Resultant, WinDir_Std_Dev, WS_ms_75cm_Avg, WS_ms_150cm_Avg, WS_ms_300cm_Avg,
WS_ms_75cm_Max, WS_ms_150cm_Max and WS_ms_300cm_Max converted to data columns, flag codes updated
in metadata ('flags2cols')
|
|
| | Substep 22 | | Description: |
01-Mar-2019 12:48:40: converted dates in column(s) Hours to format yyyy-mm-dd HH:MM:SS
|
|
|
| Quality Control |
---|
Quality Control Step 1: | | Description: |
Quality control analysis was performed using the GCE Data Toolbox for MATLAB software. Column data
types are validated upon importing the table into MATLAB, and qualifier flags are automatically
generated for data values based on QA/QC criteria for each data column pre-defined in metadata
templates (e.g. value range checks, sanity checks, pattern checks). Automatically-assigned
qualifier flags are reviewed graphically and revised or augmented as deemed appropriate by GCE
information management staff, based on metadata information from the contributor, values of other
measured variables, or statistical tests. Qualifier flags are also assigned to values that are
imputed or derived, revised, or otherwise differ from values in the original data submission. A
column of coded qualifier flags is generated and included in the data table if flags are assigned
to any value in a data column.
Data anomalies: Values of 10 records in Ptemp_C_Avg were flagged as Q (questionable value) for
dates: 06/18/2016, 07/15/2016, 07/24/2016, 06/22/2017, 06/23/2017, 07/22/2018. Values of 199
records in Air_TempC_Avg were flagged as I (invalid value (out of range)) for dates:
03/14/2018-03/19/2018, 03/19/2018-03/20/2018, 03/20/2018-03/21/2018, 03/21/2018-03/28/2018,
03/29/2018. Values of 628 records in Air_TempC_Avg are missing for dates: 01/31/2018, 03/19/2018,
03/29/2018-04/24/2018. Values of 186 records in Air_TempC_Max were flagged as I (invalid value (out
of range)) for dates: 03/14/2018-03/15/2018, 03/15/2018-03/19/2018, 03/20/2018,
03/20/2018-03/21/2018, 03/21/2018-03/22/2018, 03/22/2018-03/28/2018. Values of 628 records in
Air_TempC_Max are missing for dates: 01/31/2018, 03/19/2018, 03/29/2018-04/24/2018. Values of 203
records in Air_TempC_Min were flagged as I (invalid value (out of range)) for dates:
03/14/2018-03/19/2018, 03/19/2018-03/20/2018, 03/20/2018-03/28/2018, 03/29/2018. Values of 628
records in Air_TempC_Min are missing for dates: 01/31/2018, 03/19/2018, 03/29/2018-04/24/2018.
Values of 202 records in Relative_Humidity_Avg were flagged as I (invalid value (out of range)) for
dates: 03/14/2018-03/20/2018, 03/20/2018-03/21/2018, 03/21/2018-03/28/2018, 03/29/2018.
|
|
| Table Structure |
---|
Object Name: | knb-lter-jrn.210437034.1.csv | Size: | 7061903 byte | Character Encoding: | ASCII | Text Format: |
Number of Header Lines: | 5 |
Number of Foot Lines: | 0 |
Record Delimiter: | \r\n |
Line Number For One Record: | 1 |
Orientation: | column |
Simple Delimited: |
Field Delimiter: | , |
Quote Character: | " |
|
|
|
|
Table Column Descriptions |
---|
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | |
---|
Column Name: | Date
| Year
| YearDay
| Hours
| RECORD
| Flag_RECORD
| Sitename
| Ptemp_C_Avg
| Flag_Ptemp_C_Avg
| Air_TempC_Avg
| Flag_Air_TempC_Avg
| Air_TempC_Max
| Flag_Air_TempC_Max
| Air_TempC_Min
| Flag_Air_TempC_Min
| Relative_Humidity_Avg
| Flag_Relative_Humidity_Avg
| Ppt_mm_Tot
| Flag_Ppt_mm_Tot
| Ws_Mean_300cm
| Flag_Ws_Mean_300cm
| Ws_mean_Resultant_300cm
| Flag_Ws_mean_Resultant_300cm
| WinDir_mean_Resultant
| Flag_WinDir_mean_Resultant
| WinDir_Std_Dev
| Flag_WinDir_Std_Dev
| WS_ms_75cm_Avg
| Flag_WS_ms_75cm_Avg
| WS_ms_150cm_Avg
| Flag_WS_ms_150cm_Avg
| WS_ms_300cm_Avg
| Flag_WS_ms_300cm_Avg
| WS_ms_75cm_Max
| Flag_WS_ms_75cm_Max
| WS_ms_150cm_Max
| Flag_WS_ms_150cm_Max
| WS_ms_300cm_Max
| Flag_WS_ms_300cm_Max
| Definition: | Date and time of observation | Calendar year | Numerical year day (day number within the current year) | Time of day in fractional hours | Record number generated by datalogger program | QA/QC flags for Record number generated by datalogger program (flagging criteria, where "x" is
RECORD: x<0="I") | Site identifier | Datalogger Panel Temperature: 1 hour Average | QA/QC flags for Datalogger Panel Temperature: 1 hour Average (flagging criteria, where "x" is
Ptemp_C_Avg: x<-35="I", (x>=-35 & x<-30 | x>45 & x<=50)="Q", x>50="I") | Air Temperature: 1 hour Average | QA/QC flags for Air Temperature: 1 hour Average (flagging criteria, where "x" is Air_TempC_Avg:
x<-35="I", (x>=-35 & x<-30 | x>45 & x<=50)="Q", x>50="I") | Air Temperature: 1 hour Maximum | QA/QC flags for Air Temperature: 1 hour Maximum (flagging criteria, where "x" is Air_TempC_Max:
x<-35="I", (x>=-35 & x<-30 | x>45 & x<=50)="Q", x>50="I") | Air Temperature: 1 hour Minimum | QA/QC flags for Air Temperature: 1 hour Minimum (flagging criteria, where "x" is Air_TempC_Min:
x<-35="I", (x>=-35 & x<-30 | x>45 & x<=50)="Q", x>50="I") | Relative Humidity: 1 hour Average | QA/QC flags for Relative Humidity: 1 hour Average (flagging criteria, where "x" is
Relative_Humidity_Avg: x<0="I", (x>100 & x<=105)="Q", x>105="I") | Precipitation: 1 hour Total | QA/QC flags for Precipitation: 1 hour Total (flagging criteria, where "x" is Ppt_mm_Tot: x<0="I",
(x>101.6 & x<=177.8)="Q", x>177.8="I") | Wind Speed: 1 hour Average at 300 cm height | QA/QC flags for Wind Speed: 1 hour Average at 300 cm height (flagging criteria, where "x" is
Ws_Mean_300cm: x<0="I", (x>32 & x<=55)="Q", x>55="I") | Wind Speed: 1 hour Resultant Vector Average at 300 cm height | QA/QC flags for Wind Speed: 1 hour Resultant Vector Average at 300 cm height (flagging criteria,
where "x" is Ws_mean_Resultant_300cm: x<0="I", (x>32 & x<=55)="Q", x>55="I") | Wind Direction: 1 hour Resultant Vector Average at 300 cm height | QA/QC flags for Wind Direction: 1 hour Resultant Vector Average at 300 cm height (flagging
criteria, where "x" is WinDir_mean_Resultant: x<0="I", x>360="I") | Wind Direction: 1 hour Standard Deviation at 300 cm height | QA/QC flags for Wind Direction: 1 hour Standard Deviation at 300 cm height (flagging criteria,
where "x" is WinDir_Std_Dev: x<0="I", x>360="I") | Wind Speed: 1 hour Average at 75 cm height | QA/QC flags for Wind Speed: 1 hour Average at 75 cm height (flagging criteria, where "x" is
WS_ms_75cm_Avg: x<0="I", (x>32 & x<=55)="Q", x>55="I") | Wind Speed: 1 hour Average at 150 cm height | QA/QC flags for Wind Speed: 1 hour Average at 150 cm height (flagging criteria, where "x" is
WS_ms_150cm_Avg: x<0="I", (x>32 & x<=55)="Q", x>55="I") | Wind Speed: 1 hour Average at 300 cm height | QA/QC flags for Wind Speed: 1 hour Average at 300 cm height (flagging criteria, where "x" is
WS_ms_300cm_Avg: x<0="I", (x>32 & x<=55)="Q", x>55="I") | Wind Speed: 1 hour Maximum at 75 cm height | QA/QC flags for Wind Speed: 1 hour Maximum at 75 cm height (flagging criteria, where "x" is
WS_ms_75cm_Max: x<0="I", (x>32 & x<=55)="Q", x>55="I") | Wind Speed: 1 hour Maximum at 150 cm height | QA/QC flags for Wind Speed: 1 hour Maximum at 150 cm height (flagging criteria, where "x" is
WS_ms_150cm_Max: x<0="I", (x>32 & x<=55)="Q", x>55="I") | Wind Speed: 1 hour Maximum at 300 cm height | QA/QC flags for Wind Speed: 1 hour Maximum at 300 cm height (flagging criteria, where "x" is
WS_ms_300cm_Max: x<0="I", (x>32 & x<=55)="Q", x>55="I") | Storage Type: | string
| integer
| integer
| string
| integer
| string
| integer
| floating-point
| string
| floating-point
| string
| floating-point
| string
| floating-point
| string
| floating-point
| string
| floating-point
| string
| floating-point
| string
| floating-point
| string
| integer
| string
| floating-point
| string
| floating-point
| string
| floating-point
| string
| floating-point
| string
| floating-point
| string
| floating-point
| string
| floating-point
| string
| Measurement Type: | dateTime | interval | interval | dateTime | ratio | ordinal | ordinal | ratio | ordinal | ratio | ordinal | ratio | ordinal | ratio | ordinal | ratio | ordinal | ratio | ordinal | ratio | ordinal | ratio | ordinal | ratio | ordinal | ratio | ordinal | ratio | ordinal | ratio | ordinal | ratio | ordinal | ratio | ordinal | ratio | ordinal | ratio | ordinal | Measurement Values Domain: | Format | DD-WWW-YYYY hh:mm:ss | Precision | |
| Unit | nominalYear | Precision | 1 | Type | real |
| Unit | nominalYear | Precision | 1 | Type | real | Min | 1 | Max | 366 |
| Format | YYYY-MM-DD hh:mm:ss | Precision | |
| Unit | none | Precision | 1 | Type | real | Min | 0 | Max | |
| Definition | QA/QC flags for Record number generated by datalogger program (flagging criteria, where "x" is
RECORD: x<0="I") |
| Definition | Site identifier |
| Unit | degreeCelcius | Precision | 0.01 | Type | real | Min | -35 | Max | 50 |
| Allowed Values and DefinitionsEnumerated Domain | | Code Definition | Code | Q | Definition | questionable value | Source | |
|
|
| Unit | degreeCelcius | Precision | 0.01 | Type | real | Min | -35 | Max | 50 |
| Allowed Values and DefinitionsEnumerated Domain | | Code Definition | Code | I | Definition | invalid value (out of range) | Source | |
|
|
| Unit | degreeCelcius | Precision | 0.01 | Type | real | Min | -35 | Max | 50 |
| Allowed Values and DefinitionsEnumerated Domain | | Code Definition | Code | I | Definition | invalid value (out of range) | Source | |
|
|
| Unit | degreeCelcius | Precision | 0.01 | Type | real | Min | -35 | Max | 50 |
| Allowed Values and DefinitionsEnumerated Domain | | Code Definition | Code | I | Definition | invalid value (out of range) | Source | |
|
|
| Unit | percent | Precision | 0.01 | Type | real | Min | 0 | Max | 105 |
| Allowed Values and DefinitionsEnumerated Domain | | Code Definition | Code | I | Definition | invalid value (out of range) | Source | |
|
|
| Unit | millimeter | Precision | 0.1 | Type | real | Min | 0 | Max | 177.8 |
| Definition | QA/QC flags for Precipitation: 1 hour Total (flagging criteria, where "x" is Ppt_mm_Tot: x<0="I",
(x>101.6 & x<=177.8)="Q", x>177.8="I") |
| Unit | metersPerSecond | Precision | 0.001 | Type | real | Min | 0 | Max | 55 |
| Definition | QA/QC flags for Wind Speed: 1 hour Average at 300 cm height (flagging criteria, where "x" is
Ws_Mean_300cm: x<0="I", (x>32 & x<=55)="Q", x>55="I") |
| Unit | metersPerSecond | Precision | 0.001 | Type | real | Min | 0 | Max | 55 |
| Definition | QA/QC flags for Wind Speed: 1 hour Resultant Vector Average at 300 cm height (flagging criteria,
where "x" is Ws_mean_Resultant_300cm: x<0="I", (x>32 & x<=55)="Q", x>55="I") |
| Unit | degrees | Precision | 1 | Type | real | Min | 0 | Max | 360 |
| Definition | QA/QC flags for Wind Direction: 1 hour Resultant Vector Average at 300 cm height (flagging
criteria, where "x" is WinDir_mean_Resultant: x<0="I", x>360="I") |
| Unit | degrees | Precision | 0.001 | Type | real | Min | 0 | Max | 360 |
| Definition | QA/QC flags for Wind Direction: 1 hour Standard Deviation at 300 cm height (flagging criteria,
where "x" is WinDir_Std_Dev: x<0="I", x>360="I") |
| Unit | metersPerSecond | Precision | 0.001 | Type | real | Min | 0 | Max | 55 |
| Definition | QA/QC flags for Wind Speed: 1 hour Average at 75 cm height (flagging criteria, where "x" is
WS_ms_75cm_Avg: x<0="I", (x>32 & x<=55)="Q", x>55="I") |
| Unit | metersPerSecond | Precision | 0.001 | Type | real | Min | 0 | Max | 55 |
| Definition | QA/QC flags for Wind Speed: 1 hour Average at 150 cm height (flagging criteria, where "x" is
WS_ms_150cm_Avg: x<0="I", (x>32 & x<=55)="Q", x>55="I") |
| Unit | metersPerSecond | Precision | 0.001 | Type | real | Min | 0 | Max | 55 |
| Definition | QA/QC flags for Wind Speed: 1 hour Average at 300 cm height (flagging criteria, where "x" is
WS_ms_300cm_Avg: x<0="I", (x>32 & x<=55)="Q", x>55="I") |
| Unit | metersPerSecond | Precision | 0.001 | Type | real | Min | 0 | Max | 55 |
| Definition | QA/QC flags for Wind Speed: 1 hour Maximum at 75 cm height (flagging criteria, where "x" is
WS_ms_75cm_Max: x<0="I", (x>32 & x<=55)="Q", x>55="I") |
| Unit | metersPerSecond | Precision | 0.001 | Type | real | Min | 0 | Max | 55 |
| Definition | QA/QC flags for Wind Speed: 1 hour Maximum at 150 cm height (flagging criteria, where "x" is
WS_ms_150cm_Max: x<0="I", (x>32 & x<=55)="Q", x>55="I") |
| Unit | metersPerSecond | Precision | 0.001 | Type | real | Min | 0 | Max | 55 |
| Definition | QA/QC flags for Wind Speed: 1 hour Maximum at 300 cm height (flagging criteria, where "x" is
WS_ms_300cm_Max: x<0="I", (x>32 & x<=55)="Q", x>55="I") |
| Missing Value Code: | | Code | NaN | Expl | value not recorded or censored based on quality control analysis (see methods) |
| Code | NaN | Expl | value not recorded or censored based on quality control analysis (see methods) |
| | Code | NaN | Expl | value not recorded or censored based on quality control analysis (see methods) |
| | | Code | NaN | Expl | value not recorded or censored based on quality control analysis (see methods) |
| | Code | NaN | Expl | value not recorded or censored based on quality control analysis (see methods) |
| | Code | NaN | Expl | value not recorded or censored based on quality control analysis (see methods) |
| | Code | NaN | Expl | value not recorded or censored based on quality control analysis (see methods) |
| | Code | NaN | Expl | value not recorded or censored based on quality control analysis (see methods) |
| | Code | NaN | Expl | value not recorded or censored based on quality control analysis (see methods) |
| | Code | NaN | Expl | value not recorded or censored based on quality control analysis (see methods) |
| | Code | NaN | Expl | value not recorded or censored based on quality control analysis (see methods) |
| | Code | NaN | Expl | value not recorded or censored based on quality control analysis (see methods) |
| | Code | NaN | Expl | value not recorded or censored based on quality control analysis (see methods) |
| | Code | NaN | Expl | value not recorded or censored based on quality control analysis (see methods) |
| | Code | NaN | Expl | value not recorded or censored based on quality control analysis (see methods) |
| | Code | NaN | Expl | value not recorded or censored based on quality control analysis (see methods) |
| | Code | NaN | Expl | value not recorded or censored based on quality control analysis (see methods) |
| | Code | NaN | Expl | value not recorded or censored based on quality control analysis (see methods) |
| | Code | NaN | Expl | value not recorded or censored based on quality control analysis (see methods) |
| | Accuracy Report: | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | Accuracy Assessment: | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | Coverage: | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | Methods: | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | |
|
|