Description: |
Data processing using the GCE Data Toolbox for MATLAB
|
Software: | Title: | GCE Data Toolbox for MATLAB | Author(s): | Organization: | Georgia Coastal Ecosystems LTER | Email Address: | |
| Abstract: |
The GCE Data Toolbox is a comprehensive library of functions for metadata-based analysis quality
control, transformation and management of ecological data sets. The toolbox is based on the GCE
Data Structure, a MATLAB specification for storing tabular data along with all information required
to interpret the data and generate formatted metadata (documentation). Metadata fields in the
structure are queried by toolbox functions for all operations, allowing functions to process and
format values appropriately based on the type of information they represent. This semantic
processing approach supports highly automated and intelligent data analysis and ensures data set
validity throughout all processing steps.
| Implementation Info: | Distribution: | | Url: | https://gce-svn.marsci.uga.edu/trac/GCE_Toolbox | Version Number: | Toolbox Version 3.9.9b (06-Mar-2019) |
|
| Substep 1 | | Description: |
17-May-2019 16:24:57: new GCE Data Structure 1.1 created ('newstruct')
|
|
|
| Substep 2 | | Description: |
17-May-2019 16:24:57: 2177 rows imported from ASCII data file
'npp_cr1000_c-cali_data_table_daily.dat' ('imp_ascii')
|
|
|
| Substep 3 | | Description: |
17-May-2019 16:24:57: 4 metadata fields in file header parsed ('parse_header')
|
|
|
| Substep 4 | | Description: |
17-May-2019 16:24:57: data descriptor metadata updated based on the template
'npp_CR1000_C-CALI_Data_Table_Daily' ('meta_template')
|
|
|
| Substep 5 | | Description: |
17-May-2019 16:24:57: data structure validated ('gce_valid')
|
|
|
| Substep 6 | | Description: |
17-May-2019 16:24:57: Q/C flagging criteria applied, 'flags' field updated ('dataflag')
|
|
|
| Substep 7 | | Description: |
17-May-2019 16:24:57: automatically assigned study date metadata descriptors based on the range of
date values in date/time columns (add_studydates)
|
|
|
| Substep 8 | | Description: |
17-May-2019 16:24:57: converted dates in column(s) Date to format MATLAB serial date
|
|
|
| Substep 9 | | Description: |
17-May-2019 16:24:57: sorted by column Date(ascending) ('sortdata')
|
|
|
| Substep 10 | | Description: |
17-May-2019 16:24:57: removed 158 row(s) with duplicate values in the column(s) Date ('cleardupes')
|
|
|
| Substep 11 | | Description: |
17-May-2019 16:24:57: documented flagged and missing values in columns Batt_V_Min, Air_TempC_Avg,
Air_TempC_Max, Air_TempC_Min and Ws_mean_Resultant_300cm as data set anomalies in the metadata
('add_anomalies')
|
|
|
| Substep 12 | | Description: |
17-May-2019 16:24:58: added calculated Year, YearDay and Hours columns based on date/time
information in the data structure ('add_year_yearday_hours')
|
|
|
| Substep 13 | | Description: |
17-May-2019 16:24:58: CheckWindData -> add 9 flags to 3 related variables to WS_ms_150cm_Avg
|
|
|
| Substep 14 | | Description: |
17-May-2019 16:24:58: CheckWindData -> add 150 flags to 2 related variables to WinDir_Std_Dev
|
|
|
| Substep 15 | | Description: |
17-May-2019 16:24:58: converted dates in column(s) Date to format dd-mmm-yyyy
|
|
|
| Substep 16 | | Description: |
17-May-2019 19:21:53: Flag for column WinDir_mean_Resultant, at row 695 (30-Sep-2015) was changed
from 'I' to '<No flag>'
|
|
|
| Substep 17 | | Description: |
17-May-2019 19:22:02: Flag for column WinDir_Std_Dev, at row 695 (30-Sep-2015) was changed from 'I'
to '<No flag>'
|
|
|
| Substep 18 | | Description: |
20-May-2019 01:27:37: new GCE Data Structure 1.1 created ('newstruct')
|
|
|
| Substep 19 | | Description: |
20-May-2019 01:27:37: 2180 rows imported from ASCII data file
'npp_cr1000_c-cali_data_table_daily.dat' ('imp_ascii')
|
|
|
| Substep 20 | | Description: |
20-May-2019 01:27:37: 4 metadata fields in file header parsed ('parse_header')
|
|
|
| Substep 21 | | Description: |
20-May-2019 01:27:37: data descriptor metadata updated based on the template
'npp_CR1000_C-CALI_Data_Table_Daily' ('meta_template')
|
|
|
| Substep 22 | | Description: |
20-May-2019 01:27:37: data structure validated ('gce_valid')
|
|
|
| Substep 23 | | Description: |
20-May-2019 01:27:37: Q/C flagging criteria applied, 'flags' field updated ('dataflag')
|
|
|
| Substep 24 | | Description: |
20-May-2019 01:27:37: automatically assigned study date metadata descriptors based on the range of
date values in date/time columns (add_studydates)
|
|
|
| Substep 25 | | Description: |
20-May-2019 01:27:38: converted dates in column(s) Date to format MATLAB serial date
|
|
|
| Substep 26 | | Description: |
20-May-2019 01:27:38: sorted by column Date(ascending) ('sortdata')
|
|
|
| Substep 27 | | Description: |
20-May-2019 01:27:38: removed 158 row(s) with duplicate values in the column(s) Date ('cleardupes')
|
|
|
| Substep 28 | | Description: |
20-May-2019 01:27:38: documented flagged and missing values in columns Batt_V_Min, Air_TempC_Avg,
Air_TempC_Max, Air_TempC_Min and Ws_mean_Resultant_300cm as data set anomalies in the metadata
('add_anomalies')
|
|
|
| Substep 29 | | Description: |
20-May-2019 01:27:38: added calculated Year, YearDay and Hours columns based on date/time
information in the data structure ('add_year_yearday_hours')
|
|
|
| Substep 30 | | Description: |
20-May-2019 01:27:39: CheckWindData -> add 9 flags to 3 related variables to WS_ms_150cm_Avg
|
|
|
| Substep 31 | | Description: |
20-May-2019 01:27:39: CheckWindData -> add 150 flags to 2 related variables to WinDir_Std_Dev
|
|
|
| Substep 32 | | Description: |
20-May-2019 01:27:39: converted dates in column(s) Date to format dd-mmm-yyyy
|
|
|
| Substep 33 | | Description: |
20-May-2019 01:28:16: 3 new rows where added using levelTwo.m
|
|
|
| Substep 34 | | Description: |
20-May-2019 12:21:14: Data approved from row 1 () to 2022 (19-May-2019)
|
|
|
| Substep 35 | | Description: |
21-May-2019 02:33:43: new GCE Data Structure 1.1 created ('newstruct')
|
|
|
| Substep 36 | | Description: |
21-May-2019 02:33:43: 2181 rows imported from ASCII data file
'npp_cr1000_c-cali_data_table_daily.dat' ('imp_ascii')
|
|
|
| Substep 37 | | Description: |
21-May-2019 02:33:43: 4 metadata fields in file header parsed ('parse_header')
|
|
|
| Substep 38 | | Description: |
21-May-2019 02:33:43: data descriptor metadata updated based on the template
'npp_CR1000_C-CALI_Data_Table_Daily' ('meta_template')
|
|
|
| Substep 39 | | Description: |
21-May-2019 02:33:43: data structure validated ('gce_valid')
|
|
|
| Substep 40 | | Description: |
21-May-2019 02:33:43: Q/C flagging criteria applied, 'flags' field updated ('dataflag')
|
|
|
| Substep 41 | | Description: |
21-May-2019 02:33:43: automatically assigned study date metadata descriptors based on the range of
date values in date/time columns (add_studydates)
|
|
|
| Substep 42 | | Description: |
21-May-2019 02:33:43: converted dates in column(s) Date to format MATLAB serial date
|
|
|
| Substep 43 | | Description: |
21-May-2019 02:33:43: sorted by column Date(ascending) ('sortdata')
|
|
|
| Substep 44 | | Description: |
21-May-2019 02:33:43: removed 158 row(s) with duplicate values in the column(s) Date ('cleardupes')
|
|
|
| Substep 45 | | Description: |
21-May-2019 02:33:44: documented flagged and missing values in columns Batt_V_Min, Air_TempC_Avg,
Air_TempC_Max, Air_TempC_Min and Ws_mean_Resultant_300cm as data set anomalies in the metadata
('add_anomalies')
|
|
|
| Substep 46 | | Description: |
21-May-2019 02:33:44: added calculated Year, YearDay and Hours columns based on date/time
information in the data structure ('add_year_yearday_hours')
|
|
|
| Substep 47 | | Description: |
21-May-2019 02:33:44: CheckWindData -> add 9 flags to 3 related variables to WS_ms_150cm_Avg
|
|
|
| Substep 48 | | Description: |
21-May-2019 02:33:44: CheckWindData -> add 150 flags to 2 related variables to WinDir_Std_Dev
|
|
|
| Substep 49 | | Description: |
21-May-2019 02:33:44: converted dates in column(s) Date to format dd-mmm-yyyy
|
|
|
| Substep 50 | | Description: |
21-May-2019 08:19:01: 1 new rows where added using levelTwo.m
|
|
|
| Substep 51 | | Description: |
21-May-2019 08:20:13: Data approved from row 2022 (19-May-2019) to 2023 (20-May-2019)
|
|
|
| Substep 52 | | Description: |
22-May-2019 17:19:16: converted dates in column(s) Date to format yyyy-mm-dd
|
|
|
| Substep 53 | | Description: |
23-May-2019 17:10:07: CheckNanData -> add 2 flags to variable to Air_TempC_Avg, add 2 flags to
variable to Air_TempC_Max, add 2 flags to variable to Air_TempC_Min, add 1 flags to variable to
Ws_mean_Resultant_300cm
|
|
|
| Substep 54 | | Description: |
23-May-2019 02:34:20: new GCE Data Structure 1.1 created ('newstruct')
|
|
|
| Substep 55 | | Description: |
23-May-2019 02:34:20: 2183 rows imported from ASCII data file
'npp_cr1000_c-cali_data_table_daily.dat' ('imp_ascii')
|
|
|
| Substep 56 | | Description: |
23-May-2019 02:34:20: 4 metadata fields in file header parsed ('parse_header')
|
|
|
| Substep 57 | | Description: |
23-May-2019 02:34:20: data descriptor metadata updated based on the template
'npp_CR1000_C-CALI_Data_Table_Daily' ('meta_template')
|
|
|
| Substep 58 | | Description: |
23-May-2019 02:34:20: data structure validated ('gce_valid')
|
|
|
| Substep 59 | | Description: |
23-May-2019 02:34:20: Q/C flagging criteria applied, 'flags' field updated ('dataflag')
|
|
|
| Substep 60 | | Description: |
23-May-2019 02:34:20: automatically assigned study date metadata descriptors based on the range of
date values in date/time columns (add_studydates)
|
|
|
| Substep 61 | | Description: |
23-May-2019 02:34:20: converted dates in column(s) Date to format MATLAB serial date
|
|
|
| Substep 62 | | Description: |
23-May-2019 02:34:20: sorted by column Date(ascending) ('sortdata')
|
|
|
| Substep 63 | | Description: |
23-May-2019 02:34:20: removed 158 row(s) with duplicate values in the column(s) Date ('cleardupes')
|
|
|
| Substep 64 | | Description: |
23-May-2019 02:34:20: documented flagged and missing values in columns Batt_V_Min, Air_TempC_Avg,
Air_TempC_Max, Air_TempC_Min and Ws_mean_Resultant_300cm as data set anomalies in the metadata
('add_anomalies')
|
|
|
| Substep 65 | | Description: |
23-May-2019 02:34:21: CheckNanData -> add 2 flags to variable to Air_TempC_Avg, add 2 flags to
variable to Air_TempC_Max, add 2 flags to variable to Air_TempC_Min, add 1 flags to variable to
Ws_mean_Resultant_300cm
|
|
|
| Substep 66 | | Description: |
23-May-2019 02:34:21: added calculated Year, YearDay and Hours columns based on date/time
information in the data structure ('add_year_yearday_hours')
|
|
|
| Substep 67 | | Description: |
23-May-2019 02:34:21: CheckWindData -> add 9 flags to 3 related variables to WS_ms_150cm_Avg
|
|
|
| Substep 68 | | Description: |
23-May-2019 02:34:21: CheckWindData -> add 150 flags to 2 related variables to WinDir_Std_Dev
|
|
|
| Substep 69 | | Description: |
23-May-2019 02:34:21: converted dates in column(s) Date to format yyyy-mm-dd
|
|
|
| Substep 70 | | Description: |
23-May-2019 18:18:27: 2 new rows where added using levelTwo.m
|
|
|
| Substep 71 | | Description: |
23-May-2019 18:19:28: Data approved from row 2023 (2019-05-20) to 2025 (2019-05-22)
|
|
|
| Substep 72 | | Description: |
28-May-2019 02:34:14: new GCE Data Structure 1.1 created ('newstruct')
|
|
|
| Substep 73 | | Description: |
28-May-2019 02:34:14: 2188 rows imported from ASCII data file
'npp_cr1000_c-cali_data_table_daily.dat' ('imp_ascii')
|
|
|
| Substep 74 | | Description: |
28-May-2019 02:34:14: 4 metadata fields in file header parsed ('parse_header')
|
|
|
| Substep 75 | | Description: |
28-May-2019 02:34:14: data descriptor metadata updated based on the template
'npp_CR1000_C-CALI_Data_Table_Daily' ('meta_template')
|
|
|
| Substep 76 | | Description: |
28-May-2019 02:34:14: data structure validated ('gce_valid')
|
|
|
| Substep 77 | | Description: |
28-May-2019 02:34:14: Q/C flagging criteria applied, 'flags' field updated ('dataflag')
|
|
|
| Substep 78 | | Description: |
28-May-2019 02:34:14: automatically assigned study date metadata descriptors based on the range of
date values in date/time columns (add_studydates)
|
|
|
| Substep 79 | | Description: |
28-May-2019 02:34:14: converted dates in column(s) Date to format MATLAB serial date
|
|
|
| Substep 80 | | Description: |
28-May-2019 02:34:15: sorted by column Date(ascending) ('sortdata')
|
|
|
| Substep 81 | | Description: |
28-May-2019 02:34:15: removed 158 row(s) with duplicate values in the column(s) Date ('cleardupes')
|
|
|
| Substep 82 | | Description: |
28-May-2019 02:34:15: documented flagged and missing values in columns Batt_V_Min, Air_TempC_Avg,
Air_TempC_Max, Air_TempC_Min and Ws_mean_Resultant_300cm as data set anomalies in the metadata
('add_anomalies')
|
|
|
| Substep 83 | | Description: |
28-May-2019 02:34:15: CheckNanData -> add 2 flags to variable to Air_TempC_Avg, add 2 flags to
variable to Air_TempC_Max, add 2 flags to variable to Air_TempC_Min, add 1 flags to variable to
Ws_mean_Resultant_300cm
|
|
|
| Substep 84 | | Description: |
28-May-2019 02:34:15: added calculated Year, YearDay and Hours columns based on date/time
information in the data structure ('add_year_yearday_hours')
|
|
|
| Substep 85 | | Description: |
28-May-2019 02:34:15: CheckWindData -> add 9 flags to 3 related variables to WS_ms_150cm_Avg
|
|
|
| Substep 86 | | Description: |
28-May-2019 02:34:15: CheckWindData -> add 150 flags to 2 related variables to WinDir_Std_Dev
|
|
|
| Substep 87 | | Description: |
28-May-2019 02:34:16: converted dates in column(s) Date to format yyyy-mm-dd
|
|
|
| Substep 88 | | Description: |
29-May-2019 00:58:55: 5 new rows where added using levelTwo.m
|
|
|
| Substep 89 | | Description: |
03-Jun-2019 15:23:27: new GCE Data Structure 1.1 created ('newstruct')
|
|
|
| Substep 90 | | Description: |
03-Jun-2019 15:23:27: 2194 rows imported from ASCII data file
'npp_cr1000_c-cali_data_table_daily.dat' ('imp_ascii')
|
|
|
| Substep 91 | | Description: |
03-Jun-2019 15:23:27: 4 metadata fields in file header parsed ('parse_header')
|
|
|
| Substep 92 | | Description: |
03-Jun-2019 15:23:27: data descriptor metadata updated based on the template
'npp_CR1000_C-CALI_Data_Table_Daily' ('meta_template')
|
|
|
| Substep 93 | | Description: |
03-Jun-2019 15:23:27: data structure validated ('gce_valid')
|
|
|
| Substep 94 | | Description: |
03-Jun-2019 15:23:27: Q/C flagging criteria applied, 'flags' field updated ('dataflag')
|
|
|
| Substep 95 | | Description: |
03-Jun-2019 15:23:27: automatically assigned study date metadata descriptors based on the range of
date values in date/time columns (add_studydates)
|
|
|
| Substep 96 | | Description: |
03-Jun-2019 15:23:27: converted dates in column(s) Date to format MATLAB serial date
|
|
|
| Substep 97 | | Description: |
03-Jun-2019 15:23:27: sorted by column Date(ascending) ('sortdata')
|
|
|
| Substep 98 | | Description: |
03-Jun-2019 15:23:27: removed 158 row(s) with duplicate values in the column(s) Date ('cleardupes')
|
|
|
| Substep 99 | | Description: |
03-Jun-2019 15:23:27: documented flagged and missing values in columns Batt_V_Min, Air_TempC_Avg,
Air_TempC_Max, Air_TempC_Min and Ws_mean_Resultant_300cm as data set anomalies in the metadata
('add_anomalies')
|
|
|
| Substep 100 | | Description: |
03-Jun-2019 15:23:27: CheckNanData -> add 2 flags to variable to Air_TempC_Avg, add 2 flags to
variable to Air_TempC_Max, add 2 flags to variable to Air_TempC_Min, add 1 flags to variable to
Ws_mean_Resultant_300cm
|
|
|
| Substep 101 | | Description: |
03-Jun-2019 15:23:27: added calculated Year, YearDay and Hours columns based on date/time
information in the data structure ('add_year_yearday_hours')
|
|
|
| Substep 102 | | Description: |
03-Jun-2019 15:23:28: CheckWindData -> add 9 flags to 3 related variables to WS_ms_150cm_Avg
|
|
|
| Substep 103 | | Description: |
03-Jun-2019 15:23:28: CheckWindData -> add 150 flags to 2 related variables to WinDir_Std_Dev
|
|
|
| Substep 104 | | Description: |
03-Jun-2019 15:23:28: converted dates in column(s) Date to format yyyy-mm-dd
|
|
|
| Substep 105 | | Description: |
03-Jun-2019 19:22:36: 6 new rows where added using levelTwo.m
|
|
|
| Substep 106 | | Description: |
04-Jun-2019 16:48:33: new GCE Data Structure 1.1 created ('newstruct')
|
|
|
| Substep 107 | | Description: |
04-Jun-2019 16:48:33: 2195 rows imported from ASCII data file
'npp_cr1000_c-cali_data_table_daily.dat' ('imp_ascii')
|
|
|
| Substep 108 | | Description: |
04-Jun-2019 16:48:33: 4 metadata fields in file header parsed ('parse_header')
|
|
|
| Substep 109 | | Description: |
04-Jun-2019 16:48:33: data descriptor metadata updated based on the template
'npp_CR1000_C-CALI_Data_Table_Daily' ('meta_template')
|
|
|
| Substep 110 | | Description: |
04-Jun-2019 16:48:33: data structure validated ('gce_valid')
|
|
|
| Substep 111 | | Description: |
04-Jun-2019 16:48:33: Q/C flagging criteria applied, 'flags' field updated ('dataflag')
|
|
|
| Substep 112 | | Description: |
04-Jun-2019 16:48:33: automatically assigned study date metadata descriptors based on the range of
date values in date/time columns (add_studydates)
|
|
|
| Substep 113 | | Description: |
04-Jun-2019 16:48:33: converted dates in column(s) Date to format MATLAB serial date
|
|
|
| Substep 114 | | Description: |
04-Jun-2019 16:48:33: sorted by column Date(ascending) ('sortdata')
|
|
|
| Substep 115 | | Description: |
04-Jun-2019 16:48:33: removed 158 row(s) with duplicate values in the column(s) Date ('cleardupes')
|
|
|
| Substep 116 | | Description: |
04-Jun-2019 16:48:34: documented flagged and missing values in columns Batt_V_Min, Air_TempC_Avg,
Air_TempC_Max, Air_TempC_Min and Ws_mean_Resultant_300cm as data set anomalies in the metadata
('add_anomalies')
|
|
|
| Substep 117 | | Description: |
04-Jun-2019 16:48:34: CheckNanData -> add 2 flags to variable to Air_TempC_Avg, add 2 flags to
variable to Air_TempC_Max, add 2 flags to variable to Air_TempC_Min, add 1 flags to variable to
Ws_mean_Resultant_300cm
|
|
|
| Substep 118 | | Description: |
04-Jun-2019 16:48:34: added calculated Year, YearDay and Hours columns based on date/time
information in the data structure ('add_year_yearday_hours')
|
|
|
| Substep 119 | | Description: |
04-Jun-2019 16:48:34: CheckWindData -> add 9 flags to 3 related variables to WS_ms_150cm_Avg
|
|
|
| Substep 120 | | Description: |
04-Jun-2019 16:48:34: CheckWindData -> add 150 flags to 2 related variables to WinDir_Std_Dev
|
|
|
| Substep 121 | | Description: |
04-Jun-2019 16:48:35: converted dates in column(s) Date to format yyyy-mm-dd
|
|
|
| Substep 122 | | Description: |
04-Jun-2019 19:17:21: 1 new rows where added using levelTwo.m
|
|
|
| Substep 123 | | Description: |
04-Jun-2019 19:17:31: All rows from 1 (2013-11-05) to 2025 (2019-05-22) were disapproved
|
|
|
| Substep 124 | | Description: |
04-Jun-2019 19:19:33: Flag for column Ppt_mm_Tot, at row 1870 (2018-12-18) was changed from '<No
flag>' to 'E'
|
|
|
| Substep 125 | | Description: |
04-Jun-2019 19:19:40: Value for column Ppt_mm_Tot, at row 1870 (2018-12-18) was changed from 0.3000
to 0.2000
|
|
|
| Substep 126 | | Description: |
04-Jun-2019 19:19:55: Data approved from row 1 () to 2034 (2019-05-31)
|
|
|
| Substep 127 | | Description: |
10-Jun-2019 02:34:26: new GCE Data Structure 1.1 created ('newstruct')
|
|
|
| Substep 128 | | Description: |
10-Jun-2019 02:34:26: 2201 rows imported from ASCII data file
'npp_cr1000_c-cali_data_table_daily.dat' ('imp_ascii')
|
|
|
| Substep 129 | | Description: |
10-Jun-2019 02:34:26: 4 metadata fields in file header parsed ('parse_header')
|
|
|
| Substep 130 | | Description: |
10-Jun-2019 02:34:26: data descriptor metadata updated based on the template
'npp_CR1000_C-CALI_Data_Table_Daily' ('meta_template')
|
|
|
| Substep 131 | | Description: |
10-Jun-2019 02:34:26: data structure validated ('gce_valid')
|
|
|
| Substep 132 | | Description: |
10-Jun-2019 02:34:26: Q/C flagging criteria applied, 'flags' field updated ('dataflag')
|
|
|
| Substep 133 | | Description: |
10-Jun-2019 02:34:26: automatically assigned study date metadata descriptors based on the range of
date values in date/time columns (add_studydates)
|
|
|
| Substep 134 | | Description: |
10-Jun-2019 02:34:26: converted dates in column(s) Date to format MATLAB serial date
|
|
|
| Substep 135 | | Description: |
10-Jun-2019 02:34:27: sorted by column Date(ascending) ('sortdata')
|
|
|
| Substep 136 | | Description: |
10-Jun-2019 02:34:27: removed 158 row(s) with duplicate values in the column(s) Date ('cleardupes')
|
|
|
| Substep 137 | | Description: |
10-Jun-2019 02:34:27: documented flagged and missing values in columns Batt_V_Min, Air_TempC_Avg,
Air_TempC_Max, Air_TempC_Min and Ws_mean_Resultant_300cm as data set anomalies in the metadata
('add_anomalies')
|
|
|
| Substep 138 | | Description: |
10-Jun-2019 02:34:27: CheckNanData -> add 2 flags to variable to Air_TempC_Avg, add 2 flags to
variable to Air_TempC_Max, add 2 flags to variable to Air_TempC_Min, add 1 flags to variable to
Ws_mean_Resultant_300cm
|
|
|
| Substep 139 | | Description: |
10-Jun-2019 02:34:27: added calculated Year, YearDay and Hours columns based on date/time
information in the data structure ('add_year_yearday_hours')
|
|
|
| Substep 140 | | Description: |
10-Jun-2019 02:34:27: CheckWindData -> add 9 flags to 3 related variables to WS_ms_150cm_Avg
|
|
|
| Substep 141 | | Description: |
10-Jun-2019 02:34:27: CheckWindData -> add 150 flags to 2 related variables to WinDir_Std_Dev
|
|
|
| Substep 142 | | Description: |
10-Jun-2019 02:34:28: converted dates in column(s) Date to format yyyy-mm-dd
|
|
|
| Substep 143 | | Description: |
10-Jun-2019 11:27:31: 6 new rows where added using levelTwo.m
|
|
|
| Substep 144 | | Description: |
21-Jun-2019 16:32:00: new GCE Data Structure 1.1 created ('newstruct')
|
|
|
| Substep 145 | | Description: |
21-Jun-2019 16:32:00: 2212 rows imported from ASCII data file
'npp_cr1000_c-cali_data_table_daily.dat' ('imp_ascii')
|
|
|
| Substep 146 | | Description: |
21-Jun-2019 16:32:00: 4 metadata fields in file header parsed ('parse_header')
|
|
|
| Substep 147 | | Description: |
21-Jun-2019 16:32:00: data descriptor metadata updated based on the template
'npp_CR1000_C-CALI_Data_Table_Daily' ('meta_template')
|
|
|
| Substep 148 | | Description: |
21-Jun-2019 16:32:00: data structure validated ('gce_valid')
|
|
|
| Substep 149 | | Description: |
21-Jun-2019 16:32:00: Q/C flagging criteria applied, 'flags' field updated ('dataflag')
|
|
|
| Substep 150 | | Description: |
21-Jun-2019 16:32:00: automatically assigned study date metadata descriptors based on the range of
date values in date/time columns (add_studydates)
|
|
|
| Substep 151 | | Description: |
21-Jun-2019 16:32:00: converted dates in column(s) Date to format MATLAB serial date
|
|
|
| Substep 152 | | Description: |
21-Jun-2019 16:32:00: sorted by column Date(ascending) ('sortdata')
|
|
|
| Substep 153 | | Description: |
21-Jun-2019 16:32:00: removed 158 row(s) with duplicate values in the column(s) Date ('cleardupes')
|
|
|
| Substep 154 | | Description: |
21-Jun-2019 16:32:00: documented flagged and missing values in columns Batt_V_Min, Air_TempC_Avg,
Air_TempC_Max, Air_TempC_Min and Ws_mean_Resultant_300cm as data set anomalies in the metadata
('add_anomalies')
|
|
|
| Substep 155 | | Description: |
21-Jun-2019 16:32:00: CheckNanData -> add 2 flags to variable to Air_TempC_Avg, add 2 flags to
variable to Air_TempC_Max, add 2 flags to variable to Air_TempC_Min, add 1 flags to variable to
Ws_mean_Resultant_300cm
|
|
|
| Substep 156 | | Description: |
21-Jun-2019 16:32:00: added calculated Year, YearDay and Hours columns based on date/time
information in the data structure ('add_year_yearday_hours')
|
|
|
| Substep 157 | | Description: |
21-Jun-2019 16:32:01: CheckWindData -> add 9 flags to 3 related variables to WS_ms_150cm_Avg
|
|
|
| Substep 158 | | Description: |
21-Jun-2019 16:32:01: CheckWindData -> add 150 flags to 2 related variables to WinDir_Std_Dev
|
|
|
| Substep 159 | | Description: |
21-Jun-2019 16:32:01: converted dates in column(s) Date to format yyyy-mm-dd
|
|
|
| Substep 160 | | Description: |
21-Jun-2019 18:24:35: 11 new rows where added using levelTwo.m
|
|
|
| Substep 161 | | Description: |
21-Jun-2019 18:25:32: flags for columns RECORD, Batt_V_Min, Ptemp_C_Avg, Air_TempC_Avg,
Air_TempC_Max, Air_TempC_Min, Relative_Humidity_Avg, Relative_Humidity_Max, Relative_Humidity_Min,
Ppt_mm_Tot, Ws_Mean_300cm, Ws_mean_Resultant_300cm, WinDir_mean_Resultant, WinDir_Std_Dev,
WS_ms_75cm_Avg, WS_ms_150cm_Avg, WS_ms_300cm_Avg, WS_ms_75cm_Max, WS_ms_150cm_Max, WS_ms_300cm_Max,
WS_ms_75cm_Min, WS_ms_150cm_Min and WS_ms_300cm_Min converted to data columns, flag codes updated
in metadata ('flags2cols')
|
|
|
| Substep 162 | | Description: |
21-Jun-2019 18:25:32: deleted columns Flag_RECORD, Flag_Batt_V_Min, Flag_Ptemp_C_Avg,
Flag_Air_TempC_Avg, Flag_Air_TempC_Max, Flag_Air_TempC_Min, Flag_Relative_Humidity_Avg,
Flag_Relative_Humidity_Max, Flag_Relative_Humidity_Min, Flag_Ppt_mm_Tot, Flag_Ws_Mean_300cm,
Flag_Ws_mean_Resultant_300cm, Flag_WinDir_mean_Resultant, Flag_WinDir_Std_Dev, Flag_WS_ms_75cm_Avg,
Flag_WS_ms_150cm_Avg, Flag_WS_ms_300cm_Avg, Flag_WS_ms_75cm_Max, Flag_WS_ms_150cm_Max,
Flag_WS_ms_300cm_Max, Flag_WS_ms_75cm_Min, Flag_WS_ms_150cm_Min and Flag_WS_ms_300cm_Min from the
structure ('deletecols')
|
|
|
| Substep 163 | | Description: |
21-Jun-2019 18:25:32: flags for columns RECORD, Batt_V_Min, Ptemp_C_Avg, Air_TempC_Avg,
Air_TempC_Max, Air_TempC_Min, Relative_Humidity_Avg, Relative_Humidity_Max, Relative_Humidity_Min,
Ppt_mm_Tot, Ws_Mean_300cm, Ws_mean_Resultant_300cm, WinDir_mean_Resultant, WinDir_Std_Dev,
WS_ms_75cm_Avg, WS_ms_150cm_Avg, WS_ms_300cm_Avg, WS_ms_75cm_Max, WS_ms_150cm_Max, WS_ms_300cm_Max,
WS_ms_75cm_Min, WS_ms_150cm_Min and WS_ms_300cm_Min converted to data columns, flag codes updated
in metadata ('flags2cols')
|
|
|
| Substep 164 | | Description: |
21-Jun-2019 18:25:32: automatically assigned study date metadata descriptors based on the range of
date values in date/time columns (add_studydates)
|
|
|
| Substep 165 | | Description: |
21-Jun-2019 18:25:32: converted dates in column(s) Hours to format yyyy-mm-dd HH:MM:SS
|
|
|