Description: |
Data processing using the GCE Data Toolbox for MATLAB
|
Software: | Title: | GCE Data Toolbox for MATLAB | Author(s): | Organization: | Georgia Coastal Ecosystems LTER | Email Address: | |
| Abstract: |
The GCE Data Toolbox is a comprehensive library of functions for metadata-based analysis quality
control, transformation and management of ecological data sets. The toolbox is based on the GCE
Data Structure, a MATLAB specification for storing tabular data along with all information required
to interpret the data and generate formatted metadata (documentation). Metadata fields in the
structure are queried by toolbox functions for all operations, allowing functions to process and
format values appropriately based on the type of information they represent. This semantic
processing approach supports highly automated and intelligent data analysis and ensures data set
validity throughout all processing steps.
| Implementation Info: | Distribution: | | Url: | https://gce-svn.marsci.uga.edu/trac/GCE_Toolbox | Version Number: | Toolbox Version 3.9.9b (06-Mar-2019) |
|
| Substep 1 | | Description: |
20-May-2019 17:41:05: new GCE Data Structure 1.1 created ('newstruct')
|
|
|
| Substep 2 | | Description: |
20-May-2019 17:41:05: 16882 rows imported from ASCII data file 'npp_cr1000_c-cali_ppt_detailed.dat'
('imp_ascii')
|
|
|
| Substep 3 | | Description: |
20-May-2019 17:41:05: 4 metadata fields in file header parsed ('parse_header')
|
|
|
| Substep 4 | | Description: |
20-May-2019 17:41:05: data descriptor metadata updated based on the template
'npp_CR1000_C-CALI_Ppt_Detailed' ('meta_template')
|
|
|
| Substep 5 | | Description: |
20-May-2019 17:41:05: data structure validated ('gce_valid')
|
|
|
| Substep 6 | | Description: |
20-May-2019 17:41:05: Q/C flagging criteria applied, 'flags' field updated ('dataflag')
|
|
|
| Substep 7 | | Description: |
20-May-2019 17:41:06: automatically assigned study date metadata descriptors based on the range of
date values in date/time columns (add_studydates)
|
|
|
| Substep 8 | | Description: |
20-May-2019 17:41:06: converted dates in column(s) Date to format MATLAB serial date
|
|
|
| Substep 9 | | Description: |
20-May-2019 17:41:06: sorted by column Date(ascending) ('sortdata')
|
|
|
| Substep 10 | | Description: |
20-May-2019 17:41:06: removed 1411 row(s) with duplicate values in the column(s) Date ('cleardupes')
|
|
|
| Substep 11 | | Description: |
20-May-2019 17:41:07: documented flagged and missing values in column Ppt_mm_Tot as data set
anomalies in the metadata ('add_anomalies')
|
|
|
| Substep 12 | | Description: |
20-May-2019 17:41:07: added calculated Year, YearDay and Hours columns based on date/time
information in the data structure ('add_year_yearday_hours')
|
|
|
| Substep 13 | | Description: |
20-May-2019 17:41:08: converted dates in column(s) Date to format dd-mmm-yyyy HH:MM:SS
|
|
|
| Substep 14 | | Description: |
20-May-2019 17:42:41: Data approved from row 1 () to 15471 (12-May-2019 17:15:46)
|
|
|
| Substep 15 | | Description: |
22-May-2019 17:19:17: converted dates in column(s) Date to format yyyy-mm-dd HH:MM:SS
|
|
|
| Substep 16 | | Description: |
03-Jun-2019 16:35:48: flags for columns RECORD and Ppt_mm_Tot converted to data columns, flag codes
updated in metadata ('flags2cols')
|
|
|
| Substep 17 | | Description: |
03-Jun-2019 16:35:48: deleted columns Flag_RECORD and Flag_Ppt_mm_Tot from the structure
('deletecols')
|
|
|
| Substep 18 | | Description: |
03-Jun-2019 16:35:48: flags for columns RECORD and Ppt_mm_Tot converted to data columns, flag codes
updated in metadata ('flags2cols')
|
|
|
| Substep 19 | | Description: |
03-Jun-2019 16:35:49: automatically assigned study date metadata descriptors based on the range of
date values in date/time columns (add_studydates)
|
|
|
| Substep 20 | | Description: |
03-Jun-2019 16:35:49: converted dates in column(s) Hours to format yyyy-mm-dd HH:MM:SS
|
|
|