Data Package Quality Report
PackageId: knb-lter-jrn.210465001.1
Report Date/Time: 2023-11-08T01:03:55
Dataset Report
# Identifier Status Quality Check Name Description Expected Found Explanation Suggestion Reference
1packageIdPatternvalid
Type:metadata
System:lter
On failure:error
packageId pattern matches "scope.identifier.revision"Check against LTER requirements for scope.identifier.revision'scope.n.m', where 'n' and 'm' are integers and 'scope' is one of an allowed set of valuesknb-lter-jrn.210465001.1
2emlVersionvalid
Type:metadata
System:lter
On failure:error
EML version 2.1.0 or beyondCheck the EML document declaration for version 2.1.0 or highereml://ecoinformatics.org/eml-2.1.0 or higherhttps://eml.ecoinformatics.org/eml-2.2.0Validity of this quality report is dependent on this check being valid.
3schemaValidvalid
Type:metadata
System:knb
On failure:error
Document is schema-valid EMLCheck document schema validityschema-validDocument validated for namespace: 'https://eml.ecoinformatics.org/eml-2.2.0'Validity of this quality report is dependent on this check being valid.
4parserValidvalid
Type:metadata
System:knb
On failure:error
Document is EML parser-validCheck document using the EML IDs and references parserValidates with the EML IDs and references parserEML IDs and references parser succeededValidity of this quality report is dependent on this check being valid.
5schemaValidDereferencedvalid
Type:metadata
System:lter
On failure:error
Dereferenced document is schema-valid EMLReferences are dereferenced, and the resulting file validatedschema-validDereferenced document validated for namespace: 'https://eml.ecoinformatics.org/eml-2.2.0'Validity of this quality report is dependent on this check being valid.
6keywordPresentvalid
Type:metadata
System:lter
On failure:warn
keyword element is presentChecks to see if at least one keyword is presentPresence of one or more keyword elements18 'keyword' element(s) found
7methodsElementPresentvalid
Type:metadata
System:lter
On failure:warn
A 'methods' element is presentAll datasets should contain a 'methods' element, at a minimum a link to a separate methods doc.presence of 'methods' at one or more xpaths.1 'methods' element(s) foundEML Best Practices, p. 28
8coveragePresentvalid
Type:metadata
System:lter
On failure:warn
coverage element is presentAt least one coverage element should be present in a dataset.At least one of geographicCoverage, taxonomicCoverage, or temporalCoverage is present in the EML.1 'coverage' element(s) found
9geographicCoveragePresentinfo
Type:metadata
System:lter
On failure:info
geographicCoverage is presentCheck that geographicCoverage exists in EML at the dataset level, or at least one entity's level, or at least one attribute's level.geographicCoverage at least at the dataset level.1 'geographicCoverage' element(s) foundMany but not all datasets are appropriate to have spatial coverage.If sampling EML is used within methods, does that obviate geographicCoverage? Or should those sites be repeated or referenced?EML Best Practices v.2, p. 22-23. "One geographicCoverage element should be included, whose boundingCoordinates describe the extent of the data....Additional geographicCoverage elements may be entered at the dataset level if there are significant distances between study sites and it would be confusing if they were grouped into one bounding box." 6 decimal places.
10taxonomicCoveragePresentinfo
Type:metadata
System:lter
On failure:info
taxonomicCoverage is presentCheck that taxonomicCoverage exists in EML at the dataset level, or at least one entity's level, or at least one attribute's level.taxonomicCoverage at least at the dataset level.0 'taxonomicCoverage' element(s) foundOnly when taxa are pertinent to the dataset will they have taxonomicCoverage.Could search title, abstract, keywords for any taxonomic name (huge). Could search keywordType="taxonomic".EML Best Practices v.2, p. 25
11temporalCoveragePresentinfo
Type:metadata
System:lter
On failure:info
temporalCoverage is presentCheck that temporalCoverage exists in EML at the dataset level, or at least one entity's level, or at least one attribute's level.temporalCoverage at least at the dataset level.1 'temporalCoverage' element(s) foundLTER wants to search datasets by time; the best place to search is the dataset level temporal coverage.Most datasets have a temporal range.EML Best Practices v.2, p. 24
12pastaDoiAbsentvalid
Type:metadata
System:lter
On failure:error
An alternateIdentifier with a DOI system attribute that looks like it is generated by PASTA should not be presentReject the data package if it contains an alternateIdentifier DOI that looks like PASTA generated it.No PASTA DOIs are expected to be found in the uploaded data packageNo PASTA DOI alternateIdentifier elements foundPASTA DOI values might appear in an uploaded data package (by various mechanisms). PASTA will assign a DOI after the upload has completed successfully, so an initial one should not be there.
13titleLengthvalid
Type:metadata
System:lter
On failure:warn
Dataset title length is at 5 least words.If the title is shorter than 5 words, it might be insufficient. Title word count between 7 and 20 including prepositions and numbers.Between 7 and 20 words11 words found.EML Best Practices, v.2, p. 13
14fundingPresencevalid
Type:metadata
System:lter
On failure:warn
check to see if funding element is presentChecks to see if the funding element is included.the funding element is expected to be included The Jornada LTER program has been continuously funded by the U.S. National Science Foundation since 1982 (Current NSF award: DEB-2025166)
15datasetAbstractLengthvalid
Type:metadata
System:lter
On failure:warn
Dataset abstract element is a minimum of 20 wordsCheck the length of a dataset abstract and warn if less than 20 words.An abstract is 20 words or more.51 words found.EML Best Practices
16duplicateEntityNamevalid
Type:metadata
System:lter
On failure:error
There are no duplicate entity namesChecks that content is not duplicated by other entityName elements in the documententityName is not a duplicate within the documentNo duplicates foundData Manager requires a non-empty, non-duplicate entityName value for every entityDeclare a non-empty entityName and ensure that there are no duplicate entityName values in the document
Entity Report
Entity Name: playa_03_water_L1_all
Entity Identifier:
# Identifier Status Quality Check Name Description Expected Found Explanation Suggestion Reference
1entityNameLengthvalid
Type:metadata
System:knb
On failure:warn
Length of entityName is not excessive (less than 100 char)length of entity name is less than 100 charactersentityName value is 100 characters or less21
2entityDescriptionPresentvalid
Type:metadata
System:lter
On failure:warn
An entity description is presentCheck for presence of an entity description.EML Best practices pp. 32-33, "...should have enough information for a user..."trueWith entityName sometimes serving as a file name rather than a title, it is important to be very descriptive here.
3numHeaderLinesPresentinfo
Type:metadata
System:knb
On failure:info
'numHeaderLines' element is presentCheck for presence of the 'numHeaderLines' element.Document contains 'numHeaderLines' element.'numHeaderLines' element: 1
4numFooterLinesPresentinfo
Type:metadata
System:knb
On failure:info
'numFooterLines' element is presentCheck for presence of the 'numFooterLines' element.Document contains 'numFooterLines' element.'numFooterLines' element: 0
5fieldDelimiterValidvalid
Type:metadata
System:knb
On failure:error
Field delimiter is a single characterField delimiters should be one character onlyA single character is expected,A valid fieldDelimiter value was foundhttp://knb.ecoinformatics.org/software/eml/eml-2.1.0/eml-physical.html#fieldDelimiter
6recordDelimiterPresentvalid
Type:metadata
System:knb
On failure:warn
Record delimiter is presentCheck presence of record delimiter. Check that the record delimiter is one of the suggested values.A record delimiter from a list of suggested values: \n, \r, \r\n, #x0A, #x0D, #x0D#x0A\nA valid recordDelimiter value was foundhttp://knb.ecoinformatics.org/software/eml/eml-2.1.0/eml-physical.html#recordDelimiter
7numberOfRecordsPresencevalid
Type:metadata
System:knb
On failure:warn
Is the numberOfRecords element present?Warn the user if the numberOfRecords check is not presentA number of records element is expected for this entitynumberOfRecords element foundThis is a valuable check that we have the correct table.
8entitySizePresencevalid
Type:metadata
System:knb
On failure:warn
Check for presence of an entity size elementLook for entity size element as a prep for checking congruence, and if not present, generate a warn. Note that to be most useful (i.e, to check congruence), entity size should contain the most precise measure of size, which is "byte" (the default unit); however, the presence or name of the entity size unit is NOT checked.Entity size is present. If unit="byte" or unit is omitted (default = byte), then congruence can be checked.Found entity size element with value of 9901650 and size unit specified as 'byte'.Examining the entity size is prep for checking congruence. Including the element is best practice, and if not present, a warn is generated. To be most useful, entity size should contain the most precise measure of size, which is "byte" (the default unit).Include an entity size in bytes Example success: knb-lter-sbc.3.12. Example of size in units other than byte: knb-lter-mcr.6.56.
9integrityChecksumPresencevalid
Type:metadata
System:lter
On failure:warn
A physical/authentication element is present and specifies a method attribute with a value of MD5 or SHA-1Check for presence of a physical/authentication element containing a checksum or hash value for an integrity check (e.g. MD5, SHA-1). Warn if an entity does not have a physical/authentication element, or if none of the physical/authentication elements specify a method attribute with a value of MD5 or SHA-1.At least one physical/authentication element with a method attribute specifying MD5 or SHA-1 and containing a checksum or hash value that can be used to perform an integrity check on the data.truePASTA will use this value to check the integrity of the data it downloads from your site. In addition, PASTA is planning to compare the contributor-supplied checksum/hash value documented in the physical/authentication element to the checksum/hash value of this entity downloaded from previous revisions of this data package. If PASTA already has a copy of this entity, it will be able to avoid an unnecessary download of the entity from your site, resulting in faster processing of the new data package revision when you update it in PASTA.Add a physical/authentication element and store the entity checksum or hash value in it using a method such as MD5 or SHA-1.
10dateTimeFormatStringvalid
Type:metadata
System:knb
On failure:warn
dateTime/formatString specified in metadata is from a preferred set of valuesCertain features of dateTime data formats are preferred, eg, ISO 8601, 4-digit years. This check looks at metadata to see if the dateTime format is in that preferred list.A formatString value that is a member of the preferred set is expected.YYYY-MM-DD hh:mmA preferred format string was found.Modify the dateTime/formatString, selecting from among the preferred values one that best matches the data format
11attributeNamesUniquevalid
Type:metadata
System:knb
On failure:warn
Attribute names are uniqueChecks if attributeName values are unique in the table. Not required by EML.Unique attribute names.trueA good table does not have duplicate column names.EML Best Practices
12displayDownloadDatainfo
Type:data
System:knb
On failure:info
Display downloaded dataDisplay the first kilobyte of data that is downloadedUp to one kilobyte of data should be displayed
13urlReturnsDatavalid
Type:congruency
System:knb
On failure:error
URL returns dataChecks whether a URL returns data. Unless the URL is specified to be function="information", the URL should return the resource for download.A data entity that matches the metadatatruehttp://knb.ecoinformatics.org/software/eml/eml-2.1.0/eml-resource.html#UrlType
14onlineURLsvalid
Type:congruency
System:knb
On failure:error
Online URLs are liveCheck that online URLs return somethingtruetrueSucceeded in accessing URL: <![CDATA[https://ezeml.edirepository.org/user-data/Charles_Kimsal-ec0b143426e3768a0901eeb5c7c10f9f/uploads/Playa%20Water%20Levels/playa_03_water_L1_all.csv]]>
15integrityChecksumvalid
Type:congruency
System:lter
On failure:error
Compare the metadata checksum for an entity to the checksum of the downloaded entityTwo possible responses: valid if checksums match; error if checksums do not match.7b28ada1613d63dfc3271c324aa60d697b28ada1613d63dfc3271c324aa60d69Matching checksums will ensure data integrity during upload to the repository.If the found integrity hash value does not match the expected integrity hash value, there may have been a loss of integrity in the data download. Check that the hash method and hash value documented in the metadata are the correct values.
16entitySizeCongruencevalid
Type:congruency
System:knb
On failure:error
Check that the entity size in the Level 0 metadata matches the one PASTA+ generates.Compare raw file size of file to [entity]/physical/size element in metadata. Return error if not matching.99016509901650Examining the entity size is a method for checking that this is the correct entity.Check the entity size.
17databaseTableCreatedvalid
Type:metadata
System:knb
On failure:error
Database table createdStatus of creating a database tableA database table is expected to be generated from the EML attributes.A database table was generated from the attributes description<![CDATA[CREATE TABLE _f2d154130c7db41bb1a6e12098b2d7e1("site" TEXT,"timestamp" TIMESTAMP,"absolutePressure_kPa" FLOAT,"temp_C" FLOAT,"waterLevel_m" FLOAT,"waterLevel_m_filtered" FLOAT,"qflag" TEXT,"comment" TEXT);]]>
18examineRecordDelimiterwarn
Type:congruency
System:knb
On failure:warn
Data are examined and possible record delimiters are displayedIf no record delimiter was specified, we assume that \r\n is the delimiter. Search the first row for other record delimiters and see if other delimiters are found.No other potential record delimiters expected in the first row.Other potential record delimiters were found in the first row: [\r\n]Detection of line endings may be automatic on most systems, so this may not be important.Ensure that record delimiters are correctly specified.http://knb.ecoinformatics.org/software/eml/eml-2.1.0/eml-physical.html#recordDelimiter
19displayFirstInsertRowinfo
Type:data
System:knb
On failure:info
Display first insert rowDisplay the first row of data values to be inserted into the database tableThe first row of data values should be displayed<![CDATA[3, 2016-06-15 00:00, 86.581, 11.334, -0.011, 0, , ]]>
20onlineURLsvalid
Type:congruency
System:knb
On failure:error
Online URLs are liveCheck that online URLs return somethingtruetrueSucceeded in accessing URL: <![CDATA[file:///home/pasta/local/data/knb-lter-jrn.210465001.1/f2d154130c7db41bb1a6e12098b2d7e1]]>
21tooFewFieldsvalid
Type:congruency
System:knb
On failure:error
Data does not have fewer fields than metadata attributesCompare number of fields specified in metadata to number of fields found in a data recordNo errors detectedhttp://knb.ecoinformatics.org/software/eml/eml-2.1.0/eml-physical.html#dataFormat
22tooManyFieldsvalid
Type:congruency
System:knb
On failure:error
Data does not have more fields than metadata attributesCompare number of fields specified in metadata to number of fields found in a data recordNo errors detectedhttp://knb.ecoinformatics.org/software/eml/eml-2.1.0/eml-physical.html#dataFormat
23dataLoadStatusvalid
Type:congruency
System:knb
On failure:warn
Data can be loaded into the databaseStatus of loading the data table into a databaseNo errors expected during data loading or data loading was not attempted for this data entityThe data table loaded successfully into a database
24numberOfRecordsvalid
Type:congruency
System:knb
On failure:warn
Number of records in metadata matches number of rows loadedCompare number of records specified in metadata to number of records found in data224309224309The expected number of records (224309) was found in the data table.
25headerRowAttributeNamesinfo
Type:congruency
System:lter
On failure:info
Header row is displayed alongside attribute namesCompare the content of the data header row to the content of EML attribute names.No expectation, information only Customer should evaluate the findings
26dateFormatMatchesvalid
Type:congruency
System:lter
On failure:warn
Date format in metadata matches datadateTime/formatString in attribute metadata is from the preferred list, and the data matches. A non-match generates only a warn.Format string is preferred, and all data values match the format stringData values matched the specified formatString.Dates should be consistently formatted and match the formatString in metadata.
Entity Report
Entity Name: playa_05_water_L1_all
Entity Identifier:
# Identifier Status Quality Check Name Description Expected Found Explanation Suggestion Reference
1entityNameLengthvalid
Type:metadata
System:knb
On failure:warn
Length of entityName is not excessive (less than 100 char)length of entity name is less than 100 charactersentityName value is 100 characters or less21
2entityDescriptionPresentvalid
Type:metadata
System:lter
On failure:warn
An entity description is presentCheck for presence of an entity description.EML Best practices pp. 32-33, "...should have enough information for a user..."trueWith entityName sometimes serving as a file name rather than a title, it is important to be very descriptive here.
3numHeaderLinesPresentinfo
Type:metadata
System:knb
On failure:info
'numHeaderLines' element is presentCheck for presence of the 'numHeaderLines' element.Document contains 'numHeaderLines' element.'numHeaderLines' element: 1
4numFooterLinesPresentinfo
Type:metadata
System:knb
On failure:info
'numFooterLines' element is presentCheck for presence of the 'numFooterLines' element.Document contains 'numFooterLines' element.'numFooterLines' element: 0
5fieldDelimiterValidvalid
Type:metadata
System:knb
On failure:error
Field delimiter is a single characterField delimiters should be one character onlyA single character is expected,A valid fieldDelimiter value was foundhttp://knb.ecoinformatics.org/software/eml/eml-2.1.0/eml-physical.html#fieldDelimiter
6recordDelimiterPresentvalid
Type:metadata
System:knb
On failure:warn
Record delimiter is presentCheck presence of record delimiter. Check that the record delimiter is one of the suggested values.A record delimiter from a list of suggested values: \n, \r, \r\n, #x0A, #x0D, #x0D#x0A\nA valid recordDelimiter value was foundhttp://knb.ecoinformatics.org/software/eml/eml-2.1.0/eml-physical.html#recordDelimiter
7numberOfRecordsPresencevalid
Type:metadata
System:knb
On failure:warn
Is the numberOfRecords element present?Warn the user if the numberOfRecords check is not presentA number of records element is expected for this entitynumberOfRecords element foundThis is a valuable check that we have the correct table.
8entitySizePresencevalid
Type:metadata
System:knb
On failure:warn
Check for presence of an entity size elementLook for entity size element as a prep for checking congruence, and if not present, generate a warn. Note that to be most useful (i.e, to check congruence), entity size should contain the most precise measure of size, which is "byte" (the default unit); however, the presence or name of the entity size unit is NOT checked.Entity size is present. If unit="byte" or unit is omitted (default = byte), then congruence can be checked.Found entity size element with value of 9875128 and size unit specified as 'byte'.Examining the entity size is prep for checking congruence. Including the element is best practice, and if not present, a warn is generated. To be most useful, entity size should contain the most precise measure of size, which is &#34;byte&#34; (the default unit).Include an entity size in bytes Example success: knb-lter-sbc.3.12. Example of size in units other than byte: knb-lter-mcr.6.56.
9integrityChecksumPresencevalid
Type:metadata
System:lter
On failure:warn
A physical/authentication element is present and specifies a method attribute with a value of MD5 or SHA-1Check for presence of a physical/authentication element containing a checksum or hash value for an integrity check (e.g. MD5, SHA-1). Warn if an entity does not have a physical/authentication element, or if none of the physical/authentication elements specify a method attribute with a value of MD5 or SHA-1.At least one physical/authentication element with a method attribute specifying MD5 or SHA-1 and containing a checksum or hash value that can be used to perform an integrity check on the data.truePASTA will use this value to check the integrity of the data it downloads from your site. In addition, PASTA is planning to compare the contributor-supplied checksum/hash value documented in the physical/authentication element to the checksum/hash value of this entity downloaded from previous revisions of this data package. If PASTA already has a copy of this entity, it will be able to avoid an unnecessary download of the entity from your site, resulting in faster processing of the new data package revision when you update it in PASTA.Add a physical/authentication element and store the entity checksum or hash value in it using a method such as MD5 or SHA-1.
10dateTimeFormatStringvalid
Type:metadata
System:knb
On failure:warn
dateTime/formatString specified in metadata is from a preferred set of valuesCertain features of dateTime data formats are preferred, eg, ISO 8601, 4-digit years. This check looks at metadata to see if the dateTime format is in that preferred list.A formatString value that is a member of the preferred set is expected.YYYY-MM-DD hh:mmA preferred format string was found.Modify the dateTime/formatString, selecting from among the preferred values one that best matches the data format
11attributeNamesUniquevalid
Type:metadata
System:knb
On failure:warn
Attribute names are uniqueChecks if attributeName values are unique in the table. Not required by EML.Unique attribute names.trueA good table does not have duplicate column names.EML Best Practices
12displayDownloadDatainfo
Type:data
System:knb
On failure:info
Display downloaded dataDisplay the first kilobyte of data that is downloadedUp to one kilobyte of data should be displayed
13urlReturnsDatavalid
Type:congruency
System:knb
On failure:error
URL returns dataChecks whether a URL returns data. Unless the URL is specified to be function="information", the URL should return the resource for download.A data entity that matches the metadatatruehttp://knb.ecoinformatics.org/software/eml/eml-2.1.0/eml-resource.html#UrlType
14onlineURLsvalid
Type:congruency
System:knb
On failure:error
Online URLs are liveCheck that online URLs return somethingtruetrueSucceeded in accessing URL: <![CDATA[https://ezeml.edirepository.org/user-data/Charles_Kimsal-ec0b143426e3768a0901eeb5c7c10f9f/uploads/Playa%20Water%20Levels/playa_05_water_L1_all.csv]]>
15integrityChecksumvalid
Type:congruency
System:lter
On failure:error
Compare the metadata checksum for an entity to the checksum of the downloaded entityTwo possible responses: valid if checksums match; error if checksums do not match.b66c9ca0df1c52c4e432a721150d0001b66c9ca0df1c52c4e432a721150d0001Matching checksums will ensure data integrity during upload to the repository.If the found integrity hash value does not match the expected integrity hash value, there may have been a loss of integrity in the data download. Check that the hash method and hash value documented in the metadata are the correct values.
16entitySizeCongruencevalid
Type:congruency
System:knb
On failure:error
Check that the entity size in the Level 0 metadata matches the one PASTA+ generates.Compare raw file size of file to [entity]/physical/size element in metadata. Return error if not matching.98751289875128Examining the entity size is a method for checking that this is the correct entity.Check the entity size.
17databaseTableCreatedvalid
Type:metadata
System:knb
On failure:error
Database table createdStatus of creating a database tableA database table is expected to be generated from the EML attributes.A database table was generated from the attributes description<![CDATA[CREATE TABLE _00ba107ae8ee8c98fff039ec34153959("site" TEXT,"timestamp" TIMESTAMP,"absolutePressure_kPa" FLOAT,"temp_C" FLOAT,"waterLevel_m" FLOAT,"waterLevel_m_filtered" FLOAT,"qflag" TEXT,"comment" TEXT);]]>
18examineRecordDelimiterwarn
Type:congruency
System:knb
On failure:warn
Data are examined and possible record delimiters are displayedIf no record delimiter was specified, we assume that \r\n is the delimiter. Search the first row for other record delimiters and see if other delimiters are found.No other potential record delimiters expected in the first row.Other potential record delimiters were found in the first row: [\r\n]Detection of line endings may be automatic on most systems, so this may not be important.Ensure that record delimiters are correctly specified.http://knb.ecoinformatics.org/software/eml/eml-2.1.0/eml-physical.html#recordDelimiter
19displayFirstInsertRowinfo
Type:data
System:knb
On failure:info
Display first insert rowDisplay the first row of data values to be inserted into the database tableThe first row of data values should be displayed<![CDATA[5, 2016-06-15 00:00, 86.506, 11.431, -0.011, 0, , ]]>
20onlineURLsvalid
Type:congruency
System:knb
On failure:error
Online URLs are liveCheck that online URLs return somethingtruetrueSucceeded in accessing URL: <![CDATA[file:///home/pasta/local/data/knb-lter-jrn.210465001.1/00ba107ae8ee8c98fff039ec34153959]]>
21tooFewFieldsvalid
Type:congruency
System:knb
On failure:error
Data does not have fewer fields than metadata attributesCompare number of fields specified in metadata to number of fields found in a data recordNo errors detectedhttp://knb.ecoinformatics.org/software/eml/eml-2.1.0/eml-physical.html#dataFormat
22tooManyFieldsvalid
Type:congruency
System:knb
On failure:error
Data does not have more fields than metadata attributesCompare number of fields specified in metadata to number of fields found in a data recordNo errors detectedhttp://knb.ecoinformatics.org/software/eml/eml-2.1.0/eml-physical.html#dataFormat
23dataLoadStatusvalid
Type:congruency
System:knb
On failure:warn
Data can be loaded into the databaseStatus of loading the data table into a databaseNo errors expected during data loading or data loading was not attempted for this data entityThe data table loaded successfully into a database
24numberOfRecordsvalid
Type:congruency
System:knb
On failure:warn
Number of records in metadata matches number of rows loadedCompare number of records specified in metadata to number of records found in data224308224308The expected number of records (224308) was found in the data table.
25headerRowAttributeNamesinfo
Type:congruency
System:lter
On failure:info
Header row is displayed alongside attribute namesCompare the content of the data header row to the content of EML attribute names.No expectation, information only Customer should evaluate the findings
26dateFormatMatchesvalid
Type:congruency
System:lter
On failure:warn
Date format in metadata matches datadateTime/formatString in attribute metadata is from the preferred list, and the data matches. A non-match generates only a warn.Format string is preferred, and all data values match the format stringData values matched the specified formatString.Dates should be consistently formatted and match the formatString in metadata.
Entity Report
Entity Name: playa_06_water_L1_all
Entity Identifier:
# Identifier Status Quality Check Name Description Expected Found Explanation Suggestion Reference
1entityNameLengthvalid
Type:metadata
System:knb
On failure:warn
Length of entityName is not excessive (less than 100 char)length of entity name is less than 100 charactersentityName value is 100 characters or less21
2entityDescriptionPresentvalid
Type:metadata
System:lter
On failure:warn
An entity description is presentCheck for presence of an entity description.EML Best practices pp. 32-33, "...should have enough information for a user..."trueWith entityName sometimes serving as a file name rather than a title, it is important to be very descriptive here.
3numHeaderLinesPresentinfo
Type:metadata
System:knb
On failure:info
'numHeaderLines' element is presentCheck for presence of the 'numHeaderLines' element.Document contains 'numHeaderLines' element.'numHeaderLines' element: 1
4numFooterLinesPresentinfo
Type:metadata
System:knb
On failure:info
'numFooterLines' element is presentCheck for presence of the 'numFooterLines' element.Document contains 'numFooterLines' element.'numFooterLines' element: 0
5fieldDelimiterValidvalid
Type:metadata
System:knb
On failure:error
Field delimiter is a single characterField delimiters should be one character onlyA single character is expected,A valid fieldDelimiter value was foundhttp://knb.ecoinformatics.org/software/eml/eml-2.1.0/eml-physical.html#fieldDelimiter
6recordDelimiterPresentvalid
Type:metadata
System:knb
On failure:warn
Record delimiter is presentCheck presence of record delimiter. Check that the record delimiter is one of the suggested values.A record delimiter from a list of suggested values: \n, \r, \r\n, #x0A, #x0D, #x0D#x0A\nA valid recordDelimiter value was foundhttp://knb.ecoinformatics.org/software/eml/eml-2.1.0/eml-physical.html#recordDelimiter
7numberOfRecordsPresencevalid
Type:metadata
System:knb
On failure:warn
Is the numberOfRecords element present?Warn the user if the numberOfRecords check is not presentA number of records element is expected for this entitynumberOfRecords element foundThis is a valuable check that we have the correct table.
8entitySizePresencevalid
Type:metadata
System:knb
On failure:warn
Check for presence of an entity size elementLook for entity size element as a prep for checking congruence, and if not present, generate a warn. Note that to be most useful (i.e, to check congruence), entity size should contain the most precise measure of size, which is "byte" (the default unit); however, the presence or name of the entity size unit is NOT checked.Entity size is present. If unit="byte" or unit is omitted (default = byte), then congruence can be checked.Found entity size element with value of 10005147 and size unit specified as 'byte'.Examining the entity size is prep for checking congruence. Including the element is best practice, and if not present, a warn is generated. To be most useful, entity size should contain the most precise measure of size, which is &#34;byte&#34; (the default unit).Include an entity size in bytes Example success: knb-lter-sbc.3.12. Example of size in units other than byte: knb-lter-mcr.6.56.
9integrityChecksumPresencevalid
Type:metadata
System:lter
On failure:warn
A physical/authentication element is present and specifies a method attribute with a value of MD5 or SHA-1Check for presence of a physical/authentication element containing a checksum or hash value for an integrity check (e.g. MD5, SHA-1). Warn if an entity does not have a physical/authentication element, or if none of the physical/authentication elements specify a method attribute with a value of MD5 or SHA-1.At least one physical/authentication element with a method attribute specifying MD5 or SHA-1 and containing a checksum or hash value that can be used to perform an integrity check on the data.truePASTA will use this value to check the integrity of the data it downloads from your site. In addition, PASTA is planning to compare the contributor-supplied checksum/hash value documented in the physical/authentication element to the checksum/hash value of this entity downloaded from previous revisions of this data package. If PASTA already has a copy of this entity, it will be able to avoid an unnecessary download of the entity from your site, resulting in faster processing of the new data package revision when you update it in PASTA.Add a physical/authentication element and store the entity checksum or hash value in it using a method such as MD5 or SHA-1.
10dateTimeFormatStringvalid
Type:metadata
System:knb
On failure:warn
dateTime/formatString specified in metadata is from a preferred set of valuesCertain features of dateTime data formats are preferred, eg, ISO 8601, 4-digit years. This check looks at metadata to see if the dateTime format is in that preferred list.A formatString value that is a member of the preferred set is expected.YYYY-MM-DD hh:mmA preferred format string was found.Modify the dateTime/formatString, selecting from among the preferred values one that best matches the data format
11attributeNamesUniquevalid
Type:metadata
System:knb
On failure:warn
Attribute names are uniqueChecks if attributeName values are unique in the table. Not required by EML.Unique attribute names.trueA good table does not have duplicate column names.EML Best Practices
12displayDownloadDatainfo
Type:data
System:knb
On failure:info
Display downloaded dataDisplay the first kilobyte of data that is downloadedUp to one kilobyte of data should be displayed
13urlReturnsDatavalid
Type:congruency
System:knb
On failure:error
URL returns dataChecks whether a URL returns data. Unless the URL is specified to be function="information", the URL should return the resource for download.A data entity that matches the metadatatruehttp://knb.ecoinformatics.org/software/eml/eml-2.1.0/eml-resource.html#UrlType
14onlineURLsvalid
Type:congruency
System:knb
On failure:error
Online URLs are liveCheck that online URLs return somethingtruetrueSucceeded in accessing URL: <![CDATA[https://ezeml.edirepository.org/user-data/Charles_Kimsal-ec0b143426e3768a0901eeb5c7c10f9f/uploads/Playa%20Water%20Levels/playa_06_water_L1_all.csv]]>
15integrityChecksumvalid
Type:congruency
System:lter
On failure:error
Compare the metadata checksum for an entity to the checksum of the downloaded entityTwo possible responses: valid if checksums match; error if checksums do not match.40eb7d710c1f5618398ae51157e0028940eb7d710c1f5618398ae51157e00289Matching checksums will ensure data integrity during upload to the repository.If the found integrity hash value does not match the expected integrity hash value, there may have been a loss of integrity in the data download. Check that the hash method and hash value documented in the metadata are the correct values.
16entitySizeCongruencevalid
Type:congruency
System:knb
On failure:error
Check that the entity size in the Level 0 metadata matches the one PASTA+ generates.Compare raw file size of file to [entity]/physical/size element in metadata. Return error if not matching.1000514710005147Examining the entity size is a method for checking that this is the correct entity.Check the entity size.
17databaseTableCreatedvalid
Type:metadata
System:knb
On failure:error
Database table createdStatus of creating a database tableA database table is expected to be generated from the EML attributes.A database table was generated from the attributes description<![CDATA[CREATE TABLE _4f20e173a8bde6ff5c782087936aca58("site" TEXT,"timestamp" TIMESTAMP,"absolutePressure_kPa" FLOAT,"temp_C" FLOAT,"waterLevel_m" FLOAT,"waterLevel_m_filtered" FLOAT,"qflag" TEXT,"comment" TEXT);]]>
18examineRecordDelimiterwarn
Type:congruency
System:knb
On failure:warn
Data are examined and possible record delimiters are displayedIf no record delimiter was specified, we assume that \r\n is the delimiter. Search the first row for other record delimiters and see if other delimiters are found.No other potential record delimiters expected in the first row.Other potential record delimiters were found in the first row: [\r\n]Detection of line endings may be automatic on most systems, so this may not be important.Ensure that record delimiters are correctly specified.http://knb.ecoinformatics.org/software/eml/eml-2.1.0/eml-physical.html#recordDelimiter
19displayFirstInsertRowinfo
Type:data
System:knb
On failure:info
Display first insert rowDisplay the first row of data values to be inserted into the database tableThe first row of data values should be displayed<![CDATA[6, 2016-06-15 00:00, 86.533, 14.709, -0.013, 0, , ]]>
20onlineURLsvalid
Type:congruency
System:knb
On failure:error
Online URLs are liveCheck that online URLs return somethingtruetrueSucceeded in accessing URL: <![CDATA[file:///home/pasta/local/data/knb-lter-jrn.210465001.1/4f20e173a8bde6ff5c782087936aca58]]>
21tooFewFieldsvalid
Type:congruency
System:knb
On failure:error
Data does not have fewer fields than metadata attributesCompare number of fields specified in metadata to number of fields found in a data recordNo errors detectedhttp://knb.ecoinformatics.org/software/eml/eml-2.1.0/eml-physical.html#dataFormat
22tooManyFieldsvalid
Type:congruency
System:knb
On failure:error
Data does not have more fields than metadata attributesCompare number of fields specified in metadata to number of fields found in a data recordNo errors detectedhttp://knb.ecoinformatics.org/software/eml/eml-2.1.0/eml-physical.html#dataFormat
23dataLoadStatusvalid
Type:congruency
System:knb
On failure:warn
Data can be loaded into the databaseStatus of loading the data table into a databaseNo errors expected during data loading or data loading was not attempted for this data entityThe data table loaded successfully into a database
24numberOfRecordsvalid
Type:congruency
System:knb
On failure:warn
Number of records in metadata matches number of rows loadedCompare number of records specified in metadata to number of records found in data224307224307The expected number of records (224307) was found in the data table.
25headerRowAttributeNamesinfo
Type:congruency
System:lter
On failure:info
Header row is displayed alongside attribute namesCompare the content of the data header row to the content of EML attribute names.No expectation, information only Customer should evaluate the findings
26dateFormatMatchesvalid
Type:congruency
System:lter
On failure:warn
Date format in metadata matches datadateTime/formatString in attribute metadata is from the preferred list, and the data matches. A non-match generates only a warn.Format string is preferred, and all data values match the format stringData values matched the specified formatString.Dates should be consistently formatted and match the formatString in metadata.
Entity Report
Entity Name: playa_07_water_L1_all
Entity Identifier:
# Identifier Status Quality Check Name Description Expected Found Explanation Suggestion Reference
1entityNameLengthvalid
Type:metadata
System:knb
On failure:warn
Length of entityName is not excessive (less than 100 char)length of entity name is less than 100 charactersentityName value is 100 characters or less21
2entityDescriptionPresentvalid
Type:metadata
System:lter
On failure:warn
An entity description is presentCheck for presence of an entity description.EML Best practices pp. 32-33, "...should have enough information for a user..."trueWith entityName sometimes serving as a file name rather than a title, it is important to be very descriptive here.
3numHeaderLinesPresentinfo
Type:metadata
System:knb
On failure:info
'numHeaderLines' element is presentCheck for presence of the 'numHeaderLines' element.Document contains 'numHeaderLines' element.'numHeaderLines' element: 1
4numFooterLinesPresentinfo
Type:metadata
System:knb
On failure:info
'numFooterLines' element is presentCheck for presence of the 'numFooterLines' element.Document contains 'numFooterLines' element.'numFooterLines' element: 0
5fieldDelimiterValidvalid
Type:metadata
System:knb
On failure:error
Field delimiter is a single characterField delimiters should be one character onlyA single character is expected,A valid fieldDelimiter value was foundhttp://knb.ecoinformatics.org/software/eml/eml-2.1.0/eml-physical.html#fieldDelimiter
6recordDelimiterPresentvalid
Type:metadata
System:knb
On failure:warn
Record delimiter is presentCheck presence of record delimiter. Check that the record delimiter is one of the suggested values.A record delimiter from a list of suggested values: \n, \r, \r\n, #x0A, #x0D, #x0D#x0A\nA valid recordDelimiter value was foundhttp://knb.ecoinformatics.org/software/eml/eml-2.1.0/eml-physical.html#recordDelimiter
7numberOfRecordsPresencevalid
Type:metadata
System:knb
On failure:warn
Is the numberOfRecords element present?Warn the user if the numberOfRecords check is not presentA number of records element is expected for this entitynumberOfRecords element foundThis is a valuable check that we have the correct table.
8entitySizePresencevalid
Type:metadata
System:knb
On failure:warn
Check for presence of an entity size elementLook for entity size element as a prep for checking congruence, and if not present, generate a warn. Note that to be most useful (i.e, to check congruence), entity size should contain the most precise measure of size, which is "byte" (the default unit); however, the presence or name of the entity size unit is NOT checked.Entity size is present. If unit="byte" or unit is omitted (default = byte), then congruence can be checked.Found entity size element with value of 9927241 and size unit specified as 'byte'.Examining the entity size is prep for checking congruence. Including the element is best practice, and if not present, a warn is generated. To be most useful, entity size should contain the most precise measure of size, which is &#34;byte&#34; (the default unit).Include an entity size in bytes Example success: knb-lter-sbc.3.12. Example of size in units other than byte: knb-lter-mcr.6.56.
9integrityChecksumPresencevalid
Type:metadata
System:lter
On failure:warn
A physical/authentication element is present and specifies a method attribute with a value of MD5 or SHA-1Check for presence of a physical/authentication element containing a checksum or hash value for an integrity check (e.g. MD5, SHA-1). Warn if an entity does not have a physical/authentication element, or if none of the physical/authentication elements specify a method attribute with a value of MD5 or SHA-1.At least one physical/authentication element with a method attribute specifying MD5 or SHA-1 and containing a checksum or hash value that can be used to perform an integrity check on the data.truePASTA will use this value to check the integrity of the data it downloads from your site. In addition, PASTA is planning to compare the contributor-supplied checksum/hash value documented in the physical/authentication element to the checksum/hash value of this entity downloaded from previous revisions of this data package. If PASTA already has a copy of this entity, it will be able to avoid an unnecessary download of the entity from your site, resulting in faster processing of the new data package revision when you update it in PASTA.Add a physical/authentication element and store the entity checksum or hash value in it using a method such as MD5 or SHA-1.
10dateTimeFormatStringvalid
Type:metadata
System:knb
On failure:warn
dateTime/formatString specified in metadata is from a preferred set of valuesCertain features of dateTime data formats are preferred, eg, ISO 8601, 4-digit years. This check looks at metadata to see if the dateTime format is in that preferred list.A formatString value that is a member of the preferred set is expected.YYYY-MM-DD hh:mmA preferred format string was found.Modify the dateTime/formatString, selecting from among the preferred values one that best matches the data format
11attributeNamesUniquevalid
Type:metadata
System:knb
On failure:warn
Attribute names are uniqueChecks if attributeName values are unique in the table. Not required by EML.Unique attribute names.trueA good table does not have duplicate column names.EML Best Practices
12displayDownloadDatainfo
Type:data
System:knb
On failure:info
Display downloaded dataDisplay the first kilobyte of data that is downloadedUp to one kilobyte of data should be displayed
13urlReturnsDatavalid
Type:congruency
System:knb
On failure:error
URL returns dataChecks whether a URL returns data. Unless the URL is specified to be function="information", the URL should return the resource for download.A data entity that matches the metadatatruehttp://knb.ecoinformatics.org/software/eml/eml-2.1.0/eml-resource.html#UrlType
14onlineURLsvalid
Type:congruency
System:knb
On failure:error
Online URLs are liveCheck that online URLs return somethingtruetrueSucceeded in accessing URL: <![CDATA[https://ezeml.edirepository.org/user-data/Charles_Kimsal-ec0b143426e3768a0901eeb5c7c10f9f/uploads/Playa%20Water%20Levels/playa_07_water_L1_all.csv]]>
15integrityChecksumvalid
Type:congruency
System:lter
On failure:error
Compare the metadata checksum for an entity to the checksum of the downloaded entityTwo possible responses: valid if checksums match; error if checksums do not match.8f9d54bae8ff4a27a2323a679d27c2988f9d54bae8ff4a27a2323a679d27c298Matching checksums will ensure data integrity during upload to the repository.If the found integrity hash value does not match the expected integrity hash value, there may have been a loss of integrity in the data download. Check that the hash method and hash value documented in the metadata are the correct values.
16entitySizeCongruencevalid
Type:congruency
System:knb
On failure:error
Check that the entity size in the Level 0 metadata matches the one PASTA+ generates.Compare raw file size of file to [entity]/physical/size element in metadata. Return error if not matching.99272419927241Examining the entity size is a method for checking that this is the correct entity.Check the entity size.
17databaseTableCreatedvalid
Type:metadata
System:knb
On failure:error
Database table createdStatus of creating a database tableA database table is expected to be generated from the EML attributes.A database table was generated from the attributes description<![CDATA[CREATE TABLE _efe908d937d5d0fb7340817c83c61844("site" TEXT,"timestamp" TIMESTAMP,"absolutePressure_kPa" FLOAT,"temp_C" FLOAT,"waterLevel_m" FLOAT,"waterLevel_m_filtered" FLOAT,"qflag" TEXT,"comment" TEXT);]]>
18examineRecordDelimiterwarn
Type:congruency
System:knb
On failure:warn
Data are examined and possible record delimiters are displayedIf no record delimiter was specified, we assume that \r\n is the delimiter. Search the first row for other record delimiters and see if other delimiters are found.No other potential record delimiters expected in the first row.Other potential record delimiters were found in the first row: [\r\n]Detection of line endings may be automatic on most systems, so this may not be important.Ensure that record delimiters are correctly specified.http://knb.ecoinformatics.org/software/eml/eml-2.1.0/eml-physical.html#recordDelimiter
19displayFirstInsertRowinfo
Type:data
System:knb
On failure:info
Display first insert rowDisplay the first row of data values to be inserted into the database tableThe first row of data values should be displayed<![CDATA[7, 2016-06-15 00:00, 86.67, 11.819, -0.007, 0, , ]]>
20onlineURLsvalid
Type:congruency
System:knb
On failure:error
Online URLs are liveCheck that online URLs return somethingtruetrueSucceeded in accessing URL: <![CDATA[file:///home/pasta/local/data/knb-lter-jrn.210465001.1/efe908d937d5d0fb7340817c83c61844]]>
21tooFewFieldsvalid
Type:congruency
System:knb
On failure:error
Data does not have fewer fields than metadata attributesCompare number of fields specified in metadata to number of fields found in a data recordNo errors detectedhttp://knb.ecoinformatics.org/software/eml/eml-2.1.0/eml-physical.html#dataFormat
22tooManyFieldsvalid
Type:congruency
System:knb
On failure:error
Data does not have more fields than metadata attributesCompare number of fields specified in metadata to number of fields found in a data recordNo errors detectedhttp://knb.ecoinformatics.org/software/eml/eml-2.1.0/eml-physical.html#dataFormat
23dataLoadStatusvalid
Type:congruency
System:knb
On failure:warn
Data can be loaded into the databaseStatus of loading the data table into a databaseNo errors expected during data loading or data loading was not attempted for this data entityThe data table loaded successfully into a database
24numberOfRecordsvalid
Type:congruency
System:knb
On failure:warn
Number of records in metadata matches number of rows loadedCompare number of records specified in metadata to number of records found in data224304224304The expected number of records (224304) was found in the data table.
25headerRowAttributeNamesinfo
Type:congruency
System:lter
On failure:info
Header row is displayed alongside attribute namesCompare the content of the data header row to the content of EML attribute names.No expectation, information only Customer should evaluate the findings
26dateFormatMatchesvalid
Type:congruency
System:lter
On failure:warn
Date format in metadata matches datadateTime/formatString in attribute metadata is from the preferred list, and the data matches. A non-match generates only a warn.Format string is preferred, and all data values match the format stringData values matched the specified formatString.Dates should be consistently formatted and match the formatString in metadata.
Entity Report
Entity Name: playa_09_water_L1_all
Entity Identifier:
# Identifier Status Quality Check Name Description Expected Found Explanation Suggestion Reference
1entityNameLengthvalid
Type:metadata
System:knb
On failure:warn
Length of entityName is not excessive (less than 100 char)length of entity name is less than 100 charactersentityName value is 100 characters or less21
2entityDescriptionPresentvalid
Type:metadata
System:lter
On failure:warn
An entity description is presentCheck for presence of an entity description.EML Best practices pp. 32-33, "...should have enough information for a user..."trueWith entityName sometimes serving as a file name rather than a title, it is important to be very descriptive here.
3numHeaderLinesPresentinfo
Type:metadata
System:knb
On failure:info
'numHeaderLines' element is presentCheck for presence of the 'numHeaderLines' element.Document contains 'numHeaderLines' element.'numHeaderLines' element: 1
4numFooterLinesPresentinfo
Type:metadata
System:knb
On failure:info
'numFooterLines' element is presentCheck for presence of the 'numFooterLines' element.Document contains 'numFooterLines' element.'numFooterLines' element: 0
5fieldDelimiterValidvalid
Type:metadata
System:knb
On failure:error
Field delimiter is a single characterField delimiters should be one character onlyA single character is expected,A valid fieldDelimiter value was foundhttp://knb.ecoinformatics.org/software/eml/eml-2.1.0/eml-physical.html#fieldDelimiter
6recordDelimiterPresentvalid
Type:metadata
System:knb
On failure:warn
Record delimiter is presentCheck presence of record delimiter. Check that the record delimiter is one of the suggested values.A record delimiter from a list of suggested values: \n, \r, \r\n, #x0A, #x0D, #x0D#x0A\nA valid recordDelimiter value was foundhttp://knb.ecoinformatics.org/software/eml/eml-2.1.0/eml-physical.html#recordDelimiter
7numberOfRecordsPresencevalid
Type:metadata
System:knb
On failure:warn
Is the numberOfRecords element present?Warn the user if the numberOfRecords check is not presentA number of records element is expected for this entitynumberOfRecords element foundThis is a valuable check that we have the correct table.
8entitySizePresencevalid
Type:metadata
System:knb
On failure:warn
Check for presence of an entity size elementLook for entity size element as a prep for checking congruence, and if not present, generate a warn. Note that to be most useful (i.e, to check congruence), entity size should contain the most precise measure of size, which is "byte" (the default unit); however, the presence or name of the entity size unit is NOT checked.Entity size is present. If unit="byte" or unit is omitted (default = byte), then congruence can be checked.Found entity size element with value of 9934271 and size unit specified as 'byte'.Examining the entity size is prep for checking congruence. Including the element is best practice, and if not present, a warn is generated. To be most useful, entity size should contain the most precise measure of size, which is &#34;byte&#34; (the default unit).Include an entity size in bytes Example success: knb-lter-sbc.3.12. Example of size in units other than byte: knb-lter-mcr.6.56.
9integrityChecksumPresencevalid
Type:metadata
System:lter
On failure:warn
A physical/authentication element is present and specifies a method attribute with a value of MD5 or SHA-1Check for presence of a physical/authentication element containing a checksum or hash value for an integrity check (e.g. MD5, SHA-1). Warn if an entity does not have a physical/authentication element, or if none of the physical/authentication elements specify a method attribute with a value of MD5 or SHA-1.At least one physical/authentication element with a method attribute specifying MD5 or SHA-1 and containing a checksum or hash value that can be used to perform an integrity check on the data.truePASTA will use this value to check the integrity of the data it downloads from your site. In addition, PASTA is planning to compare the contributor-supplied checksum/hash value documented in the physical/authentication element to the checksum/hash value of this entity downloaded from previous revisions of this data package. If PASTA already has a copy of this entity, it will be able to avoid an unnecessary download of the entity from your site, resulting in faster processing of the new data package revision when you update it in PASTA.Add a physical/authentication element and store the entity checksum or hash value in it using a method such as MD5 or SHA-1.
10dateTimeFormatStringvalid
Type:metadata
System:knb
On failure:warn
dateTime/formatString specified in metadata is from a preferred set of valuesCertain features of dateTime data formats are preferred, eg, ISO 8601, 4-digit years. This check looks at metadata to see if the dateTime format is in that preferred list.A formatString value that is a member of the preferred set is expected.YYYY-MM-DD hh:mmA preferred format string was found.Modify the dateTime/formatString, selecting from among the preferred values one that best matches the data format
11attributeNamesUniquevalid
Type:metadata
System:knb
On failure:warn
Attribute names are uniqueChecks if attributeName values are unique in the table. Not required by EML.Unique attribute names.trueA good table does not have duplicate column names.EML Best Practices
12displayDownloadDatainfo
Type:data
System:knb
On failure:info
Display downloaded dataDisplay the first kilobyte of data that is downloadedUp to one kilobyte of data should be displayed
13urlReturnsDatavalid
Type:congruency
System:knb
On failure:error
URL returns dataChecks whether a URL returns data. Unless the URL is specified to be function="information", the URL should return the resource for download.A data entity that matches the metadatatruehttp://knb.ecoinformatics.org/software/eml/eml-2.1.0/eml-resource.html#UrlType
14onlineURLsvalid
Type:congruency
System:knb
On failure:error
Online URLs are liveCheck that online URLs return somethingtruetrueSucceeded in accessing URL: <![CDATA[https://ezeml.edirepository.org/user-data/Charles_Kimsal-ec0b143426e3768a0901eeb5c7c10f9f/uploads/Playa%20Water%20Levels/playa_09_water_L1_all.csv]]>
15integrityChecksumvalid
Type:congruency
System:lter
On failure:error
Compare the metadata checksum for an entity to the checksum of the downloaded entityTwo possible responses: valid if checksums match; error if checksums do not match.11e02f0986170a2a6464f7b79148425e11e02f0986170a2a6464f7b79148425eMatching checksums will ensure data integrity during upload to the repository.If the found integrity hash value does not match the expected integrity hash value, there may have been a loss of integrity in the data download. Check that the hash method and hash value documented in the metadata are the correct values.
16entitySizeCongruencevalid
Type:congruency
System:knb
On failure:error
Check that the entity size in the Level 0 metadata matches the one PASTA+ generates.Compare raw file size of file to [entity]/physical/size element in metadata. Return error if not matching.99342719934271Examining the entity size is a method for checking that this is the correct entity.Check the entity size.
17databaseTableCreatedvalid
Type:metadata
System:knb
On failure:error
Database table createdStatus of creating a database tableA database table is expected to be generated from the EML attributes.A database table was generated from the attributes description<![CDATA[CREATE TABLE _5f904f59e3c0a0ea56b29059949ef836("site" TEXT,"timestamp" TIMESTAMP,"absolutePressure_kPa" FLOAT,"temp_C" FLOAT,"waterLevel_m" FLOAT,"waterLevel_m_filtered" FLOAT,"qflag" TEXT,"comment" TEXT);]]>
18examineRecordDelimiterwarn
Type:congruency
System:knb
On failure:warn
Data are examined and possible record delimiters are displayedIf no record delimiter was specified, we assume that \r\n is the delimiter. Search the first row for other record delimiters and see if other delimiters are found.No other potential record delimiters expected in the first row.Other potential record delimiters were found in the first row: [\r\n]Detection of line endings may be automatic on most systems, so this may not be important.Ensure that record delimiters are correctly specified.http://knb.ecoinformatics.org/software/eml/eml-2.1.0/eml-physical.html#recordDelimiter
19displayFirstInsertRowinfo
Type:data
System:knb
On failure:info
Display first insert rowDisplay the first row of data values to be inserted into the database tableThe first row of data values should be displayed<![CDATA[9, 2016-06-15 00:00, 86.584, 13.654, 0, 0, , ]]>
20onlineURLsvalid
Type:congruency
System:knb
On failure:error
Online URLs are liveCheck that online URLs return somethingtruetrueSucceeded in accessing URL: <![CDATA[file:///home/pasta/local/data/knb-lter-jrn.210465001.1/5f904f59e3c0a0ea56b29059949ef836]]>
21tooFewFieldsvalid
Type:congruency
System:knb
On failure:error
Data does not have fewer fields than metadata attributesCompare number of fields specified in metadata to number of fields found in a data recordNo errors detectedhttp://knb.ecoinformatics.org/software/eml/eml-2.1.0/eml-physical.html#dataFormat
22tooManyFieldsvalid
Type:congruency
System:knb
On failure:error
Data does not have more fields than metadata attributesCompare number of fields specified in metadata to number of fields found in a data recordNo errors detectedhttp://knb.ecoinformatics.org/software/eml/eml-2.1.0/eml-physical.html#dataFormat
23dataLoadStatusvalid
Type:congruency
System:knb
On failure:warn
Data can be loaded into the databaseStatus of loading the data table into a databaseNo errors expected during data loading or data loading was not attempted for this data entityThe data table loaded successfully into a database
24numberOfRecordsvalid
Type:congruency
System:knb
On failure:warn
Number of records in metadata matches number of rows loadedCompare number of records specified in metadata to number of records found in data225654225654The expected number of records (225654) was found in the data table.
25headerRowAttributeNamesinfo
Type:congruency
System:lter
On failure:info
Header row is displayed alongside attribute namesCompare the content of the data header row to the content of EML attribute names.No expectation, information only Customer should evaluate the findings
26dateFormatMatchesvalid
Type:congruency
System:lter
On failure:warn
Date format in metadata matches datadateTime/formatString in attribute metadata is from the preferred list, and the data matches. A non-match generates only a warn.Format string is preferred, and all data values match the format stringData values matched the specified formatString.Dates should be consistently formatted and match the formatString in metadata.
Entity Report
Entity Name: playa_11_water_L1_all
Entity Identifier:
# Identifier Status Quality Check Name Description Expected Found Explanation Suggestion Reference
1entityNameLengthvalid
Type:metadata
System:knb
On failure:warn
Length of entityName is not excessive (less than 100 char)length of entity name is less than 100 charactersentityName value is 100 characters or less21
2entityDescriptionPresentvalid
Type:metadata
System:lter
On failure:warn
An entity description is presentCheck for presence of an entity description.EML Best practices pp. 32-33, "...should have enough information for a user..."trueWith entityName sometimes serving as a file name rather than a title, it is important to be very descriptive here.
3numHeaderLinesPresentinfo
Type:metadata
System:knb
On failure:info
'numHeaderLines' element is presentCheck for presence of the 'numHeaderLines' element.Document contains 'numHeaderLines' element.'numHeaderLines' element: 1
4numFooterLinesPresentinfo
Type:metadata
System:knb
On failure:info
'numFooterLines' element is presentCheck for presence of the 'numFooterLines' element.Document contains 'numFooterLines' element.'numFooterLines' element: 0
5fieldDelimiterValidvalid
Type:metadata
System:knb
On failure:error
Field delimiter is a single characterField delimiters should be one character onlyA single character is expected,A valid fieldDelimiter value was foundhttp://knb.ecoinformatics.org/software/eml/eml-2.1.0/eml-physical.html#fieldDelimiter
6recordDelimiterPresentvalid
Type:metadata
System:knb
On failure:warn
Record delimiter is presentCheck presence of record delimiter. Check that the record delimiter is one of the suggested values.A record delimiter from a list of suggested values: \n, \r, \r\n, #x0A, #x0D, #x0D#x0A\nA valid recordDelimiter value was foundhttp://knb.ecoinformatics.org/software/eml/eml-2.1.0/eml-physical.html#recordDelimiter
7numberOfRecordsPresencevalid
Type:metadata
System:knb
On failure:warn
Is the numberOfRecords element present?Warn the user if the numberOfRecords check is not presentA number of records element is expected for this entitynumberOfRecords element foundThis is a valuable check that we have the correct table.
8entitySizePresencevalid
Type:metadata
System:knb
On failure:warn
Check for presence of an entity size elementLook for entity size element as a prep for checking congruence, and if not present, generate a warn. Note that to be most useful (i.e, to check congruence), entity size should contain the most precise measure of size, which is "byte" (the default unit); however, the presence or name of the entity size unit is NOT checked.Entity size is present. If unit="byte" or unit is omitted (default = byte), then congruence can be checked.Found entity size element with value of 10116740 and size unit specified as 'byte'.Examining the entity size is prep for checking congruence. Including the element is best practice, and if not present, a warn is generated. To be most useful, entity size should contain the most precise measure of size, which is &#34;byte&#34; (the default unit).Include an entity size in bytes Example success: knb-lter-sbc.3.12. Example of size in units other than byte: knb-lter-mcr.6.56.
9integrityChecksumPresencevalid
Type:metadata
System:lter
On failure:warn
A physical/authentication element is present and specifies a method attribute with a value of MD5 or SHA-1Check for presence of a physical/authentication element containing a checksum or hash value for an integrity check (e.g. MD5, SHA-1). Warn if an entity does not have a physical/authentication element, or if none of the physical/authentication elements specify a method attribute with a value of MD5 or SHA-1.At least one physical/authentication element with a method attribute specifying MD5 or SHA-1 and containing a checksum or hash value that can be used to perform an integrity check on the data.truePASTA will use this value to check the integrity of the data it downloads from your site. In addition, PASTA is planning to compare the contributor-supplied checksum/hash value documented in the physical/authentication element to the checksum/hash value of this entity downloaded from previous revisions of this data package. If PASTA already has a copy of this entity, it will be able to avoid an unnecessary download of the entity from your site, resulting in faster processing of the new data package revision when you update it in PASTA.Add a physical/authentication element and store the entity checksum or hash value in it using a method such as MD5 or SHA-1.
10dateTimeFormatStringvalid
Type:metadata
System:knb
On failure:warn
dateTime/formatString specified in metadata is from a preferred set of valuesCertain features of dateTime data formats are preferred, eg, ISO 8601, 4-digit years. This check looks at metadata to see if the dateTime format is in that preferred list.A formatString value that is a member of the preferred set is expected.YYYY-MM-DD hh:mmA preferred format string was found.Modify the dateTime/formatString, selecting from among the preferred values one that best matches the data format
11attributeNamesUniquevalid
Type:metadata
System:knb
On failure:warn
Attribute names are uniqueChecks if attributeName values are unique in the table. Not required by EML.Unique attribute names.trueA good table does not have duplicate column names.EML Best Practices
12displayDownloadDatainfo
Type:data
System:knb
On failure:info
Display downloaded dataDisplay the first kilobyte of data that is downloadedUp to one kilobyte of data should be displayed
13urlReturnsDatavalid
Type:congruency
System:knb
On failure:error
URL returns dataChecks whether a URL returns data. Unless the URL is specified to be function="information", the URL should return the resource for download.A data entity that matches the metadatatruehttp://knb.ecoinformatics.org/software/eml/eml-2.1.0/eml-resource.html#UrlType
14onlineURLsvalid
Type:congruency
System:knb
On failure:error
Online URLs are liveCheck that online URLs return somethingtruetrueSucceeded in accessing URL: <![CDATA[https://ezeml.edirepository.org/user-data/Charles_Kimsal-ec0b143426e3768a0901eeb5c7c10f9f/uploads/Playa%20Water%20Levels/playa_11_water_L1_all.csv]]>
15integrityChecksumvalid
Type:congruency
System:lter
On failure:error
Compare the metadata checksum for an entity to the checksum of the downloaded entityTwo possible responses: valid if checksums match; error if checksums do not match.e53f305f6cd6c3bf295fbf7dcb8bb2a1e53f305f6cd6c3bf295fbf7dcb8bb2a1Matching checksums will ensure data integrity during upload to the repository.If the found integrity hash value does not match the expected integrity hash value, there may have been a loss of integrity in the data download. Check that the hash method and hash value documented in the metadata are the correct values.
16entitySizeCongruencevalid
Type:congruency
System:knb
On failure:error
Check that the entity size in the Level 0 metadata matches the one PASTA+ generates.Compare raw file size of file to [entity]/physical/size element in metadata. Return error if not matching.1011674010116740Examining the entity size is a method for checking that this is the correct entity.Check the entity size.
17databaseTableCreatedvalid
Type:metadata
System:knb
On failure:error
Database table createdStatus of creating a database tableA database table is expected to be generated from the EML attributes.A database table was generated from the attributes description<![CDATA[CREATE TABLE _70cbe72deef9ce8bab2098840c9b211e("site" TEXT,"timestamp" TIMESTAMP,"absolutePressure_kPa" FLOAT,"temp_C" FLOAT,"waterLevel_m" FLOAT,"waterLevel_m_filtered" FLOAT,"qflag" TEXT,"comment" TEXT);]]>
18examineRecordDelimiterwarn
Type:congruency
System:knb
On failure:warn
Data are examined and possible record delimiters are displayedIf no record delimiter was specified, we assume that \r\n is the delimiter. Search the first row for other record delimiters and see if other delimiters are found.No other potential record delimiters expected in the first row.Other potential record delimiters were found in the first row: [\r\n]Detection of line endings may be automatic on most systems, so this may not be important.Ensure that record delimiters are correctly specified.http://knb.ecoinformatics.org/software/eml/eml-2.1.0/eml-physical.html#recordDelimiter
19displayFirstInsertRowinfo
Type:data
System:knb
On failure:info
Display first insert rowDisplay the first row of data values to be inserted into the database tableThe first row of data values should be displayed<![CDATA[11, 2016-06-15 00:00, 86.388, 11.139, 0.005, 0, , ]]>
20onlineURLsvalid
Type:congruency
System:knb
On failure:error
Online URLs are liveCheck that online URLs return somethingtruetrueSucceeded in accessing URL: <![CDATA[file:///home/pasta/local/data/knb-lter-jrn.210465001.1/70cbe72deef9ce8bab2098840c9b211e]]>
21tooFewFieldsvalid
Type:congruency
System:knb
On failure:error
Data does not have fewer fields than metadata attributesCompare number of fields specified in metadata to number of fields found in a data recordNo errors detectedhttp://knb.ecoinformatics.org/software/eml/eml-2.1.0/eml-physical.html#dataFormat
22tooManyFieldsvalid
Type:congruency
System:knb
On failure:error
Data does not have more fields than metadata attributesCompare number of fields specified in metadata to number of fields found in a data recordNo errors detectedhttp://knb.ecoinformatics.org/software/eml/eml-2.1.0/eml-physical.html#dataFormat
23dataLoadStatusvalid
Type:congruency
System:knb
On failure:warn
Data can be loaded into the databaseStatus of loading the data table into a databaseNo errors expected during data loading or data loading was not attempted for this data entityThe data table loaded successfully into a database
24numberOfRecordsvalid
Type:congruency
System:knb
On failure:warn
Number of records in metadata matches number of rows loadedCompare number of records specified in metadata to number of records found in data224301224301The expected number of records (224301) was found in the data table.
25headerRowAttributeNamesinfo
Type:congruency
System:lter
On failure:info
Header row is displayed alongside attribute namesCompare the content of the data header row to the content of EML attribute names.No expectation, information only Customer should evaluate the findings
26dateFormatMatchesvalid
Type:congruency
System:lter
On failure:warn
Date format in metadata matches datadateTime/formatString in attribute metadata is from the preferred list, and the data matches. A non-match generates only a warn.Format string is preferred, and all data values match the format stringData values matched the specified formatString.Dates should be consistently formatted and match the formatString in metadata.
Entity Report
Entity Name: playa_12_water_L1_all
Entity Identifier:
# Identifier Status Quality Check Name Description Expected Found Explanation Suggestion Reference
1entityNameLengthvalid
Type:metadata
System:knb
On failure:warn
Length of entityName is not excessive (less than 100 char)length of entity name is less than 100 charactersentityName value is 100 characters or less21
2entityDescriptionPresentvalid
Type:metadata
System:lter
On failure:warn
An entity description is presentCheck for presence of an entity description.EML Best practices pp. 32-33, "...should have enough information for a user..."trueWith entityName sometimes serving as a file name rather than a title, it is important to be very descriptive here.
3numHeaderLinesPresentinfo
Type:metadata
System:knb
On failure:info
'numHeaderLines' element is presentCheck for presence of the 'numHeaderLines' element.Document contains 'numHeaderLines' element.'numHeaderLines' element: 1
4numFooterLinesPresentinfo
Type:metadata
System:knb
On failure:info
'numFooterLines' element is presentCheck for presence of the 'numFooterLines' element.Document contains 'numFooterLines' element.'numFooterLines' element: 0
5fieldDelimiterValidvalid
Type:metadata
System:knb
On failure:error
Field delimiter is a single characterField delimiters should be one character onlyA single character is expected,A valid fieldDelimiter value was foundhttp://knb.ecoinformatics.org/software/eml/eml-2.1.0/eml-physical.html#fieldDelimiter
6recordDelimiterPresentvalid
Type:metadata
System:knb
On failure:warn
Record delimiter is presentCheck presence of record delimiter. Check that the record delimiter is one of the suggested values.A record delimiter from a list of suggested values: \n, \r, \r\n, #x0A, #x0D, #x0D#x0A\nA valid recordDelimiter value was foundhttp://knb.ecoinformatics.org/software/eml/eml-2.1.0/eml-physical.html#recordDelimiter
7numberOfRecordsPresencevalid
Type:metadata
System:knb
On failure:warn
Is the numberOfRecords element present?Warn the user if the numberOfRecords check is not presentA number of records element is expected for this entitynumberOfRecords element foundThis is a valuable check that we have the correct table.
8entitySizePresencevalid
Type:metadata
System:knb
On failure:warn
Check for presence of an entity size elementLook for entity size element as a prep for checking congruence, and if not present, generate a warn. Note that to be most useful (i.e, to check congruence), entity size should contain the most precise measure of size, which is "byte" (the default unit); however, the presence or name of the entity size unit is NOT checked.Entity size is present. If unit="byte" or unit is omitted (default = byte), then congruence can be checked.Found entity size element with value of 10125568 and size unit specified as 'byte'.Examining the entity size is prep for checking congruence. Including the element is best practice, and if not present, a warn is generated. To be most useful, entity size should contain the most precise measure of size, which is &#34;byte&#34; (the default unit).Include an entity size in bytes Example success: knb-lter-sbc.3.12. Example of size in units other than byte: knb-lter-mcr.6.56.
9integrityChecksumPresencevalid
Type:metadata
System:lter
On failure:warn
A physical/authentication element is present and specifies a method attribute with a value of MD5 or SHA-1Check for presence of a physical/authentication element containing a checksum or hash value for an integrity check (e.g. MD5, SHA-1). Warn if an entity does not have a physical/authentication element, or if none of the physical/authentication elements specify a method attribute with a value of MD5 or SHA-1.At least one physical/authentication element with a method attribute specifying MD5 or SHA-1 and containing a checksum or hash value that can be used to perform an integrity check on the data.truePASTA will use this value to check the integrity of the data it downloads from your site. In addition, PASTA is planning to compare the contributor-supplied checksum/hash value documented in the physical/authentication element to the checksum/hash value of this entity downloaded from previous revisions of this data package. If PASTA already has a copy of this entity, it will be able to avoid an unnecessary download of the entity from your site, resulting in faster processing of the new data package revision when you update it in PASTA.Add a physical/authentication element and store the entity checksum or hash value in it using a method such as MD5 or SHA-1.
10dateTimeFormatStringvalid
Type:metadata
System:knb
On failure:warn
dateTime/formatString specified in metadata is from a preferred set of valuesCertain features of dateTime data formats are preferred, eg, ISO 8601, 4-digit years. This check looks at metadata to see if the dateTime format is in that preferred list.A formatString value that is a member of the preferred set is expected.YYYY-MM-DD hh:mmA preferred format string was found.Modify the dateTime/formatString, selecting from among the preferred values one that best matches the data format
11attributeNamesUniquevalid
Type:metadata
System:knb
On failure:warn
Attribute names are uniqueChecks if attributeName values are unique in the table. Not required by EML.Unique attribute names.trueA good table does not have duplicate column names.EML Best Practices
12displayDownloadDatainfo
Type:data
System:knb
On failure:info
Display downloaded dataDisplay the first kilobyte of data that is downloadedUp to one kilobyte of data should be displayed
13urlReturnsDatavalid
Type:congruency
System:knb
On failure:error
URL returns dataChecks whether a URL returns data. Unless the URL is specified to be function="information", the URL should return the resource for download.A data entity that matches the metadatatruehttp://knb.ecoinformatics.org/software/eml/eml-2.1.0/eml-resource.html#UrlType
14onlineURLsvalid
Type:congruency
System:knb
On failure:error
Online URLs are liveCheck that online URLs return somethingtruetrueSucceeded in accessing URL: <![CDATA[https://ezeml.edirepository.org/user-data/Charles_Kimsal-ec0b143426e3768a0901eeb5c7c10f9f/uploads/Playa%20Water%20Levels/playa_12_water_L1_all.csv]]>
15integrityChecksumvalid
Type:congruency
System:lter
On failure:error
Compare the metadata checksum for an entity to the checksum of the downloaded entityTwo possible responses: valid if checksums match; error if checksums do not match.c3c6a0f08987f085345857f82f47e69cc3c6a0f08987f085345857f82f47e69cMatching checksums will ensure data integrity during upload to the repository.If the found integrity hash value does not match the expected integrity hash value, there may have been a loss of integrity in the data download. Check that the hash method and hash value documented in the metadata are the correct values.
16entitySizeCongruencevalid
Type:congruency
System:knb
On failure:error
Check that the entity size in the Level 0 metadata matches the one PASTA+ generates.Compare raw file size of file to [entity]/physical/size element in metadata. Return error if not matching.1012556810125568Examining the entity size is a method for checking that this is the correct entity.Check the entity size.
17databaseTableCreatedvalid
Type:metadata
System:knb
On failure:error
Database table createdStatus of creating a database tableA database table is expected to be generated from the EML attributes.A database table was generated from the attributes description<![CDATA[CREATE TABLE _ce591b9d6e4ea7fdb071bc9c6e665fab("site" TEXT,"timestamp" TIMESTAMP,"absolutePressure_kPa" FLOAT,"temp_C" FLOAT,"waterLevel_m" FLOAT,"waterLevel_m_filtered" FLOAT,"qflag" TEXT,"comment" TEXT);]]>
18examineRecordDelimiterwarn
Type:congruency
System:knb
On failure:warn
Data are examined and possible record delimiters are displayedIf no record delimiter was specified, we assume that \r\n is the delimiter. Search the first row for other record delimiters and see if other delimiters are found.No other potential record delimiters expected in the first row.Other potential record delimiters were found in the first row: [\r\n]Detection of line endings may be automatic on most systems, so this may not be important.Ensure that record delimiters are correctly specified.http://knb.ecoinformatics.org/software/eml/eml-2.1.0/eml-physical.html#recordDelimiter
19displayFirstInsertRowinfo
Type:data
System:knb
On failure:info
Display first insert rowDisplay the first row of data values to be inserted into the database tableThe first row of data values should be displayed<![CDATA[12, 2016-06-15 00:00, 86.426, 12.69, 0.002, 0, , ]]>
20onlineURLsvalid
Type:congruency
System:knb
On failure:error
Online URLs are liveCheck that online URLs return somethingtruetrueSucceeded in accessing URL: <![CDATA[file:///home/pasta/local/data/knb-lter-jrn.210465001.1/ce591b9d6e4ea7fdb071bc9c6e665fab]]>
21tooFewFieldsvalid
Type:congruency
System:knb
On failure:error
Data does not have fewer fields than metadata attributesCompare number of fields specified in metadata to number of fields found in a data recordNo errors detectedhttp://knb.ecoinformatics.org/software/eml/eml-2.1.0/eml-physical.html#dataFormat
22tooManyFieldsvalid
Type:congruency
System:knb
On failure:error
Data does not have more fields than metadata attributesCompare number of fields specified in metadata to number of fields found in a data recordNo errors detectedhttp://knb.ecoinformatics.org/software/eml/eml-2.1.0/eml-physical.html#dataFormat
23dataLoadStatusvalid
Type:congruency
System:knb
On failure:warn
Data can be loaded into the databaseStatus of loading the data table into a databaseNo errors expected during data loading or data loading was not attempted for this data entityThe data table loaded successfully into a database
24numberOfRecordsvalid
Type:congruency
System:knb
On failure:warn
Number of records in metadata matches number of rows loadedCompare number of records specified in metadata to number of records found in data224489224489The expected number of records (224489) was found in the data table.
25headerRowAttributeNamesinfo
Type:congruency
System:lter
On failure:info
Header row is displayed alongside attribute namesCompare the content of the data header row to the content of EML attribute names.No expectation, information only Customer should evaluate the findings
26dateFormatMatchesvalid
Type:congruency
System:lter
On failure:warn
Date format in metadata matches datadateTime/formatString in attribute metadata is from the preferred list, and the data matches. A non-match generates only a warn.Format string is preferred, and all data values match the format stringData values matched the specified formatString.Dates should be consistently formatted and match the formatString in metadata.
Entity Report
Entity Name: playa_14_water_L1_all
Entity Identifier:
# Identifier Status Quality Check Name Description Expected Found Explanation Suggestion Reference
1entityNameLengthvalid
Type:metadata
System:knb
On failure:warn
Length of entityName is not excessive (less than 100 char)length of entity name is less than 100 charactersentityName value is 100 characters or less21
2entityDescriptionPresentvalid
Type:metadata
System:lter
On failure:warn
An entity description is presentCheck for presence of an entity description.EML Best practices pp. 32-33, "...should have enough information for a user..."trueWith entityName sometimes serving as a file name rather than a title, it is important to be very descriptive here.
3numHeaderLinesPresentinfo
Type:metadata
System:knb
On failure:info
'numHeaderLines' element is presentCheck for presence of the 'numHeaderLines' element.Document contains 'numHeaderLines' element.'numHeaderLines' element: 1
4numFooterLinesPresentinfo
Type:metadata
System:knb
On failure:info
'numFooterLines' element is presentCheck for presence of the 'numFooterLines' element.Document contains 'numFooterLines' element.'numFooterLines' element: 0
5fieldDelimiterValidvalid
Type:metadata
System:knb
On failure:error
Field delimiter is a single characterField delimiters should be one character onlyA single character is expected,A valid fieldDelimiter value was foundhttp://knb.ecoinformatics.org/software/eml/eml-2.1.0/eml-physical.html#fieldDelimiter
6recordDelimiterPresentvalid
Type:metadata
System:knb
On failure:warn
Record delimiter is presentCheck presence of record delimiter. Check that the record delimiter is one of the suggested values.A record delimiter from a list of suggested values: \n, \r, \r\n, #x0A, #x0D, #x0D#x0A\nA valid recordDelimiter value was foundhttp://knb.ecoinformatics.org/software/eml/eml-2.1.0/eml-physical.html#recordDelimiter
7numberOfRecordsPresencevalid
Type:metadata
System:knb
On failure:warn
Is the numberOfRecords element present?Warn the user if the numberOfRecords check is not presentA number of records element is expected for this entitynumberOfRecords element foundThis is a valuable check that we have the correct table.
8entitySizePresencevalid
Type:metadata
System:knb
On failure:warn
Check for presence of an entity size elementLook for entity size element as a prep for checking congruence, and if not present, generate a warn. Note that to be most useful (i.e, to check congruence), entity size should contain the most precise measure of size, which is "byte" (the default unit); however, the presence or name of the entity size unit is NOT checked.Entity size is present. If unit="byte" or unit is omitted (default = byte), then congruence can be checked.Found entity size element with value of 10117160 and size unit specified as 'byte'.Examining the entity size is prep for checking congruence. Including the element is best practice, and if not present, a warn is generated. To be most useful, entity size should contain the most precise measure of size, which is &#34;byte&#34; (the default unit).Include an entity size in bytes Example success: knb-lter-sbc.3.12. Example of size in units other than byte: knb-lter-mcr.6.56.
9integrityChecksumPresencevalid
Type:metadata
System:lter
On failure:warn
A physical/authentication element is present and specifies a method attribute with a value of MD5 or SHA-1Check for presence of a physical/authentication element containing a checksum or hash value for an integrity check (e.g. MD5, SHA-1). Warn if an entity does not have a physical/authentication element, or if none of the physical/authentication elements specify a method attribute with a value of MD5 or SHA-1.At least one physical/authentication element with a method attribute specifying MD5 or SHA-1 and containing a checksum or hash value that can be used to perform an integrity check on the data.truePASTA will use this value to check the integrity of the data it downloads from your site. In addition, PASTA is planning to compare the contributor-supplied checksum/hash value documented in the physical/authentication element to the checksum/hash value of this entity downloaded from previous revisions of this data package. If PASTA already has a copy of this entity, it will be able to avoid an unnecessary download of the entity from your site, resulting in faster processing of the new data package revision when you update it in PASTA.Add a physical/authentication element and store the entity checksum or hash value in it using a method such as MD5 or SHA-1.
10dateTimeFormatStringvalid
Type:metadata
System:knb
On failure:warn
dateTime/formatString specified in metadata is from a preferred set of valuesCertain features of dateTime data formats are preferred, eg, ISO 8601, 4-digit years. This check looks at metadata to see if the dateTime format is in that preferred list.A formatString value that is a member of the preferred set is expected.YYYY-MM-DD hh:mmA preferred format string was found.Modify the dateTime/formatString, selecting from among the preferred values one that best matches the data format
11attributeNamesUniquevalid
Type:metadata
System:knb
On failure:warn
Attribute names are uniqueChecks if attributeName values are unique in the table. Not required by EML.Unique attribute names.trueA good table does not have duplicate column names.EML Best Practices
12displayDownloadDatainfo
Type:data
System:knb
On failure:info
Display downloaded dataDisplay the first kilobyte of data that is downloadedUp to one kilobyte of data should be displayed
13urlReturnsDatavalid
Type:congruency
System:knb
On failure:error
URL returns dataChecks whether a URL returns data. Unless the URL is specified to be function="information", the URL should return the resource for download.A data entity that matches the metadatatruehttp://knb.ecoinformatics.org/software/eml/eml-2.1.0/eml-resource.html#UrlType
14onlineURLsvalid
Type:congruency
System:knb
On failure:error
Online URLs are liveCheck that online URLs return somethingtruetrueSucceeded in accessing URL: <![CDATA[https://ezeml.edirepository.org/user-data/Charles_Kimsal-ec0b143426e3768a0901eeb5c7c10f9f/uploads/Playa%20Water%20Levels/playa_14_water_L1_all.csv]]>
15integrityChecksumvalid
Type:congruency
System:lter
On failure:error
Compare the metadata checksum for an entity to the checksum of the downloaded entityTwo possible responses: valid if checksums match; error if checksums do not match.cfc5793870925d6044794cbe65be05f7cfc5793870925d6044794cbe65be05f7Matching checksums will ensure data integrity during upload to the repository.If the found integrity hash value does not match the expected integrity hash value, there may have been a loss of integrity in the data download. Check that the hash method and hash value documented in the metadata are the correct values.
16entitySizeCongruencevalid
Type:congruency
System:knb
On failure:error
Check that the entity size in the Level 0 metadata matches the one PASTA+ generates.Compare raw file size of file to [entity]/physical/size element in metadata. Return error if not matching.1011716010117160Examining the entity size is a method for checking that this is the correct entity.Check the entity size.
17databaseTableCreatedvalid
Type:metadata
System:knb
On failure:error
Database table createdStatus of creating a database tableA database table is expected to be generated from the EML attributes.A database table was generated from the attributes description<![CDATA[CREATE TABLE _aabc51b7355cd2a93961068481be8064("site" TEXT,"timestamp" TIMESTAMP,"absolutePressure_kPa" FLOAT,"temp_C" FLOAT,"waterLevel_m" FLOAT,"waterLevel_m_filtered" FLOAT,"qflag" TEXT,"comment" TEXT);]]>
18examineRecordDelimiterwarn
Type:congruency
System:knb
On failure:warn
Data are examined and possible record delimiters are displayedIf no record delimiter was specified, we assume that \r\n is the delimiter. Search the first row for other record delimiters and see if other delimiters are found.No other potential record delimiters expected in the first row.Other potential record delimiters were found in the first row: [\r\n]Detection of line endings may be automatic on most systems, so this may not be important.Ensure that record delimiters are correctly specified.http://knb.ecoinformatics.org/software/eml/eml-2.1.0/eml-physical.html#recordDelimiter
19displayFirstInsertRowinfo
Type:data
System:knb
On failure:info
Display first insert rowDisplay the first row of data values to be inserted into the database tableThe first row of data values should be displayed<![CDATA[14, 2016-06-15 00:00, 86.544, 12.401, -0.001, 0, , ]]>
20onlineURLsvalid
Type:congruency
System:knb
On failure:error
Online URLs are liveCheck that online URLs return somethingtruetrueSucceeded in accessing URL: <![CDATA[file:///home/pasta/local/data/knb-lter-jrn.210465001.1/aabc51b7355cd2a93961068481be8064]]>
21tooFewFieldsvalid
Type:congruency
System:knb
On failure:error
Data does not have fewer fields than metadata attributesCompare number of fields specified in metadata to number of fields found in a data recordNo errors detectedhttp://knb.ecoinformatics.org/software/eml/eml-2.1.0/eml-physical.html#dataFormat
22tooManyFieldsvalid
Type:congruency
System:knb
On failure:error
Data does not have more fields than metadata attributesCompare number of fields specified in metadata to number of fields found in a data recordNo errors detectedhttp://knb.ecoinformatics.org/software/eml/eml-2.1.0/eml-physical.html#dataFormat
23dataLoadStatusvalid
Type:congruency
System:knb
On failure:warn
Data can be loaded into the databaseStatus of loading the data table into a databaseNo errors expected during data loading or data loading was not attempted for this data entityThe data table loaded successfully into a database
24numberOfRecordsvalid
Type:congruency
System:knb
On failure:warn
Number of records in metadata matches number of rows loadedCompare number of records specified in metadata to number of records found in data224487224487The expected number of records (224487) was found in the data table.
25headerRowAttributeNamesinfo
Type:congruency
System:lter
On failure:info
Header row is displayed alongside attribute namesCompare the content of the data header row to the content of EML attribute names.No expectation, information only Customer should evaluate the findings
26dateFormatMatchesvalid
Type:congruency
System:lter
On failure:warn
Date format in metadata matches datadateTime/formatString in attribute metadata is from the preferred list, and the data matches. A non-match generates only a warn.Format string is preferred, and all data values match the format stringData values matched the specified formatString.Dates should be consistently formatted and match the formatString in metadata.
Entity Report
Entity Name: playa_17_water_L1_all
Entity Identifier:
# Identifier Status Quality Check Name Description Expected Found Explanation Suggestion Reference
1entityNameLengthvalid
Type:metadata
System:knb
On failure:warn
Length of entityName is not excessive (less than 100 char)length of entity name is less than 100 charactersentityName value is 100 characters or less21
2entityDescriptionPresentvalid
Type:metadata
System:lter
On failure:warn
An entity description is presentCheck for presence of an entity description.EML Best practices pp. 32-33, "...should have enough information for a user..."trueWith entityName sometimes serving as a file name rather than a title, it is important to be very descriptive here.
3numHeaderLinesPresentinfo
Type:metadata
System:knb
On failure:info
'numHeaderLines' element is presentCheck for presence of the 'numHeaderLines' element.Document contains 'numHeaderLines' element.'numHeaderLines' element: 1
4numFooterLinesPresentinfo
Type:metadata
System:knb
On failure:info
'numFooterLines' element is presentCheck for presence of the 'numFooterLines' element.Document contains 'numFooterLines' element.'numFooterLines' element: 0
5fieldDelimiterValidvalid
Type:metadata
System:knb
On failure:error
Field delimiter is a single characterField delimiters should be one character onlyA single character is expected,A valid fieldDelimiter value was foundhttp://knb.ecoinformatics.org/software/eml/eml-2.1.0/eml-physical.html#fieldDelimiter
6recordDelimiterPresentvalid
Type:metadata
System:knb
On failure:warn
Record delimiter is presentCheck presence of record delimiter. Check that the record delimiter is one of the suggested values.A record delimiter from a list of suggested values: \n, \r, \r\n, #x0A, #x0D, #x0D#x0A\nA valid recordDelimiter value was foundhttp://knb.ecoinformatics.org/software/eml/eml-2.1.0/eml-physical.html#recordDelimiter
7numberOfRecordsPresencevalid
Type:metadata
System:knb
On failure:warn
Is the numberOfRecords element present?Warn the user if the numberOfRecords check is not presentA number of records element is expected for this entitynumberOfRecords element foundThis is a valuable check that we have the correct table.
8entitySizePresencevalid
Type:metadata
System:knb
On failure:warn
Check for presence of an entity size elementLook for entity size element as a prep for checking congruence, and if not present, generate a warn. Note that to be most useful (i.e, to check congruence), entity size should contain the most precise measure of size, which is "byte" (the default unit); however, the presence or name of the entity size unit is NOT checked.Entity size is present. If unit="byte" or unit is omitted (default = byte), then congruence can be checked.Found entity size element with value of 10081211 and size unit specified as 'byte'.Examining the entity size is prep for checking congruence. Including the element is best practice, and if not present, a warn is generated. To be most useful, entity size should contain the most precise measure of size, which is &#34;byte&#34; (the default unit).Include an entity size in bytes Example success: knb-lter-sbc.3.12. Example of size in units other than byte: knb-lter-mcr.6.56.
9integrityChecksumPresencevalid
Type:metadata
System:lter
On failure:warn
A physical/authentication element is present and specifies a method attribute with a value of MD5 or SHA-1Check for presence of a physical/authentication element containing a checksum or hash value for an integrity check (e.g. MD5, SHA-1). Warn if an entity does not have a physical/authentication element, or if none of the physical/authentication elements specify a method attribute with a value of MD5 or SHA-1.At least one physical/authentication element with a method attribute specifying MD5 or SHA-1 and containing a checksum or hash value that can be used to perform an integrity check on the data.truePASTA will use this value to check the integrity of the data it downloads from your site. In addition, PASTA is planning to compare the contributor-supplied checksum/hash value documented in the physical/authentication element to the checksum/hash value of this entity downloaded from previous revisions of this data package. If PASTA already has a copy of this entity, it will be able to avoid an unnecessary download of the entity from your site, resulting in faster processing of the new data package revision when you update it in PASTA.Add a physical/authentication element and store the entity checksum or hash value in it using a method such as MD5 or SHA-1.
10dateTimeFormatStringvalid
Type:metadata
System:knb
On failure:warn
dateTime/formatString specified in metadata is from a preferred set of valuesCertain features of dateTime data formats are preferred, eg, ISO 8601, 4-digit years. This check looks at metadata to see if the dateTime format is in that preferred list.A formatString value that is a member of the preferred set is expected.YYYY-MM-DD hh:mmA preferred format string was found.Modify the dateTime/formatString, selecting from among the preferred values one that best matches the data format
11attributeNamesUniquevalid
Type:metadata
System:knb
On failure:warn
Attribute names are uniqueChecks if attributeName values are unique in the table. Not required by EML.Unique attribute names.trueA good table does not have duplicate column names.EML Best Practices
12displayDownloadDatainfo
Type:data
System:knb
On failure:info
Display downloaded dataDisplay the first kilobyte of data that is downloadedUp to one kilobyte of data should be displayed
13urlReturnsDatavalid
Type:congruency
System:knb
On failure:error
URL returns dataChecks whether a URL returns data. Unless the URL is specified to be function="information", the URL should return the resource for download.A data entity that matches the metadatatruehttp://knb.ecoinformatics.org/software/eml/eml-2.1.0/eml-resource.html#UrlType
14onlineURLsvalid
Type:congruency
System:knb
On failure:error
Online URLs are liveCheck that online URLs return somethingtruetrueSucceeded in accessing URL: <![CDATA[https://ezeml.edirepository.org/user-data/Charles_Kimsal-ec0b143426e3768a0901eeb5c7c10f9f/uploads/Playa%20Water%20Levels/playa_17_water_L1_all.csv]]>
15integrityChecksumvalid
Type:congruency
System:lter
On failure:error
Compare the metadata checksum for an entity to the checksum of the downloaded entityTwo possible responses: valid if checksums match; error if checksums do not match.7e956d1d3088d3a5867409459ddb111f7e956d1d3088d3a5867409459ddb111fMatching checksums will ensure data integrity during upload to the repository.If the found integrity hash value does not match the expected integrity hash value, there may have been a loss of integrity in the data download. Check that the hash method and hash value documented in the metadata are the correct values.
16entitySizeCongruencevalid
Type:congruency
System:knb
On failure:error
Check that the entity size in the Level 0 metadata matches the one PASTA+ generates.Compare raw file size of file to [entity]/physical/size element in metadata. Return error if not matching.1008121110081211Examining the entity size is a method for checking that this is the correct entity.Check the entity size.
17databaseTableCreatedvalid
Type:metadata
System:knb
On failure:error
Database table createdStatus of creating a database tableA database table is expected to be generated from the EML attributes.A database table was generated from the attributes description<![CDATA[CREATE TABLE _558c3058adf1abcf1dbe7179376bd55d("site" TEXT,"timestamp" TIMESTAMP,"absolutePressure_kPa" FLOAT,"temp_C" FLOAT,"waterLevel_m" FLOAT,"waterLevel_m_filtered" FLOAT,"qflag" TEXT,"comment" TEXT);]]>
18examineRecordDelimiterwarn
Type:congruency
System:knb
On failure:warn
Data are examined and possible record delimiters are displayedIf no record delimiter was specified, we assume that \r\n is the delimiter. Search the first row for other record delimiters and see if other delimiters are found.No other potential record delimiters expected in the first row.Other potential record delimiters were found in the first row: [\r\n]Detection of line endings may be automatic on most systems, so this may not be important.Ensure that record delimiters are correctly specified.http://knb.ecoinformatics.org/software/eml/eml-2.1.0/eml-physical.html#recordDelimiter
19displayFirstInsertRowinfo
Type:data
System:knb
On failure:info
Display first insert rowDisplay the first row of data values to be inserted into the database tableThe first row of data values should be displayed<![CDATA[17, 2016-06-15 00:00, 86.667, 11.916, 0, 0, , ]]>
20onlineURLsvalid
Type:congruency
System:knb
On failure:error
Online URLs are liveCheck that online URLs return somethingtruetrueSucceeded in accessing URL: <![CDATA[file:///home/pasta/local/data/knb-lter-jrn.210465001.1/558c3058adf1abcf1dbe7179376bd55d]]>
21tooFewFieldsvalid
Type:congruency
System:knb
On failure:error
Data does not have fewer fields than metadata attributesCompare number of fields specified in metadata to number of fields found in a data recordNo errors detectedhttp://knb.ecoinformatics.org/software/eml/eml-2.1.0/eml-physical.html#dataFormat
22tooManyFieldsvalid
Type:congruency
System:knb
On failure:error
Data does not have more fields than metadata attributesCompare number of fields specified in metadata to number of fields found in a data recordNo errors detectedhttp://knb.ecoinformatics.org/software/eml/eml-2.1.0/eml-physical.html#dataFormat
23dataLoadStatusvalid
Type:congruency
System:knb
On failure:warn
Data can be loaded into the databaseStatus of loading the data table into a databaseNo errors expected during data loading or data loading was not attempted for this data entityThe data table loaded successfully into a database
24numberOfRecordsvalid
Type:congruency
System:knb
On failure:warn
Number of records in metadata matches number of rows loadedCompare number of records specified in metadata to number of records found in data224293224293The expected number of records (224293) was found in the data table.
25headerRowAttributeNamesinfo
Type:congruency
System:lter
On failure:info
Header row is displayed alongside attribute namesCompare the content of the data header row to the content of EML attribute names.No expectation, information only Customer should evaluate the findings
26dateFormatMatchesvalid
Type:congruency
System:lter
On failure:warn
Date format in metadata matches datadateTime/formatString in attribute metadata is from the preferred list, and the data matches. A non-match generates only a warn.Format string is preferred, and all data values match the format stringData values matched the specified formatString.Dates should be consistently formatted and match the formatString in metadata.
Entity Report
Entity Name: playa_18_water_L1_all
Entity Identifier:
# Identifier Status Quality Check Name Description Expected Found Explanation Suggestion Reference
1entityNameLengthvalid
Type:metadata
System:knb
On failure:warn
Length of entityName is not excessive (less than 100 char)length of entity name is less than 100 charactersentityName value is 100 characters or less21
2entityDescriptionPresentvalid
Type:metadata
System:lter
On failure:warn
An entity description is presentCheck for presence of an entity description.EML Best practices pp. 32-33, "...should have enough information for a user..."trueWith entityName sometimes serving as a file name rather than a title, it is important to be very descriptive here.
3numHeaderLinesPresentinfo
Type:metadata
System:knb
On failure:info
'numHeaderLines' element is presentCheck for presence of the 'numHeaderLines' element.Document contains 'numHeaderLines' element.'numHeaderLines' element: 1
4numFooterLinesPresentinfo
Type:metadata
System:knb
On failure:info
'numFooterLines' element is presentCheck for presence of the 'numFooterLines' element.Document contains 'numFooterLines' element.'numFooterLines' element: 0
5fieldDelimiterValidvalid
Type:metadata
System:knb
On failure:error
Field delimiter is a single characterField delimiters should be one character onlyA single character is expected,A valid fieldDelimiter value was foundhttp://knb.ecoinformatics.org/software/eml/eml-2.1.0/eml-physical.html#fieldDelimiter
6recordDelimiterPresentvalid
Type:metadata
System:knb
On failure:warn
Record delimiter is presentCheck presence of record delimiter. Check that the record delimiter is one of the suggested values.A record delimiter from a list of suggested values: \n, \r, \r\n, #x0A, #x0D, #x0D#x0A\nA valid recordDelimiter value was foundhttp://knb.ecoinformatics.org/software/eml/eml-2.1.0/eml-physical.html#recordDelimiter
7numberOfRecordsPresencevalid
Type:metadata
System:knb
On failure:warn
Is the numberOfRecords element present?Warn the user if the numberOfRecords check is not presentA number of records element is expected for this entitynumberOfRecords element foundThis is a valuable check that we have the correct table.
8entitySizePresencevalid
Type:metadata
System:knb
On failure:warn
Check for presence of an entity size elementLook for entity size element as a prep for checking congruence, and if not present, generate a warn. Note that to be most useful (i.e, to check congruence), entity size should contain the most precise measure of size, which is "byte" (the default unit); however, the presence or name of the entity size unit is NOT checked.Entity size is present. If unit="byte" or unit is omitted (default = byte), then congruence can be checked.Found entity size element with value of 10080849 and size unit specified as 'byte'.Examining the entity size is prep for checking congruence. Including the element is best practice, and if not present, a warn is generated. To be most useful, entity size should contain the most precise measure of size, which is &#34;byte&#34; (the default unit).Include an entity size in bytes Example success: knb-lter-sbc.3.12. Example of size in units other than byte: knb-lter-mcr.6.56.
9integrityChecksumPresencevalid
Type:metadata
System:lter
On failure:warn
A physical/authentication element is present and specifies a method attribute with a value of MD5 or SHA-1Check for presence of a physical/authentication element containing a checksum or hash value for an integrity check (e.g. MD5, SHA-1). Warn if an entity does not have a physical/authentication element, or if none of the physical/authentication elements specify a method attribute with a value of MD5 or SHA-1.At least one physical/authentication element with a method attribute specifying MD5 or SHA-1 and containing a checksum or hash value that can be used to perform an integrity check on the data.truePASTA will use this value to check the integrity of the data it downloads from your site. In addition, PASTA is planning to compare the contributor-supplied checksum/hash value documented in the physical/authentication element to the checksum/hash value of this entity downloaded from previous revisions of this data package. If PASTA already has a copy of this entity, it will be able to avoid an unnecessary download of the entity from your site, resulting in faster processing of the new data package revision when you update it in PASTA.Add a physical/authentication element and store the entity checksum or hash value in it using a method such as MD5 or SHA-1.
10dateTimeFormatStringvalid
Type:metadata
System:knb
On failure:warn
dateTime/formatString specified in metadata is from a preferred set of valuesCertain features of dateTime data formats are preferred, eg, ISO 8601, 4-digit years. This check looks at metadata to see if the dateTime format is in that preferred list.A formatString value that is a member of the preferred set is expected.YYYY-MM-DD hh:mmA preferred format string was found.Modify the dateTime/formatString, selecting from among the preferred values one that best matches the data format
11attributeNamesUniquevalid
Type:metadata
System:knb
On failure:warn
Attribute names are uniqueChecks if attributeName values are unique in the table. Not required by EML.Unique attribute names.trueA good table does not have duplicate column names.EML Best Practices
12displayDownloadDatainfo
Type:data
System:knb
On failure:info
Display downloaded dataDisplay the first kilobyte of data that is downloadedUp to one kilobyte of data should be displayed
13urlReturnsDatavalid
Type:congruency
System:knb
On failure:error
URL returns dataChecks whether a URL returns data. Unless the URL is specified to be function="information", the URL should return the resource for download.A data entity that matches the metadatatruehttp://knb.ecoinformatics.org/software/eml/eml-2.1.0/eml-resource.html#UrlType
14onlineURLsvalid
Type:congruency
System:knb
On failure:error
Online URLs are liveCheck that online URLs return somethingtruetrueSucceeded in accessing URL: <![CDATA[https://ezeml.edirepository.org/user-data/Charles_Kimsal-ec0b143426e3768a0901eeb5c7c10f9f/uploads/Playa%20Water%20Levels/playa_18_water_L1_all.csv]]>
15integrityChecksumvalid
Type:congruency
System:lter
On failure:error
Compare the metadata checksum for an entity to the checksum of the downloaded entityTwo possible responses: valid if checksums match; error if checksums do not match.f784f2fdc15ed9a2de1b0b72aab2a10ef784f2fdc15ed9a2de1b0b72aab2a10eMatching checksums will ensure data integrity during upload to the repository.If the found integrity hash value does not match the expected integrity hash value, there may have been a loss of integrity in the data download. Check that the hash method and hash value documented in the metadata are the correct values.
16entitySizeCongruencevalid
Type:congruency
System:knb
On failure:error
Check that the entity size in the Level 0 metadata matches the one PASTA+ generates.Compare raw file size of file to [entity]/physical/size element in metadata. Return error if not matching.1008084910080849Examining the entity size is a method for checking that this is the correct entity.Check the entity size.
17databaseTableCreatedvalid
Type:metadata
System:knb
On failure:error
Database table createdStatus of creating a database tableA database table is expected to be generated from the EML attributes.A database table was generated from the attributes description<![CDATA[CREATE TABLE _90a0bdb9cdd24e560dc8d02e2ceb74b5("site" TEXT,"timestamp" TIMESTAMP,"absolutePressure_kPa" FLOAT,"temp_C" FLOAT,"waterLevel_m" FLOAT,"waterLevel_m_filtered" FLOAT,"qflag" TEXT,"comment" TEXT);]]>
18examineRecordDelimiterwarn
Type:congruency
System:knb
On failure:warn
Data are examined and possible record delimiters are displayedIf no record delimiter was specified, we assume that \r\n is the delimiter. Search the first row for other record delimiters and see if other delimiters are found.No other potential record delimiters expected in the first row.Other potential record delimiters were found in the first row: [\r\n]Detection of line endings may be automatic on most systems, so this may not be important.Ensure that record delimiters are correctly specified.http://knb.ecoinformatics.org/software/eml/eml-2.1.0/eml-physical.html#recordDelimiter
19displayFirstInsertRowinfo
Type:data
System:knb
On failure:info
Display first insert rowDisplay the first row of data values to be inserted into the database tableThe first row of data values should be displayed<![CDATA[18, 2016-06-15 00:00, 86.572, 9.472, 0, 0, , ]]>
20onlineURLsvalid
Type:congruency
System:knb
On failure:error
Online URLs are liveCheck that online URLs return somethingtruetrueSucceeded in accessing URL: <![CDATA[file:///home/pasta/local/data/knb-lter-jrn.210465001.1/90a0bdb9cdd24e560dc8d02e2ceb74b5]]>
21tooFewFieldsvalid
Type:congruency
System:knb
On failure:error
Data does not have fewer fields than metadata attributesCompare number of fields specified in metadata to number of fields found in a data recordNo errors detectedhttp://knb.ecoinformatics.org/software/eml/eml-2.1.0/eml-physical.html#dataFormat
22tooManyFieldsvalid
Type:congruency
System:knb
On failure:error
Data does not have more fields than metadata attributesCompare number of fields specified in metadata to number of fields found in a data recordNo errors detectedhttp://knb.ecoinformatics.org/software/eml/eml-2.1.0/eml-physical.html#dataFormat
23dataLoadStatusvalid
Type:congruency
System:knb
On failure:warn
Data can be loaded into the databaseStatus of loading the data table into a databaseNo errors expected during data loading or data loading was not attempted for this data entityThe data table loaded successfully into a database
24numberOfRecordsvalid
Type:congruency
System:knb
On failure:warn
Number of records in metadata matches number of rows loadedCompare number of records specified in metadata to number of records found in data224400224400The expected number of records (224400) was found in the data table.
25headerRowAttributeNamesinfo
Type:congruency
System:lter
On failure:info
Header row is displayed alongside attribute namesCompare the content of the data header row to the content of EML attribute names.No expectation, information only Customer should evaluate the findings
26dateFormatMatchesvalid
Type:congruency
System:lter
On failure:warn
Date format in metadata matches datadateTime/formatString in attribute metadata is from the preferred list, and the data matches. A non-match generates only a warn.Format string is preferred, and all data values match the format stringData values matched the specified formatString.Dates should be consistently formatted and match the formatString in metadata.
Entity Report
Entity Name: playa_21_water_L1_all
Entity Identifier:
# Identifier Status Quality Check Name Description Expected Found Explanation Suggestion Reference
1entityNameLengthvalid
Type:metadata
System:knb
On failure:warn
Length of entityName is not excessive (less than 100 char)length of entity name is less than 100 charactersentityName value is 100 characters or less21
2entityDescriptionPresentvalid
Type:metadata
System:lter
On failure:warn
An entity description is presentCheck for presence of an entity description.EML Best practices pp. 32-33, "...should have enough information for a user..."trueWith entityName sometimes serving as a file name rather than a title, it is important to be very descriptive here.
3numHeaderLinesPresentinfo
Type:metadata
System:knb
On failure:info
'numHeaderLines' element is presentCheck for presence of the 'numHeaderLines' element.Document contains 'numHeaderLines' element.'numHeaderLines' element: 1
4numFooterLinesPresentinfo
Type:metadata
System:knb
On failure:info
'numFooterLines' element is presentCheck for presence of the 'numFooterLines' element.Document contains 'numFooterLines' element.'numFooterLines' element: 0
5fieldDelimiterValidvalid
Type:metadata
System:knb
On failure:error
Field delimiter is a single characterField delimiters should be one character onlyA single character is expected,A valid fieldDelimiter value was foundhttp://knb.ecoinformatics.org/software/eml/eml-2.1.0/eml-physical.html#fieldDelimiter
6recordDelimiterPresentvalid
Type:metadata
System:knb
On failure:warn
Record delimiter is presentCheck presence of record delimiter. Check that the record delimiter is one of the suggested values.A record delimiter from a list of suggested values: \n, \r, \r\n, #x0A, #x0D, #x0D#x0A\nA valid recordDelimiter value was foundhttp://knb.ecoinformatics.org/software/eml/eml-2.1.0/eml-physical.html#recordDelimiter
7numberOfRecordsPresencevalid
Type:metadata
System:knb
On failure:warn
Is the numberOfRecords element present?Warn the user if the numberOfRecords check is not presentA number of records element is expected for this entitynumberOfRecords element foundThis is a valuable check that we have the correct table.
8entitySizePresencevalid
Type:metadata
System:knb
On failure:warn
Check for presence of an entity size elementLook for entity size element as a prep for checking congruence, and if not present, generate a warn. Note that to be most useful (i.e, to check congruence), entity size should contain the most precise measure of size, which is "byte" (the default unit); however, the presence or name of the entity size unit is NOT checked.Entity size is present. If unit="byte" or unit is omitted (default = byte), then congruence can be checked.Found entity size element with value of 10107609 and size unit specified as 'byte'.Examining the entity size is prep for checking congruence. Including the element is best practice, and if not present, a warn is generated. To be most useful, entity size should contain the most precise measure of size, which is &#34;byte&#34; (the default unit).Include an entity size in bytes Example success: knb-lter-sbc.3.12. Example of size in units other than byte: knb-lter-mcr.6.56.
9integrityChecksumPresencevalid
Type:metadata
System:lter
On failure:warn
A physical/authentication element is present and specifies a method attribute with a value of MD5 or SHA-1Check for presence of a physical/authentication element containing a checksum or hash value for an integrity check (e.g. MD5, SHA-1). Warn if an entity does not have a physical/authentication element, or if none of the physical/authentication elements specify a method attribute with a value of MD5 or SHA-1.At least one physical/authentication element with a method attribute specifying MD5 or SHA-1 and containing a checksum or hash value that can be used to perform an integrity check on the data.truePASTA will use this value to check the integrity of the data it downloads from your site. In addition, PASTA is planning to compare the contributor-supplied checksum/hash value documented in the physical/authentication element to the checksum/hash value of this entity downloaded from previous revisions of this data package. If PASTA already has a copy of this entity, it will be able to avoid an unnecessary download of the entity from your site, resulting in faster processing of the new data package revision when you update it in PASTA.Add a physical/authentication element and store the entity checksum or hash value in it using a method such as MD5 or SHA-1.
10dateTimeFormatStringvalid
Type:metadata
System:knb
On failure:warn
dateTime/formatString specified in metadata is from a preferred set of valuesCertain features of dateTime data formats are preferred, eg, ISO 8601, 4-digit years. This check looks at metadata to see if the dateTime format is in that preferred list.A formatString value that is a member of the preferred set is expected.YYYY-MM-DD hh:mmA preferred format string was found.Modify the dateTime/formatString, selecting from among the preferred values one that best matches the data format
11attributeNamesUniquevalid
Type:metadata
System:knb
On failure:warn
Attribute names are uniqueChecks if attributeName values are unique in the table. Not required by EML.Unique attribute names.trueA good table does not have duplicate column names.EML Best Practices
12displayDownloadDatainfo
Type:data
System:knb
On failure:info
Display downloaded dataDisplay the first kilobyte of data that is downloadedUp to one kilobyte of data should be displayed
13urlReturnsDatavalid
Type:congruency
System:knb
On failure:error
URL returns dataChecks whether a URL returns data. Unless the URL is specified to be function="information", the URL should return the resource for download.A data entity that matches the metadatatruehttp://knb.ecoinformatics.org/software/eml/eml-2.1.0/eml-resource.html#UrlType
14onlineURLsvalid
Type:congruency
System:knb
On failure:error
Online URLs are liveCheck that online URLs return somethingtruetrueSucceeded in accessing URL: <![CDATA[https://ezeml.edirepository.org/user-data/Charles_Kimsal-ec0b143426e3768a0901eeb5c7c10f9f/uploads/Playa%20Water%20Levels/playa_21_water_L1_all.csv]]>
15integrityChecksumvalid
Type:congruency
System:lter
On failure:error
Compare the metadata checksum for an entity to the checksum of the downloaded entityTwo possible responses: valid if checksums match; error if checksums do not match.f00f2f8a71cf94b71f887d6014bf0c51f00f2f8a71cf94b71f887d6014bf0c51Matching checksums will ensure data integrity during upload to the repository.If the found integrity hash value does not match the expected integrity hash value, there may have been a loss of integrity in the data download. Check that the hash method and hash value documented in the metadata are the correct values.
16entitySizeCongruencevalid
Type:congruency
System:knb
On failure:error
Check that the entity size in the Level 0 metadata matches the one PASTA+ generates.Compare raw file size of file to [entity]/physical/size element in metadata. Return error if not matching.1010760910107609Examining the entity size is a method for checking that this is the correct entity.Check the entity size.
17databaseTableCreatedvalid
Type:metadata
System:knb
On failure:error
Database table createdStatus of creating a database tableA database table is expected to be generated from the EML attributes.A database table was generated from the attributes description<![CDATA[CREATE TABLE _452f1d4ca28bc1ce08b18daf121a75b9("site" TEXT,"timestamp" TIMESTAMP,"absolutePressure_kPa" FLOAT,"temp_C" FLOAT,"waterLevel_m" FLOAT,"waterLevel_m_filtered" FLOAT,"qflag" TEXT,"comment" TEXT);]]>
18examineRecordDelimiterwarn
Type:congruency
System:knb
On failure:warn
Data are examined and possible record delimiters are displayedIf no record delimiter was specified, we assume that \r\n is the delimiter. Search the first row for other record delimiters and see if other delimiters are found.No other potential record delimiters expected in the first row.Other potential record delimiters were found in the first row: [\r\n]Detection of line endings may be automatic on most systems, so this may not be important.Ensure that record delimiters are correctly specified.http://knb.ecoinformatics.org/software/eml/eml-2.1.0/eml-physical.html#recordDelimiter
19displayFirstInsertRowinfo
Type:data
System:knb
On failure:info
Display first insert rowDisplay the first row of data values to be inserted into the database tableThe first row of data values should be displayed<![CDATA[21, 2016-06-15 00:00, 86.642, 12.11, 0.001, 0, , ]]>
20onlineURLsvalid
Type:congruency
System:knb
On failure:error
Online URLs are liveCheck that online URLs return somethingtruetrueSucceeded in accessing URL: <![CDATA[file:///home/pasta/local/data/knb-lter-jrn.210465001.1/452f1d4ca28bc1ce08b18daf121a75b9]]>
21tooFewFieldsvalid
Type:congruency
System:knb
On failure:error
Data does not have fewer fields than metadata attributesCompare number of fields specified in metadata to number of fields found in a data recordNo errors detectedhttp://knb.ecoinformatics.org/software/eml/eml-2.1.0/eml-physical.html#dataFormat
22tooManyFieldsvalid
Type:congruency
System:knb
On failure:error
Data does not have more fields than metadata attributesCompare number of fields specified in metadata to number of fields found in a data recordNo errors detectedhttp://knb.ecoinformatics.org/software/eml/eml-2.1.0/eml-physical.html#dataFormat
23dataLoadStatusvalid
Type:congruency
System:knb
On failure:warn
Data can be loaded into the databaseStatus of loading the data table into a databaseNo errors expected during data loading or data loading was not attempted for this data entityThe data table loaded successfully into a database
24numberOfRecordsvalid
Type:congruency
System:knb
On failure:warn
Number of records in metadata matches number of rows loadedCompare number of records specified in metadata to number of records found in data224392224392The expected number of records (224392) was found in the data table.
25headerRowAttributeNamesinfo
Type:congruency
System:lter
On failure:info
Header row is displayed alongside attribute namesCompare the content of the data header row to the content of EML attribute names.No expectation, information only Customer should evaluate the findings
26dateFormatMatchesvalid
Type:congruency
System:lter
On failure:warn
Date format in metadata matches datadateTime/formatString in attribute metadata is from the preferred list, and the data matches. A non-match generates only a warn.Format string is preferred, and all data values match the format stringData values matched the specified formatString.Dates should be consistently formatted and match the formatString in metadata.
Entity Report
Entity Name: playa_22_water_L1_all
Entity Identifier:
# Identifier Status Quality Check Name Description Expected Found Explanation Suggestion Reference
1entityNameLengthvalid
Type:metadata
System:knb
On failure:warn
Length of entityName is not excessive (less than 100 char)length of entity name is less than 100 charactersentityName value is 100 characters or less21
2entityDescriptionPresentvalid
Type:metadata
System:lter
On failure:warn
An entity description is presentCheck for presence of an entity description.EML Best practices pp. 32-33, "...should have enough information for a user..."trueWith entityName sometimes serving as a file name rather than a title, it is important to be very descriptive here.
3numHeaderLinesPresentinfo
Type:metadata
System:knb
On failure:info
'numHeaderLines' element is presentCheck for presence of the 'numHeaderLines' element.Document contains 'numHeaderLines' element.'numHeaderLines' element: 1
4numFooterLinesPresentinfo
Type:metadata
System:knb
On failure:info
'numFooterLines' element is presentCheck for presence of the 'numFooterLines' element.Document contains 'numFooterLines' element.'numFooterLines' element: 0
5fieldDelimiterValidvalid
Type:metadata
System:knb
On failure:error
Field delimiter is a single characterField delimiters should be one character onlyA single character is expected,A valid fieldDelimiter value was foundhttp://knb.ecoinformatics.org/software/eml/eml-2.1.0/eml-physical.html#fieldDelimiter
6recordDelimiterPresentvalid
Type:metadata
System:knb
On failure:warn
Record delimiter is presentCheck presence of record delimiter. Check that the record delimiter is one of the suggested values.A record delimiter from a list of suggested values: \n, \r, \r\n, #x0A, #x0D, #x0D#x0A\nA valid recordDelimiter value was foundhttp://knb.ecoinformatics.org/software/eml/eml-2.1.0/eml-physical.html#recordDelimiter
7numberOfRecordsPresencevalid
Type:metadata
System:knb
On failure:warn
Is the numberOfRecords element present?Warn the user if the numberOfRecords check is not presentA number of records element is expected for this entitynumberOfRecords element foundThis is a valuable check that we have the correct table.
8entitySizePresencevalid
Type:metadata
System:knb
On failure:warn
Check for presence of an entity size elementLook for entity size element as a prep for checking congruence, and if not present, generate a warn. Note that to be most useful (i.e, to check congruence), entity size should contain the most precise measure of size, which is "byte" (the default unit); however, the presence or name of the entity size unit is NOT checked.Entity size is present. If unit="byte" or unit is omitted (default = byte), then congruence can be checked.Found entity size element with value of 10120596 and size unit specified as 'byte'.Examining the entity size is prep for checking congruence. Including the element is best practice, and if not present, a warn is generated. To be most useful, entity size should contain the most precise measure of size, which is &#34;byte&#34; (the default unit).Include an entity size in bytes Example success: knb-lter-sbc.3.12. Example of size in units other than byte: knb-lter-mcr.6.56.
9integrityChecksumPresencevalid
Type:metadata
System:lter
On failure:warn
A physical/authentication element is present and specifies a method attribute with a value of MD5 or SHA-1Check for presence of a physical/authentication element containing a checksum or hash value for an integrity check (e.g. MD5, SHA-1). Warn if an entity does not have a physical/authentication element, or if none of the physical/authentication elements specify a method attribute with a value of MD5 or SHA-1.At least one physical/authentication element with a method attribute specifying MD5 or SHA-1 and containing a checksum or hash value that can be used to perform an integrity check on the data.truePASTA will use this value to check the integrity of the data it downloads from your site. In addition, PASTA is planning to compare the contributor-supplied checksum/hash value documented in the physical/authentication element to the checksum/hash value of this entity downloaded from previous revisions of this data package. If PASTA already has a copy of this entity, it will be able to avoid an unnecessary download of the entity from your site, resulting in faster processing of the new data package revision when you update it in PASTA.Add a physical/authentication element and store the entity checksum or hash value in it using a method such as MD5 or SHA-1.
10dateTimeFormatStringvalid
Type:metadata
System:knb
On failure:warn
dateTime/formatString specified in metadata is from a preferred set of valuesCertain features of dateTime data formats are preferred, eg, ISO 8601, 4-digit years. This check looks at metadata to see if the dateTime format is in that preferred list.A formatString value that is a member of the preferred set is expected.YYYY-MM-DD hh:mmA preferred format string was found.Modify the dateTime/formatString, selecting from among the preferred values one that best matches the data format
11attributeNamesUniquevalid
Type:metadata
System:knb
On failure:warn
Attribute names are uniqueChecks if attributeName values are unique in the table. Not required by EML.Unique attribute names.trueA good table does not have duplicate column names.EML Best Practices
12displayDownloadDatainfo
Type:data
System:knb
On failure:info
Display downloaded dataDisplay the first kilobyte of data that is downloadedUp to one kilobyte of data should be displayed
13urlReturnsDatavalid
Type:congruency
System:knb
On failure:error
URL returns dataChecks whether a URL returns data. Unless the URL is specified to be function="information", the URL should return the resource for download.A data entity that matches the metadatatruehttp://knb.ecoinformatics.org/software/eml/eml-2.1.0/eml-resource.html#UrlType
14onlineURLsvalid
Type:congruency
System:knb
On failure:error
Online URLs are liveCheck that online URLs return somethingtruetrueSucceeded in accessing URL: <![CDATA[https://ezeml.edirepository.org/user-data/Charles_Kimsal-ec0b143426e3768a0901eeb5c7c10f9f/uploads/Playa%20Water%20Levels/playa_22_water_L1_all.csv]]>
15integrityChecksumvalid
Type:congruency
System:lter
On failure:error
Compare the metadata checksum for an entity to the checksum of the downloaded entityTwo possible responses: valid if checksums match; error if checksums do not match.eb108c9d3654510f3f37ef6437ff545feb108c9d3654510f3f37ef6437ff545fMatching checksums will ensure data integrity during upload to the repository.If the found integrity hash value does not match the expected integrity hash value, there may have been a loss of integrity in the data download. Check that the hash method and hash value documented in the metadata are the correct values.
16entitySizeCongruencevalid
Type:congruency
System:knb
On failure:error
Check that the entity size in the Level 0 metadata matches the one PASTA+ generates.Compare raw file size of file to [entity]/physical/size element in metadata. Return error if not matching.1012059610120596Examining the entity size is a method for checking that this is the correct entity.Check the entity size.
17databaseTableCreatedvalid
Type:metadata
System:knb
On failure:error
Database table createdStatus of creating a database tableA database table is expected to be generated from the EML attributes.A database table was generated from the attributes description<![CDATA[CREATE TABLE _0c2345c68b667dfe46cee83116c8b74f("site" TEXT,"timestamp" TIMESTAMP,"absolutePressure_kPa" FLOAT,"temp_C" FLOAT,"waterLevel_m" FLOAT,"waterLevel_m_filtered" FLOAT,"qflag" TEXT,"comment" TEXT);]]>
18examineRecordDelimiterwarn
Type:congruency
System:knb
On failure:warn
Data are examined and possible record delimiters are displayedIf no record delimiter was specified, we assume that \r\n is the delimiter. Search the first row for other record delimiters and see if other delimiters are found.No other potential record delimiters expected in the first row.Other potential record delimiters were found in the first row: [\r\n]Detection of line endings may be automatic on most systems, so this may not be important.Ensure that record delimiters are correctly specified.http://knb.ecoinformatics.org/software/eml/eml-2.1.0/eml-physical.html#recordDelimiter
19displayFirstInsertRowinfo
Type:data
System:knb
On failure:info
Display first insert rowDisplay the first row of data values to be inserted into the database tableThe first row of data values should be displayed<![CDATA[22, 2016-06-15 00:00, 86.473, 12.207, -0.002, 0, , ]]>
20onlineURLsvalid
Type:congruency
System:knb
On failure:error
Online URLs are liveCheck that online URLs return somethingtruetrueSucceeded in accessing URL: <![CDATA[file:///home/pasta/local/data/knb-lter-jrn.210465001.1/0c2345c68b667dfe46cee83116c8b74f]]>
21tooFewFieldsvalid
Type:congruency
System:knb
On failure:error
Data does not have fewer fields than metadata attributesCompare number of fields specified in metadata to number of fields found in a data recordNo errors detectedhttp://knb.ecoinformatics.org/software/eml/eml-2.1.0/eml-physical.html#dataFormat
22tooManyFieldsvalid
Type:congruency
System:knb
On failure:error
Data does not have more fields than metadata attributesCompare number of fields specified in metadata to number of fields found in a data recordNo errors detectedhttp://knb.ecoinformatics.org/software/eml/eml-2.1.0/eml-physical.html#dataFormat
23dataLoadStatusvalid
Type:congruency
System:knb
On failure:warn
Data can be loaded into the databaseStatus of loading the data table into a databaseNo errors expected during data loading or data loading was not attempted for this data entityThe data table loaded successfully into a database
24numberOfRecordsvalid
Type:congruency
System:knb
On failure:warn
Number of records in metadata matches number of rows loadedCompare number of records specified in metadata to number of records found in data224394224394The expected number of records (224394) was found in the data table.
25headerRowAttributeNamesinfo
Type:congruency
System:lter
On failure:info
Header row is displayed alongside attribute namesCompare the content of the data header row to the content of EML attribute names.No expectation, information only Customer should evaluate the findings
26dateFormatMatchesvalid
Type:congruency
System:lter
On failure:warn
Date format in metadata matches datadateTime/formatString in attribute metadata is from the preferred list, and the data matches. A non-match generates only a warn.Format string is preferred, and all data values match the format stringData values matched the specified formatString.Dates should be consistently formatted and match the formatString in metadata.
Entity Report
Entity Name: playa_23_water_L1_all
Entity Identifier:
# Identifier Status Quality Check Name Description Expected Found Explanation Suggestion Reference
1entityNameLengthvalid
Type:metadata
System:knb
On failure:warn
Length of entityName is not excessive (less than 100 char)length of entity name is less than 100 charactersentityName value is 100 characters or less21
2entityDescriptionPresentvalid
Type:metadata
System:lter
On failure:warn
An entity description is presentCheck for presence of an entity description.EML Best practices pp. 32-33, "...should have enough information for a user..."trueWith entityName sometimes serving as a file name rather than a title, it is important to be very descriptive here.
3numHeaderLinesPresentinfo
Type:metadata
System:knb
On failure:info
'numHeaderLines' element is presentCheck for presence of the 'numHeaderLines' element.Document contains 'numHeaderLines' element.'numHeaderLines' element: 1
4numFooterLinesPresentinfo
Type:metadata
System:knb
On failure:info
'numFooterLines' element is presentCheck for presence of the 'numFooterLines' element.Document contains 'numFooterLines' element.'numFooterLines' element: 0
5fieldDelimiterValidvalid
Type:metadata
System:knb
On failure:error
Field delimiter is a single characterField delimiters should be one character onlyA single character is expected,A valid fieldDelimiter value was foundhttp://knb.ecoinformatics.org/software/eml/eml-2.1.0/eml-physical.html#fieldDelimiter
6recordDelimiterPresentvalid
Type:metadata
System:knb
On failure:warn
Record delimiter is presentCheck presence of record delimiter. Check that the record delimiter is one of the suggested values.A record delimiter from a list of suggested values: \n, \r, \r\n, #x0A, #x0D, #x0D#x0A\nA valid recordDelimiter value was foundhttp://knb.ecoinformatics.org/software/eml/eml-2.1.0/eml-physical.html#recordDelimiter
7numberOfRecordsPresencevalid
Type:metadata
System:knb
On failure:warn
Is the numberOfRecords element present?Warn the user if the numberOfRecords check is not presentA number of records element is expected for this entitynumberOfRecords element foundThis is a valuable check that we have the correct table.
8entitySizePresencevalid
Type:metadata
System:knb
On failure:warn
Check for presence of an entity size elementLook for entity size element as a prep for checking congruence, and if not present, generate a warn. Note that to be most useful (i.e, to check congruence), entity size should contain the most precise measure of size, which is "byte" (the default unit); however, the presence or name of the entity size unit is NOT checked.Entity size is present. If unit="byte" or unit is omitted (default = byte), then congruence can be checked.Found entity size element with value of 10097669 and size unit specified as 'byte'.Examining the entity size is prep for checking congruence. Including the element is best practice, and if not present, a warn is generated. To be most useful, entity size should contain the most precise measure of size, which is &#34;byte&#34; (the default unit).Include an entity size in bytes Example success: knb-lter-sbc.3.12. Example of size in units other than byte: knb-lter-mcr.6.56.
9integrityChecksumPresencevalid
Type:metadata
System:lter
On failure:warn
A physical/authentication element is present and specifies a method attribute with a value of MD5 or SHA-1Check for presence of a physical/authentication element containing a checksum or hash value for an integrity check (e.g. MD5, SHA-1). Warn if an entity does not have a physical/authentication element, or if none of the physical/authentication elements specify a method attribute with a value of MD5 or SHA-1.At least one physical/authentication element with a method attribute specifying MD5 or SHA-1 and containing a checksum or hash value that can be used to perform an integrity check on the data.truePASTA will use this value to check the integrity of the data it downloads from your site. In addition, PASTA is planning to compare the contributor-supplied checksum/hash value documented in the physical/authentication element to the checksum/hash value of this entity downloaded from previous revisions of this data package. If PASTA already has a copy of this entity, it will be able to avoid an unnecessary download of the entity from your site, resulting in faster processing of the new data package revision when you update it in PASTA.Add a physical/authentication element and store the entity checksum or hash value in it using a method such as MD5 or SHA-1.
10dateTimeFormatStringvalid
Type:metadata
System:knb
On failure:warn
dateTime/formatString specified in metadata is from a preferred set of valuesCertain features of dateTime data formats are preferred, eg, ISO 8601, 4-digit years. This check looks at metadata to see if the dateTime format is in that preferred list.A formatString value that is a member of the preferred set is expected.YYYY-MM-DD hh:mmA preferred format string was found.Modify the dateTime/formatString, selecting from among the preferred values one that best matches the data format
11attributeNamesUniquevalid
Type:metadata
System:knb
On failure:warn
Attribute names are uniqueChecks if attributeName values are unique in the table. Not required by EML.Unique attribute names.trueA good table does not have duplicate column names.EML Best Practices
12displayDownloadDatainfo
Type:data
System:knb
On failure:info
Display downloaded dataDisplay the first kilobyte of data that is downloadedUp to one kilobyte of data should be displayed
13urlReturnsDatavalid
Type:congruency
System:knb
On failure:error
URL returns dataChecks whether a URL returns data. Unless the URL is specified to be function="information", the URL should return the resource for download.A data entity that matches the metadatatruehttp://knb.ecoinformatics.org/software/eml/eml-2.1.0/eml-resource.html#UrlType
14onlineURLsvalid
Type:congruency
System:knb
On failure:error
Online URLs are liveCheck that online URLs return somethingtruetrueSucceeded in accessing URL: <![CDATA[https://ezeml.edirepository.org/user-data/Charles_Kimsal-ec0b143426e3768a0901eeb5c7c10f9f/uploads/Playa%20Water%20Levels/playa_23_water_L1_all.csv]]>
15integrityChecksumvalid
Type:congruency
System:lter
On failure:error
Compare the metadata checksum for an entity to the checksum of the downloaded entityTwo possible responses: valid if checksums match; error if checksums do not match.56401fca4ebbd2fcdfd4d8b9f3ecfc2056401fca4ebbd2fcdfd4d8b9f3ecfc20Matching checksums will ensure data integrity during upload to the repository.If the found integrity hash value does not match the expected integrity hash value, there may have been a loss of integrity in the data download. Check that the hash method and hash value documented in the metadata are the correct values.
16entitySizeCongruencevalid
Type:congruency
System:knb
On failure:error
Check that the entity size in the Level 0 metadata matches the one PASTA+ generates.Compare raw file size of file to [entity]/physical/size element in metadata. Return error if not matching.1009766910097669Examining the entity size is a method for checking that this is the correct entity.Check the entity size.
17databaseTableCreatedvalid
Type:metadata
System:knb
On failure:error
Database table createdStatus of creating a database tableA database table is expected to be generated from the EML attributes.A database table was generated from the attributes description<![CDATA[CREATE TABLE _c31141a5cfb819637d2b9cc2d2e2a2a7("site" TEXT,"timestamp" TIMESTAMP,"absolutePressure_kPa" FLOAT,"temp_C" FLOAT,"waterLevel_m" FLOAT,"waterLevel_m_filtered" FLOAT,"qflag" TEXT,"comment" TEXT);]]>
18examineRecordDelimiterwarn
Type:congruency
System:knb
On failure:warn
Data are examined and possible record delimiters are displayedIf no record delimiter was specified, we assume that \r\n is the delimiter. Search the first row for other record delimiters and see if other delimiters are found.No other potential record delimiters expected in the first row.Other potential record delimiters were found in the first row: [\r\n]Detection of line endings may be automatic on most systems, so this may not be important.Ensure that record delimiters are correctly specified.http://knb.ecoinformatics.org/software/eml/eml-2.1.0/eml-physical.html#recordDelimiter
19displayFirstInsertRowinfo
Type:data
System:knb
On failure:info
Display first insert rowDisplay the first row of data values to be inserted into the database tableThe first row of data values should be displayed<![CDATA[23, 2016-06-15 00:00, 86.723, 11.236, 0.002, 0, , ]]>
20onlineURLsvalid
Type:congruency
System:knb
On failure:error
Online URLs are liveCheck that online URLs return somethingtruetrueSucceeded in accessing URL: <![CDATA[file:///home/pasta/local/data/knb-lter-jrn.210465001.1/c31141a5cfb819637d2b9cc2d2e2a2a7]]>
21tooFewFieldsvalid
Type:congruency
System:knb
On failure:error
Data does not have fewer fields than metadata attributesCompare number of fields specified in metadata to number of fields found in a data recordNo errors detectedhttp://knb.ecoinformatics.org/software/eml/eml-2.1.0/eml-physical.html#dataFormat
22tooManyFieldsvalid
Type:congruency
System:knb
On failure:error
Data does not have more fields than metadata attributesCompare number of fields specified in metadata to number of fields found in a data recordNo errors detectedhttp://knb.ecoinformatics.org/software/eml/eml-2.1.0/eml-physical.html#dataFormat
23dataLoadStatusvalid
Type:congruency
System:knb
On failure:warn
Data can be loaded into the databaseStatus of loading the data table into a databaseNo errors expected during data loading or data loading was not attempted for this data entityThe data table loaded successfully into a database
24numberOfRecordsvalid
Type:congruency
System:knb
On failure:warn
Number of records in metadata matches number of rows loadedCompare number of records specified in metadata to number of records found in data224395224395The expected number of records (224395) was found in the data table.
25headerRowAttributeNamesinfo
Type:congruency
System:lter
On failure:info
Header row is displayed alongside attribute namesCompare the content of the data header row to the content of EML attribute names.No expectation, information only Customer should evaluate the findings
26dateFormatMatchesvalid
Type:congruency
System:lter
On failure:warn
Date format in metadata matches datadateTime/formatString in attribute metadata is from the preferred list, and the data matches. A non-match generates only a warn.Format string is preferred, and all data values match the format stringData values matched the specified formatString.Dates should be consistently formatted and match the formatString in metadata.
Entity Report
Entity Name: playa_24_water_L1_all
Entity Identifier:
# Identifier Status Quality Check Name Description Expected Found Explanation Suggestion Reference
1entityNameLengthvalid
Type:metadata
System:knb
On failure:warn
Length of entityName is not excessive (less than 100 char)length of entity name is less than 100 charactersentityName value is 100 characters or less21
2entityDescriptionPresentvalid
Type:metadata
System:lter
On failure:warn
An entity description is presentCheck for presence of an entity description.EML Best practices pp. 32-33, "...should have enough information for a user..."trueWith entityName sometimes serving as a file name rather than a title, it is important to be very descriptive here.
3numHeaderLinesPresentinfo
Type:metadata
System:knb
On failure:info
'numHeaderLines' element is presentCheck for presence of the 'numHeaderLines' element.Document contains 'numHeaderLines' element.'numHeaderLines' element: 1
4numFooterLinesPresentinfo
Type:metadata
System:knb
On failure:info
'numFooterLines' element is presentCheck for presence of the 'numFooterLines' element.Document contains 'numFooterLines' element.'numFooterLines' element: 0
5fieldDelimiterValidvalid
Type:metadata
System:knb
On failure:error
Field delimiter is a single characterField delimiters should be one character onlyA single character is expected,A valid fieldDelimiter value was foundhttp://knb.ecoinformatics.org/software/eml/eml-2.1.0/eml-physical.html#fieldDelimiter
6recordDelimiterPresentvalid
Type:metadata
System:knb
On failure:warn
Record delimiter is presentCheck presence of record delimiter. Check that the record delimiter is one of the suggested values.A record delimiter from a list of suggested values: \n, \r, \r\n, #x0A, #x0D, #x0D#x0A\nA valid recordDelimiter value was foundhttp://knb.ecoinformatics.org/software/eml/eml-2.1.0/eml-physical.html#recordDelimiter
7numberOfRecordsPresencevalid
Type:metadata
System:knb
On failure:warn
Is the numberOfRecords element present?Warn the user if the numberOfRecords check is not presentA number of records element is expected for this entitynumberOfRecords element foundThis is a valuable check that we have the correct table.
8entitySizePresencevalid
Type:metadata
System:knb
On failure:warn
Check for presence of an entity size elementLook for entity size element as a prep for checking congruence, and if not present, generate a warn. Note that to be most useful (i.e, to check congruence), entity size should contain the most precise measure of size, which is "byte" (the default unit); however, the presence or name of the entity size unit is NOT checked.Entity size is present. If unit="byte" or unit is omitted (default = byte), then congruence can be checked.Found entity size element with value of 10095117 and size unit specified as 'byte'.Examining the entity size is prep for checking congruence. Including the element is best practice, and if not present, a warn is generated. To be most useful, entity size should contain the most precise measure of size, which is &#34;byte&#34; (the default unit).Include an entity size in bytes Example success: knb-lter-sbc.3.12. Example of size in units other than byte: knb-lter-mcr.6.56.
9integrityChecksumPresencevalid
Type:metadata
System:lter
On failure:warn
A physical/authentication element is present and specifies a method attribute with a value of MD5 or SHA-1Check for presence of a physical/authentication element containing a checksum or hash value for an integrity check (e.g. MD5, SHA-1). Warn if an entity does not have a physical/authentication element, or if none of the physical/authentication elements specify a method attribute with a value of MD5 or SHA-1.At least one physical/authentication element with a method attribute specifying MD5 or SHA-1 and containing a checksum or hash value that can be used to perform an integrity check on the data.truePASTA will use this value to check the integrity of the data it downloads from your site. In addition, PASTA is planning to compare the contributor-supplied checksum/hash value documented in the physical/authentication element to the checksum/hash value of this entity downloaded from previous revisions of this data package. If PASTA already has a copy of this entity, it will be able to avoid an unnecessary download of the entity from your site, resulting in faster processing of the new data package revision when you update it in PASTA.Add a physical/authentication element and store the entity checksum or hash value in it using a method such as MD5 or SHA-1.
10dateTimeFormatStringvalid
Type:metadata
System:knb
On failure:warn
dateTime/formatString specified in metadata is from a preferred set of valuesCertain features of dateTime data formats are preferred, eg, ISO 8601, 4-digit years. This check looks at metadata to see if the dateTime format is in that preferred list.A formatString value that is a member of the preferred set is expected.YYYY-MM-DD hh:mmA preferred format string was found.Modify the dateTime/formatString, selecting from among the preferred values one that best matches the data format
11attributeNamesUniquevalid
Type:metadata
System:knb
On failure:warn
Attribute names are uniqueChecks if attributeName values are unique in the table. Not required by EML.Unique attribute names.trueA good table does not have duplicate column names.EML Best Practices
12displayDownloadDatainfo
Type:data
System:knb
On failure:info
Display downloaded dataDisplay the first kilobyte of data that is downloadedUp to one kilobyte of data should be displayed
13urlReturnsDatavalid
Type:congruency
System:knb
On failure:error
URL returns dataChecks whether a URL returns data. Unless the URL is specified to be function="information", the URL should return the resource for download.A data entity that matches the metadatatruehttp://knb.ecoinformatics.org/software/eml/eml-2.1.0/eml-resource.html#UrlType
14onlineURLsvalid
Type:congruency
System:knb
On failure:error
Online URLs are liveCheck that online URLs return somethingtruetrueSucceeded in accessing URL: <![CDATA[https://ezeml.edirepository.org/user-data/Charles_Kimsal-ec0b143426e3768a0901eeb5c7c10f9f/uploads/Playa%20Water%20Levels/playa_24_water_L1_all.csv]]>
15integrityChecksumvalid
Type:congruency
System:lter
On failure:error
Compare the metadata checksum for an entity to the checksum of the downloaded entityTwo possible responses: valid if checksums match; error if checksums do not match.b09b7f639fb50a7fac097d1d52a29f7fb09b7f639fb50a7fac097d1d52a29f7fMatching checksums will ensure data integrity during upload to the repository.If the found integrity hash value does not match the expected integrity hash value, there may have been a loss of integrity in the data download. Check that the hash method and hash value documented in the metadata are the correct values.
16entitySizeCongruencevalid
Type:congruency
System:knb
On failure:error
Check that the entity size in the Level 0 metadata matches the one PASTA+ generates.Compare raw file size of file to [entity]/physical/size element in metadata. Return error if not matching.1009511710095117Examining the entity size is a method for checking that this is the correct entity.Check the entity size.
17databaseTableCreatedvalid
Type:metadata
System:knb
On failure:error
Database table createdStatus of creating a database tableA database table is expected to be generated from the EML attributes.A database table was generated from the attributes description<![CDATA[CREATE TABLE _b7a34e7df67a2af7501aefc3a763659b("site" TEXT,"timestamp" TIMESTAMP,"absolutePressure_kPa" FLOAT,"temp_C" FLOAT,"waterLevel_m" FLOAT,"waterLevel_m_filtered" FLOAT,"qflag" TEXT,"comment" TEXT);]]>
18examineRecordDelimiterwarn
Type:congruency
System:knb
On failure:warn
Data are examined and possible record delimiters are displayedIf no record delimiter was specified, we assume that \r\n is the delimiter. Search the first row for other record delimiters and see if other delimiters are found.No other potential record delimiters expected in the first row.Other potential record delimiters were found in the first row: [\r\n]Detection of line endings may be automatic on most systems, so this may not be important.Ensure that record delimiters are correctly specified.http://knb.ecoinformatics.org/software/eml/eml-2.1.0/eml-physical.html#recordDelimiter
19displayFirstInsertRowinfo
Type:data
System:knb
On failure:info
Display first insert rowDisplay the first row of data values to be inserted into the database tableThe first row of data values should be displayed<![CDATA[24, 2016-06-15 00:00, 86.539, 11.236, -0.001, 0, , ]]>
20onlineURLsvalid
Type:congruency
System:knb
On failure:error
Online URLs are liveCheck that online URLs return somethingtruetrueSucceeded in accessing URL: <![CDATA[file:///home/pasta/local/data/knb-lter-jrn.210465001.1/b7a34e7df67a2af7501aefc3a763659b]]>
21tooFewFieldsvalid
Type:congruency
System:knb
On failure:error
Data does not have fewer fields than metadata attributesCompare number of fields specified in metadata to number of fields found in a data recordNo errors detectedhttp://knb.ecoinformatics.org/software/eml/eml-2.1.0/eml-physical.html#dataFormat
22tooManyFieldsvalid
Type:congruency
System:knb
On failure:error
Data does not have more fields than metadata attributesCompare number of fields specified in metadata to number of fields found in a data recordNo errors detectedhttp://knb.ecoinformatics.org/software/eml/eml-2.1.0/eml-physical.html#dataFormat
23dataLoadStatusvalid
Type:congruency
System:knb
On failure:warn
Data can be loaded into the databaseStatus of loading the data table into a databaseNo errors expected during data loading or data loading was not attempted for this data entityThe data table loaded successfully into a database
24numberOfRecordsvalid
Type:congruency
System:knb
On failure:warn
Number of records in metadata matches number of rows loadedCompare number of records specified in metadata to number of records found in data224397224397The expected number of records (224397) was found in the data table.
25headerRowAttributeNamesinfo
Type:congruency
System:lter
On failure:info
Header row is displayed alongside attribute namesCompare the content of the data header row to the content of EML attribute names.No expectation, information only Customer should evaluate the findings
26dateFormatMatchesvalid
Type:congruency
System:lter
On failure:warn
Date format in metadata matches datadateTime/formatString in attribute metadata is from the preferred list, and the data matches. A non-match generates only a warn.Format string is preferred, and all data values match the format stringData values matched the specified formatString.Dates should be consistently formatted and match the formatString in metadata.
Entity Report
Entity Name: playa_25_water_L1_all
Entity Identifier:
# Identifier Status Quality Check Name Description Expected Found Explanation Suggestion Reference
1entityNameLengthvalid
Type:metadata
System:knb
On failure:warn
Length of entityName is not excessive (less than 100 char)length of entity name is less than 100 charactersentityName value is 100 characters or less21
2entityDescriptionPresentvalid
Type:metadata
System:lter
On failure:warn
An entity description is presentCheck for presence of an entity description.EML Best practices pp. 32-33, "...should have enough information for a user..."trueWith entityName sometimes serving as a file name rather than a title, it is important to be very descriptive here.
3numHeaderLinesPresentinfo
Type:metadata
System:knb
On failure:info
'numHeaderLines' element is presentCheck for presence of the 'numHeaderLines' element.Document contains 'numHeaderLines' element.'numHeaderLines' element: 1
4numFooterLinesPresentinfo
Type:metadata
System:knb
On failure:info
'numFooterLines' element is presentCheck for presence of the 'numFooterLines' element.Document contains 'numFooterLines' element.'numFooterLines' element: 0
5fieldDelimiterValidvalid
Type:metadata
System:knb
On failure:error
Field delimiter is a single characterField delimiters should be one character onlyA single character is expected,A valid fieldDelimiter value was foundhttp://knb.ecoinformatics.org/software/eml/eml-2.1.0/eml-physical.html#fieldDelimiter
6recordDelimiterPresentvalid
Type:metadata
System:knb
On failure:warn
Record delimiter is presentCheck presence of record delimiter. Check that the record delimiter is one of the suggested values.A record delimiter from a list of suggested values: \n, \r, \r\n, #x0A, #x0D, #x0D#x0A\nA valid recordDelimiter value was foundhttp://knb.ecoinformatics.org/software/eml/eml-2.1.0/eml-physical.html#recordDelimiter
7numberOfRecordsPresencevalid
Type:metadata
System:knb
On failure:warn
Is the numberOfRecords element present?Warn the user if the numberOfRecords check is not presentA number of records element is expected for this entitynumberOfRecords element foundThis is a valuable check that we have the correct table.
8entitySizePresencevalid
Type:metadata
System:knb
On failure:warn
Check for presence of an entity size elementLook for entity size element as a prep for checking congruence, and if not present, generate a warn. Note that to be most useful (i.e, to check congruence), entity size should contain the most precise measure of size, which is "byte" (the default unit); however, the presence or name of the entity size unit is NOT checked.Entity size is present. If unit="byte" or unit is omitted (default = byte), then congruence can be checked.Found entity size element with value of 10119629 and size unit specified as 'byte'.Examining the entity size is prep for checking congruence. Including the element is best practice, and if not present, a warn is generated. To be most useful, entity size should contain the most precise measure of size, which is &#34;byte&#34; (the default unit).Include an entity size in bytes Example success: knb-lter-sbc.3.12. Example of size in units other than byte: knb-lter-mcr.6.56.
9integrityChecksumPresencevalid
Type:metadata
System:lter
On failure:warn
A physical/authentication element is present and specifies a method attribute with a value of MD5 or SHA-1Check for presence of a physical/authentication element containing a checksum or hash value for an integrity check (e.g. MD5, SHA-1). Warn if an entity does not have a physical/authentication element, or if none of the physical/authentication elements specify a method attribute with a value of MD5 or SHA-1.At least one physical/authentication element with a method attribute specifying MD5 or SHA-1 and containing a checksum or hash value that can be used to perform an integrity check on the data.truePASTA will use this value to check the integrity of the data it downloads from your site. In addition, PASTA is planning to compare the contributor-supplied checksum/hash value documented in the physical/authentication element to the checksum/hash value of this entity downloaded from previous revisions of this data package. If PASTA already has a copy of this entity, it will be able to avoid an unnecessary download of the entity from your site, resulting in faster processing of the new data package revision when you update it in PASTA.Add a physical/authentication element and store the entity checksum or hash value in it using a method such as MD5 or SHA-1.
10dateTimeFormatStringvalid
Type:metadata
System:knb
On failure:warn
dateTime/formatString specified in metadata is from a preferred set of valuesCertain features of dateTime data formats are preferred, eg, ISO 8601, 4-digit years. This check looks at metadata to see if the dateTime format is in that preferred list.A formatString value that is a member of the preferred set is expected.YYYY-MM-DD hh:mmA preferred format string was found.Modify the dateTime/formatString, selecting from among the preferred values one that best matches the data format
11attributeNamesUniquevalid
Type:metadata
System:knb
On failure:warn
Attribute names are uniqueChecks if attributeName values are unique in the table. Not required by EML.Unique attribute names.trueA good table does not have duplicate column names.EML Best Practices
12displayDownloadDatainfo
Type:data
System:knb
On failure:info
Display downloaded dataDisplay the first kilobyte of data that is downloadedUp to one kilobyte of data should be displayed
13urlReturnsDatavalid
Type:congruency
System:knb
On failure:error
URL returns dataChecks whether a URL returns data. Unless the URL is specified to be function="information", the URL should return the resource for download.A data entity that matches the metadatatruehttp://knb.ecoinformatics.org/software/eml/eml-2.1.0/eml-resource.html#UrlType
14onlineURLsvalid
Type:congruency
System:knb
On failure:error
Online URLs are liveCheck that online URLs return somethingtruetrueSucceeded in accessing URL: <![CDATA[https://ezeml.edirepository.org/user-data/Charles_Kimsal-ec0b143426e3768a0901eeb5c7c10f9f/uploads/Playa%20Water%20Levels/playa_25_water_L1_all.csv]]>
15integrityChecksumvalid
Type:congruency
System:lter
On failure:error
Compare the metadata checksum for an entity to the checksum of the downloaded entityTwo possible responses: valid if checksums match; error if checksums do not match.c9a5512360bf22e16d1c1eab94ac90a7c9a5512360bf22e16d1c1eab94ac90a7Matching checksums will ensure data integrity during upload to the repository.If the found integrity hash value does not match the expected integrity hash value, there may have been a loss of integrity in the data download. Check that the hash method and hash value documented in the metadata are the correct values.
16entitySizeCongruencevalid
Type:congruency
System:knb
On failure:error
Check that the entity size in the Level 0 metadata matches the one PASTA+ generates.Compare raw file size of file to [entity]/physical/size element in metadata. Return error if not matching.1011962910119629Examining the entity size is a method for checking that this is the correct entity.Check the entity size.
17databaseTableCreatedvalid
Type:metadata
System:knb
On failure:error
Database table createdStatus of creating a database tableA database table is expected to be generated from the EML attributes.A database table was generated from the attributes description<![CDATA[CREATE TABLE _26b95ed6d0c5ebcaf3edbc40e207cc61("site" TEXT,"timestamp" TIMESTAMP,"absolutePressure_kPa" FLOAT,"temp_C" FLOAT,"waterLevel_m" FLOAT,"waterLevel_m_filtered" FLOAT,"qflag" TEXT,"comment" TEXT);]]>
18examineRecordDelimiterwarn
Type:congruency
System:knb
On failure:warn
Data are examined and possible record delimiters are displayedIf no record delimiter was specified, we assume that \r\n is the delimiter. Search the first row for other record delimiters and see if other delimiters are found.No other potential record delimiters expected in the first row.Other potential record delimiters were found in the first row: [\r\n]Detection of line endings may be automatic on most systems, so this may not be important.Ensure that record delimiters are correctly specified.http://knb.ecoinformatics.org/software/eml/eml-2.1.0/eml-physical.html#recordDelimiter
19displayFirstInsertRowinfo
Type:data
System:knb
On failure:info
Display first insert rowDisplay the first row of data values to be inserted into the database tableThe first row of data values should be displayed<![CDATA[25, 2016-06-15 00:00, 86.517, 11.722, -0.001, 0, , ]]>
20onlineURLsvalid
Type:congruency
System:knb
On failure:error
Online URLs are liveCheck that online URLs return somethingtruetrueSucceeded in accessing URL: <![CDATA[file:///home/pasta/local/data/knb-lter-jrn.210465001.1/26b95ed6d0c5ebcaf3edbc40e207cc61]]>
21tooFewFieldsvalid
Type:congruency
System:knb
On failure:error
Data does not have fewer fields than metadata attributesCompare number of fields specified in metadata to number of fields found in a data recordNo errors detectedhttp://knb.ecoinformatics.org/software/eml/eml-2.1.0/eml-physical.html#dataFormat
22tooManyFieldsvalid
Type:congruency
System:knb
On failure:error
Data does not have more fields than metadata attributesCompare number of fields specified in metadata to number of fields found in a data recordNo errors detectedhttp://knb.ecoinformatics.org/software/eml/eml-2.1.0/eml-physical.html#dataFormat
23dataLoadStatusvalid
Type:congruency
System:knb
On failure:warn
Data can be loaded into the databaseStatus of loading the data table into a databaseNo errors expected during data loading or data loading was not attempted for this data entityThe data table loaded successfully into a database
24numberOfRecordsvalid
Type:congruency
System:knb
On failure:warn
Number of records in metadata matches number of rows loadedCompare number of records specified in metadata to number of records found in data224397224397The expected number of records (224397) was found in the data table.
25headerRowAttributeNamesinfo
Type:congruency
System:lter
On failure:info
Header row is displayed alongside attribute namesCompare the content of the data header row to the content of EML attribute names.No expectation, information only Customer should evaluate the findings
26dateFormatMatchesvalid
Type:congruency
System:lter
On failure:warn
Date format in metadata matches datadateTime/formatString in attribute metadata is from the preferred list, and the data matches. A non-match generates only a warn.Format string is preferred, and all data values match the format stringData values matched the specified formatString.Dates should be consistently formatted and match the formatString in metadata.
Entity Report
Entity Name: playa_28_water_L1_all
Entity Identifier:
# Identifier Status Quality Check Name Description Expected Found Explanation Suggestion Reference
1entityNameLengthvalid
Type:metadata
System:knb
On failure:warn
Length of entityName is not excessive (less than 100 char)length of entity name is less than 100 charactersentityName value is 100 characters or less21
2entityDescriptionPresentvalid
Type:metadata
System:lter
On failure:warn
An entity description is presentCheck for presence of an entity description.EML Best practices pp. 32-33, "...should have enough information for a user..."trueWith entityName sometimes serving as a file name rather than a title, it is important to be very descriptive here.
3numHeaderLinesPresentinfo
Type:metadata
System:knb
On failure:info
'numHeaderLines' element is presentCheck for presence of the 'numHeaderLines' element.Document contains 'numHeaderLines' element.'numHeaderLines' element: 1
4numFooterLinesPresentinfo
Type:metadata
System:knb
On failure:info
'numFooterLines' element is presentCheck for presence of the 'numFooterLines' element.Document contains 'numFooterLines' element.'numFooterLines' element: 0
5fieldDelimiterValidvalid
Type:metadata
System:knb
On failure:error
Field delimiter is a single characterField delimiters should be one character onlyA single character is expected,A valid fieldDelimiter value was foundhttp://knb.ecoinformatics.org/software/eml/eml-2.1.0/eml-physical.html#fieldDelimiter
6recordDelimiterPresentvalid
Type:metadata
System:knb
On failure:warn
Record delimiter is presentCheck presence of record delimiter. Check that the record delimiter is one of the suggested values.A record delimiter from a list of suggested values: \n, \r, \r\n, #x0A, #x0D, #x0D#x0A\nA valid recordDelimiter value was foundhttp://knb.ecoinformatics.org/software/eml/eml-2.1.0/eml-physical.html#recordDelimiter
7numberOfRecordsPresencevalid
Type:metadata
System:knb
On failure:warn
Is the numberOfRecords element present?Warn the user if the numberOfRecords check is not presentA number of records element is expected for this entitynumberOfRecords element foundThis is a valuable check that we have the correct table.
8entitySizePresencevalid
Type:metadata
System:knb
On failure:warn
Check for presence of an entity size elementLook for entity size element as a prep for checking congruence, and if not present, generate a warn. Note that to be most useful (i.e, to check congruence), entity size should contain the most precise measure of size, which is "byte" (the default unit); however, the presence or name of the entity size unit is NOT checked.Entity size is present. If unit="byte" or unit is omitted (default = byte), then congruence can be checked.Found entity size element with value of 10111307 and size unit specified as 'byte'.Examining the entity size is prep for checking congruence. Including the element is best practice, and if not present, a warn is generated. To be most useful, entity size should contain the most precise measure of size, which is &#34;byte&#34; (the default unit).Include an entity size in bytes Example success: knb-lter-sbc.3.12. Example of size in units other than byte: knb-lter-mcr.6.56.
9integrityChecksumPresencevalid
Type:metadata
System:lter
On failure:warn
A physical/authentication element is present and specifies a method attribute with a value of MD5 or SHA-1Check for presence of a physical/authentication element containing a checksum or hash value for an integrity check (e.g. MD5, SHA-1). Warn if an entity does not have a physical/authentication element, or if none of the physical/authentication elements specify a method attribute with a value of MD5 or SHA-1.At least one physical/authentication element with a method attribute specifying MD5 or SHA-1 and containing a checksum or hash value that can be used to perform an integrity check on the data.truePASTA will use this value to check the integrity of the data it downloads from your site. In addition, PASTA is planning to compare the contributor-supplied checksum/hash value documented in the physical/authentication element to the checksum/hash value of this entity downloaded from previous revisions of this data package. If PASTA already has a copy of this entity, it will be able to avoid an unnecessary download of the entity from your site, resulting in faster processing of the new data package revision when you update it in PASTA.Add a physical/authentication element and store the entity checksum or hash value in it using a method such as MD5 or SHA-1.
10dateTimeFormatStringvalid
Type:metadata
System:knb
On failure:warn
dateTime/formatString specified in metadata is from a preferred set of valuesCertain features of dateTime data formats are preferred, eg, ISO 8601, 4-digit years. This check looks at metadata to see if the dateTime format is in that preferred list.A formatString value that is a member of the preferred set is expected.YYYY-MM-DD hh:mmA preferred format string was found.Modify the dateTime/formatString, selecting from among the preferred values one that best matches the data format
11attributeNamesUniquevalid
Type:metadata
System:knb
On failure:warn
Attribute names are uniqueChecks if attributeName values are unique in the table. Not required by EML.Unique attribute names.trueA good table does not have duplicate column names.EML Best Practices
12displayDownloadDatainfo
Type:data
System:knb
On failure:info
Display downloaded dataDisplay the first kilobyte of data that is downloadedUp to one kilobyte of data should be displayed
13urlReturnsDatavalid
Type:congruency
System:knb
On failure:error
URL returns dataChecks whether a URL returns data. Unless the URL is specified to be function="information", the URL should return the resource for download.A data entity that matches the metadatatruehttp://knb.ecoinformatics.org/software/eml/eml-2.1.0/eml-resource.html#UrlType
14onlineURLsvalid
Type:congruency
System:knb
On failure:error
Online URLs are liveCheck that online URLs return somethingtruetrueSucceeded in accessing URL: <![CDATA[https://ezeml.edirepository.org/user-data/Charles_Kimsal-ec0b143426e3768a0901eeb5c7c10f9f/uploads/Playa%20Water%20Levels/playa_28_water_L1_all.csv]]>
15integrityChecksumvalid
Type:congruency
System:lter
On failure:error
Compare the metadata checksum for an entity to the checksum of the downloaded entityTwo possible responses: valid if checksums match; error if checksums do not match.e45939399844f8b552e81baa7f1f1403e45939399844f8b552e81baa7f1f1403Matching checksums will ensure data integrity during upload to the repository.If the found integrity hash value does not match the expected integrity hash value, there may have been a loss of integrity in the data download. Check that the hash method and hash value documented in the metadata are the correct values.
16entitySizeCongruencevalid
Type:congruency
System:knb
On failure:error
Check that the entity size in the Level 0 metadata matches the one PASTA+ generates.Compare raw file size of file to [entity]/physical/size element in metadata. Return error if not matching.1011130710111307Examining the entity size is a method for checking that this is the correct entity.Check the entity size.
17databaseTableCreatedvalid
Type:metadata
System:knb
On failure:error
Database table createdStatus of creating a database tableA database table is expected to be generated from the EML attributes.A database table was generated from the attributes description<![CDATA[CREATE TABLE _f845405cb987ab2800f38b9766c4bc3b("site" TEXT,"timestamp" TIMESTAMP,"absolutePressure_kPa" FLOAT,"temp_C" FLOAT,"waterLevel_m" FLOAT,"waterLevel_m_filtered" FLOAT,"qflag" TEXT,"comment" TEXT);]]>
18examineRecordDelimiterwarn
Type:congruency
System:knb
On failure:warn
Data are examined and possible record delimiters are displayedIf no record delimiter was specified, we assume that \r\n is the delimiter. Search the first row for other record delimiters and see if other delimiters are found.No other potential record delimiters expected in the first row.Other potential record delimiters were found in the first row: [\r\n]Detection of line endings may be automatic on most systems, so this may not be important.Ensure that record delimiters are correctly specified.http://knb.ecoinformatics.org/software/eml/eml-2.1.0/eml-physical.html#recordDelimiter
19displayFirstInsertRowinfo
Type:data
System:knb
On failure:info
Display first insert rowDisplay the first row of data values to be inserted into the database tableThe first row of data values should be displayed<![CDATA[28, 2016-06-15 00:00, 86.615, 14.134, -0.001, 0, , ]]>
20onlineURLsvalid
Type:congruency
System:knb
On failure:error
Online URLs are liveCheck that online URLs return somethingtruetrueSucceeded in accessing URL: <![CDATA[file:///home/pasta/local/data/knb-lter-jrn.210465001.1/f845405cb987ab2800f38b9766c4bc3b]]>
21tooFewFieldsvalid
Type:congruency
System:knb
On failure:error
Data does not have fewer fields than metadata attributesCompare number of fields specified in metadata to number of fields found in a data recordNo errors detectedhttp://knb.ecoinformatics.org/software/eml/eml-2.1.0/eml-physical.html#dataFormat
22tooManyFieldsvalid
Type:congruency
System:knb
On failure:error
Data does not have more fields than metadata attributesCompare number of fields specified in metadata to number of fields found in a data recordNo errors detectedhttp://knb.ecoinformatics.org/software/eml/eml-2.1.0/eml-physical.html#dataFormat
23dataLoadStatusvalid
Type:congruency
System:knb
On failure:warn
Data can be loaded into the databaseStatus of loading the data table into a databaseNo errors expected during data loading or data loading was not attempted for this data entityThe data table loaded successfully into a database
24numberOfRecordsvalid
Type:congruency
System:knb
On failure:warn
Number of records in metadata matches number of rows loadedCompare number of records specified in metadata to number of records found in data224397224397The expected number of records (224397) was found in the data table.
25headerRowAttributeNamesinfo
Type:congruency
System:lter
On failure:info
Header row is displayed alongside attribute namesCompare the content of the data header row to the content of EML attribute names.No expectation, information only Customer should evaluate the findings
26dateFormatMatchesvalid
Type:congruency
System:lter
On failure:warn
Date format in metadata matches datadateTime/formatString in attribute metadata is from the preferred list, and the data matches. A non-match generates only a warn.Format string is preferred, and all data values match the format stringData values matched the specified formatString.Dates should be consistently formatted and match the formatString in metadata.
Entity Report
Entity Name: playa_29_water_L1_all
Entity Identifier:
# Identifier Status Quality Check Name Description Expected Found Explanation Suggestion Reference
1entityNameLengthvalid
Type:metadata
System:knb
On failure:warn
Length of entityName is not excessive (less than 100 char)length of entity name is less than 100 charactersentityName value is 100 characters or less21
2entityDescriptionPresentvalid
Type:metadata
System:lter
On failure:warn
An entity description is presentCheck for presence of an entity description.EML Best practices pp. 32-33, "...should have enough information for a user..."trueWith entityName sometimes serving as a file name rather than a title, it is important to be very descriptive here.
3numHeaderLinesPresentinfo
Type:metadata
System:knb
On failure:info
'numHeaderLines' element is presentCheck for presence of the 'numHeaderLines' element.Document contains 'numHeaderLines' element.'numHeaderLines' element: 1
4numFooterLinesPresentinfo
Type:metadata
System:knb
On failure:info
'numFooterLines' element is presentCheck for presence of the 'numFooterLines' element.Document contains 'numFooterLines' element.'numFooterLines' element: 0
5fieldDelimiterValidvalid
Type:metadata
System:knb
On failure:error
Field delimiter is a single characterField delimiters should be one character onlyA single character is expected,A valid fieldDelimiter value was foundhttp://knb.ecoinformatics.org/software/eml/eml-2.1.0/eml-physical.html#fieldDelimiter
6recordDelimiterPresentvalid
Type:metadata
System:knb
On failure:warn
Record delimiter is presentCheck presence of record delimiter. Check that the record delimiter is one of the suggested values.A record delimiter from a list of suggested values: \n, \r, \r\n, #x0A, #x0D, #x0D#x0A\nA valid recordDelimiter value was foundhttp://knb.ecoinformatics.org/software/eml/eml-2.1.0/eml-physical.html#recordDelimiter
7numberOfRecordsPresencevalid
Type:metadata
System:knb
On failure:warn
Is the numberOfRecords element present?Warn the user if the numberOfRecords check is not presentA number of records element is expected for this entitynumberOfRecords element foundThis is a valuable check that we have the correct table.
8entitySizePresencevalid
Type:metadata
System:knb
On failure:warn
Check for presence of an entity size elementLook for entity size element as a prep for checking congruence, and if not present, generate a warn. Note that to be most useful (i.e, to check congruence), entity size should contain the most precise measure of size, which is "byte" (the default unit); however, the presence or name of the entity size unit is NOT checked.Entity size is present. If unit="byte" or unit is omitted (default = byte), then congruence can be checked.Found entity size element with value of 10103638 and size unit specified as 'byte'.Examining the entity size is prep for checking congruence. Including the element is best practice, and if not present, a warn is generated. To be most useful, entity size should contain the most precise measure of size, which is &#34;byte&#34; (the default unit).Include an entity size in bytes Example success: knb-lter-sbc.3.12. Example of size in units other than byte: knb-lter-mcr.6.56.
9integrityChecksumPresencevalid
Type:metadata
System:lter
On failure:warn
A physical/authentication element is present and specifies a method attribute with a value of MD5 or SHA-1Check for presence of a physical/authentication element containing a checksum or hash value for an integrity check (e.g. MD5, SHA-1). Warn if an entity does not have a physical/authentication element, or if none of the physical/authentication elements specify a method attribute with a value of MD5 or SHA-1.At least one physical/authentication element with a method attribute specifying MD5 or SHA-1 and containing a checksum or hash value that can be used to perform an integrity check on the data.truePASTA will use this value to check the integrity of the data it downloads from your site. In addition, PASTA is planning to compare the contributor-supplied checksum/hash value documented in the physical/authentication element to the checksum/hash value of this entity downloaded from previous revisions of this data package. If PASTA already has a copy of this entity, it will be able to avoid an unnecessary download of the entity from your site, resulting in faster processing of the new data package revision when you update it in PASTA.Add a physical/authentication element and store the entity checksum or hash value in it using a method such as MD5 or SHA-1.
10dateTimeFormatStringvalid
Type:metadata
System:knb
On failure:warn
dateTime/formatString specified in metadata is from a preferred set of valuesCertain features of dateTime data formats are preferred, eg, ISO 8601, 4-digit years. This check looks at metadata to see if the dateTime format is in that preferred list.A formatString value that is a member of the preferred set is expected.YYYY-MM-DD hh:mmA preferred format string was found.Modify the dateTime/formatString, selecting from among the preferred values one that best matches the data format
11attributeNamesUniquevalid
Type:metadata
System:knb
On failure:warn
Attribute names are uniqueChecks if attributeName values are unique in the table. Not required by EML.Unique attribute names.trueA good table does not have duplicate column names.EML Best Practices
12displayDownloadDatainfo
Type:data
System:knb
On failure:info
Display downloaded dataDisplay the first kilobyte of data that is downloadedUp to one kilobyte of data should be displayed
13urlReturnsDatavalid
Type:congruency
System:knb
On failure:error
URL returns dataChecks whether a URL returns data. Unless the URL is specified to be function="information", the URL should return the resource for download.A data entity that matches the metadatatruehttp://knb.ecoinformatics.org/software/eml/eml-2.1.0/eml-resource.html#UrlType
14onlineURLsvalid
Type:congruency
System:knb
On failure:error
Online URLs are liveCheck that online URLs return somethingtruetrueSucceeded in accessing URL: <![CDATA[https://ezeml.edirepository.org/user-data/Charles_Kimsal-ec0b143426e3768a0901eeb5c7c10f9f/uploads/Playa%20Water%20Levels/playa_29_water_L1_all.csv]]>
15integrityChecksumvalid
Type:congruency
System:lter
On failure:error
Compare the metadata checksum for an entity to the checksum of the downloaded entityTwo possible responses: valid if checksums match; error if checksums do not match.d0b1ab9a91dc4cd7ef8a11ac10cacc01d0b1ab9a91dc4cd7ef8a11ac10cacc01Matching checksums will ensure data integrity during upload to the repository.If the found integrity hash value does not match the expected integrity hash value, there may have been a loss of integrity in the data download. Check that the hash method and hash value documented in the metadata are the correct values.
16entitySizeCongruencevalid
Type:congruency
System:knb
On failure:error
Check that the entity size in the Level 0 metadata matches the one PASTA+ generates.Compare raw file size of file to [entity]/physical/size element in metadata. Return error if not matching.1010363810103638Examining the entity size is a method for checking that this is the correct entity.Check the entity size.
17databaseTableCreatedvalid
Type:metadata
System:knb
On failure:error
Database table createdStatus of creating a database tableA database table is expected to be generated from the EML attributes.A database table was generated from the attributes description<![CDATA[CREATE TABLE _b601a10e0327b75fb8f3881bdd639768("site" TEXT,"timestamp" TIMESTAMP,"absolutePressure_kPa" FLOAT,"temp_C" FLOAT,"waterLevel_m" FLOAT,"waterLevel_m_filtered" FLOAT,"qflag" TEXT,"comment" TEXT);]]>
18examineRecordDelimiterwarn
Type:congruency
System:knb
On failure:warn
Data are examined and possible record delimiters are displayedIf no record delimiter was specified, we assume that \r\n is the delimiter. Search the first row for other record delimiters and see if other delimiters are found.No other potential record delimiters expected in the first row.Other potential record delimiters were found in the first row: [\r\n]Detection of line endings may be automatic on most systems, so this may not be important.Ensure that record delimiters are correctly specified.http://knb.ecoinformatics.org/software/eml/eml-2.1.0/eml-physical.html#recordDelimiter
19displayFirstInsertRowinfo
Type:data
System:knb
On failure:info
Display first insert rowDisplay the first row of data values to be inserted into the database tableThe first row of data values should be displayed<![CDATA[29, 2016-06-15 00:00, 86.394, 15.951, 0.001, 0, , ]]>
20onlineURLsvalid
Type:congruency
System:knb
On failure:error
Online URLs are liveCheck that online URLs return somethingtruetrueSucceeded in accessing URL: <![CDATA[file:///home/pasta/local/data/knb-lter-jrn.210465001.1/b601a10e0327b75fb8f3881bdd639768]]>
21tooFewFieldsvalid
Type:congruency
System:knb
On failure:error
Data does not have fewer fields than metadata attributesCompare number of fields specified in metadata to number of fields found in a data recordNo errors detectedhttp://knb.ecoinformatics.org/software/eml/eml-2.1.0/eml-physical.html#dataFormat
22tooManyFieldsvalid
Type:congruency
System:knb
On failure:error
Data does not have more fields than metadata attributesCompare number of fields specified in metadata to number of fields found in a data recordNo errors detectedhttp://knb.ecoinformatics.org/software/eml/eml-2.1.0/eml-physical.html#dataFormat
23dataLoadStatusvalid
Type:congruency
System:knb
On failure:warn
Data can be loaded into the databaseStatus of loading the data table into a databaseNo errors expected during data loading or data loading was not attempted for this data entityThe data table loaded successfully into a database
24numberOfRecordsvalid
Type:congruency
System:knb
On failure:warn
Number of records in metadata matches number of rows loadedCompare number of records specified in metadata to number of records found in data224296224296The expected number of records (224296) was found in the data table.
25headerRowAttributeNamesinfo
Type:congruency
System:lter
On failure:info
Header row is displayed alongside attribute namesCompare the content of the data header row to the content of EML attribute names.No expectation, information only Customer should evaluate the findings
26dateFormatMatchesvalid
Type:congruency
System:lter
On failure:warn
Date format in metadata matches datadateTime/formatString in attribute metadata is from the preferred list, and the data matches. A non-match generates only a warn.Format string is preferred, and all data values match the format stringData values matched the specified formatString.Dates should be consistently formatted and match the formatString in metadata.
Entity Report
Entity Name: playa_30_water_L1_all
Entity Identifier:
# Identifier Status Quality Check Name Description Expected Found Explanation Suggestion Reference
1entityNameLengthvalid
Type:metadata
System:knb
On failure:warn
Length of entityName is not excessive (less than 100 char)length of entity name is less than 100 charactersentityName value is 100 characters or less21
2entityDescriptionPresentvalid
Type:metadata
System:lter
On failure:warn
An entity description is presentCheck for presence of an entity description.EML Best practices pp. 32-33, "...should have enough information for a user..."trueWith entityName sometimes serving as a file name rather than a title, it is important to be very descriptive here.
3numHeaderLinesPresentinfo
Type:metadata
System:knb
On failure:info
'numHeaderLines' element is presentCheck for presence of the 'numHeaderLines' element.Document contains 'numHeaderLines' element.'numHeaderLines' element: 1
4numFooterLinesPresentinfo
Type:metadata
System:knb
On failure:info
'numFooterLines' element is presentCheck for presence of the 'numFooterLines' element.Document contains 'numFooterLines' element.'numFooterLines' element: 0
5fieldDelimiterValidvalid
Type:metadata
System:knb
On failure:error
Field delimiter is a single characterField delimiters should be one character onlyA single character is expected,A valid fieldDelimiter value was foundhttp://knb.ecoinformatics.org/software/eml/eml-2.1.0/eml-physical.html#fieldDelimiter
6recordDelimiterPresentvalid
Type:metadata
System:knb
On failure:warn
Record delimiter is presentCheck presence of record delimiter. Check that the record delimiter is one of the suggested values.A record delimiter from a list of suggested values: \n, \r, \r\n, #x0A, #x0D, #x0D#x0A\nA valid recordDelimiter value was foundhttp://knb.ecoinformatics.org/software/eml/eml-2.1.0/eml-physical.html#recordDelimiter
7numberOfRecordsPresencevalid
Type:metadata
System:knb
On failure:warn
Is the numberOfRecords element present?Warn the user if the numberOfRecords check is not presentA number of records element is expected for this entitynumberOfRecords element foundThis is a valuable check that we have the correct table.
8entitySizePresencevalid
Type:metadata
System:knb
On failure:warn
Check for presence of an entity size elementLook for entity size element as a prep for checking congruence, and if not present, generate a warn. Note that to be most useful (i.e, to check congruence), entity size should contain the most precise measure of size, which is "byte" (the default unit); however, the presence or name of the entity size unit is NOT checked.Entity size is present. If unit="byte" or unit is omitted (default = byte), then congruence can be checked.Found entity size element with value of 10091424 and size unit specified as 'byte'.Examining the entity size is prep for checking congruence. Including the element is best practice, and if not present, a warn is generated. To be most useful, entity size should contain the most precise measure of size, which is &#34;byte&#34; (the default unit).Include an entity size in bytes Example success: knb-lter-sbc.3.12. Example of size in units other than byte: knb-lter-mcr.6.56.
9integrityChecksumPresencevalid
Type:metadata
System:lter
On failure:warn
A physical/authentication element is present and specifies a method attribute with a value of MD5 or SHA-1Check for presence of a physical/authentication element containing a checksum or hash value for an integrity check (e.g. MD5, SHA-1). Warn if an entity does not have a physical/authentication element, or if none of the physical/authentication elements specify a method attribute with a value of MD5 or SHA-1.At least one physical/authentication element with a method attribute specifying MD5 or SHA-1 and containing a checksum or hash value that can be used to perform an integrity check on the data.truePASTA will use this value to check the integrity of the data it downloads from your site. In addition, PASTA is planning to compare the contributor-supplied checksum/hash value documented in the physical/authentication element to the checksum/hash value of this entity downloaded from previous revisions of this data package. If PASTA already has a copy of this entity, it will be able to avoid an unnecessary download of the entity from your site, resulting in faster processing of the new data package revision when you update it in PASTA.Add a physical/authentication element and store the entity checksum or hash value in it using a method such as MD5 or SHA-1.
10dateTimeFormatStringvalid
Type:metadata
System:knb
On failure:warn
dateTime/formatString specified in metadata is from a preferred set of valuesCertain features of dateTime data formats are preferred, eg, ISO 8601, 4-digit years. This check looks at metadata to see if the dateTime format is in that preferred list.A formatString value that is a member of the preferred set is expected.YYYY-MM-DD hh:mmA preferred format string was found.Modify the dateTime/formatString, selecting from among the preferred values one that best matches the data format
11attributeNamesUniquevalid
Type:metadata
System:knb
On failure:warn
Attribute names are uniqueChecks if attributeName values are unique in the table. Not required by EML.Unique attribute names.trueA good table does not have duplicate column names.EML Best Practices
12displayDownloadDatainfo
Type:data
System:knb
On failure:info
Display downloaded dataDisplay the first kilobyte of data that is downloadedUp to one kilobyte of data should be displayed
13urlReturnsDatavalid
Type:congruency
System:knb
On failure:error
URL returns dataChecks whether a URL returns data. Unless the URL is specified to be function="information", the URL should return the resource for download.A data entity that matches the metadatatruehttp://knb.ecoinformatics.org/software/eml/eml-2.1.0/eml-resource.html#UrlType
14onlineURLsvalid
Type:congruency
System:knb
On failure:error
Online URLs are liveCheck that online URLs return somethingtruetrueSucceeded in accessing URL: <![CDATA[https://ezeml.edirepository.org/user-data/Charles_Kimsal-ec0b143426e3768a0901eeb5c7c10f9f/uploads/Playa%20Water%20Levels/playa_30_water_L1_all.csv]]>
15integrityChecksumvalid
Type:congruency
System:lter
On failure:error
Compare the metadata checksum for an entity to the checksum of the downloaded entityTwo possible responses: valid if checksums match; error if checksums do not match.2619032e816865f54ca6e657a50fd81d2619032e816865f54ca6e657a50fd81dMatching checksums will ensure data integrity during upload to the repository.If the found integrity hash value does not match the expected integrity hash value, there may have been a loss of integrity in the data download. Check that the hash method and hash value documented in the metadata are the correct values.
16entitySizeCongruencevalid
Type:congruency
System:knb
On failure:error
Check that the entity size in the Level 0 metadata matches the one PASTA+ generates.Compare raw file size of file to [entity]/physical/size element in metadata. Return error if not matching.1009142410091424Examining the entity size is a method for checking that this is the correct entity.Check the entity size.
17databaseTableCreatedvalid
Type:metadata
System:knb
On failure:error
Database table createdStatus of creating a database tableA database table is expected to be generated from the EML attributes.A database table was generated from the attributes description<![CDATA[CREATE TABLE _bccf09fc7942f284b8335047f0f95257("site" TEXT,"timestamp" TIMESTAMP,"absolutePressure_kPa" FLOAT,"temp_C" FLOAT,"waterLevel_m" FLOAT,"waterLevel_m_filtered" FLOAT,"qflag" TEXT,"comment" TEXT);]]>
18examineRecordDelimiterwarn
Type:congruency
System:knb
On failure:warn
Data are examined and possible record delimiters are displayedIf no record delimiter was specified, we assume that \r\n is the delimiter. Search the first row for other record delimiters and see if other delimiters are found.No other potential record delimiters expected in the first row.Other potential record delimiters were found in the first row: [\r\n]Detection of line endings may be automatic on most systems, so this may not be important.Ensure that record delimiters are correctly specified.http://knb.ecoinformatics.org/software/eml/eml-2.1.0/eml-physical.html#recordDelimiter
19displayFirstInsertRowinfo
Type:data
System:knb
On failure:info
Display first insert rowDisplay the first row of data values to be inserted into the database tableThe first row of data values should be displayed<![CDATA[30, 2016-06-15 00:00, 86.369, 15.091, 0.002, 0, , ]]>
20onlineURLsvalid
Type:congruency
System:knb
On failure:error
Online URLs are liveCheck that online URLs return somethingtruetrueSucceeded in accessing URL: <![CDATA[file:///home/pasta/local/data/knb-lter-jrn.210465001.1/bccf09fc7942f284b8335047f0f95257]]>
21tooFewFieldsvalid
Type:congruency
System:knb
On failure:error
Data does not have fewer fields than metadata attributesCompare number of fields specified in metadata to number of fields found in a data recordNo errors detectedhttp://knb.ecoinformatics.org/software/eml/eml-2.1.0/eml-physical.html#dataFormat
22tooManyFieldsvalid
Type:congruency
System:knb
On failure:error
Data does not have more fields than metadata attributesCompare number of fields specified in metadata to number of fields found in a data recordNo errors detectedhttp://knb.ecoinformatics.org/software/eml/eml-2.1.0/eml-physical.html#dataFormat
23dataLoadStatusvalid
Type:congruency
System:knb
On failure:warn
Data can be loaded into the databaseStatus of loading the data table into a databaseNo errors expected during data loading or data loading was not attempted for this data entityThe data table loaded successfully into a database
24numberOfRecordsvalid
Type:congruency
System:knb
On failure:warn
Number of records in metadata matches number of rows loadedCompare number of records specified in metadata to number of records found in data224294224294The expected number of records (224294) was found in the data table.
25headerRowAttributeNamesinfo
Type:congruency
System:lter
On failure:info
Header row is displayed alongside attribute namesCompare the content of the data header row to the content of EML attribute names.No expectation, information only Customer should evaluate the findings
26dateFormatMatchesvalid
Type:congruency
System:lter
On failure:warn
Date format in metadata matches datadateTime/formatString in attribute metadata is from the preferred list, and the data matches. A non-match generates only a warn.Format string is preferred, and all data values match the format stringData values matched the specified formatString.Dates should be consistently formatted and match the formatString in metadata.