Data Package Quality Report
PackageId: edi.1337.3
Report Date/Time: 2023-05-03T10:59:03
Dataset Report
# Identifier Status Quality Check Name Description Expected Found Explanation Suggestion Reference
1packageIdPatternvalid
Type:metadata
System:lter
On failure:error
packageId pattern matches "scope.identifier.revision"Check against LTER requirements for scope.identifier.revision'scope.n.m', where 'n' and 'm' are integers and 'scope' is one of an allowed set of valuesedi.1337.3
2emlVersionvalid
Type:metadata
System:lter
On failure:error
EML version 2.1.0 or beyondCheck the EML document declaration for version 2.1.0 or highereml://ecoinformatics.org/eml-2.1.0 or higherhttps://eml.ecoinformatics.org/eml-2.2.0Validity of this quality report is dependent on this check being valid.
3schemaValidvalid
Type:metadata
System:knb
On failure:error
Document is schema-valid EMLCheck document schema validityschema-validDocument validated for namespace: 'https://eml.ecoinformatics.org/eml-2.2.0'Validity of this quality report is dependent on this check being valid.
4parserValidvalid
Type:metadata
System:knb
On failure:error
Document is EML parser-validCheck document using the EML IDs and references parserValidates with the EML IDs and references parserEML IDs and references parser succeededValidity of this quality report is dependent on this check being valid.
5schemaValidDereferencedvalid
Type:metadata
System:lter
On failure:error
Dereferenced document is schema-valid EMLReferences are dereferenced, and the resulting file validatedschema-validDereferenced document validated for namespace: 'https://eml.ecoinformatics.org/eml-2.2.0'Validity of this quality report is dependent on this check being valid.
6keywordPresentvalid
Type:metadata
System:lter
On failure:warn
keyword element is presentChecks to see if at least one keyword is presentPresence of one or more keyword elements11 'keyword' element(s) found
7methodsElementPresentvalid
Type:metadata
System:lter
On failure:warn
A 'methods' element is presentAll datasets should contain a 'methods' element, at a minimum a link to a separate methods doc.presence of 'methods' at one or more xpaths.1 'methods' element(s) foundEML Best Practices, p. 28
8coveragePresentvalid
Type:metadata
System:lter
On failure:warn
coverage element is presentAt least one coverage element should be present in a dataset.At least one of geographicCoverage, taxonomicCoverage, or temporalCoverage is present in the EML.1 'coverage' element(s) found
9geographicCoveragePresentinfo
Type:metadata
System:lter
On failure:info
geographicCoverage is presentCheck that geographicCoverage exists in EML at the dataset level, or at least one entity's level, or at least one attribute's level.geographicCoverage at least at the dataset level.1 'geographicCoverage' element(s) foundMany but not all datasets are appropriate to have spatial coverage.If sampling EML is used within methods, does that obviate geographicCoverage? Or should those sites be repeated or referenced?EML Best Practices v.2, p. 22-23. "One geographicCoverage element should be included, whose boundingCoordinates describe the extent of the data....Additional geographicCoverage elements may be entered at the dataset level if there are significant distances between study sites and it would be confusing if they were grouped into one bounding box." 6 decimal places.
10taxonomicCoveragePresentinfo
Type:metadata
System:lter
On failure:info
taxonomicCoverage is presentCheck that taxonomicCoverage exists in EML at the dataset level, or at least one entity's level, or at least one attribute's level.taxonomicCoverage at least at the dataset level.0 'taxonomicCoverage' element(s) foundOnly when taxa are pertinent to the dataset will they have taxonomicCoverage.Could search title, abstract, keywords for any taxonomic name (huge). Could search keywordType="taxonomic".EML Best Practices v.2, p. 25
11temporalCoveragePresentinfo
Type:metadata
System:lter
On failure:info
temporalCoverage is presentCheck that temporalCoverage exists in EML at the dataset level, or at least one entity's level, or at least one attribute's level.temporalCoverage at least at the dataset level.1 'temporalCoverage' element(s) foundLTER wants to search datasets by time; the best place to search is the dataset level temporal coverage.Most datasets have a temporal range.EML Best Practices v.2, p. 24
12pastaDoiAbsentvalid
Type:metadata
System:lter
On failure:error
An alternateIdentifier with a DOI system attribute that looks like it is generated by PASTA should not be presentReject the data package if it contains an alternateIdentifier DOI that looks like PASTA generated it.No PASTA DOIs are expected to be found in the uploaded data packageNo PASTA DOI alternateIdentifier elements foundPASTA DOI values might appear in an uploaded data package (by various mechanisms). PASTA will assign a DOI after the upload has completed successfully, so an initial one should not be there.
13titleLengthvalid
Type:metadata
System:lter
On failure:warn
Dataset title length is at 5 least words.If the title is shorter than 5 words, it might be insufficient. Title word count between 7 and 20 including prepositions and numbers.Between 7 and 20 words26 words found.EML Best Practices, v.2, p. 13
14fundingPresencewarn
Type:metadata
System:lter
On failure:warn
check to see if funding element is presentChecks to see if the funding element is included.the funding element is expected to be includedfunding not foundSearches will want to display datasets by funder or grant id.Include the funding source, please.
15datasetAbstractLengthvalid
Type:metadata
System:lter
On failure:warn
Dataset abstract element is a minimum of 20 wordsCheck the length of a dataset abstract and warn if less than 20 words.An abstract is 20 words or more.109 words found.EML Best Practices
16duplicateEntityNamevalid
Type:metadata
System:lter
On failure:error
There are no duplicate entity namesChecks that content is not duplicated by other entityName elements in the documententityName is not a duplicate within the documentNo duplicates foundData Manager requires a non-empty, non-duplicate entityName value for every entityDeclare a non-empty entityName and ensure that there are no duplicate entityName values in the document
Entity Report
Entity Name: Daily Air Temperature
Entity Identifier:
# Identifier Status Quality Check Name Description Expected Found Explanation Suggestion Reference
1entityNameLengthvalid
Type:metadata
System:knb
On failure:warn
Length of entityName is not excessive (less than 100 char)length of entity name is less than 100 charactersentityName value is 100 characters or less21
2entityDescriptionPresentvalid
Type:metadata
System:lter
On failure:warn
An entity description is presentCheck for presence of an entity description.EML Best practices pp. 32-33, "...should have enough information for a user..."trueWith entityName sometimes serving as a file name rather than a title, it is important to be very descriptive here.
3numHeaderLinesPresentinfo
Type:metadata
System:knb
On failure:info
'numHeaderLines' element is presentCheck for presence of the 'numHeaderLines' element.Document contains 'numHeaderLines' element.'numHeaderLines' element: 1
4numFooterLinesPresentinfo
Type:metadata
System:knb
On failure:info
'numFooterLines' element is presentCheck for presence of the 'numFooterLines' element.Document contains 'numFooterLines' element.No 'numFooterLines' element foundIf data file contains footer lines, 'numFooterLines' must be specified.Add 'numFooterLines' element if needed.
5fieldDelimiterValidvalid
Type:metadata
System:knb
On failure:error
Field delimiter is a single characterField delimiters should be one character onlyA single character is expected,A valid fieldDelimiter value was foundhttp://knb.ecoinformatics.org/software/eml/eml-2.1.0/eml-physical.html#fieldDelimiter
6recordDelimiterPresentvalid
Type:metadata
System:knb
On failure:warn
Record delimiter is presentCheck presence of record delimiter. Check that the record delimiter is one of the suggested values.A record delimiter from a list of suggested values: \n, \r, \r\n, #x0A, #x0D, #x0D#x0A\r\nA valid recordDelimiter value was foundhttp://knb.ecoinformatics.org/software/eml/eml-2.1.0/eml-physical.html#recordDelimiter
7numberOfRecordsPresencevalid
Type:metadata
System:knb
On failure:warn
Is the numberOfRecords element present?Warn the user if the numberOfRecords check is not presentA number of records element is expected for this entitynumberOfRecords element foundThis is a valuable check that we have the correct table.
8entitySizePresencevalid
Type:metadata
System:knb
On failure:warn
Check for presence of an entity size elementLook for entity size element as a prep for checking congruence, and if not present, generate a warn. Note that to be most useful (i.e, to check congruence), entity size should contain the most precise measure of size, which is "byte" (the default unit); however, the presence or name of the entity size unit is NOT checked.Entity size is present. If unit="byte" or unit is omitted (default = byte), then congruence can be checked.Found entity size element with value of 133072 and size unit specified as 'byte'.Examining the entity size is prep for checking congruence. Including the element is best practice, and if not present, a warn is generated. To be most useful, entity size should contain the most precise measure of size, which is "byte" (the default unit).Include an entity size in bytes Example success: knb-lter-sbc.3.12. Example of size in units other than byte: knb-lter-mcr.6.56.
9integrityChecksumPresencevalid
Type:metadata
System:lter
On failure:warn
A physical/authentication element is present and specifies a method attribute with a value of MD5 or SHA-1Check for presence of a physical/authentication element containing a checksum or hash value for an integrity check (e.g. MD5, SHA-1). Warn if an entity does not have a physical/authentication element, or if none of the physical/authentication elements specify a method attribute with a value of MD5 or SHA-1.At least one physical/authentication element with a method attribute specifying MD5 or SHA-1 and containing a checksum or hash value that can be used to perform an integrity check on the data.truePASTA will use this value to check the integrity of the data it downloads from your site. In addition, PASTA is planning to compare the contributor-supplied checksum/hash value documented in the physical/authentication element to the checksum/hash value of this entity downloaded from previous revisions of this data package. If PASTA already has a copy of this entity, it will be able to avoid an unnecessary download of the entity from your site, resulting in faster processing of the new data package revision when you update it in PASTA.Add a physical/authentication element and store the entity checksum or hash value in it using a method such as MD5 or SHA-1.
10dateTimeFormatStringvalid
Type:metadata
System:knb
On failure:warn
dateTime/formatString specified in metadata is from a preferred set of valuesCertain features of dateTime data formats are preferred, eg, ISO 8601, 4-digit years. This check looks at metadata to see if the dateTime format is in that preferred list.A formatString value that is a member of the preferred set is expected.YYYYA preferred format string was found.Modify the dateTime/formatString, selecting from among the preferred values one that best matches the data format
11dateTimeFormatStringvalid
Type:metadata
System:knb
On failure:warn
dateTime/formatString specified in metadata is from a preferred set of valuesCertain features of dateTime data formats are preferred, eg, ISO 8601, 4-digit years. This check looks at metadata to see if the dateTime format is in that preferred list.A formatString value that is a member of the preferred set is expected.YYYY-MM-DDA preferred format string was found.Modify the dateTime/formatString, selecting from among the preferred values one that best matches the data format
12attributeNamesUniquevalid
Type:metadata
System:knb
On failure:warn
Attribute names are uniqueChecks if attributeName values are unique in the table. Not required by EML.Unique attribute names.trueA good table does not have duplicate column names.EML Best Practices
13displayDownloadDatainfo
Type:data
System:knb
On failure:info
Display downloaded dataDisplay the first kilobyte of data that is downloadedUp to one kilobyte of data should be displayed
14urlReturnsDatavalid
Type:congruency
System:knb
On failure:error
URL returns dataChecks whether a URL returns data. Unless the URL is specified to be function="information", the URL should return the resource for download.A data entity that matches the metadatatruehttp://knb.ecoinformatics.org/software/eml/eml-2.1.0/eml-resource.html#UrlType
15onlineURLsvalid
Type:congruency
System:knb
On failure:error
Online URLs are liveCheck that online URLs return somethingtruetrueSucceeded in accessing URL: <![CDATA[https://ezeml.edirepository.org/user-data/iep-6f022aeb59daaf04006d61b9f2d3a887/uploads/Impact%20of%202021%20Drought%20Management%20on%20Harmful%20Algal%20Blooms%20and%20Aquatic%20Weeds%20in%20the%20Delta/air_temp_daily_dd.csv]]>
16integrityChecksumvalid
Type:congruency
System:lter
On failure:error
Compare the metadata checksum for an entity to the checksum of the downloaded entityTwo possible responses: valid if checksums match; error if checksums do not match.a5f36e27651ed91305274eab10f0810da5f36e27651ed91305274eab10f0810dMatching checksums will ensure data integrity during upload to the repository.If the found integrity hash value does not match the expected integrity hash value, there may have been a loss of integrity in the data download. Check that the hash method and hash value documented in the metadata are the correct values.
17entitySizeCongruencevalid
Type:congruency
System:knb
On failure:error
Check that the entity size in the Level 0 metadata matches the one PASTA+ generates.Compare raw file size of file to [entity]/physical/size element in metadata. Return error if not matching.133072133072Examining the entity size is a method for checking that this is the correct entity.Check the entity size.
18databaseTableCreatedvalid
Type:metadata
System:knb
On failure:error
Database table createdStatus of creating a database tableA database table is expected to be generated from the EML attributes.A database table was generated from the attributes description<![CDATA[CREATE TABLE _f8863c200074ecbd507df6bf51807333("Year" TIMESTAMP,"Date" TIMESTAMP,"AirTemp_Avg" FLOAT,"AirTemp_DD" FLOAT);]]>
19examineRecordDelimitervalid
Type:congruency
System:knb
On failure:warn
Data are examined and possible record delimiters are displayedIf no record delimiter was specified, we assume that \r\n is the delimiter. Search the first row for other record delimiters and see if other delimiters are found.No other potential record delimiters expected in the first row.No other potential record delimiters were detected. A valid record delimiter was previously detectedhttp://knb.ecoinformatics.org/software/eml/eml-2.1.0/eml-physical.html#recordDelimiter
20displayFirstInsertRowinfo
Type:data
System:knb
On failure:info
Display first insert rowDisplay the first row of data values to be inserted into the database tableThe first row of data values should be displayed<![CDATA[2015, 2015-01-01, 3.9888320337881744, 0]]>
21onlineURLsvalid
Type:congruency
System:knb
On failure:error
Online URLs are liveCheck that online URLs return somethingtruetrueSucceeded in accessing URL: <![CDATA[file:///home/pasta/local/data/edi.1337.3/f8863c200074ecbd507df6bf51807333]]>
22tooFewFieldsvalid
Type:congruency
System:knb
On failure:error
Data does not have fewer fields than metadata attributesCompare number of fields specified in metadata to number of fields found in a data recordNo errors detectedhttp://knb.ecoinformatics.org/software/eml/eml-2.1.0/eml-physical.html#dataFormat
23tooManyFieldsvalid
Type:congruency
System:knb
On failure:error
Data does not have more fields than metadata attributesCompare number of fields specified in metadata to number of fields found in a data recordNo errors detectedhttp://knb.ecoinformatics.org/software/eml/eml-2.1.0/eml-physical.html#dataFormat
24dataLoadStatusvalid
Type:congruency
System:knb
On failure:warn
Data can be loaded into the databaseStatus of loading the data table into a databaseNo errors expected during data loading or data loading was not attempted for this data entityThe data table loaded successfully into a database
25numberOfRecordsvalid
Type:congruency
System:knb
On failure:warn
Number of records in metadata matches number of rows loadedCompare number of records specified in metadata to number of records found in data25562556The expected number of records (2556) was found in the data table.
26headerRowAttributeNamesinfo
Type:congruency
System:lter
On failure:info
Header row is displayed alongside attribute namesCompare the content of the data header row to the content of EML attribute names.No expectation, information only Customer should evaluate the findings
27dateFormatMatchesvalid
Type:congruency
System:lter
On failure:warn
Date format in metadata matches datadateTime/formatString in attribute metadata is from the preferred list, and the data matches. A non-match generates only a warn.Format string is preferred, and all data values match the format stringData values matched the specified formatString.Dates should be consistently formatted and match the formatString in metadata.
Entity Report
Entity Name: Discrete Nutrients and Chlorophyll
Entity Identifier:
# Identifier Status Quality Check Name Description Expected Found Explanation Suggestion Reference
1entityNameLengthvalid
Type:metadata
System:knb
On failure:warn
Length of entityName is not excessive (less than 100 char)length of entity name is less than 100 charactersentityName value is 100 characters or less34
2entityDescriptionPresentvalid
Type:metadata
System:lter
On failure:warn
An entity description is presentCheck for presence of an entity description.EML Best practices pp. 32-33, "...should have enough information for a user..."trueWith entityName sometimes serving as a file name rather than a title, it is important to be very descriptive here.
3numHeaderLinesPresentinfo
Type:metadata
System:knb
On failure:info
'numHeaderLines' element is presentCheck for presence of the 'numHeaderLines' element.Document contains 'numHeaderLines' element.'numHeaderLines' element: 1
4numFooterLinesPresentinfo
Type:metadata
System:knb
On failure:info
'numFooterLines' element is presentCheck for presence of the 'numFooterLines' element.Document contains 'numFooterLines' element.No 'numFooterLines' element foundIf data file contains footer lines, &#39;numFooterLines&#39; must be specified.Add 'numFooterLines' element if needed.
5fieldDelimiterValidvalid
Type:metadata
System:knb
On failure:error
Field delimiter is a single characterField delimiters should be one character onlyA single character is expected,A valid fieldDelimiter value was foundhttp://knb.ecoinformatics.org/software/eml/eml-2.1.0/eml-physical.html#fieldDelimiter
6recordDelimiterPresentvalid
Type:metadata
System:knb
On failure:warn
Record delimiter is presentCheck presence of record delimiter. Check that the record delimiter is one of the suggested values.A record delimiter from a list of suggested values: \n, \r, \r\n, #x0A, #x0D, #x0D#x0A\r\nA valid recordDelimiter value was foundhttp://knb.ecoinformatics.org/software/eml/eml-2.1.0/eml-physical.html#recordDelimiter
7numberOfRecordsPresencevalid
Type:metadata
System:knb
On failure:warn
Is the numberOfRecords element present?Warn the user if the numberOfRecords check is not presentA number of records element is expected for this entitynumberOfRecords element foundThis is a valuable check that we have the correct table.
8entitySizePresencevalid
Type:metadata
System:knb
On failure:warn
Check for presence of an entity size elementLook for entity size element as a prep for checking congruence, and if not present, generate a warn. Note that to be most useful (i.e, to check congruence), entity size should contain the most precise measure of size, which is "byte" (the default unit); however, the presence or name of the entity size unit is NOT checked.Entity size is present. If unit="byte" or unit is omitted (default = byte), then congruence can be checked.Found entity size element with value of 350190 and size unit specified as 'byte'.Examining the entity size is prep for checking congruence. Including the element is best practice, and if not present, a warn is generated. To be most useful, entity size should contain the most precise measure of size, which is &#34;byte&#34; (the default unit).Include an entity size in bytes Example success: knb-lter-sbc.3.12. Example of size in units other than byte: knb-lter-mcr.6.56.
9integrityChecksumPresencevalid
Type:metadata
System:lter
On failure:warn
A physical/authentication element is present and specifies a method attribute with a value of MD5 or SHA-1Check for presence of a physical/authentication element containing a checksum or hash value for an integrity check (e.g. MD5, SHA-1). Warn if an entity does not have a physical/authentication element, or if none of the physical/authentication elements specify a method attribute with a value of MD5 or SHA-1.At least one physical/authentication element with a method attribute specifying MD5 or SHA-1 and containing a checksum or hash value that can be used to perform an integrity check on the data.truePASTA will use this value to check the integrity of the data it downloads from your site. In addition, PASTA is planning to compare the contributor-supplied checksum/hash value documented in the physical/authentication element to the checksum/hash value of this entity downloaded from previous revisions of this data package. If PASTA already has a copy of this entity, it will be able to avoid an unnecessary download of the entity from your site, resulting in faster processing of the new data package revision when you update it in PASTA.Add a physical/authentication element and store the entity checksum or hash value in it using a method such as MD5 or SHA-1.
10dateTimeFormatStringvalid
Type:metadata
System:knb
On failure:warn
dateTime/formatString specified in metadata is from a preferred set of valuesCertain features of dateTime data formats are preferred, eg, ISO 8601, 4-digit years. This check looks at metadata to see if the dateTime format is in that preferred list.A formatString value that is a member of the preferred set is expected.YYYY-MM-DDA preferred format string was found.Modify the dateTime/formatString, selecting from among the preferred values one that best matches the data format
11dateTimeFormatStringvalid
Type:metadata
System:knb
On failure:warn
dateTime/formatString specified in metadata is from a preferred set of valuesCertain features of dateTime data formats are preferred, eg, ISO 8601, 4-digit years. This check looks at metadata to see if the dateTime format is in that preferred list.A formatString value that is a member of the preferred set is expected.YYYY-MM-DD hh:mm:ssA preferred format string was found.Modify the dateTime/formatString, selecting from among the preferred values one that best matches the data format
12attributeNamesUniquevalid
Type:metadata
System:knb
On failure:warn
Attribute names are uniqueChecks if attributeName values are unique in the table. Not required by EML.Unique attribute names.trueA good table does not have duplicate column names.EML Best Practices
13displayDownloadDatainfo
Type:data
System:knb
On failure:info
Display downloaded dataDisplay the first kilobyte of data that is downloadedUp to one kilobyte of data should be displayed
14urlReturnsDatavalid
Type:congruency
System:knb
On failure:error
URL returns dataChecks whether a URL returns data. Unless the URL is specified to be function="information", the URL should return the resource for download.A data entity that matches the metadatatruehttp://knb.ecoinformatics.org/software/eml/eml-2.1.0/eml-resource.html#UrlType
15onlineURLsvalid
Type:congruency
System:knb
On failure:error
Online URLs are liveCheck that online URLs return somethingtruetrueSucceeded in accessing URL: <![CDATA[https://ezeml.edirepository.org/user-data/iep-6f022aeb59daaf04006d61b9f2d3a887/uploads/Impact%20of%202021%20Drought%20Management%20on%20Harmful%20Algal%20Blooms%20and%20Aquatic%20Weeds%20in%20the%20Delta/disc_nutr_chla.csv]]>
16integrityChecksumvalid
Type:congruency
System:lter
On failure:error
Compare the metadata checksum for an entity to the checksum of the downloaded entityTwo possible responses: valid if checksums match; error if checksums do not match.ffcf5e75407531b811c2b2387565b9d9ffcf5e75407531b811c2b2387565b9d9Matching checksums will ensure data integrity during upload to the repository.If the found integrity hash value does not match the expected integrity hash value, there may have been a loss of integrity in the data download. Check that the hash method and hash value documented in the metadata are the correct values.
17entitySizeCongruencevalid
Type:congruency
System:knb
On failure:error
Check that the entity size in the Level 0 metadata matches the one PASTA+ generates.Compare raw file size of file to [entity]/physical/size element in metadata. Return error if not matching.350190350190Examining the entity size is a method for checking that this is the correct entity.Check the entity size.
18databaseTableCreatedvalid
Type:metadata
System:knb
On failure:error
Database table createdStatus of creating a database tableA database table is expected to be generated from the EML attributes.A database table was generated from the attributes description<![CDATA[CREATE TABLE _a39bebb12c8bdfbd67be99c05675ce72("Source" TEXT,"Station" TEXT,"Latitude" FLOAT,"Longitude" FLOAT,"Region" TEXT,"Date" TIMESTAMP,"Datetime" TIMESTAMP,"DissAmmonia_Sign" TEXT,"DissAmmonia" FLOAT,"DissNitrateNitrite_Sign" TEXT,"DissNitrateNitrite" FLOAT,"DissOrthophos_Sign" TEXT,"DissOrthophos" FLOAT,"Chlorophyll_Sign" TEXT,"Chlorophyll" FLOAT);]]>
19examineRecordDelimitervalid
Type:congruency
System:knb
On failure:warn
Data are examined and possible record delimiters are displayedIf no record delimiter was specified, we assume that \r\n is the delimiter. Search the first row for other record delimiters and see if other delimiters are found.No other potential record delimiters expected in the first row.No other potential record delimiters were detected. A valid record delimiter was previously detectedhttp://knb.ecoinformatics.org/software/eml/eml-2.1.0/eml-physical.html#recordDelimiter
20displayFirstInsertRowinfo
Type:data
System:knb
On failure:info
Display first insert rowDisplay the first row of data values to be inserted into the database tableThe first row of data values should be displayed<![CDATA[DWR_EMP, C3A, 38.36771, -121.5205, Upper Sac, 2014-01-07, 2014-01-07 10:30:00, =, 0.02, =, 0.08, =, 0.03, =, 3.03]]>
21onlineURLsvalid
Type:congruency
System:knb
On failure:error
Online URLs are liveCheck that online URLs return somethingtruetrueSucceeded in accessing URL: <![CDATA[file:///home/pasta/local/data/edi.1337.3/a39bebb12c8bdfbd67be99c05675ce72]]>
22tooFewFieldsvalid
Type:congruency
System:knb
On failure:error
Data does not have fewer fields than metadata attributesCompare number of fields specified in metadata to number of fields found in a data recordNo errors detectedhttp://knb.ecoinformatics.org/software/eml/eml-2.1.0/eml-physical.html#dataFormat
23tooManyFieldsvalid
Type:congruency
System:knb
On failure:error
Data does not have more fields than metadata attributesCompare number of fields specified in metadata to number of fields found in a data recordNo errors detectedhttp://knb.ecoinformatics.org/software/eml/eml-2.1.0/eml-physical.html#dataFormat
24dataLoadStatusvalid
Type:congruency
System:knb
On failure:warn
Data can be loaded into the databaseStatus of loading the data table into a databaseNo errors expected during data loading or data loading was not attempted for this data entityThe data table loaded successfully into a database
25numberOfRecordsvalid
Type:congruency
System:knb
On failure:warn
Number of records in metadata matches number of rows loadedCompare number of records specified in metadata to number of records found in data31333133The expected number of records (3133) was found in the data table.
26headerRowAttributeNamesinfo
Type:congruency
System:lter
On failure:info
Header row is displayed alongside attribute namesCompare the content of the data header row to the content of EML attribute names.No expectation, information only Customer should evaluate the findings
27dateFormatMatchesvalid
Type:congruency
System:lter
On failure:warn
Date format in metadata matches datadateTime/formatString in attribute metadata is from the preferred list, and the data matches. A non-match generates only a warn.Format string is preferred, and all data values match the format stringData values matched the specified formatString.Dates should be consistently formatted and match the formatString in metadata.
Entity Report
Entity Name: Continuous Water Quality
Entity Identifier:
# Identifier Status Quality Check Name Description Expected Found Explanation Suggestion Reference
1entityNameLengthvalid
Type:metadata
System:knb
On failure:warn
Length of entityName is not excessive (less than 100 char)length of entity name is less than 100 charactersentityName value is 100 characters or less24
2entityDescriptionPresentvalid
Type:metadata
System:lter
On failure:warn
An entity description is presentCheck for presence of an entity description.EML Best practices pp. 32-33, "...should have enough information for a user..."trueWith entityName sometimes serving as a file name rather than a title, it is important to be very descriptive here.
3numHeaderLinesPresentinfo
Type:metadata
System:knb
On failure:info
'numHeaderLines' element is presentCheck for presence of the 'numHeaderLines' element.Document contains 'numHeaderLines' element.'numHeaderLines' element: 1
4numFooterLinesPresentinfo
Type:metadata
System:knb
On failure:info
'numFooterLines' element is presentCheck for presence of the 'numFooterLines' element.Document contains 'numFooterLines' element.No 'numFooterLines' element foundIf data file contains footer lines, &#39;numFooterLines&#39; must be specified.Add 'numFooterLines' element if needed.
5fieldDelimiterValidvalid
Type:metadata
System:knb
On failure:error
Field delimiter is a single characterField delimiters should be one character onlyA single character is expected,A valid fieldDelimiter value was foundhttp://knb.ecoinformatics.org/software/eml/eml-2.1.0/eml-physical.html#fieldDelimiter
6recordDelimiterPresentvalid
Type:metadata
System:knb
On failure:warn
Record delimiter is presentCheck presence of record delimiter. Check that the record delimiter is one of the suggested values.A record delimiter from a list of suggested values: \n, \r, \r\n, #x0A, #x0D, #x0D#x0A\r\nA valid recordDelimiter value was foundhttp://knb.ecoinformatics.org/software/eml/eml-2.1.0/eml-physical.html#recordDelimiter
7numberOfRecordsPresencevalid
Type:metadata
System:knb
On failure:warn
Is the numberOfRecords element present?Warn the user if the numberOfRecords check is not presentA number of records element is expected for this entitynumberOfRecords element foundThis is a valuable check that we have the correct table.
8entitySizePresencevalid
Type:metadata
System:knb
On failure:warn
Check for presence of an entity size elementLook for entity size element as a prep for checking congruence, and if not present, generate a warn. Note that to be most useful (i.e, to check congruence), entity size should contain the most precise measure of size, which is "byte" (the default unit); however, the presence or name of the entity size unit is NOT checked.Entity size is present. If unit="byte" or unit is omitted (default = byte), then congruence can be checked.Found entity size element with value of 736242 and size unit specified as 'byte'.Examining the entity size is prep for checking congruence. Including the element is best practice, and if not present, a warn is generated. To be most useful, entity size should contain the most precise measure of size, which is &#34;byte&#34; (the default unit).Include an entity size in bytes Example success: knb-lter-sbc.3.12. Example of size in units other than byte: knb-lter-mcr.6.56.
9integrityChecksumPresencevalid
Type:metadata
System:lter
On failure:warn
A physical/authentication element is present and specifies a method attribute with a value of MD5 or SHA-1Check for presence of a physical/authentication element containing a checksum or hash value for an integrity check (e.g. MD5, SHA-1). Warn if an entity does not have a physical/authentication element, or if none of the physical/authentication elements specify a method attribute with a value of MD5 or SHA-1.At least one physical/authentication element with a method attribute specifying MD5 or SHA-1 and containing a checksum or hash value that can be used to perform an integrity check on the data.truePASTA will use this value to check the integrity of the data it downloads from your site. In addition, PASTA is planning to compare the contributor-supplied checksum/hash value documented in the physical/authentication element to the checksum/hash value of this entity downloaded from previous revisions of this data package. If PASTA already has a copy of this entity, it will be able to avoid an unnecessary download of the entity from your site, resulting in faster processing of the new data package revision when you update it in PASTA.Add a physical/authentication element and store the entity checksum or hash value in it using a method such as MD5 or SHA-1.
10dateTimeFormatStringvalid
Type:metadata
System:knb
On failure:warn
dateTime/formatString specified in metadata is from a preferred set of valuesCertain features of dateTime data formats are preferred, eg, ISO 8601, 4-digit years. This check looks at metadata to see if the dateTime format is in that preferred list.A formatString value that is a member of the preferred set is expected.YYYY-MM-DDA preferred format string was found.Modify the dateTime/formatString, selecting from among the preferred values one that best matches the data format
11attributeNamesUniquevalid
Type:metadata
System:knb
On failure:warn
Attribute names are uniqueChecks if attributeName values are unique in the table. Not required by EML.Unique attribute names.trueA good table does not have duplicate column names.EML Best Practices
12displayDownloadDatainfo
Type:data
System:knb
On failure:info
Display downloaded dataDisplay the first kilobyte of data that is downloadedUp to one kilobyte of data should be displayed
13urlReturnsDatavalid
Type:congruency
System:knb
On failure:error
URL returns dataChecks whether a URL returns data. Unless the URL is specified to be function="information", the URL should return the resource for download.A data entity that matches the metadatatruehttp://knb.ecoinformatics.org/software/eml/eml-2.1.0/eml-resource.html#UrlType
14onlineURLsvalid
Type:congruency
System:knb
On failure:error
Online URLs are liveCheck that online URLs return somethingtruetrueSucceeded in accessing URL: <![CDATA[https://ezeml.edirepository.org/user-data/iep-6f022aeb59daaf04006d61b9f2d3a887/uploads/Impact%20of%202021%20Drought%20Management%20on%20Harmful%20Algal%20Blooms%20and%20Aquatic%20Weeds%20in%20the%20Delta/cont_wq_daily_avg.csv]]>
15integrityChecksumvalid
Type:congruency
System:lter
On failure:error
Compare the metadata checksum for an entity to the checksum of the downloaded entityTwo possible responses: valid if checksums match; error if checksums do not match.d83a9f4061605cacea3b1229c7e34b50d83a9f4061605cacea3b1229c7e34b50Matching checksums will ensure data integrity during upload to the repository.If the found integrity hash value does not match the expected integrity hash value, there may have been a loss of integrity in the data download. Check that the hash method and hash value documented in the metadata are the correct values.
16entitySizeCongruencevalid
Type:congruency
System:knb
On failure:error
Check that the entity size in the Level 0 metadata matches the one PASTA+ generates.Compare raw file size of file to [entity]/physical/size element in metadata. Return error if not matching.736242736242Examining the entity size is a method for checking that this is the correct entity.Check the entity size.
17databaseTableCreatedvalid
Type:metadata
System:knb
On failure:error
Database table createdStatus of creating a database tableA database table is expected to be generated from the EML attributes.A database table was generated from the attributes description<![CDATA[CREATE TABLE _640462a710748f133ba680ee760fbc6a("Source" TEXT,"Station" TEXT,"Date" TIMESTAMP,"DO" FLOAT,"pH" FLOAT,"Chla" FLOAT);]]>
18examineRecordDelimitervalid
Type:congruency
System:knb
On failure:warn
Data are examined and possible record delimiters are displayedIf no record delimiter was specified, we assume that \r\n is the delimiter. Search the first row for other record delimiters and see if other delimiters are found.No other potential record delimiters expected in the first row.No other potential record delimiters were detected. A valid record delimiter was previously detectedhttp://knb.ecoinformatics.org/software/eml/eml-2.1.0/eml-physical.html#recordDelimiter
19displayFirstInsertRowinfo
Type:data
System:knb
On failure:info
Display first insert rowDisplay the first row of data values to be inserted into the database tableThe first row of data values should be displayed<![CDATA[DWR_NCRO, FAL, 2015-01-01, 10.3709375, NA, 6.15625]]>
20onlineURLsvalid
Type:congruency
System:knb
On failure:error
Online URLs are liveCheck that online URLs return somethingtruetrueSucceeded in accessing URL: <![CDATA[file:///home/pasta/local/data/edi.1337.3/640462a710748f133ba680ee760fbc6a]]>
21tooFewFieldsvalid
Type:congruency
System:knb
On failure:error
Data does not have fewer fields than metadata attributesCompare number of fields specified in metadata to number of fields found in a data recordNo errors detectedhttp://knb.ecoinformatics.org/software/eml/eml-2.1.0/eml-physical.html#dataFormat
22tooManyFieldsvalid
Type:congruency
System:knb
On failure:error
Data does not have more fields than metadata attributesCompare number of fields specified in metadata to number of fields found in a data recordNo errors detectedhttp://knb.ecoinformatics.org/software/eml/eml-2.1.0/eml-physical.html#dataFormat
23dataLoadStatusvalid
Type:congruency
System:knb
On failure:warn
Data can be loaded into the databaseStatus of loading the data table into a databaseNo errors expected during data loading or data loading was not attempted for this data entityThe data table loaded successfully into a database
24numberOfRecordsvalid
Type:congruency
System:knb
On failure:warn
Number of records in metadata matches number of rows loadedCompare number of records specified in metadata to number of records found in data1327313273The expected number of records (13273) was found in the data table.
25headerRowAttributeNamesinfo
Type:congruency
System:lter
On failure:info
Header row is displayed alongside attribute namesCompare the content of the data header row to the content of EML attribute names.No expectation, information only Customer should evaluate the findings
26dateFormatMatchesvalid
Type:congruency
System:lter
On failure:warn
Date format in metadata matches datadateTime/formatString in attribute metadata is from the preferred list, and the data matches. A non-match generates only a warn.Format string is preferred, and all data values match the format stringData values matched the specified formatString.Dates should be consistently formatted and match the formatString in metadata.
Entity Report
Entity Name: Daily water tempertaure
Entity Identifier:
# Identifier Status Quality Check Name Description Expected Found Explanation Suggestion Reference
1entityNameLengthvalid
Type:metadata
System:knb
On failure:warn
Length of entityName is not excessive (less than 100 char)length of entity name is less than 100 charactersentityName value is 100 characters or less23
2entityDescriptionPresentvalid
Type:metadata
System:lter
On failure:warn
An entity description is presentCheck for presence of an entity description.EML Best practices pp. 32-33, "...should have enough information for a user..."trueWith entityName sometimes serving as a file name rather than a title, it is important to be very descriptive here.
3numHeaderLinesPresentinfo
Type:metadata
System:knb
On failure:info
'numHeaderLines' element is presentCheck for presence of the 'numHeaderLines' element.Document contains 'numHeaderLines' element.'numHeaderLines' element: 1
4numFooterLinesPresentinfo
Type:metadata
System:knb
On failure:info
'numFooterLines' element is presentCheck for presence of the 'numFooterLines' element.Document contains 'numFooterLines' element.No 'numFooterLines' element foundIf data file contains footer lines, &#39;numFooterLines&#39; must be specified.Add 'numFooterLines' element if needed.
5fieldDelimiterValidvalid
Type:metadata
System:knb
On failure:error
Field delimiter is a single characterField delimiters should be one character onlyA single character is expected,A valid fieldDelimiter value was foundhttp://knb.ecoinformatics.org/software/eml/eml-2.1.0/eml-physical.html#fieldDelimiter
6recordDelimiterPresentvalid
Type:metadata
System:knb
On failure:warn
Record delimiter is presentCheck presence of record delimiter. Check that the record delimiter is one of the suggested values.A record delimiter from a list of suggested values: \n, \r, \r\n, #x0A, #x0D, #x0D#x0A\r\nA valid recordDelimiter value was foundhttp://knb.ecoinformatics.org/software/eml/eml-2.1.0/eml-physical.html#recordDelimiter
7numberOfRecordsPresencevalid
Type:metadata
System:knb
On failure:warn
Is the numberOfRecords element present?Warn the user if the numberOfRecords check is not presentA number of records element is expected for this entitynumberOfRecords element foundThis is a valuable check that we have the correct table.
8entitySizePresencevalid
Type:metadata
System:knb
On failure:warn
Check for presence of an entity size elementLook for entity size element as a prep for checking congruence, and if not present, generate a warn. Note that to be most useful (i.e, to check congruence), entity size should contain the most precise measure of size, which is "byte" (the default unit); however, the presence or name of the entity size unit is NOT checked.Entity size is present. If unit="byte" or unit is omitted (default = byte), then congruence can be checked.Found entity size element with value of 120829 and size unit specified as 'byte'.Examining the entity size is prep for checking congruence. Including the element is best practice, and if not present, a warn is generated. To be most useful, entity size should contain the most precise measure of size, which is &#34;byte&#34; (the default unit).Include an entity size in bytes Example success: knb-lter-sbc.3.12. Example of size in units other than byte: knb-lter-mcr.6.56.
9integrityChecksumPresencevalid
Type:metadata
System:lter
On failure:warn
A physical/authentication element is present and specifies a method attribute with a value of MD5 or SHA-1Check for presence of a physical/authentication element containing a checksum or hash value for an integrity check (e.g. MD5, SHA-1). Warn if an entity does not have a physical/authentication element, or if none of the physical/authentication elements specify a method attribute with a value of MD5 or SHA-1.At least one physical/authentication element with a method attribute specifying MD5 or SHA-1 and containing a checksum or hash value that can be used to perform an integrity check on the data.truePASTA will use this value to check the integrity of the data it downloads from your site. In addition, PASTA is planning to compare the contributor-supplied checksum/hash value documented in the physical/authentication element to the checksum/hash value of this entity downloaded from previous revisions of this data package. If PASTA already has a copy of this entity, it will be able to avoid an unnecessary download of the entity from your site, resulting in faster processing of the new data package revision when you update it in PASTA.Add a physical/authentication element and store the entity checksum or hash value in it using a method such as MD5 or SHA-1.
10dateTimeFormatStringvalid
Type:metadata
System:knb
On failure:warn
dateTime/formatString specified in metadata is from a preferred set of valuesCertain features of dateTime data formats are preferred, eg, ISO 8601, 4-digit years. This check looks at metadata to see if the dateTime format is in that preferred list.A formatString value that is a member of the preferred set is expected.YYYYA preferred format string was found.Modify the dateTime/formatString, selecting from among the preferred values one that best matches the data format
11dateTimeFormatStringvalid
Type:metadata
System:knb
On failure:warn
dateTime/formatString specified in metadata is from a preferred set of valuesCertain features of dateTime data formats are preferred, eg, ISO 8601, 4-digit years. This check looks at metadata to see if the dateTime format is in that preferred list.A formatString value that is a member of the preferred set is expected.YYYY-MM-DDA preferred format string was found.Modify the dateTime/formatString, selecting from among the preferred values one that best matches the data format
12attributeNamesUniquevalid
Type:metadata
System:knb
On failure:warn
Attribute names are uniqueChecks if attributeName values are unique in the table. Not required by EML.Unique attribute names.trueA good table does not have duplicate column names.EML Best Practices
13displayDownloadDatainfo
Type:data
System:knb
On failure:info
Display downloaded dataDisplay the first kilobyte of data that is downloadedUp to one kilobyte of data should be displayed
14urlReturnsDatavalid
Type:congruency
System:knb
On failure:error
URL returns dataChecks whether a URL returns data. Unless the URL is specified to be function="information", the URL should return the resource for download.A data entity that matches the metadatatruehttp://knb.ecoinformatics.org/software/eml/eml-2.1.0/eml-resource.html#UrlType
15onlineURLsvalid
Type:congruency
System:knb
On failure:error
Online URLs are liveCheck that online URLs return somethingtruetrueSucceeded in accessing URL: <![CDATA[https://ezeml.edirepository.org/user-data/iep-6f022aeb59daaf04006d61b9f2d3a887/uploads/Impact%20of%202021%20Drought%20Management%20on%20Harmful%20Algal%20Blooms%20and%20Aquatic%20Weeds%20in%20the%20Delta/wtr_temp_daily_dd.csv]]>
16integrityChecksumvalid
Type:congruency
System:lter
On failure:error
Compare the metadata checksum for an entity to the checksum of the downloaded entityTwo possible responses: valid if checksums match; error if checksums do not match.fbc7239db73baa0d22a02c20786dff26fbc7239db73baa0d22a02c20786dff26Matching checksums will ensure data integrity during upload to the repository.If the found integrity hash value does not match the expected integrity hash value, there may have been a loss of integrity in the data download. Check that the hash method and hash value documented in the metadata are the correct values.
17entitySizeCongruencevalid
Type:congruency
System:knb
On failure:error
Check that the entity size in the Level 0 metadata matches the one PASTA+ generates.Compare raw file size of file to [entity]/physical/size element in metadata. Return error if not matching.120829120829Examining the entity size is a method for checking that this is the correct entity.Check the entity size.
18databaseTableCreatedvalid
Type:metadata
System:knb
On failure:error
Database table createdStatus of creating a database tableA database table is expected to be generated from the EML attributes.A database table was generated from the attributes description<![CDATA[CREATE TABLE _d0efea3283984c56603f52810aebbcb1("Year" TIMESTAMP,"Date" TIMESTAMP,"WaterTemp_Avg" FLOAT,"WaterTemp_DD" FLOAT);]]>
19examineRecordDelimitervalid
Type:congruency
System:knb
On failure:warn
Data are examined and possible record delimiters are displayedIf no record delimiter was specified, we assume that \r\n is the delimiter. Search the first row for other record delimiters and see if other delimiters are found.No other potential record delimiters expected in the first row.No other potential record delimiters were detected. A valid record delimiter was previously detectedhttp://knb.ecoinformatics.org/software/eml/eml-2.1.0/eml-physical.html#recordDelimiter
20displayFirstInsertRowinfo
Type:data
System:knb
On failure:info
Display first insert rowDisplay the first row of data values to be inserted into the database tableThe first row of data values should be displayed<![CDATA[2015, 2015-01-01, 8.6671875, 0]]>
21onlineURLsvalid
Type:congruency
System:knb
On failure:error
Online URLs are liveCheck that online URLs return somethingtruetrueSucceeded in accessing URL: <![CDATA[file:///home/pasta/local/data/edi.1337.3/d0efea3283984c56603f52810aebbcb1]]>
22tooFewFieldsvalid
Type:congruency
System:knb
On failure:error
Data does not have fewer fields than metadata attributesCompare number of fields specified in metadata to number of fields found in a data recordNo errors detectedhttp://knb.ecoinformatics.org/software/eml/eml-2.1.0/eml-physical.html#dataFormat
23tooManyFieldsvalid
Type:congruency
System:knb
On failure:error
Data does not have more fields than metadata attributesCompare number of fields specified in metadata to number of fields found in a data recordNo errors detectedhttp://knb.ecoinformatics.org/software/eml/eml-2.1.0/eml-physical.html#dataFormat
24dataLoadStatusvalid
Type:congruency
System:knb
On failure:warn
Data can be loaded into the databaseStatus of loading the data table into a databaseNo errors expected during data loading or data loading was not attempted for this data entityThe data table loaded successfully into a database
25numberOfRecordsvalid
Type:congruency
System:knb
On failure:warn
Number of records in metadata matches number of rows loadedCompare number of records specified in metadata to number of records found in data25572557The expected number of records (2557) was found in the data table.
26headerRowAttributeNamesinfo
Type:congruency
System:lter
On failure:info
Header row is displayed alongside attribute namesCompare the content of the data header row to the content of EML attribute names.No expectation, information only Customer should evaluate the findings
27dateFormatMatchesvalid
Type:congruency
System:lter
On failure:warn
Date format in metadata matches datadateTime/formatString in attribute metadata is from the preferred list, and the data matches. A non-match generates only a warn.Format string is preferred, and all data values match the format stringData values matched the specified formatString.Dates should be consistently formatted and match the formatString in metadata.
Entity Report
Entity Name: Cyanobacteria Satellite data
Entity Identifier:
# Identifier Status Quality Check Name Description Expected Found Explanation Suggestion Reference
1entityNameLengthvalid
Type:metadata
System:knb
On failure:warn
Length of entityName is not excessive (less than 100 char)length of entity name is less than 100 charactersentityName value is 100 characters or less28
2entityDescriptionPresentvalid
Type:metadata
System:lter
On failure:warn
An entity description is presentCheck for presence of an entity description.EML Best practices pp. 32-33, "...should have enough information for a user..."trueWith entityName sometimes serving as a file name rather than a title, it is important to be very descriptive here.
3numHeaderLinesPresentinfo
Type:metadata
System:knb
On failure:info
'numHeaderLines' element is presentCheck for presence of the 'numHeaderLines' element.Document contains 'numHeaderLines' element.'numHeaderLines' element: 1
4numFooterLinesPresentinfo
Type:metadata
System:knb
On failure:info
'numFooterLines' element is presentCheck for presence of the 'numFooterLines' element.Document contains 'numFooterLines' element.No 'numFooterLines' element foundIf data file contains footer lines, &#39;numFooterLines&#39; must be specified.Add 'numFooterLines' element if needed.
5fieldDelimiterValidvalid
Type:metadata
System:knb
On failure:error
Field delimiter is a single characterField delimiters should be one character onlyA single character is expected,A valid fieldDelimiter value was foundhttp://knb.ecoinformatics.org/software/eml/eml-2.1.0/eml-physical.html#fieldDelimiter
6recordDelimiterPresentvalid
Type:metadata
System:knb
On failure:warn
Record delimiter is presentCheck presence of record delimiter. Check that the record delimiter is one of the suggested values.A record delimiter from a list of suggested values: \n, \r, \r\n, #x0A, #x0D, #x0D#x0A\r\nA valid recordDelimiter value was foundhttp://knb.ecoinformatics.org/software/eml/eml-2.1.0/eml-physical.html#recordDelimiter
7numberOfRecordsPresencevalid
Type:metadata
System:knb
On failure:warn
Is the numberOfRecords element present?Warn the user if the numberOfRecords check is not presentA number of records element is expected for this entitynumberOfRecords element foundThis is a valuable check that we have the correct table.
8entitySizePresencevalid
Type:metadata
System:knb
On failure:warn
Check for presence of an entity size elementLook for entity size element as a prep for checking congruence, and if not present, generate a warn. Note that to be most useful (i.e, to check congruence), entity size should contain the most precise measure of size, which is "byte" (the default unit); however, the presence or name of the entity size unit is NOT checked.Entity size is present. If unit="byte" or unit is omitted (default = byte), then congruence can be checked.Found entity size element with value of 34267 and size unit specified as 'byte'.Examining the entity size is prep for checking congruence. Including the element is best practice, and if not present, a warn is generated. To be most useful, entity size should contain the most precise measure of size, which is &#34;byte&#34; (the default unit).Include an entity size in bytes Example success: knb-lter-sbc.3.12. Example of size in units other than byte: knb-lter-mcr.6.56.
9integrityChecksumPresencevalid
Type:metadata
System:lter
On failure:warn
A physical/authentication element is present and specifies a method attribute with a value of MD5 or SHA-1Check for presence of a physical/authentication element containing a checksum or hash value for an integrity check (e.g. MD5, SHA-1). Warn if an entity does not have a physical/authentication element, or if none of the physical/authentication elements specify a method attribute with a value of MD5 or SHA-1.At least one physical/authentication element with a method attribute specifying MD5 or SHA-1 and containing a checksum or hash value that can be used to perform an integrity check on the data.truePASTA will use this value to check the integrity of the data it downloads from your site. In addition, PASTA is planning to compare the contributor-supplied checksum/hash value documented in the physical/authentication element to the checksum/hash value of this entity downloaded from previous revisions of this data package. If PASTA already has a copy of this entity, it will be able to avoid an unnecessary download of the entity from your site, resulting in faster processing of the new data package revision when you update it in PASTA.Add a physical/authentication element and store the entity checksum or hash value in it using a method such as MD5 or SHA-1.
10dateTimeFormatStringvalid
Type:metadata
System:knb
On failure:warn
dateTime/formatString specified in metadata is from a preferred set of valuesCertain features of dateTime data formats are preferred, eg, ISO 8601, 4-digit years. This check looks at metadata to see if the dateTime format is in that preferred list.A formatString value that is a member of the preferred set is expected.YYYY-MM-DDA preferred format string was found.Modify the dateTime/formatString, selecting from among the preferred values one that best matches the data format
11attributeNamesUniquevalid
Type:metadata
System:knb
On failure:warn
Attribute names are uniqueChecks if attributeName values are unique in the table. Not required by EML.Unique attribute names.trueA good table does not have duplicate column names.EML Best Practices
12displayDownloadDatainfo
Type:data
System:knb
On failure:info
Display downloaded dataDisplay the first kilobyte of data that is downloadedUp to one kilobyte of data should be displayed
13urlReturnsDatavalid
Type:congruency
System:knb
On failure:error
URL returns dataChecks whether a URL returns data. Unless the URL is specified to be function="information", the URL should return the resource for download.A data entity that matches the metadatatruehttp://knb.ecoinformatics.org/software/eml/eml-2.1.0/eml-resource.html#UrlType
14onlineURLsvalid
Type:congruency
System:knb
On failure:error
Online URLs are liveCheck that online URLs return somethingtruetrueSucceeded in accessing URL: <![CDATA[https://ezeml.edirepository.org/user-data/iep-6f022aeb59daaf04006d61b9f2d3a887/uploads/Impact%20of%202021%20Drought%20Management%20on%20Harmful%20Algal%20Blooms%20and%20Aquatic%20Weeds%20in%20the%20Delta/hab_sat_ow_delta.csv]]>
15integrityChecksumvalid
Type:congruency
System:lter
On failure:error
Compare the metadata checksum for an entity to the checksum of the downloaded entityTwo possible responses: valid if checksums match; error if checksums do not match.e7eaeea4f9707dcb25aacb4816f86157e7eaeea4f9707dcb25aacb4816f86157Matching checksums will ensure data integrity during upload to the repository.If the found integrity hash value does not match the expected integrity hash value, there may have been a loss of integrity in the data download. Check that the hash method and hash value documented in the metadata are the correct values.
16entitySizeCongruencevalid
Type:congruency
System:knb
On failure:error
Check that the entity size in the Level 0 metadata matches the one PASTA+ generates.Compare raw file size of file to [entity]/physical/size element in metadata. Return error if not matching.3426734267Examining the entity size is a method for checking that this is the correct entity.Check the entity size.
17databaseTableCreatedvalid
Type:metadata
System:knb
On failure:error
Database table createdStatus of creating a database tableA database table is expected to be generated from the EML attributes.A database table was generated from the attributes description<![CDATA[CREATE TABLE _b01bc008ac1a0fe6be945939f297a5c2("Date" TIMESTAMP,"Region" TEXT,"NonDetect" FLOAT,"Low" FLOAT,"Moderate" FLOAT,"High" FLOAT,"VeryHigh" FLOAT,"InvalidOrMissing" FLOAT);]]>
18examineRecordDelimitervalid
Type:congruency
System:knb
On failure:warn
Data are examined and possible record delimiters are displayedIf no record delimiter was specified, we assume that \r\n is the delimiter. Search the first row for other record delimiters and see if other delimiters are found.No other potential record delimiters expected in the first row.No other potential record delimiters were detected. A valid record delimiter was previously detectedhttp://knb.ecoinformatics.org/software/eml/eml-2.1.0/eml-physical.html#recordDelimiter
19displayFirstInsertRowinfo
Type:data
System:knb
On failure:info
Display first insert rowDisplay the first row of data values to be inserted into the database tableThe first row of data values should be displayed<![CDATA[2019-06-03, Franks Tract, 130, 0, 0, 0, 0, 36]]>
20onlineURLsvalid
Type:congruency
System:knb
On failure:error
Online URLs are liveCheck that online URLs return somethingtruetrueSucceeded in accessing URL: <![CDATA[file:///home/pasta/local/data/edi.1337.3/b01bc008ac1a0fe6be945939f297a5c2]]>
21tooFewFieldsvalid
Type:congruency
System:knb
On failure:error
Data does not have fewer fields than metadata attributesCompare number of fields specified in metadata to number of fields found in a data recordNo errors detectedhttp://knb.ecoinformatics.org/software/eml/eml-2.1.0/eml-physical.html#dataFormat
22tooManyFieldsvalid
Type:congruency
System:knb
On failure:error
Data does not have more fields than metadata attributesCompare number of fields specified in metadata to number of fields found in a data recordNo errors detectedhttp://knb.ecoinformatics.org/software/eml/eml-2.1.0/eml-physical.html#dataFormat
23dataLoadStatusvalid
Type:congruency
System:knb
On failure:warn
Data can be loaded into the databaseStatus of loading the data table into a databaseNo errors expected during data loading or data loading was not attempted for this data entityThe data table loaded successfully into a database
24numberOfRecordsvalid
Type:congruency
System:knb
On failure:warn
Number of records in metadata matches number of rows loadedCompare number of records specified in metadata to number of records found in data800800The expected number of records (800) was found in the data table.
25headerRowAttributeNamesinfo
Type:congruency
System:lter
On failure:info
Header row is displayed alongside attribute namesCompare the content of the data header row to the content of EML attribute names.No expectation, information only Customer should evaluate the findings
26dateFormatMatchesvalid
Type:congruency
System:lter
On failure:warn
Date format in metadata matches datadateTime/formatString in attribute metadata is from the preferred list, and the data matches. A non-match generates only a warn.Format string is preferred, and all data values match the format stringData values matched the specified formatString.Dates should be consistently formatted and match the formatString in metadata.
Entity Report
Entity Name: HAB Incident Reports
Entity Identifier:
# Identifier Status Quality Check Name Description Expected Found Explanation Suggestion Reference
1entityNameLengthvalid
Type:metadata
System:knb
On failure:warn
Length of entityName is not excessive (less than 100 char)length of entity name is less than 100 charactersentityName value is 100 characters or less20
2entityDescriptionPresentvalid
Type:metadata
System:lter
On failure:warn
An entity description is presentCheck for presence of an entity description.EML Best practices pp. 32-33, "...should have enough information for a user..."trueWith entityName sometimes serving as a file name rather than a title, it is important to be very descriptive here.
3numHeaderLinesPresentinfo
Type:metadata
System:knb
On failure:info
'numHeaderLines' element is presentCheck for presence of the 'numHeaderLines' element.Document contains 'numHeaderLines' element.'numHeaderLines' element: 1
4numFooterLinesPresentinfo
Type:metadata
System:knb
On failure:info
'numFooterLines' element is presentCheck for presence of the 'numFooterLines' element.Document contains 'numFooterLines' element.No 'numFooterLines' element foundIf data file contains footer lines, &#39;numFooterLines&#39; must be specified.Add 'numFooterLines' element if needed.
5fieldDelimiterValidvalid
Type:metadata
System:knb
On failure:error
Field delimiter is a single characterField delimiters should be one character onlyA single character is expected,A valid fieldDelimiter value was foundhttp://knb.ecoinformatics.org/software/eml/eml-2.1.0/eml-physical.html#fieldDelimiter
6recordDelimiterPresentvalid
Type:metadata
System:knb
On failure:warn
Record delimiter is presentCheck presence of record delimiter. Check that the record delimiter is one of the suggested values.A record delimiter from a list of suggested values: \n, \r, \r\n, #x0A, #x0D, #x0D#x0A\r\nA valid recordDelimiter value was foundhttp://knb.ecoinformatics.org/software/eml/eml-2.1.0/eml-physical.html#recordDelimiter
7numberOfRecordsPresencevalid
Type:metadata
System:knb
On failure:warn
Is the numberOfRecords element present?Warn the user if the numberOfRecords check is not presentA number of records element is expected for this entitynumberOfRecords element foundThis is a valuable check that we have the correct table.
8entitySizePresencevalid
Type:metadata
System:knb
On failure:warn
Check for presence of an entity size elementLook for entity size element as a prep for checking congruence, and if not present, generate a warn. Note that to be most useful (i.e, to check congruence), entity size should contain the most precise measure of size, which is "byte" (the default unit); however, the presence or name of the entity size unit is NOT checked.Entity size is present. If unit="byte" or unit is omitted (default = byte), then congruence can be checked.Found entity size element with value of 2043 and size unit specified as 'byte'.Examining the entity size is prep for checking congruence. Including the element is best practice, and if not present, a warn is generated. To be most useful, entity size should contain the most precise measure of size, which is &#34;byte&#34; (the default unit).Include an entity size in bytes Example success: knb-lter-sbc.3.12. Example of size in units other than byte: knb-lter-mcr.6.56.
9integrityChecksumPresencevalid
Type:metadata
System:lter
On failure:warn
A physical/authentication element is present and specifies a method attribute with a value of MD5 or SHA-1Check for presence of a physical/authentication element containing a checksum or hash value for an integrity check (e.g. MD5, SHA-1). Warn if an entity does not have a physical/authentication element, or if none of the physical/authentication elements specify a method attribute with a value of MD5 or SHA-1.At least one physical/authentication element with a method attribute specifying MD5 or SHA-1 and containing a checksum or hash value that can be used to perform an integrity check on the data.truePASTA will use this value to check the integrity of the data it downloads from your site. In addition, PASTA is planning to compare the contributor-supplied checksum/hash value documented in the physical/authentication element to the checksum/hash value of this entity downloaded from previous revisions of this data package. If PASTA already has a copy of this entity, it will be able to avoid an unnecessary download of the entity from your site, resulting in faster processing of the new data package revision when you update it in PASTA.Add a physical/authentication element and store the entity checksum or hash value in it using a method such as MD5 or SHA-1.
10dateTimeFormatStringvalid
Type:metadata
System:knb
On failure:warn
dateTime/formatString specified in metadata is from a preferred set of valuesCertain features of dateTime data formats are preferred, eg, ISO 8601, 4-digit years. This check looks at metadata to see if the dateTime format is in that preferred list.A formatString value that is a member of the preferred set is expected.YYYY-MM-DDA preferred format string was found.Modify the dateTime/formatString, selecting from among the preferred values one that best matches the data format
11attributeNamesUniquevalid
Type:metadata
System:knb
On failure:warn
Attribute names are uniqueChecks if attributeName values are unique in the table. Not required by EML.Unique attribute names.trueA good table does not have duplicate column names.EML Best Practices
12displayDownloadDatainfo
Type:data
System:knb
On failure:info
Display downloaded dataDisplay the first kilobyte of data that is downloadedUp to one kilobyte of data should be displayed
13urlReturnsDatavalid
Type:congruency
System:knb
On failure:error
URL returns dataChecks whether a URL returns data. Unless the URL is specified to be function="information", the URL should return the resource for download.A data entity that matches the metadatatruehttp://knb.ecoinformatics.org/software/eml/eml-2.1.0/eml-resource.html#UrlType
14onlineURLsvalid
Type:congruency
System:knb
On failure:error
Online URLs are liveCheck that online URLs return somethingtruetrueSucceeded in accessing URL: <![CDATA[https://ezeml.edirepository.org/user-data/iep-6f022aeb59daaf04006d61b9f2d3a887/uploads/Impact%20of%202021%20Drought%20Management%20on%20Harmful%20Algal%20Blooms%20and%20Aquatic%20Weeds%20in%20the%20Delta/hab_incidents.csv]]>
15integrityChecksumvalid
Type:congruency
System:lter
On failure:error
Compare the metadata checksum for an entity to the checksum of the downloaded entityTwo possible responses: valid if checksums match; error if checksums do not match.bf7302b70c8640ea17e3307629a7fdbfbf7302b70c8640ea17e3307629a7fdbfMatching checksums will ensure data integrity during upload to the repository.If the found integrity hash value does not match the expected integrity hash value, there may have been a loss of integrity in the data download. Check that the hash method and hash value documented in the metadata are the correct values.
16entitySizeCongruencevalid
Type:congruency
System:knb
On failure:error
Check that the entity size in the Level 0 metadata matches the one PASTA+ generates.Compare raw file size of file to [entity]/physical/size element in metadata. Return error if not matching.20432043Examining the entity size is a method for checking that this is the correct entity.Check the entity size.
17databaseTableCreatedvalid
Type:metadata
System:knb
On failure:error
Database table createdStatus of creating a database tableA database table is expected to be generated from the EML attributes.A database table was generated from the attributes description<![CDATA[CREATE TABLE _f7b1d1fcc5638c9cf6fd39719a85f3c7("Date" TIMESTAMP,"Latitude" FLOAT,"Longitude" FLOAT,"Advisory" TEXT);]]>
18examineRecordDelimitervalid
Type:congruency
System:knb
On failure:warn
Data are examined and possible record delimiters are displayedIf no record delimiter was specified, we assume that \r\n is the delimiter. Search the first row for other record delimiters and see if other delimiters are found.No other potential record delimiters expected in the first row.No other potential record delimiters were detected. A valid record delimiter was previously detectedhttp://knb.ecoinformatics.org/software/eml/eml-2.1.0/eml-physical.html#recordDelimiter
19displayFirstInsertRowinfo
Type:data
System:knb
On failure:info
Display first insert rowDisplay the first row of data values to be inserted into the database tableThe first row of data values should be displayed<![CDATA[2021-02-07, 38.115294, -121.68806, Caution]]>
20onlineURLsvalid
Type:congruency
System:knb
On failure:error
Online URLs are liveCheck that online URLs return somethingtruetrueSucceeded in accessing URL: <![CDATA[file:///home/pasta/local/data/edi.1337.3/f7b1d1fcc5638c9cf6fd39719a85f3c7]]>
21tooFewFieldsvalid
Type:congruency
System:knb
On failure:error
Data does not have fewer fields than metadata attributesCompare number of fields specified in metadata to number of fields found in a data recordNo errors detectedhttp://knb.ecoinformatics.org/software/eml/eml-2.1.0/eml-physical.html#dataFormat
22tooManyFieldsvalid
Type:congruency
System:knb
On failure:error
Data does not have more fields than metadata attributesCompare number of fields specified in metadata to number of fields found in a data recordNo errors detectedhttp://knb.ecoinformatics.org/software/eml/eml-2.1.0/eml-physical.html#dataFormat
23dataLoadStatusvalid
Type:congruency
System:knb
On failure:warn
Data can be loaded into the databaseStatus of loading the data table into a databaseNo errors expected during data loading or data loading was not attempted for this data entityThe data table loaded successfully into a database
24numberOfRecordsvalid
Type:congruency
System:knb
On failure:warn
Number of records in metadata matches number of rows loadedCompare number of records specified in metadata to number of records found in data5050The expected number of records (50) was found in the data table.
25headerRowAttributeNamesinfo
Type:congruency
System:lter
On failure:info
Header row is displayed alongside attribute namesCompare the content of the data header row to the content of EML attribute names.No expectation, information only Customer should evaluate the findings
26dateFormatMatchesvalid
Type:congruency
System:lter
On failure:warn
Date format in metadata matches datadateTime/formatString in attribute metadata is from the preferred list, and the data matches. A non-match generates only a warn.Format string is preferred, and all data values match the format stringData values matched the specified formatString.Dates should be consistently formatted and match the formatString in metadata.
Entity Report
Entity Name: Cyanotoxins
Entity Identifier:
# Identifier Status Quality Check Name Description Expected Found Explanation Suggestion Reference
1entityNameLengthvalid
Type:metadata
System:knb
On failure:warn
Length of entityName is not excessive (less than 100 char)length of entity name is less than 100 charactersentityName value is 100 characters or less11
2entityDescriptionPresentvalid
Type:metadata
System:lter
On failure:warn
An entity description is presentCheck for presence of an entity description.EML Best practices pp. 32-33, "...should have enough information for a user..."trueWith entityName sometimes serving as a file name rather than a title, it is important to be very descriptive here.
3numHeaderLinesPresentinfo
Type:metadata
System:knb
On failure:info
'numHeaderLines' element is presentCheck for presence of the 'numHeaderLines' element.Document contains 'numHeaderLines' element.'numHeaderLines' element: 1
4numFooterLinesPresentinfo
Type:metadata
System:knb
On failure:info
'numFooterLines' element is presentCheck for presence of the 'numFooterLines' element.Document contains 'numFooterLines' element.No 'numFooterLines' element foundIf data file contains footer lines, &#39;numFooterLines&#39; must be specified.Add 'numFooterLines' element if needed.
5fieldDelimiterValidvalid
Type:metadata
System:knb
On failure:error
Field delimiter is a single characterField delimiters should be one character onlyA single character is expected,A valid fieldDelimiter value was foundhttp://knb.ecoinformatics.org/software/eml/eml-2.1.0/eml-physical.html#fieldDelimiter
6recordDelimiterPresentvalid
Type:metadata
System:knb
On failure:warn
Record delimiter is presentCheck presence of record delimiter. Check that the record delimiter is one of the suggested values.A record delimiter from a list of suggested values: \n, \r, \r\n, #x0A, #x0D, #x0D#x0A\r\nA valid recordDelimiter value was foundhttp://knb.ecoinformatics.org/software/eml/eml-2.1.0/eml-physical.html#recordDelimiter
7numberOfRecordsPresencevalid
Type:metadata
System:knb
On failure:warn
Is the numberOfRecords element present?Warn the user if the numberOfRecords check is not presentA number of records element is expected for this entitynumberOfRecords element foundThis is a valuable check that we have the correct table.
8entitySizePresencevalid
Type:metadata
System:knb
On failure:warn
Check for presence of an entity size elementLook for entity size element as a prep for checking congruence, and if not present, generate a warn. Note that to be most useful (i.e, to check congruence), entity size should contain the most precise measure of size, which is "byte" (the default unit); however, the presence or name of the entity size unit is NOT checked.Entity size is present. If unit="byte" or unit is omitted (default = byte), then congruence can be checked.Found entity size element with value of 64915 and size unit specified as 'byte'.Examining the entity size is prep for checking congruence. Including the element is best practice, and if not present, a warn is generated. To be most useful, entity size should contain the most precise measure of size, which is &#34;byte&#34; (the default unit).Include an entity size in bytes Example success: knb-lter-sbc.3.12. Example of size in units other than byte: knb-lter-mcr.6.56.
9integrityChecksumPresencevalid
Type:metadata
System:lter
On failure:warn
A physical/authentication element is present and specifies a method attribute with a value of MD5 or SHA-1Check for presence of a physical/authentication element containing a checksum or hash value for an integrity check (e.g. MD5, SHA-1). Warn if an entity does not have a physical/authentication element, or if none of the physical/authentication elements specify a method attribute with a value of MD5 or SHA-1.At least one physical/authentication element with a method attribute specifying MD5 or SHA-1 and containing a checksum or hash value that can be used to perform an integrity check on the data.truePASTA will use this value to check the integrity of the data it downloads from your site. In addition, PASTA is planning to compare the contributor-supplied checksum/hash value documented in the physical/authentication element to the checksum/hash value of this entity downloaded from previous revisions of this data package. If PASTA already has a copy of this entity, it will be able to avoid an unnecessary download of the entity from your site, resulting in faster processing of the new data package revision when you update it in PASTA.Add a physical/authentication element and store the entity checksum or hash value in it using a method such as MD5 or SHA-1.
10dateTimeFormatStringvalid
Type:metadata
System:knb
On failure:warn
dateTime/formatString specified in metadata is from a preferred set of valuesCertain features of dateTime data formats are preferred, eg, ISO 8601, 4-digit years. This check looks at metadata to see if the dateTime format is in that preferred list.A formatString value that is a member of the preferred set is expected.YYYY-MM-DDA preferred format string was found.Modify the dateTime/formatString, selecting from among the preferred values one that best matches the data format
11attributeNamesUniquevalid
Type:metadata
System:knb
On failure:warn
Attribute names are uniqueChecks if attributeName values are unique in the table. Not required by EML.Unique attribute names.trueA good table does not have duplicate column names.EML Best Practices
12displayDownloadDatainfo
Type:data
System:knb
On failure:info
Display downloaded dataDisplay the first kilobyte of data that is downloadedUp to one kilobyte of data should be displayed
13urlReturnsDatavalid
Type:congruency
System:knb
On failure:error
URL returns dataChecks whether a URL returns data. Unless the URL is specified to be function="information", the URL should return the resource for download.A data entity that matches the metadatatruehttp://knb.ecoinformatics.org/software/eml/eml-2.1.0/eml-resource.html#UrlType
14onlineURLsvalid
Type:congruency
System:knb
On failure:error
Online URLs are liveCheck that online URLs return somethingtruetrueSucceeded in accessing URL: <![CDATA[https://ezeml.edirepository.org/user-data/iep-6f022aeb59daaf04006d61b9f2d3a887/uploads/Impact%20of%202021%20Drought%20Management%20on%20Harmful%20Algal%20Blooms%20and%20Aquatic%20Weeds%20in%20the%20Delta/hab_toxins.csv]]>
15integrityChecksumvalid
Type:congruency
System:lter
On failure:error
Compare the metadata checksum for an entity to the checksum of the downloaded entityTwo possible responses: valid if checksums match; error if checksums do not match.068694088cc14436e026621e58c398d5068694088cc14436e026621e58c398d5Matching checksums will ensure data integrity during upload to the repository.If the found integrity hash value does not match the expected integrity hash value, there may have been a loss of integrity in the data download. Check that the hash method and hash value documented in the metadata are the correct values.
16entitySizeCongruencevalid
Type:congruency
System:knb
On failure:error
Check that the entity size in the Level 0 metadata matches the one PASTA+ generates.Compare raw file size of file to [entity]/physical/size element in metadata. Return error if not matching.6491564915Examining the entity size is a method for checking that this is the correct entity.Check the entity size.
17databaseTableCreatedvalid
Type:metadata
System:knb
On failure:error
Database table createdStatus of creating a database tableA database table is expected to be generated from the EML attributes.A database table was generated from the attributes description<![CDATA[CREATE TABLE _c91ba16fa61f8e62cd7ca62a5a6cf269("Source" TEXT,"Station" TEXT,"Latitude" FLOAT,"Longitude" FLOAT,"Region" TEXT,"Year" FLOAT,"Month" FLOAT,"Date" TIMESTAMP,"Analyte" TEXT,"Result" FLOAT,"Result_Sign" TEXT);]]>
18examineRecordDelimitervalid
Type:congruency
System:knb
On failure:warn
Data are examined and possible record delimiters are displayedIf no record delimiter was specified, we assume that \r\n is the delimiter. Search the first row for other record delimiters and see if other delimiters are found.No other potential record delimiters expected in the first row.No other potential record delimiters were detected. A valid record delimiter was previously detectedhttp://knb.ecoinformatics.org/software/eml/eml-2.1.0/eml-physical.html#recordDelimiter
19displayFirstInsertRowinfo
Type:data
System:knb
On failure:info
Display first insert rowDisplay the first row of data values to be inserted into the database tableThe first row of data values should be displayed<![CDATA[USGS, DEC/TOL, 38.07780833333334, -121.7672861111111, Lower Sacramento, 2021, 1, 2021-01-12, Anabaenopeptins, 0, ND]]>
20onlineURLsvalid
Type:congruency
System:knb
On failure:error
Online URLs are liveCheck that online URLs return somethingtruetrueSucceeded in accessing URL: <![CDATA[file:///home/pasta/local/data/edi.1337.3/c91ba16fa61f8e62cd7ca62a5a6cf269]]>
21tooFewFieldsvalid
Type:congruency
System:knb
On failure:error
Data does not have fewer fields than metadata attributesCompare number of fields specified in metadata to number of fields found in a data recordNo errors detectedhttp://knb.ecoinformatics.org/software/eml/eml-2.1.0/eml-physical.html#dataFormat
22tooManyFieldsvalid
Type:congruency
System:knb
On failure:error
Data does not have more fields than metadata attributesCompare number of fields specified in metadata to number of fields found in a data recordNo errors detectedhttp://knb.ecoinformatics.org/software/eml/eml-2.1.0/eml-physical.html#dataFormat
23dataLoadStatusvalid
Type:congruency
System:knb
On failure:warn
Data can be loaded into the databaseStatus of loading the data table into a databaseNo errors expected during data loading or data loading was not attempted for this data entityThe data table loaded successfully into a database
24numberOfRecordsvalid
Type:congruency
System:knb
On failure:warn
Number of records in metadata matches number of rows loadedCompare number of records specified in metadata to number of records found in data719719The expected number of records (719) was found in the data table.
25headerRowAttributeNamesinfo
Type:congruency
System:lter
On failure:info
Header row is displayed alongside attribute namesCompare the content of the data header row to the content of EML attribute names.No expectation, information only Customer should evaluate the findings
26dateFormatMatchesvalid
Type:congruency
System:lter
On failure:warn
Date format in metadata matches datadateTime/formatString in attribute metadata is from the preferred list, and the data matches. A non-match generates only a warn.Format string is preferred, and all data values match the format stringData values matched the specified formatString.Dates should be consistently formatted and match the formatString in metadata.
Entity Report
Entity Name: Microcystis visual index and water quality
Entity Identifier:
# Identifier Status Quality Check Name Description Expected Found Explanation Suggestion Reference
1entityNameLengthvalid
Type:metadata
System:knb
On failure:warn
Length of entityName is not excessive (less than 100 char)length of entity name is less than 100 charactersentityName value is 100 characters or less42
2entityDescriptionPresentvalid
Type:metadata
System:lter
On failure:warn
An entity description is presentCheck for presence of an entity description.EML Best practices pp. 32-33, "...should have enough information for a user..."trueWith entityName sometimes serving as a file name rather than a title, it is important to be very descriptive here.
3numHeaderLinesPresentinfo
Type:metadata
System:knb
On failure:info
'numHeaderLines' element is presentCheck for presence of the 'numHeaderLines' element.Document contains 'numHeaderLines' element.'numHeaderLines' element: 1
4numFooterLinesPresentinfo
Type:metadata
System:knb
On failure:info
'numFooterLines' element is presentCheck for presence of the 'numFooterLines' element.Document contains 'numFooterLines' element.No 'numFooterLines' element foundIf data file contains footer lines, &#39;numFooterLines&#39; must be specified.Add 'numFooterLines' element if needed.
5fieldDelimiterValidvalid
Type:metadata
System:knb
On failure:error
Field delimiter is a single characterField delimiters should be one character onlyA single character is expected,A valid fieldDelimiter value was foundhttp://knb.ecoinformatics.org/software/eml/eml-2.1.0/eml-physical.html#fieldDelimiter
6recordDelimiterPresentvalid
Type:metadata
System:knb
On failure:warn
Record delimiter is presentCheck presence of record delimiter. Check that the record delimiter is one of the suggested values.A record delimiter from a list of suggested values: \n, \r, \r\n, #x0A, #x0D, #x0D#x0A\r\nA valid recordDelimiter value was foundhttp://knb.ecoinformatics.org/software/eml/eml-2.1.0/eml-physical.html#recordDelimiter
7numberOfRecordsPresencevalid
Type:metadata
System:knb
On failure:warn
Is the numberOfRecords element present?Warn the user if the numberOfRecords check is not presentA number of records element is expected for this entitynumberOfRecords element foundThis is a valuable check that we have the correct table.
8entitySizePresencevalid
Type:metadata
System:knb
On failure:warn
Check for presence of an entity size elementLook for entity size element as a prep for checking congruence, and if not present, generate a warn. Note that to be most useful (i.e, to check congruence), entity size should contain the most precise measure of size, which is "byte" (the default unit); however, the presence or name of the entity size unit is NOT checked.Entity size is present. If unit="byte" or unit is omitted (default = byte), then congruence can be checked.Found entity size element with value of 551222 and size unit specified as 'byte'.Examining the entity size is prep for checking congruence. Including the element is best practice, and if not present, a warn is generated. To be most useful, entity size should contain the most precise measure of size, which is &#34;byte&#34; (the default unit).Include an entity size in bytes Example success: knb-lter-sbc.3.12. Example of size in units other than byte: knb-lter-mcr.6.56.
9integrityChecksumPresencevalid
Type:metadata
System:lter
On failure:warn
A physical/authentication element is present and specifies a method attribute with a value of MD5 or SHA-1Check for presence of a physical/authentication element containing a checksum or hash value for an integrity check (e.g. MD5, SHA-1). Warn if an entity does not have a physical/authentication element, or if none of the physical/authentication elements specify a method attribute with a value of MD5 or SHA-1.At least one physical/authentication element with a method attribute specifying MD5 or SHA-1 and containing a checksum or hash value that can be used to perform an integrity check on the data.truePASTA will use this value to check the integrity of the data it downloads from your site. In addition, PASTA is planning to compare the contributor-supplied checksum/hash value documented in the physical/authentication element to the checksum/hash value of this entity downloaded from previous revisions of this data package. If PASTA already has a copy of this entity, it will be able to avoid an unnecessary download of the entity from your site, resulting in faster processing of the new data package revision when you update it in PASTA.Add a physical/authentication element and store the entity checksum or hash value in it using a method such as MD5 or SHA-1.
10dateTimeFormatStringvalid
Type:metadata
System:knb
On failure:warn
dateTime/formatString specified in metadata is from a preferred set of valuesCertain features of dateTime data formats are preferred, eg, ISO 8601, 4-digit years. This check looks at metadata to see if the dateTime format is in that preferred list.A formatString value that is a member of the preferred set is expected.YYYY-MM-DDA preferred format string was found.Modify the dateTime/formatString, selecting from among the preferred values one that best matches the data format
11attributeNamesUniquevalid
Type:metadata
System:knb
On failure:warn
Attribute names are uniqueChecks if attributeName values are unique in the table. Not required by EML.Unique attribute names.trueA good table does not have duplicate column names.EML Best Practices
12displayDownloadDatainfo
Type:data
System:knb
On failure:info
Display downloaded dataDisplay the first kilobyte of data that is downloadedUp to one kilobyte of data should be displayed
13urlReturnsDatavalid
Type:congruency
System:knb
On failure:error
URL returns dataChecks whether a URL returns data. Unless the URL is specified to be function="information", the URL should return the resource for download.A data entity that matches the metadatatruehttp://knb.ecoinformatics.org/software/eml/eml-2.1.0/eml-resource.html#UrlType
14onlineURLsvalid
Type:congruency
System:knb
On failure:error
Online URLs are liveCheck that online URLs return somethingtruetrueSucceeded in accessing URL: <![CDATA[https://ezeml.edirepository.org/user-data/iep-6f022aeb59daaf04006d61b9f2d3a887/uploads/Impact%20of%202021%20Drought%20Management%20on%20Harmful%20Algal%20Blooms%20and%20Aquatic%20Weeds%20in%20the%20Delta/mc_vis_index_wq.csv]]>
15integrityChecksumvalid
Type:congruency
System:lter
On failure:error
Compare the metadata checksum for an entity to the checksum of the downloaded entityTwo possible responses: valid if checksums match; error if checksums do not match.e8a5ea01cfa3876a649ccc4b2801f2c6e8a5ea01cfa3876a649ccc4b2801f2c6Matching checksums will ensure data integrity during upload to the repository.If the found integrity hash value does not match the expected integrity hash value, there may have been a loss of integrity in the data download. Check that the hash method and hash value documented in the metadata are the correct values.
16entitySizeCongruencevalid
Type:congruency
System:knb
On failure:error
Check that the entity size in the Level 0 metadata matches the one PASTA+ generates.Compare raw file size of file to [entity]/physical/size element in metadata. Return error if not matching.551222551222Examining the entity size is a method for checking that this is the correct entity.Check the entity size.
17databaseTableCreatedvalid
Type:metadata
System:knb
On failure:error
Database table createdStatus of creating a database tableA database table is expected to be generated from the EML attributes.A database table was generated from the attributes description<![CDATA[CREATE TABLE _10c5229a3942e631d747c9486d809aea("Source" TEXT,"Station" TEXT,"Latitude" FLOAT,"Longitude" FLOAT,"Region" TEXT,"Year" FLOAT,"Month" FLOAT,"Date" TIMESTAMP,"Microcystis" TEXT,"Secchi" FLOAT,"Temperature" FLOAT);]]>
18examineRecordDelimitervalid
Type:congruency
System:knb
On failure:warn
Data are examined and possible record delimiters are displayedIf no record delimiter was specified, we assume that \r\n is the delimiter. Search the first row for other record delimiters and see if other delimiters are found.No other potential record delimiters expected in the first row.No other potential record delimiters were detected. A valid record delimiter was previously detectedhttp://knb.ecoinformatics.org/software/eml/eml-2.1.0/eml-physical.html#recordDelimiter
19displayFirstInsertRowinfo
Type:data
System:knb
On failure:info
Display first insert rowDisplay the first row of data values to be inserted into the database tableThe first row of data values should be displayed<![CDATA[FMWT, 072, 38.18775, -121.58057, Upper Sac, 2007, 9, 2007-09-13, 1, 90, 20.8]]>
20onlineURLsvalid
Type:congruency
System:knb
On failure:error
Online URLs are liveCheck that online URLs return somethingtruetrueSucceeded in accessing URL: <![CDATA[file:///home/pasta/local/data/edi.1337.3/10c5229a3942e631d747c9486d809aea]]>
21tooFewFieldsvalid
Type:congruency
System:knb
On failure:error
Data does not have fewer fields than metadata attributesCompare number of fields specified in metadata to number of fields found in a data recordNo errors detectedhttp://knb.ecoinformatics.org/software/eml/eml-2.1.0/eml-physical.html#dataFormat
22tooManyFieldsvalid
Type:congruency
System:knb
On failure:error
Data does not have more fields than metadata attributesCompare number of fields specified in metadata to number of fields found in a data recordNo errors detectedhttp://knb.ecoinformatics.org/software/eml/eml-2.1.0/eml-physical.html#dataFormat
23dataLoadStatusvalid
Type:congruency
System:knb
On failure:warn
Data can be loaded into the databaseStatus of loading the data table into a databaseNo errors expected during data loading or data loading was not attempted for this data entityThe data table loaded successfully into a database
24numberOfRecordsvalid
Type:congruency
System:knb
On failure:warn
Number of records in metadata matches number of rows loadedCompare number of records specified in metadata to number of records found in data73397339The expected number of records (7339) was found in the data table.
25headerRowAttributeNamesinfo
Type:congruency
System:lter
On failure:info
Header row is displayed alongside attribute namesCompare the content of the data header row to the content of EML attribute names.No expectation, information only Customer should evaluate the findings
26dateFormatMatchesvalid
Type:congruency
System:lter
On failure:warn
Date format in metadata matches datadateTime/formatString in attribute metadata is from the preferred list, and the data matches. A non-match generates only a warn.Format string is preferred, and all data values match the format stringData values matched the specified formatString.Dates should be consistently formatted and match the formatString in metadata.
Entity Report
Entity Name: Potentially Toxic Cyanobacteria cell counts
Entity Identifier:
# Identifier Status Quality Check Name Description Expected Found Explanation Suggestion Reference
1entityNameLengthvalid
Type:metadata
System:knb
On failure:warn
Length of entityName is not excessive (less than 100 char)length of entity name is less than 100 charactersentityName value is 100 characters or less43
2entityDescriptionPresentvalid
Type:metadata
System:lter
On failure:warn
An entity description is presentCheck for presence of an entity description.EML Best practices pp. 32-33, "...should have enough information for a user..."trueWith entityName sometimes serving as a file name rather than a title, it is important to be very descriptive here.
3numHeaderLinesPresentinfo
Type:metadata
System:knb
On failure:info
'numHeaderLines' element is presentCheck for presence of the 'numHeaderLines' element.Document contains 'numHeaderLines' element.'numHeaderLines' element: 1
4numFooterLinesPresentinfo
Type:metadata
System:knb
On failure:info
'numFooterLines' element is presentCheck for presence of the 'numFooterLines' element.Document contains 'numFooterLines' element.No 'numFooterLines' element foundIf data file contains footer lines, &#39;numFooterLines&#39; must be specified.Add 'numFooterLines' element if needed.
5fieldDelimiterValidvalid
Type:metadata
System:knb
On failure:error
Field delimiter is a single characterField delimiters should be one character onlyA single character is expected,A valid fieldDelimiter value was foundhttp://knb.ecoinformatics.org/software/eml/eml-2.1.0/eml-physical.html#fieldDelimiter
6recordDelimiterPresentvalid
Type:metadata
System:knb
On failure:warn
Record delimiter is presentCheck presence of record delimiter. Check that the record delimiter is one of the suggested values.A record delimiter from a list of suggested values: \n, \r, \r\n, #x0A, #x0D, #x0D#x0A\r\nA valid recordDelimiter value was foundhttp://knb.ecoinformatics.org/software/eml/eml-2.1.0/eml-physical.html#recordDelimiter
7numberOfRecordsPresencevalid
Type:metadata
System:knb
On failure:warn
Is the numberOfRecords element present?Warn the user if the numberOfRecords check is not presentA number of records element is expected for this entitynumberOfRecords element foundThis is a valuable check that we have the correct table.
8entitySizePresencevalid
Type:metadata
System:knb
On failure:warn
Check for presence of an entity size elementLook for entity size element as a prep for checking congruence, and if not present, generate a warn. Note that to be most useful (i.e, to check congruence), entity size should contain the most precise measure of size, which is "byte" (the default unit); however, the presence or name of the entity size unit is NOT checked.Entity size is present. If unit="byte" or unit is omitted (default = byte), then congruence can be checked.Found entity size element with value of 26089 and size unit specified as 'byte'.Examining the entity size is prep for checking congruence. Including the element is best practice, and if not present, a warn is generated. To be most useful, entity size should contain the most precise measure of size, which is &#34;byte&#34; (the default unit).Include an entity size in bytes Example success: knb-lter-sbc.3.12. Example of size in units other than byte: knb-lter-mcr.6.56.
9integrityChecksumPresencevalid
Type:metadata
System:lter
On failure:warn
A physical/authentication element is present and specifies a method attribute with a value of MD5 or SHA-1Check for presence of a physical/authentication element containing a checksum or hash value for an integrity check (e.g. MD5, SHA-1). Warn if an entity does not have a physical/authentication element, or if none of the physical/authentication elements specify a method attribute with a value of MD5 or SHA-1.At least one physical/authentication element with a method attribute specifying MD5 or SHA-1 and containing a checksum or hash value that can be used to perform an integrity check on the data.truePASTA will use this value to check the integrity of the data it downloads from your site. In addition, PASTA is planning to compare the contributor-supplied checksum/hash value documented in the physical/authentication element to the checksum/hash value of this entity downloaded from previous revisions of this data package. If PASTA already has a copy of this entity, it will be able to avoid an unnecessary download of the entity from your site, resulting in faster processing of the new data package revision when you update it in PASTA.Add a physical/authentication element and store the entity checksum or hash value in it using a method such as MD5 or SHA-1.
10dateTimeFormatStringvalid
Type:metadata
System:knb
On failure:warn
dateTime/formatString specified in metadata is from a preferred set of valuesCertain features of dateTime data formats are preferred, eg, ISO 8601, 4-digit years. This check looks at metadata to see if the dateTime format is in that preferred list.A formatString value that is a member of the preferred set is expected.YYYY-MM-DDA preferred format string was found.Modify the dateTime/formatString, selecting from among the preferred values one that best matches the data format
11dateTimeFormatStringvalid
Type:metadata
System:knb
On failure:warn
dateTime/formatString specified in metadata is from a preferred set of valuesCertain features of dateTime data formats are preferred, eg, ISO 8601, 4-digit years. This check looks at metadata to see if the dateTime format is in that preferred list.A formatString value that is a member of the preferred set is expected.YYYY-MM-DD hh:mm:ssA preferred format string was found.Modify the dateTime/formatString, selecting from among the preferred values one that best matches the data format
12attributeNamesUniquevalid
Type:metadata
System:knb
On failure:warn
Attribute names are uniqueChecks if attributeName values are unique in the table. Not required by EML.Unique attribute names.trueA good table does not have duplicate column names.EML Best Practices
13displayDownloadDatainfo
Type:data
System:knb
On failure:info
Display downloaded dataDisplay the first kilobyte of data that is downloadedUp to one kilobyte of data should be displayed
14urlReturnsDatavalid
Type:congruency
System:knb
On failure:error
URL returns dataChecks whether a URL returns data. Unless the URL is specified to be function="information", the URL should return the resource for download.A data entity that matches the metadatatruehttp://knb.ecoinformatics.org/software/eml/eml-2.1.0/eml-resource.html#UrlType
15onlineURLsvalid
Type:congruency
System:knb
On failure:error
Online URLs are liveCheck that online URLs return somethingtruetrueSucceeded in accessing URL: <![CDATA[https://ezeml.edirepository.org/user-data/iep-6f022aeb59daaf04006d61b9f2d3a887/uploads/Impact%20of%202021%20Drought%20Management%20on%20Harmful%20Algal%20Blooms%20and%20Aquatic%20Weeds%20in%20the%20Delta/phyto_hab.csv]]>
16integrityChecksumvalid
Type:congruency
System:lter
On failure:error
Compare the metadata checksum for an entity to the checksum of the downloaded entityTwo possible responses: valid if checksums match; error if checksums do not match.a1dcc60e61a8561f29ea7741b0dae10aa1dcc60e61a8561f29ea7741b0dae10aMatching checksums will ensure data integrity during upload to the repository.If the found integrity hash value does not match the expected integrity hash value, there may have been a loss of integrity in the data download. Check that the hash method and hash value documented in the metadata are the correct values.
17entitySizeCongruencevalid
Type:congruency
System:knb
On failure:error
Check that the entity size in the Level 0 metadata matches the one PASTA+ generates.Compare raw file size of file to [entity]/physical/size element in metadata. Return error if not matching.2608926089Examining the entity size is a method for checking that this is the correct entity.Check the entity size.
18databaseTableCreatedvalid
Type:metadata
System:knb
On failure:error
Database table createdStatus of creating a database tableA database table is expected to be generated from the EML attributes.A database table was generated from the attributes description<![CDATA[CREATE TABLE _391568ac3ba723a96d9442ebfdb6379d("Station" TEXT,"Region" TEXT,"Year" FLOAT,"Date" TIMESTAMP,"Datetime" TIMESTAMP,"Taxon" TEXT,"Genus" TEXT,"Species" TEXT,"AlgalType" TEXT,"Count" FLOAT,"OrganismsPerMl" FLOAT);]]>
19examineRecordDelimitervalid
Type:congruency
System:knb
On failure:warn
Data are examined and possible record delimiters are displayedIf no record delimiter was specified, we assume that \r\n is the delimiter. Search the first row for other record delimiters and see if other delimiters are found.No other potential record delimiters expected in the first row.No other potential record delimiters were detected. A valid record delimiter was previously detectedhttp://knb.ecoinformatics.org/software/eml/eml-2.1.0/eml-physical.html#recordDelimiter
20displayFirstInsertRowinfo
Type:data
System:knb
On failure:info
Display first insert rowDisplay the first row of data values to be inserted into the database tableThe first row of data values should be displayed<![CDATA[P8, South Delta, 2014, 2014-05-08, 2014-05-08 12:45:00, cf. Planktothrix suspensa, Planktothrix, NA, Cyanobacterium, 1, 65.03]]>
21onlineURLsvalid
Type:congruency
System:knb
On failure:error
Online URLs are liveCheck that online URLs return somethingtruetrueSucceeded in accessing URL: <![CDATA[file:///home/pasta/local/data/edi.1337.3/391568ac3ba723a96d9442ebfdb6379d]]>
22tooFewFieldsvalid
Type:congruency
System:knb
On failure:error
Data does not have fewer fields than metadata attributesCompare number of fields specified in metadata to number of fields found in a data recordNo errors detectedhttp://knb.ecoinformatics.org/software/eml/eml-2.1.0/eml-physical.html#dataFormat
23tooManyFieldsvalid
Type:congruency
System:knb
On failure:error
Data does not have more fields than metadata attributesCompare number of fields specified in metadata to number of fields found in a data recordNo errors detectedhttp://knb.ecoinformatics.org/software/eml/eml-2.1.0/eml-physical.html#dataFormat
24dataLoadStatusvalid
Type:congruency
System:knb
On failure:warn
Data can be loaded into the databaseStatus of loading the data table into a databaseNo errors expected during data loading or data loading was not attempted for this data entityThe data table loaded successfully into a database
25numberOfRecordsvalid
Type:congruency
System:knb
On failure:warn
Number of records in metadata matches number of rows loadedCompare number of records specified in metadata to number of records found in data228228The expected number of records (228) was found in the data table.
26headerRowAttributeNamesinfo
Type:congruency
System:lter
On failure:info
Header row is displayed alongside attribute namesCompare the content of the data header row to the content of EML attribute names.No expectation, information only Customer should evaluate the findings
27dateFormatMatchesvalid
Type:congruency
System:lter
On failure:warn
Date format in metadata matches datadateTime/formatString in attribute metadata is from the preferred list, and the data matches. A non-match generates only a warn.Format string is preferred, and all data values match the format stringData values matched the specified formatString.Dates should be consistently formatted and match the formatString in metadata.
Entity Report
Entity Name: Dayflow2014_2021
Entity Identifier:
# Identifier Status Quality Check Name Description Expected Found Explanation Suggestion Reference
1entityNameLengthvalid
Type:metadata
System:knb
On failure:warn
Length of entityName is not excessive (less than 100 char)length of entity name is less than 100 charactersentityName value is 100 characters or less16
2entityDescriptionPresentvalid
Type:metadata
System:lter
On failure:warn
An entity description is presentCheck for presence of an entity description.EML Best practices pp. 32-33, "...should have enough information for a user..."trueWith entityName sometimes serving as a file name rather than a title, it is important to be very descriptive here.
3numHeaderLinesPresentinfo
Type:metadata
System:knb
On failure:info
'numHeaderLines' element is presentCheck for presence of the 'numHeaderLines' element.Document contains 'numHeaderLines' element.'numHeaderLines' element: 1
4numFooterLinesPresentinfo
Type:metadata
System:knb
On failure:info
'numFooterLines' element is presentCheck for presence of the 'numFooterLines' element.Document contains 'numFooterLines' element.No 'numFooterLines' element foundIf data file contains footer lines, &#39;numFooterLines&#39; must be specified.Add 'numFooterLines' element if needed.
5fieldDelimiterValidvalid
Type:metadata
System:knb
On failure:error
Field delimiter is a single characterField delimiters should be one character onlyA single character is expected,A valid fieldDelimiter value was foundhttp://knb.ecoinformatics.org/software/eml/eml-2.1.0/eml-physical.html#fieldDelimiter
6recordDelimiterPresentvalid
Type:metadata
System:knb
On failure:warn
Record delimiter is presentCheck presence of record delimiter. Check that the record delimiter is one of the suggested values.A record delimiter from a list of suggested values: \n, \r, \r\n, #x0A, #x0D, #x0D#x0A\r\nA valid recordDelimiter value was foundhttp://knb.ecoinformatics.org/software/eml/eml-2.1.0/eml-physical.html#recordDelimiter
7numberOfRecordsPresencevalid
Type:metadata
System:knb
On failure:warn
Is the numberOfRecords element present?Warn the user if the numberOfRecords check is not presentA number of records element is expected for this entitynumberOfRecords element foundThis is a valuable check that we have the correct table.
8entitySizePresencevalid
Type:metadata
System:knb
On failure:warn
Check for presence of an entity size elementLook for entity size element as a prep for checking congruence, and if not present, generate a warn. Note that to be most useful (i.e, to check congruence), entity size should contain the most precise measure of size, which is "byte" (the default unit); however, the presence or name of the entity size unit is NOT checked.Entity size is present. If unit="byte" or unit is omitted (default = byte), then congruence can be checked.Found entity size element with value of 1556873 and size unit specified as 'byte'.Examining the entity size is prep for checking congruence. Including the element is best practice, and if not present, a warn is generated. To be most useful, entity size should contain the most precise measure of size, which is &#34;byte&#34; (the default unit).Include an entity size in bytes Example success: knb-lter-sbc.3.12. Example of size in units other than byte: knb-lter-mcr.6.56.
9integrityChecksumPresencevalid
Type:metadata
System:lter
On failure:warn
A physical/authentication element is present and specifies a method attribute with a value of MD5 or SHA-1Check for presence of a physical/authentication element containing a checksum or hash value for an integrity check (e.g. MD5, SHA-1). Warn if an entity does not have a physical/authentication element, or if none of the physical/authentication elements specify a method attribute with a value of MD5 or SHA-1.At least one physical/authentication element with a method attribute specifying MD5 or SHA-1 and containing a checksum or hash value that can be used to perform an integrity check on the data.truePASTA will use this value to check the integrity of the data it downloads from your site. In addition, PASTA is planning to compare the contributor-supplied checksum/hash value documented in the physical/authentication element to the checksum/hash value of this entity downloaded from previous revisions of this data package. If PASTA already has a copy of this entity, it will be able to avoid an unnecessary download of the entity from your site, resulting in faster processing of the new data package revision when you update it in PASTA.Add a physical/authentication element and store the entity checksum or hash value in it using a method such as MD5 or SHA-1.
10dateTimeFormatStringvalid
Type:metadata
System:knb
On failure:warn
dateTime/formatString specified in metadata is from a preferred set of valuesCertain features of dateTime data formats are preferred, eg, ISO 8601, 4-digit years. This check looks at metadata to see if the dateTime format is in that preferred list.A formatString value that is a member of the preferred set is expected.YYYY-MM-DDA preferred format string was found.Modify the dateTime/formatString, selecting from among the preferred values one that best matches the data format
11attributeNamesUniquevalid
Type:metadata
System:knb
On failure:warn
Attribute names are uniqueChecks if attributeName values are unique in the table. Not required by EML.Unique attribute names.trueA good table does not have duplicate column names.EML Best Practices
12displayDownloadDatainfo
Type:data
System:knb
On failure:info
Display downloaded dataDisplay the first kilobyte of data that is downloadedUp to one kilobyte of data should be displayed
13urlReturnsDatavalid
Type:congruency
System:knb
On failure:error
URL returns dataChecks whether a URL returns data. Unless the URL is specified to be function="information", the URL should return the resource for download.A data entity that matches the metadatatruehttp://knb.ecoinformatics.org/software/eml/eml-2.1.0/eml-resource.html#UrlType
14onlineURLsvalid
Type:congruency
System:knb
On failure:error
Online URLs are liveCheck that online URLs return somethingtruetrueSucceeded in accessing URL: <![CDATA[https://ezeml.edirepository.org/user-data/iep-6f022aeb59daaf04006d61b9f2d3a887/uploads/Impact%20of%202021%20Drought%20Management%20on%20Harmful%20Algal%20Blooms%20and%20Aquatic%20Weeds%20in%20the%20Delta/Dayflow2014_2021.csv]]>
15integrityChecksumvalid
Type:congruency
System:lter
On failure:error
Compare the metadata checksum for an entity to the checksum of the downloaded entityTwo possible responses: valid if checksums match; error if checksums do not match.353d9905b54b42fffefe74120a85f53d353d9905b54b42fffefe74120a85f53dMatching checksums will ensure data integrity during upload to the repository.If the found integrity hash value does not match the expected integrity hash value, there may have been a loss of integrity in the data download. Check that the hash method and hash value documented in the metadata are the correct values.
16entitySizeCongruencevalid
Type:congruency
System:knb
On failure:error
Check that the entity size in the Level 0 metadata matches the one PASTA+ generates.Compare raw file size of file to [entity]/physical/size element in metadata. Return error if not matching.15568731556873Examining the entity size is a method for checking that this is the correct entity.Check the entity size.
17databaseTableCreatedvalid
Type:metadata
System:knb
On failure:error
Database table createdStatus of creating a database tableA database table is expected to be generated from the EML attributes.A database table was generated from the attributes description<![CDATA[CREATE TABLE _2368c56990d185597323dba8d859897b("Date" TIMESTAMP,"Metric" TEXT,"CFS" FLOAT,"Sevenday" FLOAT,"DOY" FLOAT,"Year" FLOAT);]]>
18examineRecordDelimitervalid
Type:congruency
System:knb
On failure:warn
Data are examined and possible record delimiters are displayedIf no record delimiter was specified, we assume that \r\n is the delimiter. Search the first row for other record delimiters and see if other delimiters are found.No other potential record delimiters expected in the first row.No other potential record delimiters were detected. A valid record delimiter was previously detectedhttp://knb.ecoinformatics.org/software/eml/eml-2.1.0/eml-physical.html#recordDelimiter
19displayFirstInsertRowinfo
Type:data
System:knb
On failure:info
Display first insert rowDisplay the first row of data values to be inserted into the database tableThe first row of data values should be displayed<![CDATA[1996-10-01, Outflow, 4722, NA, 275, 1996]]>
20onlineURLsvalid
Type:congruency
System:knb
On failure:error
Online URLs are liveCheck that online URLs return somethingtruetrueSucceeded in accessing URL: <![CDATA[file:///home/pasta/local/data/edi.1337.3/2368c56990d185597323dba8d859897b]]>
21tooFewFieldsvalid
Type:congruency
System:knb
On failure:error
Data does not have fewer fields than metadata attributesCompare number of fields specified in metadata to number of fields found in a data recordNo errors detectedhttp://knb.ecoinformatics.org/software/eml/eml-2.1.0/eml-physical.html#dataFormat
22tooManyFieldsvalid
Type:congruency
System:knb
On failure:error
Data does not have more fields than metadata attributesCompare number of fields specified in metadata to number of fields found in a data recordNo errors detectedhttp://knb.ecoinformatics.org/software/eml/eml-2.1.0/eml-physical.html#dataFormat
23dataLoadStatusvalid
Type:congruency
System:knb
On failure:warn
Data can be loaded into the databaseStatus of loading the data table into a databaseNo errors expected during data loading or data loading was not attempted for this data entityThe data table loaded successfully into a database
24numberOfRecordsvalid
Type:congruency
System:knb
On failure:warn
Number of records in metadata matches number of rows loadedCompare number of records specified in metadata to number of records found in data2738827388The expected number of records (27388) was found in the data table.
25headerRowAttributeNamesinfo
Type:congruency
System:lter
On failure:info
Header row is displayed alongside attribute namesCompare the content of the data header row to the content of EML attribute names.No expectation, information only Customer should evaluate the findings
26dateFormatMatchesvalid
Type:congruency
System:lter
On failure:warn
Date format in metadata matches datadateTime/formatString in attribute metadata is from the preferred list, and the data matches. A non-match generates only a warn.Format string is preferred, and all data values match the format stringData values matched the specified formatString.Dates should be consistently formatted and match the formatString in metadata.
Entity Report
Entity Name: Fluoroprobe mapping data
Entity Identifier:
# Identifier Status Quality Check Name Description Expected Found Explanation Suggestion Reference
1entityNameLengthvalid
Type:metadata
System:knb
On failure:warn
Length of entityName is not excessive (less than 100 char)length of entity name is less than 100 charactersentityName value is 100 characters or less24
2entityDescriptionPresentvalid
Type:metadata
System:lter
On failure:warn
An entity description is presentCheck for presence of an entity description.EML Best practices pp. 32-33, "...should have enough information for a user..."trueWith entityName sometimes serving as a file name rather than a title, it is important to be very descriptive here.
3numHeaderLinesPresentinfo
Type:metadata
System:knb
On failure:info
'numHeaderLines' element is presentCheck for presence of the 'numHeaderLines' element.Document contains 'numHeaderLines' element.'numHeaderLines' element: 1
4numFooterLinesPresentinfo
Type:metadata
System:knb
On failure:info
'numFooterLines' element is presentCheck for presence of the 'numFooterLines' element.Document contains 'numFooterLines' element.No 'numFooterLines' element foundIf data file contains footer lines, &#39;numFooterLines&#39; must be specified.Add 'numFooterLines' element if needed.
5fieldDelimiterValidvalid
Type:metadata
System:knb
On failure:error
Field delimiter is a single characterField delimiters should be one character onlyA single character is expected,A valid fieldDelimiter value was foundhttp://knb.ecoinformatics.org/software/eml/eml-2.1.0/eml-physical.html#fieldDelimiter
6recordDelimiterPresentvalid
Type:metadata
System:knb
On failure:warn
Record delimiter is presentCheck presence of record delimiter. Check that the record delimiter is one of the suggested values.A record delimiter from a list of suggested values: \n, \r, \r\n, #x0A, #x0D, #x0D#x0A\r\nA valid recordDelimiter value was foundhttp://knb.ecoinformatics.org/software/eml/eml-2.1.0/eml-physical.html#recordDelimiter
7numberOfRecordsPresencevalid
Type:metadata
System:knb
On failure:warn
Is the numberOfRecords element present?Warn the user if the numberOfRecords check is not presentA number of records element is expected for this entitynumberOfRecords element foundThis is a valuable check that we have the correct table.
8entitySizePresencevalid
Type:metadata
System:knb
On failure:warn
Check for presence of an entity size elementLook for entity size element as a prep for checking congruence, and if not present, generate a warn. Note that to be most useful (i.e, to check congruence), entity size should contain the most precise measure of size, which is "byte" (the default unit); however, the presence or name of the entity size unit is NOT checked.Entity size is present. If unit="byte" or unit is omitted (default = byte), then congruence can be checked.Found entity size element with value of 19518476 and size unit specified as 'byte'.Examining the entity size is prep for checking congruence. Including the element is best practice, and if not present, a warn is generated. To be most useful, entity size should contain the most precise measure of size, which is &#34;byte&#34; (the default unit).Include an entity size in bytes Example success: knb-lter-sbc.3.12. Example of size in units other than byte: knb-lter-mcr.6.56.
9integrityChecksumPresencevalid
Type:metadata
System:lter
On failure:warn
A physical/authentication element is present and specifies a method attribute with a value of MD5 or SHA-1Check for presence of a physical/authentication element containing a checksum or hash value for an integrity check (e.g. MD5, SHA-1). Warn if an entity does not have a physical/authentication element, or if none of the physical/authentication elements specify a method attribute with a value of MD5 or SHA-1.At least one physical/authentication element with a method attribute specifying MD5 or SHA-1 and containing a checksum or hash value that can be used to perform an integrity check on the data.truePASTA will use this value to check the integrity of the data it downloads from your site. In addition, PASTA is planning to compare the contributor-supplied checksum/hash value documented in the physical/authentication element to the checksum/hash value of this entity downloaded from previous revisions of this data package. If PASTA already has a copy of this entity, it will be able to avoid an unnecessary download of the entity from your site, resulting in faster processing of the new data package revision when you update it in PASTA.Add a physical/authentication element and store the entity checksum or hash value in it using a method such as MD5 or SHA-1.
10dateTimeFormatStringvalid
Type:metadata
System:knb
On failure:warn
dateTime/formatString specified in metadata is from a preferred set of valuesCertain features of dateTime data formats are preferred, eg, ISO 8601, 4-digit years. This check looks at metadata to see if the dateTime format is in that preferred list.A formatString value that is a member of the preferred set is expected.YYYY-MM-DD hh:mm:ssA preferred format string was found.Modify the dateTime/formatString, selecting from among the preferred values one that best matches the data format
11attributeNamesUniquevalid
Type:metadata
System:knb
On failure:warn
Attribute names are uniqueChecks if attributeName values are unique in the table. Not required by EML.Unique attribute names.trueA good table does not have duplicate column names.EML Best Practices
12displayDownloadDatainfo
Type:data
System:knb
On failure:info
Display downloaded dataDisplay the first kilobyte of data that is downloadedUp to one kilobyte of data should be displayed
13urlReturnsDatavalid
Type:congruency
System:knb
On failure:error
URL returns dataChecks whether a URL returns data. Unless the URL is specified to be function="information", the URL should return the resource for download.A data entity that matches the metadatatruehttp://knb.ecoinformatics.org/software/eml/eml-2.1.0/eml-resource.html#UrlType
14onlineURLsvalid
Type:congruency
System:knb
On failure:error
Online URLs are liveCheck that online URLs return somethingtruetrueSucceeded in accessing URL: <![CDATA[https://ezeml.edirepository.org/user-data/iep-6f022aeb59daaf04006d61b9f2d3a887/uploads/Impact%20of%202021%20Drought%20Management%20on%20Harmful%20Algal%20Blooms%20and%20Aquatic%20Weeds%20in%20the%20Delta/Fluoroprobe2.csv]]>
15integrityChecksumvalid
Type:congruency
System:lter
On failure:error
Compare the metadata checksum for an entity to the checksum of the downloaded entityTwo possible responses: valid if checksums match; error if checksums do not match.0e7bbe5a6b60aaf4b0423f73688c0d1d0e7bbe5a6b60aaf4b0423f73688c0d1dMatching checksums will ensure data integrity during upload to the repository.If the found integrity hash value does not match the expected integrity hash value, there may have been a loss of integrity in the data download. Check that the hash method and hash value documented in the metadata are the correct values.
16entitySizeCongruencevalid
Type:congruency
System:knb
On failure:error
Check that the entity size in the Level 0 metadata matches the one PASTA+ generates.Compare raw file size of file to [entity]/physical/size element in metadata. Return error if not matching.1951847619518476Examining the entity size is a method for checking that this is the correct entity.Check the entity size.
17databaseTableCreatedvalid
Type:metadata
System:knb
On failure:error
Database table createdStatus of creating a database tableA database table is expected to be generated from the EML attributes.A database table was generated from the attributes description<![CDATA[CREATE TABLE _7615758efc9ae650389f25a314d7cee1("DateTime" TIMESTAMP,"Latitude" FLOAT,"Longitude" FLOAT,"Temperature" FLOAT,"GreenAlgae" FLOAT,"Cyanobacteria" FLOAT,"Diatoms" FLOAT,"Cryptophyta" FLOAT,"YellowSubstances" FLOAT,"TotalChlorophyll" FLOAT,"Agency" TEXT);]]>
18examineRecordDelimitervalid
Type:congruency
System:knb
On failure:warn
Data are examined and possible record delimiters are displayedIf no record delimiter was specified, we assume that \r\n is the delimiter. Search the first row for other record delimiters and see if other delimiters are found.No other potential record delimiters expected in the first row.No other potential record delimiters were detected. A valid record delimiter was previously detectedhttp://knb.ecoinformatics.org/software/eml/eml-2.1.0/eml-physical.html#recordDelimiter
19displayFirstInsertRowinfo
Type:data
System:knb
On failure:info
Display first insert rowDisplay the first row of data values to be inserted into the database tableThe first row of data values should be displayed<![CDATA[2021-07-27 07:37:01, 38.106315, -121.701095, 21.649, 2.2, -0.02, 1.14, 0, 0.47, 9.33, USGS]]>
20onlineURLsvalid
Type:congruency
System:knb
On failure:error
Online URLs are liveCheck that online URLs return somethingtruetrueSucceeded in accessing URL: <![CDATA[file:///home/pasta/local/data/edi.1337.3/7615758efc9ae650389f25a314d7cee1]]>
21tooFewFieldsvalid
Type:congruency
System:knb
On failure:error
Data does not have fewer fields than metadata attributesCompare number of fields specified in metadata to number of fields found in a data recordNo errors detectedhttp://knb.ecoinformatics.org/software/eml/eml-2.1.0/eml-physical.html#dataFormat
22tooManyFieldsvalid
Type:congruency
System:knb
On failure:error
Data does not have more fields than metadata attributesCompare number of fields specified in metadata to number of fields found in a data recordNo errors detectedhttp://knb.ecoinformatics.org/software/eml/eml-2.1.0/eml-physical.html#dataFormat
23dataLoadStatusvalid
Type:congruency
System:knb
On failure:warn
Data can be loaded into the databaseStatus of loading the data table into a databaseNo errors expected during data loading or data loading was not attempted for this data entityThe data table loaded successfully into a database
24numberOfRecordsvalid
Type:congruency
System:knb
On failure:warn
Number of records in metadata matches number of rows loadedCompare number of records specified in metadata to number of records found in data226531226531The expected number of records (226531) was found in the data table.
25headerRowAttributeNamesinfo
Type:congruency
System:lter
On failure:info
Header row is displayed alongside attribute namesCompare the content of the data header row to the content of EML attribute names.No expectation, information only Customer should evaluate the findings
26dateFormatMatchesvalid
Type:congruency
System:lter
On failure:warn
Date format in metadata matches datadateTime/formatString in attribute metadata is from the preferred list, and the data matches. A non-match generates only a warn.Format string is preferred, and all data values match the format stringData values matched the specified formatString.Dates should be consistently formatted and match the formatString in metadata.
Entity Report
Entity Name: Vegetation regional area estimates
Entity Identifier:
# Identifier Status Quality Check Name Description Expected Found Explanation Suggestion Reference
1entityNameLengthvalid
Type:metadata
System:knb
On failure:warn
Length of entityName is not excessive (less than 100 char)length of entity name is less than 100 charactersentityName value is 100 characters or less34
2entityDescriptionPresentvalid
Type:metadata
System:lter
On failure:warn
An entity description is presentCheck for presence of an entity description.EML Best practices pp. 32-33, "...should have enough information for a user..."trueWith entityName sometimes serving as a file name rather than a title, it is important to be very descriptive here.
3numHeaderLinesPresentinfo
Type:metadata
System:knb
On failure:info
'numHeaderLines' element is presentCheck for presence of the 'numHeaderLines' element.Document contains 'numHeaderLines' element.'numHeaderLines' element: 1
4numFooterLinesPresentinfo
Type:metadata
System:knb
On failure:info
'numFooterLines' element is presentCheck for presence of the 'numFooterLines' element.Document contains 'numFooterLines' element.No 'numFooterLines' element foundIf data file contains footer lines, &#39;numFooterLines&#39; must be specified.Add 'numFooterLines' element if needed.
5fieldDelimiterValidvalid
Type:metadata
System:knb
On failure:error
Field delimiter is a single characterField delimiters should be one character onlyA single character is expected,A valid fieldDelimiter value was foundhttp://knb.ecoinformatics.org/software/eml/eml-2.1.0/eml-physical.html#fieldDelimiter
6recordDelimiterPresentvalid
Type:metadata
System:knb
On failure:warn
Record delimiter is presentCheck presence of record delimiter. Check that the record delimiter is one of the suggested values.A record delimiter from a list of suggested values: \n, \r, \r\n, #x0A, #x0D, #x0D#x0A\r\nA valid recordDelimiter value was foundhttp://knb.ecoinformatics.org/software/eml/eml-2.1.0/eml-physical.html#recordDelimiter
7numberOfRecordsPresencevalid
Type:metadata
System:knb
On failure:warn
Is the numberOfRecords element present?Warn the user if the numberOfRecords check is not presentA number of records element is expected for this entitynumberOfRecords element foundThis is a valuable check that we have the correct table.
8entitySizePresencevalid
Type:metadata
System:knb
On failure:warn
Check for presence of an entity size elementLook for entity size element as a prep for checking congruence, and if not present, generate a warn. Note that to be most useful (i.e, to check congruence), entity size should contain the most precise measure of size, which is "byte" (the default unit); however, the presence or name of the entity size unit is NOT checked.Entity size is present. If unit="byte" or unit is omitted (default = byte), then congruence can be checked.Found entity size element with value of 6983 and size unit specified as 'byte'.Examining the entity size is prep for checking congruence. Including the element is best practice, and if not present, a warn is generated. To be most useful, entity size should contain the most precise measure of size, which is &#34;byte&#34; (the default unit).Include an entity size in bytes Example success: knb-lter-sbc.3.12. Example of size in units other than byte: knb-lter-mcr.6.56.
9integrityChecksumPresencevalid
Type:metadata
System:lter
On failure:warn
A physical/authentication element is present and specifies a method attribute with a value of MD5 or SHA-1Check for presence of a physical/authentication element containing a checksum or hash value for an integrity check (e.g. MD5, SHA-1). Warn if an entity does not have a physical/authentication element, or if none of the physical/authentication elements specify a method attribute with a value of MD5 or SHA-1.At least one physical/authentication element with a method attribute specifying MD5 or SHA-1 and containing a checksum or hash value that can be used to perform an integrity check on the data.truePASTA will use this value to check the integrity of the data it downloads from your site. In addition, PASTA is planning to compare the contributor-supplied checksum/hash value documented in the physical/authentication element to the checksum/hash value of this entity downloaded from previous revisions of this data package. If PASTA already has a copy of this entity, it will be able to avoid an unnecessary download of the entity from your site, resulting in faster processing of the new data package revision when you update it in PASTA.Add a physical/authentication element and store the entity checksum or hash value in it using a method such as MD5 or SHA-1.
10attributeNamesUniquevalid
Type:metadata
System:knb
On failure:warn
Attribute names are uniqueChecks if attributeName values are unique in the table. Not required by EML.Unique attribute names.trueA good table does not have duplicate column names.EML Best Practices
11displayDownloadDatainfo
Type:data
System:knb
On failure:info
Display downloaded dataDisplay the first kilobyte of data that is downloadedUp to one kilobyte of data should be displayed
12urlReturnsDatavalid
Type:congruency
System:knb
On failure:error
URL returns dataChecks whether a URL returns data. Unless the URL is specified to be function="information", the URL should return the resource for download.A data entity that matches the metadatatruehttp://knb.ecoinformatics.org/software/eml/eml-2.1.0/eml-resource.html#UrlType
13onlineURLsvalid
Type:congruency
System:knb
On failure:error
Online URLs are liveCheck that online URLs return somethingtruetrueSucceeded in accessing URL: <![CDATA[https://ezeml.edirepository.org/user-data/iep-6f022aeb59daaf04006d61b9f2d3a887/uploads/Impact%20of%202021%20Drought%20Management%20on%20Harmful%20Algal%20Blooms%20and%20Aquatic%20Weeds%20in%20the%20Delta/ucd_imagery_regional_area_estimates.csv]]>
14integrityChecksumvalid
Type:congruency
System:lter
On failure:error
Compare the metadata checksum for an entity to the checksum of the downloaded entityTwo possible responses: valid if checksums match; error if checksums do not match.9ef703f056a5f636610750e0d87c041c9ef703f056a5f636610750e0d87c041cMatching checksums will ensure data integrity during upload to the repository.If the found integrity hash value does not match the expected integrity hash value, there may have been a loss of integrity in the data download. Check that the hash method and hash value documented in the metadata are the correct values.
15entitySizeCongruencevalid
Type:congruency
System:knb
On failure:error
Check that the entity size in the Level 0 metadata matches the one PASTA+ generates.Compare raw file size of file to [entity]/physical/size element in metadata. Return error if not matching.69836983Examining the entity size is a method for checking that this is the correct entity.Check the entity size.
16databaseTableCreatedvalid
Type:metadata
System:knb
On failure:error
Database table createdStatus of creating a database tableA database table is expected to be generated from the EML attributes.A database table was generated from the attributes description<![CDATA[CREATE TABLE _0d49aa2012e93b42ee8d9ccdd3fc7950("site" TEXT,"year" FLOAT,"month" TEXT,"veg_type" TEXT,"area_ha" FLOAT,"area_prop_h" FLOAT,"area_prop_w" FLOAT);]]>
17examineRecordDelimitervalid
Type:congruency
System:knb
On failure:warn
Data are examined and possible record delimiters are displayedIf no record delimiter was specified, we assume that \r\n is the delimiter. Search the first row for other record delimiters and see if other delimiters are found.No other potential record delimiters expected in the first row.No other potential record delimiters were detected. A valid record delimiter was previously detectedhttp://knb.ecoinformatics.org/software/eml/eml-2.1.0/eml-physical.html#recordDelimiter
18displayFirstInsertRowinfo
Type:data
System:knb
On failure:info
Display first insert rowDisplay the first row of data values to be inserted into the database tableThe first row of data values should be displayed<![CDATA[Big Break, 2004, 6, sav, 330.58, 0.3126761629116773, 0.4763400576368876]]>
19onlineURLsvalid
Type:congruency
System:knb
On failure:error
Online URLs are liveCheck that online URLs return somethingtruetrueSucceeded in accessing URL: <![CDATA[file:///home/pasta/local/data/edi.1337.3/0d49aa2012e93b42ee8d9ccdd3fc7950]]>
20tooFewFieldsvalid
Type:congruency
System:knb
On failure:error
Data does not have fewer fields than metadata attributesCompare number of fields specified in metadata to number of fields found in a data recordNo errors detectedhttp://knb.ecoinformatics.org/software/eml/eml-2.1.0/eml-physical.html#dataFormat
21tooManyFieldsvalid
Type:congruency
System:knb
On failure:error
Data does not have more fields than metadata attributesCompare number of fields specified in metadata to number of fields found in a data recordNo errors detectedhttp://knb.ecoinformatics.org/software/eml/eml-2.1.0/eml-physical.html#dataFormat
22dataLoadStatusvalid
Type:congruency
System:knb
On failure:warn
Data can be loaded into the databaseStatus of loading the data table into a databaseNo errors expected during data loading or data loading was not attempted for this data entityThe data table loaded successfully into a database
23numberOfRecordsvalid
Type:congruency
System:knb
On failure:warn
Number of records in metadata matches number of rows loadedCompare number of records specified in metadata to number of records found in data9898The expected number of records (98) was found in the data table.
24headerRowAttributeNamesinfo
Type:congruency
System:lter
On failure:info
Header row is displayed alongside attribute namesCompare the content of the data header row to the content of EML attribute names.No expectation, information only Customer should evaluate the findings
25dateFormatMatchesvalid
Type:congruency
System:lter
On failure:warn
Date format in metadata matches datadateTime/formatString in attribute metadata is from the preferred list, and the data matches. A non-match generates only a warn.Format string is preferred, and all data values match the format stringData values matched the specified formatString.Dates should be consistently formatted and match the formatString in metadata.
Entity Report
Entity Name: Franks Tract Fluridone_2006-2021
Entity Identifier:
# Identifier Status Quality Check Name Description Expected Found Explanation Suggestion Reference
1entityNameLengthvalid
Type:metadata
System:knb
On failure:warn
Length of entityName is not excessive (less than 100 char)length of entity name is less than 100 charactersentityName value is 100 characters or less32
2entityDescriptionPresentvalid
Type:metadata
System:lter
On failure:warn
An entity description is presentCheck for presence of an entity description.EML Best practices pp. 32-33, "...should have enough information for a user..."trueWith entityName sometimes serving as a file name rather than a title, it is important to be very descriptive here.
3numHeaderLinesPresentinfo
Type:metadata
System:knb
On failure:info
'numHeaderLines' element is presentCheck for presence of the 'numHeaderLines' element.Document contains 'numHeaderLines' element.'numHeaderLines' element: 1
4numFooterLinesPresentinfo
Type:metadata
System:knb
On failure:info
'numFooterLines' element is presentCheck for presence of the 'numFooterLines' element.Document contains 'numFooterLines' element.No 'numFooterLines' element foundIf data file contains footer lines, &#39;numFooterLines&#39; must be specified.Add 'numFooterLines' element if needed.
5fieldDelimiterValidvalid
Type:metadata
System:knb
On failure:error
Field delimiter is a single characterField delimiters should be one character onlyA single character is expected,A valid fieldDelimiter value was foundhttp://knb.ecoinformatics.org/software/eml/eml-2.1.0/eml-physical.html#fieldDelimiter
6recordDelimiterPresentvalid
Type:metadata
System:knb
On failure:warn
Record delimiter is presentCheck presence of record delimiter. Check that the record delimiter is one of the suggested values.A record delimiter from a list of suggested values: \n, \r, \r\n, #x0A, #x0D, #x0D#x0A\nA valid recordDelimiter value was foundhttp://knb.ecoinformatics.org/software/eml/eml-2.1.0/eml-physical.html#recordDelimiter
7numberOfRecordsPresencevalid
Type:metadata
System:knb
On failure:warn
Is the numberOfRecords element present?Warn the user if the numberOfRecords check is not presentA number of records element is expected for this entitynumberOfRecords element foundThis is a valuable check that we have the correct table.
8entitySizePresencevalid
Type:metadata
System:knb
On failure:warn
Check for presence of an entity size elementLook for entity size element as a prep for checking congruence, and if not present, generate a warn. Note that to be most useful (i.e, to check congruence), entity size should contain the most precise measure of size, which is "byte" (the default unit); however, the presence or name of the entity size unit is NOT checked.Entity size is present. If unit="byte" or unit is omitted (default = byte), then congruence can be checked.Found entity size element with value of 466 and size unit specified as 'byte'.Examining the entity size is prep for checking congruence. Including the element is best practice, and if not present, a warn is generated. To be most useful, entity size should contain the most precise measure of size, which is &#34;byte&#34; (the default unit).Include an entity size in bytes Example success: knb-lter-sbc.3.12. Example of size in units other than byte: knb-lter-mcr.6.56.
9integrityChecksumPresencevalid
Type:metadata
System:lter
On failure:warn
A physical/authentication element is present and specifies a method attribute with a value of MD5 or SHA-1Check for presence of a physical/authentication element containing a checksum or hash value for an integrity check (e.g. MD5, SHA-1). Warn if an entity does not have a physical/authentication element, or if none of the physical/authentication elements specify a method attribute with a value of MD5 or SHA-1.At least one physical/authentication element with a method attribute specifying MD5 or SHA-1 and containing a checksum or hash value that can be used to perform an integrity check on the data.truePASTA will use this value to check the integrity of the data it downloads from your site. In addition, PASTA is planning to compare the contributor-supplied checksum/hash value documented in the physical/authentication element to the checksum/hash value of this entity downloaded from previous revisions of this data package. If PASTA already has a copy of this entity, it will be able to avoid an unnecessary download of the entity from your site, resulting in faster processing of the new data package revision when you update it in PASTA.Add a physical/authentication element and store the entity checksum or hash value in it using a method such as MD5 or SHA-1.
10attributeNamesUniquevalid
Type:metadata
System:knb
On failure:warn
Attribute names are uniqueChecks if attributeName values are unique in the table. Not required by EML.Unique attribute names.trueA good table does not have duplicate column names.EML Best Practices
11displayDownloadDatainfo
Type:data
System:knb
On failure:info
Display downloaded dataDisplay the first kilobyte of data that is downloadedUp to one kilobyte of data should be displayed
12urlReturnsDatavalid
Type:congruency
System:knb
On failure:error
URL returns dataChecks whether a URL returns data. Unless the URL is specified to be function="information", the URL should return the resource for download.A data entity that matches the metadatatruehttp://knb.ecoinformatics.org/software/eml/eml-2.1.0/eml-resource.html#UrlType
13onlineURLsvalid
Type:congruency
System:knb
On failure:error
Online URLs are liveCheck that online URLs return somethingtruetrueSucceeded in accessing URL: <![CDATA[https://ezeml.edirepository.org/user-data/iep-6f022aeb59daaf04006d61b9f2d3a887/uploads/Impact%20of%202021%20Drought%20Management%20on%20Harmful%20Algal%20Blooms%20and%20Aquatic%20Weeds%20in%20the%20Delta/franks_tract_fluridone_2006-2021_summary.csv]]>
14integrityChecksumvalid
Type:congruency
System:lter
On failure:error
Compare the metadata checksum for an entity to the checksum of the downloaded entityTwo possible responses: valid if checksums match; error if checksums do not match.42ca1d03ff37065c771f77c7a47a379f42ca1d03ff37065c771f77c7a47a379fMatching checksums will ensure data integrity during upload to the repository.If the found integrity hash value does not match the expected integrity hash value, there may have been a loss of integrity in the data download. Check that the hash method and hash value documented in the metadata are the correct values.
15entitySizeCongruencevalid
Type:congruency
System:knb
On failure:error
Check that the entity size in the Level 0 metadata matches the one PASTA+ generates.Compare raw file size of file to [entity]/physical/size element in metadata. Return error if not matching.466466Examining the entity size is a method for checking that this is the correct entity.Check the entity size.
16databaseTableCreatedvalid
Type:metadata
System:knb
On failure:error
Database table createdStatus of creating a database tableA database table is expected to be generated from the EML attributes.A database table was generated from the attributes description<![CDATA[CREATE TABLE _2e5cdb780f00d927e90a28f5c2ef8180("year" FLOAT,"fl_rate_ppb" FLOAT,"fl_area_ha" FLOAT,"fl_quantity_kg" FLOAT);]]>
17onlineURLsvalid
Type:congruency
System:knb
On failure:error
Online URLs are liveCheck that online URLs return somethingtruetrueSucceeded in accessing URL: <![CDATA[file:///home/pasta/local/data/edi.1337.3/2e5cdb780f00d927e90a28f5c2ef8180]]>
18examineRecordDelimitervalid
Type:congruency
System:knb
On failure:warn
Data are examined and possible record delimiters are displayedIf no record delimiter was specified, we assume that \r\n is the delimiter. Search the first row for other record delimiters and see if other delimiters are found.No other potential record delimiters expected in the first row.No other potential record delimiters were detected. A valid record delimiter was previously detectedhttp://knb.ecoinformatics.org/software/eml/eml-2.1.0/eml-physical.html#recordDelimiter
19displayFirstInsertRowinfo
Type:data
System:knb
On failure:info
Display first insert rowDisplay the first row of data values to be inserted into the database tableThe first row of data values should be displayed<![CDATA[2006, NA, 56.65604, NA]]>
20tooFewFieldsvalid
Type:congruency
System:knb
On failure:error
Data does not have fewer fields than metadata attributesCompare number of fields specified in metadata to number of fields found in a data recordNo errors detectedhttp://knb.ecoinformatics.org/software/eml/eml-2.1.0/eml-physical.html#dataFormat
21tooManyFieldsvalid
Type:congruency
System:knb
On failure:error
Data does not have more fields than metadata attributesCompare number of fields specified in metadata to number of fields found in a data recordNo errors detectedhttp://knb.ecoinformatics.org/software/eml/eml-2.1.0/eml-physical.html#dataFormat
22dataLoadStatusvalid
Type:congruency
System:knb
On failure:warn
Data can be loaded into the databaseStatus of loading the data table into a databaseNo errors expected during data loading or data loading was not attempted for this data entityThe data table loaded successfully into a database
23numberOfRecordsvalid
Type:congruency
System:knb
On failure:warn
Number of records in metadata matches number of rows loadedCompare number of records specified in metadata to number of records found in data1616The expected number of records (16) was found in the data table.
24headerRowAttributeNamesinfo
Type:congruency
System:lter
On failure:info
Header row is displayed alongside attribute namesCompare the content of the data header row to the content of EML attribute names.No expectation, information only Customer should evaluate the findings
25dateFormatMatchesvalid
Type:congruency
System:lter
On failure:warn
Date format in metadata matches datadateTime/formatString in attribute metadata is from the preferred list, and the data matches. A non-match generates only a warn.Format string is preferred, and all data values match the format stringData values matched the specified formatString.Dates should be consistently formatted and match the formatString in metadata.
Entity Report
Entity Name: discrete_wq&outflow_data_summary
Entity Identifier:
# Identifier Status Quality Check Name Description Expected Found Explanation Suggestion Reference
1entityNameLengthvalid
Type:metadata
System:knb
On failure:warn
Length of entityName is not excessive (less than 100 char)length of entity name is less than 100 charactersentityName value is 100 characters or less32
2entityDescriptionPresentvalid
Type:metadata
System:lter
On failure:warn
An entity description is presentCheck for presence of an entity description.EML Best practices pp. 32-33, "...should have enough information for a user..."trueWith entityName sometimes serving as a file name rather than a title, it is important to be very descriptive here.
3numHeaderLinesPresentinfo
Type:metadata
System:knb
On failure:info
'numHeaderLines' element is presentCheck for presence of the 'numHeaderLines' element.Document contains 'numHeaderLines' element.'numHeaderLines' element: 1
4numFooterLinesPresentinfo
Type:metadata
System:knb
On failure:info
'numFooterLines' element is presentCheck for presence of the 'numFooterLines' element.Document contains 'numFooterLines' element.No 'numFooterLines' element foundIf data file contains footer lines, &#39;numFooterLines&#39; must be specified.Add 'numFooterLines' element if needed.
5fieldDelimiterValidvalid
Type:metadata
System:knb
On failure:error
Field delimiter is a single characterField delimiters should be one character onlyA single character is expected,A valid fieldDelimiter value was foundhttp://knb.ecoinformatics.org/software/eml/eml-2.1.0/eml-physical.html#fieldDelimiter
6recordDelimiterPresentvalid
Type:metadata
System:knb
On failure:warn
Record delimiter is presentCheck presence of record delimiter. Check that the record delimiter is one of the suggested values.A record delimiter from a list of suggested values: \n, \r, \r\n, #x0A, #x0D, #x0D#x0A\nA valid recordDelimiter value was foundhttp://knb.ecoinformatics.org/software/eml/eml-2.1.0/eml-physical.html#recordDelimiter
7numberOfRecordsPresencevalid
Type:metadata
System:knb
On failure:warn
Is the numberOfRecords element present?Warn the user if the numberOfRecords check is not presentA number of records element is expected for this entitynumberOfRecords element foundThis is a valuable check that we have the correct table.
8entitySizePresencevalid
Type:metadata
System:knb
On failure:warn
Check for presence of an entity size elementLook for entity size element as a prep for checking congruence, and if not present, generate a warn. Note that to be most useful (i.e, to check congruence), entity size should contain the most precise measure of size, which is "byte" (the default unit); however, the presence or name of the entity size unit is NOT checked.Entity size is present. If unit="byte" or unit is omitted (default = byte), then congruence can be checked.Found entity size element with value of 3650 and size unit specified as 'byte'.Examining the entity size is prep for checking congruence. Including the element is best practice, and if not present, a warn is generated. To be most useful, entity size should contain the most precise measure of size, which is &#34;byte&#34; (the default unit).Include an entity size in bytes Example success: knb-lter-sbc.3.12. Example of size in units other than byte: knb-lter-mcr.6.56.
9integrityChecksumPresencevalid
Type:metadata
System:lter
On failure:warn
A physical/authentication element is present and specifies a method attribute with a value of MD5 or SHA-1Check for presence of a physical/authentication element containing a checksum or hash value for an integrity check (e.g. MD5, SHA-1). Warn if an entity does not have a physical/authentication element, or if none of the physical/authentication elements specify a method attribute with a value of MD5 or SHA-1.At least one physical/authentication element with a method attribute specifying MD5 or SHA-1 and containing a checksum or hash value that can be used to perform an integrity check on the data.truePASTA will use this value to check the integrity of the data it downloads from your site. In addition, PASTA is planning to compare the contributor-supplied checksum/hash value documented in the physical/authentication element to the checksum/hash value of this entity downloaded from previous revisions of this data package. If PASTA already has a copy of this entity, it will be able to avoid an unnecessary download of the entity from your site, resulting in faster processing of the new data package revision when you update it in PASTA.Add a physical/authentication element and store the entity checksum or hash value in it using a method such as MD5 or SHA-1.
10attributeNamesUniquevalid
Type:metadata
System:knb
On failure:warn
Attribute names are uniqueChecks if attributeName values are unique in the table. Not required by EML.Unique attribute names.trueA good table does not have duplicate column names.EML Best Practices
11displayDownloadDatainfo
Type:data
System:knb
On failure:info
Display downloaded dataDisplay the first kilobyte of data that is downloadedUp to one kilobyte of data should be displayed
12urlReturnsDatavalid
Type:congruency
System:knb
On failure:error
URL returns dataChecks whether a URL returns data. Unless the URL is specified to be function="information", the URL should return the resource for download.A data entity that matches the metadatatruehttp://knb.ecoinformatics.org/software/eml/eml-2.1.0/eml-resource.html#UrlType
13onlineURLsvalid
Type:congruency
System:knb
On failure:error
Online URLs are liveCheck that online URLs return somethingtruetrueSucceeded in accessing URL: <![CDATA[https://ezeml.edirepository.org/user-data/iep-6f022aeb59daaf04006d61b9f2d3a887/uploads/Impact%20of%202021%20Drought%20Management%20on%20Harmful%20Algal%20Blooms%20and%20Aquatic%20Weeds%20in%20the%20Delta/discrete_wq%26outflow_data_summary.csv]]>
14integrityChecksumvalid
Type:congruency
System:lter
On failure:error
Compare the metadata checksum for an entity to the checksum of the downloaded entityTwo possible responses: valid if checksums match; error if checksums do not match.fa327ab6dc7a282c25a9beef26152dcefa327ab6dc7a282c25a9beef26152dceMatching checksums will ensure data integrity during upload to the repository.If the found integrity hash value does not match the expected integrity hash value, there may have been a loss of integrity in the data download. Check that the hash method and hash value documented in the metadata are the correct values.
15entitySizeCongruencevalid
Type:congruency
System:knb
On failure:error
Check that the entity size in the Level 0 metadata matches the one PASTA+ generates.Compare raw file size of file to [entity]/physical/size element in metadata. Return error if not matching.36503650Examining the entity size is a method for checking that this is the correct entity.Check the entity size.
16databaseTableCreatedvalid
Type:metadata
System:knb
On failure:error
Database table createdStatus of creating a database tableA database table is expected to be generated from the EML attributes.A database table was generated from the attributes description<![CDATA[CREATE TABLE _da6f3b260261e36c098a95618918674b("Station" TEXT,"year" FLOAT,"Temperature" FLOAT,"Conductivity" FLOAT,"Salinity" FLOAT,"Secchi" FLOAT,"DissolvedOxygen" FLOAT,"pH" FLOAT,"out_mean" FLOAT);]]>
17examineRecordDelimitervalid
Type:congruency
System:knb
On failure:warn
Data are examined and possible record delimiters are displayedIf no record delimiter was specified, we assume that \r\n is the delimiter. Search the first row for other record delimiters and see if other delimiters are found.No other potential record delimiters expected in the first row.No other potential record delimiters were detected. A valid record delimiter was previously detectedhttp://knb.ecoinformatics.org/software/eml/eml-2.1.0/eml-physical.html#recordDelimiter
18displayFirstInsertRowinfo
Type:data
System:knb
On failure:info
Display first insert rowDisplay the first row of data values to be inserted into the database tableThe first row of data values should be displayed<![CDATA[853, 2004, 18.975, 1286.25, 0.6533427619326614, 52.5, NA, NA, 15343.224489795919]]>
19onlineURLsvalid
Type:congruency
System:knb
On failure:error
Online URLs are liveCheck that online URLs return somethingtruetrueSucceeded in accessing URL: <![CDATA[file:///home/pasta/local/data/edi.1337.3/da6f3b260261e36c098a95618918674b]]>
20tooFewFieldsvalid
Type:congruency
System:knb
On failure:error
Data does not have fewer fields than metadata attributesCompare number of fields specified in metadata to number of fields found in a data recordNo errors detectedhttp://knb.ecoinformatics.org/software/eml/eml-2.1.0/eml-physical.html#dataFormat
21tooManyFieldsvalid
Type:congruency
System:knb
On failure:error
Data does not have more fields than metadata attributesCompare number of fields specified in metadata to number of fields found in a data recordNo errors detectedhttp://knb.ecoinformatics.org/software/eml/eml-2.1.0/eml-physical.html#dataFormat
22dataLoadStatusvalid
Type:congruency
System:knb
On failure:warn
Data can be loaded into the databaseStatus of loading the data table into a databaseNo errors expected during data loading or data loading was not attempted for this data entityThe data table loaded successfully into a database
23numberOfRecordsvalid
Type:congruency
System:knb
On failure:warn
Number of records in metadata matches number of rows loadedCompare number of records specified in metadata to number of records found in data4242The expected number of records (42) was found in the data table.
24headerRowAttributeNamesinfo
Type:congruency
System:lter
On failure:info
Header row is displayed alongside attribute namesCompare the content of the data header row to the content of EML attribute names.No expectation, information only Customer should evaluate the findings
25dateFormatMatchesvalid
Type:congruency
System:lter
On failure:warn
Date format in metadata matches datadateTime/formatString in attribute metadata is from the preferred list, and the data matches. A non-match generates only a warn.Format string is preferred, and all data values match the format stringData values matched the specified formatString.Dates should be consistently formatted and match the formatString in metadata.
Entity Report
Entity Name: CSTARS_2021_FT&BB_Formatted_EDI
Entity Identifier:
# Identifier Status Quality Check Name Description Expected Found Explanation Suggestion Reference
1entityNameLengthvalid
Type:metadata
System:knb
On failure:warn
Length of entityName is not excessive (less than 100 char)length of entity name is less than 100 charactersentityName value is 100 characters or less31
2entityDescriptionPresentvalid
Type:metadata
System:lter
On failure:warn
An entity description is presentCheck for presence of an entity description.EML Best practices pp. 32-33, "...should have enough information for a user..."trueWith entityName sometimes serving as a file name rather than a title, it is important to be very descriptive here.
3numHeaderLinesPresentinfo
Type:metadata
System:knb
On failure:info
'numHeaderLines' element is presentCheck for presence of the 'numHeaderLines' element.Document contains 'numHeaderLines' element.'numHeaderLines' element: 1
4numFooterLinesPresentinfo
Type:metadata
System:knb
On failure:info
'numFooterLines' element is presentCheck for presence of the 'numFooterLines' element.Document contains 'numFooterLines' element.No 'numFooterLines' element foundIf data file contains footer lines, &#39;numFooterLines&#39; must be specified.Add 'numFooterLines' element if needed.
5fieldDelimiterValidvalid
Type:metadata
System:knb
On failure:error
Field delimiter is a single characterField delimiters should be one character onlyA single character is expected,A valid fieldDelimiter value was foundhttp://knb.ecoinformatics.org/software/eml/eml-2.1.0/eml-physical.html#fieldDelimiter
6recordDelimiterPresentvalid
Type:metadata
System:knb
On failure:warn
Record delimiter is presentCheck presence of record delimiter. Check that the record delimiter is one of the suggested values.A record delimiter from a list of suggested values: \n, \r, \r\n, #x0A, #x0D, #x0D#x0A\nA valid recordDelimiter value was foundhttp://knb.ecoinformatics.org/software/eml/eml-2.1.0/eml-physical.html#recordDelimiter
7numberOfRecordsPresencevalid
Type:metadata
System:knb
On failure:warn
Is the numberOfRecords element present?Warn the user if the numberOfRecords check is not presentA number of records element is expected for this entitynumberOfRecords element foundThis is a valuable check that we have the correct table.
8entitySizePresencevalid
Type:metadata
System:knb
On failure:warn
Check for presence of an entity size elementLook for entity size element as a prep for checking congruence, and if not present, generate a warn. Note that to be most useful (i.e, to check congruence), entity size should contain the most precise measure of size, which is "byte" (the default unit); however, the presence or name of the entity size unit is NOT checked.Entity size is present. If unit="byte" or unit is omitted (default = byte), then congruence can be checked.Found entity size element with value of 14299 and size unit specified as 'byte'.Examining the entity size is prep for checking congruence. Including the element is best practice, and if not present, a warn is generated. To be most useful, entity size should contain the most precise measure of size, which is &#34;byte&#34; (the default unit).Include an entity size in bytes Example success: knb-lter-sbc.3.12. Example of size in units other than byte: knb-lter-mcr.6.56.
9integrityChecksumPresencevalid
Type:metadata
System:lter
On failure:warn
A physical/authentication element is present and specifies a method attribute with a value of MD5 or SHA-1Check for presence of a physical/authentication element containing a checksum or hash value for an integrity check (e.g. MD5, SHA-1). Warn if an entity does not have a physical/authentication element, or if none of the physical/authentication elements specify a method attribute with a value of MD5 or SHA-1.At least one physical/authentication element with a method attribute specifying MD5 or SHA-1 and containing a checksum or hash value that can be used to perform an integrity check on the data.truePASTA will use this value to check the integrity of the data it downloads from your site. In addition, PASTA is planning to compare the contributor-supplied checksum/hash value documented in the physical/authentication element to the checksum/hash value of this entity downloaded from previous revisions of this data package. If PASTA already has a copy of this entity, it will be able to avoid an unnecessary download of the entity from your site, resulting in faster processing of the new data package revision when you update it in PASTA.Add a physical/authentication element and store the entity checksum or hash value in it using a method such as MD5 or SHA-1.
10dateTimeFormatStringvalid
Type:metadata
System:knb
On failure:warn
dateTime/formatString specified in metadata is from a preferred set of valuesCertain features of dateTime data formats are preferred, eg, ISO 8601, 4-digit years. This check looks at metadata to see if the dateTime format is in that preferred list.A formatString value that is a member of the preferred set is expected.YYYY-MM-DDA preferred format string was found.Modify the dateTime/formatString, selecting from among the preferred values one that best matches the data format
11attributeNamesUniquevalid
Type:metadata
System:knb
On failure:warn
Attribute names are uniqueChecks if attributeName values are unique in the table. Not required by EML.Unique attribute names.trueA good table does not have duplicate column names.EML Best Practices
12displayDownloadDatainfo
Type:data
System:knb
On failure:info
Display downloaded dataDisplay the first kilobyte of data that is downloadedUp to one kilobyte of data should be displayed
13urlReturnsDatavalid
Type:congruency
System:knb
On failure:error
URL returns dataChecks whether a URL returns data. Unless the URL is specified to be function="information", the URL should return the resource for download.A data entity that matches the metadatatruehttp://knb.ecoinformatics.org/software/eml/eml-2.1.0/eml-resource.html#UrlType
14onlineURLsvalid
Type:congruency
System:knb
On failure:error
Online URLs are liveCheck that online URLs return somethingtruetrueSucceeded in accessing URL: <![CDATA[https://ezeml.edirepository.org/user-data/iep-6f022aeb59daaf04006d61b9f2d3a887/uploads/Impact%20of%202021%20Drought%20Management%20on%20Harmful%20Algal%20Blooms%20and%20Aquatic%20Weeds%20in%20the%20Delta/CSTARS_2021_FT%26BB_Formatted_EDI.csv]]>
15integrityChecksumvalid
Type:congruency
System:lter
On failure:error
Compare the metadata checksum for an entity to the checksum of the downloaded entityTwo possible responses: valid if checksums match; error if checksums do not match.33b34bc82d5b0631bec0cde54131368133b34bc82d5b0631bec0cde541313681Matching checksums will ensure data integrity during upload to the repository.If the found integrity hash value does not match the expected integrity hash value, there may have been a loss of integrity in the data download. Check that the hash method and hash value documented in the metadata are the correct values.
16entitySizeCongruencevalid
Type:congruency
System:knb
On failure:error
Check that the entity size in the Level 0 metadata matches the one PASTA+ generates.Compare raw file size of file to [entity]/physical/size element in metadata. Return error if not matching.1429914299Examining the entity size is a method for checking that this is the correct entity.Check the entity size.
17databaseTableCreatedvalid
Type:metadata
System:knb
On failure:error
Database table createdStatus of creating a database tableA database table is expected to be generated from the EML attributes.A database table was generated from the attributes description<![CDATA[CREATE TABLE _dfab3c259c1bd7b6325604d9a0a475a3("site" TEXT,"sample_id" FLOAT,"latitude_wgs84" FLOAT,"longitude_wgs84" FLOAT,"date" TIMESTAMP,"rake_teeth_corr" FLOAT,"species" TEXT,"rake_prop" FLOAT);]]>
18examineRecordDelimitervalid
Type:congruency
System:knb
On failure:warn
Data are examined and possible record delimiters are displayedIf no record delimiter was specified, we assume that \r\n is the delimiter. Search the first row for other record delimiters and see if other delimiters are found.No other potential record delimiters expected in the first row.No other potential record delimiters were detected. A valid record delimiter was previously detectedhttp://knb.ecoinformatics.org/software/eml/eml-2.1.0/eml-physical.html#recordDelimiter
19displayFirstInsertRowinfo
Type:data
System:knb
On failure:info
Display first insert rowDisplay the first row of data values to be inserted into the database tableThe first row of data values should be displayed<![CDATA[Big Break, 1, 38.008862761688135, -121.7108554442108, 2021-07-22, 100, Myriophyllum_spicatum, 100]]>
20onlineURLsvalid
Type:congruency
System:knb
On failure:error
Online URLs are liveCheck that online URLs return somethingtruetrueSucceeded in accessing URL: <![CDATA[file:///home/pasta/local/data/edi.1337.3/dfab3c259c1bd7b6325604d9a0a475a3]]>
21tooFewFieldsvalid
Type:congruency
System:knb
On failure:error
Data does not have fewer fields than metadata attributesCompare number of fields specified in metadata to number of fields found in a data recordNo errors detectedhttp://knb.ecoinformatics.org/software/eml/eml-2.1.0/eml-physical.html#dataFormat
22tooManyFieldsvalid
Type:congruency
System:knb
On failure:error
Data does not have more fields than metadata attributesCompare number of fields specified in metadata to number of fields found in a data recordNo errors detectedhttp://knb.ecoinformatics.org/software/eml/eml-2.1.0/eml-physical.html#dataFormat
23dataLoadStatusvalid
Type:congruency
System:knb
On failure:warn
Data can be loaded into the databaseStatus of loading the data table into a databaseNo errors expected during data loading or data loading was not attempted for this data entityThe data table loaded successfully into a database
24numberOfRecordsvalid
Type:congruency
System:knb
On failure:warn
Number of records in metadata matches number of rows loadedCompare number of records specified in metadata to number of records found in data160160The expected number of records (160) was found in the data table.
25headerRowAttributeNamesinfo
Type:congruency
System:lter
On failure:info
Header row is displayed alongside attribute namesCompare the content of the data header row to the content of EML attribute names.No expectation, information only Customer should evaluate the findings
26dateFormatMatchesvalid
Type:congruency
System:lter
On failure:warn
Date format in metadata matches datadateTime/formatString in attribute metadata is from the preferred list, and the data matches. A non-match generates only a warn.Format string is preferred, and all data values match the format stringData values matched the specified formatString.Dates should be consistently formatted and match the formatString in metadata.
Entity Report
Entity Name: FranksTractManagement_2014-2021_formatted_edi
Entity Identifier:
# Identifier Status Quality Check Name Description Expected Found Explanation Suggestion Reference
1entityNameLengthvalid
Type:metadata
System:knb
On failure:warn
Length of entityName is not excessive (less than 100 char)length of entity name is less than 100 charactersentityName value is 100 characters or less45
2entityDescriptionPresentvalid
Type:metadata
System:lter
On failure:warn
An entity description is presentCheck for presence of an entity description.EML Best practices pp. 32-33, "...should have enough information for a user..."trueWith entityName sometimes serving as a file name rather than a title, it is important to be very descriptive here.
3numHeaderLinesPresentinfo
Type:metadata
System:knb
On failure:info
'numHeaderLines' element is presentCheck for presence of the 'numHeaderLines' element.Document contains 'numHeaderLines' element.'numHeaderLines' element: 1
4numFooterLinesPresentinfo
Type:metadata
System:knb
On failure:info
'numFooterLines' element is presentCheck for presence of the 'numFooterLines' element.Document contains 'numFooterLines' element.No 'numFooterLines' element foundIf data file contains footer lines, &#39;numFooterLines&#39; must be specified.Add 'numFooterLines' element if needed.
5fieldDelimiterValidvalid
Type:metadata
System:knb
On failure:error
Field delimiter is a single characterField delimiters should be one character onlyA single character is expected,A valid fieldDelimiter value was foundhttp://knb.ecoinformatics.org/software/eml/eml-2.1.0/eml-physical.html#fieldDelimiter
6recordDelimiterPresentvalid
Type:metadata
System:knb
On failure:warn
Record delimiter is presentCheck presence of record delimiter. Check that the record delimiter is one of the suggested values.A record delimiter from a list of suggested values: \n, \r, \r\n, #x0A, #x0D, #x0D#x0A\nA valid recordDelimiter value was foundhttp://knb.ecoinformatics.org/software/eml/eml-2.1.0/eml-physical.html#recordDelimiter
7numberOfRecordsPresencevalid
Type:metadata
System:knb
On failure:warn
Is the numberOfRecords element present?Warn the user if the numberOfRecords check is not presentA number of records element is expected for this entitynumberOfRecords element foundThis is a valuable check that we have the correct table.
8entitySizePresencevalid
Type:metadata
System:knb
On failure:warn
Check for presence of an entity size elementLook for entity size element as a prep for checking congruence, and if not present, generate a warn. Note that to be most useful (i.e, to check congruence), entity size should contain the most precise measure of size, which is "byte" (the default unit); however, the presence or name of the entity size unit is NOT checked.Entity size is present. If unit="byte" or unit is omitted (default = byte), then congruence can be checked.Found entity size element with value of 860411 and size unit specified as 'byte'.Examining the entity size is prep for checking congruence. Including the element is best practice, and if not present, a warn is generated. To be most useful, entity size should contain the most precise measure of size, which is &#34;byte&#34; (the default unit).Include an entity size in bytes Example success: knb-lter-sbc.3.12. Example of size in units other than byte: knb-lter-mcr.6.56.
9integrityChecksumPresencevalid
Type:metadata
System:lter
On failure:warn
A physical/authentication element is present and specifies a method attribute with a value of MD5 or SHA-1Check for presence of a physical/authentication element containing a checksum or hash value for an integrity check (e.g. MD5, SHA-1). Warn if an entity does not have a physical/authentication element, or if none of the physical/authentication elements specify a method attribute with a value of MD5 or SHA-1.At least one physical/authentication element with a method attribute specifying MD5 or SHA-1 and containing a checksum or hash value that can be used to perform an integrity check on the data.truePASTA will use this value to check the integrity of the data it downloads from your site. In addition, PASTA is planning to compare the contributor-supplied checksum/hash value documented in the physical/authentication element to the checksum/hash value of this entity downloaded from previous revisions of this data package. If PASTA already has a copy of this entity, it will be able to avoid an unnecessary download of the entity from your site, resulting in faster processing of the new data package revision when you update it in PASTA.Add a physical/authentication element and store the entity checksum or hash value in it using a method such as MD5 or SHA-1.
10dateTimeFormatStringvalid
Type:metadata
System:knb
On failure:warn
dateTime/formatString specified in metadata is from a preferred set of valuesCertain features of dateTime data formats are preferred, eg, ISO 8601, 4-digit years. This check looks at metadata to see if the dateTime format is in that preferred list.A formatString value that is a member of the preferred set is expected.YYYY-MM-DDA preferred format string was found.Modify the dateTime/formatString, selecting from among the preferred values one that best matches the data format
11attributeNamesUniquevalid
Type:metadata
System:knb
On failure:warn
Attribute names are uniqueChecks if attributeName values are unique in the table. Not required by EML.Unique attribute names.trueA good table does not have duplicate column names.EML Best Practices
12displayDownloadDatainfo
Type:data
System:knb
On failure:info
Display downloaded dataDisplay the first kilobyte of data that is downloadedUp to one kilobyte of data should be displayed
13urlReturnsDatavalid
Type:congruency
System:knb
On failure:error
URL returns dataChecks whether a URL returns data. Unless the URL is specified to be function="information", the URL should return the resource for download.A data entity that matches the metadatatruehttp://knb.ecoinformatics.org/software/eml/eml-2.1.0/eml-resource.html#UrlType
14onlineURLsvalid
Type:congruency
System:knb
On failure:error
Online URLs are liveCheck that online URLs return somethingtruetrueSucceeded in accessing URL: <![CDATA[https://ezeml.edirepository.org/user-data/iep-6f022aeb59daaf04006d61b9f2d3a887/uploads/Impact%20of%202021%20Drought%20Management%20on%20Harmful%20Algal%20Blooms%20and%20Aquatic%20Weeds%20in%20the%20Delta/FranksTractManagement_2014-2021_formatted_edi.csv]]>
15integrityChecksumvalid
Type:congruency
System:lter
On failure:error
Compare the metadata checksum for an entity to the checksum of the downloaded entityTwo possible responses: valid if checksums match; error if checksums do not match.4ad6346f62f6b54ac6fd4f2606bc55a54ad6346f62f6b54ac6fd4f2606bc55a5Matching checksums will ensure data integrity during upload to the repository.If the found integrity hash value does not match the expected integrity hash value, there may have been a loss of integrity in the data download. Check that the hash method and hash value documented in the metadata are the correct values.
16entitySizeCongruencevalid
Type:congruency
System:knb
On failure:error
Check that the entity size in the Level 0 metadata matches the one PASTA+ generates.Compare raw file size of file to [entity]/physical/size element in metadata. Return error if not matching.860411860411Examining the entity size is a method for checking that this is the correct entity.Check the entity size.
17databaseTableCreatedvalid
Type:metadata
System:knb
On failure:error
Database table createdStatus of creating a database tableA database table is expected to be generated from the EML attributes.A database table was generated from the attributes description<![CDATA[CREATE TABLE _29aa82b792a1972386673df985b4dd25("station" TEXT,"sample_id" FLOAT,"latitude_wgs84" FLOAT,"longitude_wgs84" FLOAT,"date" TIMESTAMP,"sav_incidence" TEXT,"species" TEXT,"species_incidence" TEXT,"rake_coverage_ordinal" TEXT);]]>
18examineRecordDelimitervalid
Type:congruency
System:knb
On failure:warn
Data are examined and possible record delimiters are displayedIf no record delimiter was specified, we assume that \r\n is the delimiter. Search the first row for other record delimiters and see if other delimiters are found.No other potential record delimiters expected in the first row.No other potential record delimiters were detected. A valid record delimiter was previously detectedhttp://knb.ecoinformatics.org/software/eml/eml-2.1.0/eml-physical.html#recordDelimiter
19displayFirstInsertRowinfo
Type:data
System:knb
On failure:info
Display first insert rowDisplay the first row of data values to be inserted into the database tableThe first row of data values should be displayed<![CDATA[A1, 1, 38.0222583, -121.6055783, 2014-10-07, 1, Egeria_densa, 0, 0]]>
20onlineURLsvalid
Type:congruency
System:knb
On failure:error
Online URLs are liveCheck that online URLs return somethingtruetrueSucceeded in accessing URL: <![CDATA[file:///home/pasta/local/data/edi.1337.3/29aa82b792a1972386673df985b4dd25]]>
21tooFewFieldsvalid
Type:congruency
System:knb
On failure:error
Data does not have fewer fields than metadata attributesCompare number of fields specified in metadata to number of fields found in a data recordNo errors detectedhttp://knb.ecoinformatics.org/software/eml/eml-2.1.0/eml-physical.html#dataFormat
22tooManyFieldsvalid
Type:congruency
System:knb
On failure:error
Data does not have more fields than metadata attributesCompare number of fields specified in metadata to number of fields found in a data recordNo errors detectedhttp://knb.ecoinformatics.org/software/eml/eml-2.1.0/eml-physical.html#dataFormat
23dataLoadStatusvalid
Type:congruency
System:knb
On failure:warn
Data can be loaded into the databaseStatus of loading the data table into a databaseNo errors expected during data loading or data loading was not attempted for this data entityThe data table loaded successfully into a database
24numberOfRecordsvalid
Type:congruency
System:knb
On failure:warn
Number of records in metadata matches number of rows loadedCompare number of records specified in metadata to number of records found in data1267512675The expected number of records (12675) was found in the data table.
25headerRowAttributeNamesinfo
Type:congruency
System:lter
On failure:info
Header row is displayed alongside attribute namesCompare the content of the data header row to the content of EML attribute names.No expectation, information only Customer should evaluate the findings
26dateFormatMatchesvalid
Type:congruency
System:lter
On failure:warn
Date format in metadata matches datadateTime/formatString in attribute metadata is from the preferred list, and the data matches. A non-match generates only a warn.Format string is preferred, and all data values match the format stringData values matched the specified formatString.Dates should be consistently formatted and match the formatString in metadata.
Entity Report
Entity Name: Water Year Assignments
Entity Identifier:
# Identifier Status Quality Check Name Description Expected Found Explanation Suggestion Reference
1entityNameLengthvalid
Type:metadata
System:knb
On failure:warn
Length of entityName is not excessive (less than 100 char)length of entity name is less than 100 charactersentityName value is 100 characters or less22
2entityDescriptionPresentvalid
Type:metadata
System:lter
On failure:warn
An entity description is presentCheck for presence of an entity description.EML Best practices pp. 32-33, "...should have enough information for a user..."trueWith entityName sometimes serving as a file name rather than a title, it is important to be very descriptive here.
3numHeaderLinesPresentinfo
Type:metadata
System:knb
On failure:info
'numHeaderLines' element is presentCheck for presence of the 'numHeaderLines' element.Document contains 'numHeaderLines' element.'numHeaderLines' element: 1
4numFooterLinesPresentinfo
Type:metadata
System:knb
On failure:info
'numFooterLines' element is presentCheck for presence of the 'numFooterLines' element.Document contains 'numFooterLines' element.No 'numFooterLines' element foundIf data file contains footer lines, &#39;numFooterLines&#39; must be specified.Add 'numFooterLines' element if needed.
5fieldDelimiterValidvalid
Type:metadata
System:knb
On failure:error
Field delimiter is a single characterField delimiters should be one character onlyA single character is expected,A valid fieldDelimiter value was foundhttp://knb.ecoinformatics.org/software/eml/eml-2.1.0/eml-physical.html#fieldDelimiter
6recordDelimiterPresentvalid
Type:metadata
System:knb
On failure:warn
Record delimiter is presentCheck presence of record delimiter. Check that the record delimiter is one of the suggested values.A record delimiter from a list of suggested values: \n, \r, \r\n, #x0A, #x0D, #x0D#x0A\r\nA valid recordDelimiter value was foundhttp://knb.ecoinformatics.org/software/eml/eml-2.1.0/eml-physical.html#recordDelimiter
7numberOfRecordsPresencevalid
Type:metadata
System:knb
On failure:warn
Is the numberOfRecords element present?Warn the user if the numberOfRecords check is not presentA number of records element is expected for this entitynumberOfRecords element foundThis is a valuable check that we have the correct table.
8entitySizePresencevalid
Type:metadata
System:knb
On failure:warn
Check for presence of an entity size elementLook for entity size element as a prep for checking congruence, and if not present, generate a warn. Note that to be most useful (i.e, to check congruence), entity size should contain the most precise measure of size, which is "byte" (the default unit); however, the presence or name of the entity size unit is NOT checked.Entity size is present. If unit="byte" or unit is omitted (default = byte), then congruence can be checked.Found entity size element with value of 986 and size unit specified as 'byte'.Examining the entity size is prep for checking congruence. Including the element is best practice, and if not present, a warn is generated. To be most useful, entity size should contain the most precise measure of size, which is &#34;byte&#34; (the default unit).Include an entity size in bytes Example success: knb-lter-sbc.3.12. Example of size in units other than byte: knb-lter-mcr.6.56.
9integrityChecksumPresencevalid
Type:metadata
System:lter
On failure:warn
A physical/authentication element is present and specifies a method attribute with a value of MD5 or SHA-1Check for presence of a physical/authentication element containing a checksum or hash value for an integrity check (e.g. MD5, SHA-1). Warn if an entity does not have a physical/authentication element, or if none of the physical/authentication elements specify a method attribute with a value of MD5 or SHA-1.At least one physical/authentication element with a method attribute specifying MD5 or SHA-1 and containing a checksum or hash value that can be used to perform an integrity check on the data.truePASTA will use this value to check the integrity of the data it downloads from your site. In addition, PASTA is planning to compare the contributor-supplied checksum/hash value documented in the physical/authentication element to the checksum/hash value of this entity downloaded from previous revisions of this data package. If PASTA already has a copy of this entity, it will be able to avoid an unnecessary download of the entity from your site, resulting in faster processing of the new data package revision when you update it in PASTA.Add a physical/authentication element and store the entity checksum or hash value in it using a method such as MD5 or SHA-1.
10attributeNamesUniquevalid
Type:metadata
System:knb
On failure:warn
Attribute names are uniqueChecks if attributeName values are unique in the table. Not required by EML.Unique attribute names.trueA good table does not have duplicate column names.EML Best Practices
11displayDownloadDatainfo
Type:data
System:knb
On failure:info
Display downloaded dataDisplay the first kilobyte of data that is downloadedUp to one kilobyte of data should be displayed
12urlReturnsDatavalid
Type:congruency
System:knb
On failure:error
URL returns dataChecks whether a URL returns data. Unless the URL is specified to be function="information", the URL should return the resource for download.A data entity that matches the metadatatruehttp://knb.ecoinformatics.org/software/eml/eml-2.1.0/eml-resource.html#UrlType
13onlineURLsvalid
Type:congruency
System:knb
On failure:error
Online URLs are liveCheck that online URLs return somethingtruetrueSucceeded in accessing URL: <![CDATA[https://ezeml.edirepository.org/user-data/iep-6f022aeb59daaf04006d61b9f2d3a887/uploads/Impact%20of%202021%20Drought%20Management%20on%20Harmful%20Algal%20Blooms%20and%20Aquatic%20Weeds%20in%20the%20Delta/WaterYearAssignments.csv]]>
14integrityChecksumvalid
Type:congruency
System:lter
On failure:error
Compare the metadata checksum for an entity to the checksum of the downloaded entityTwo possible responses: valid if checksums match; error if checksums do not match.1e73893b731733255ccd21dab3f736821e73893b731733255ccd21dab3f73682Matching checksums will ensure data integrity during upload to the repository.If the found integrity hash value does not match the expected integrity hash value, there may have been a loss of integrity in the data download. Check that the hash method and hash value documented in the metadata are the correct values.
15entitySizeCongruencevalid
Type:congruency
System:knb
On failure:error
Check that the entity size in the Level 0 metadata matches the one PASTA+ generates.Compare raw file size of file to [entity]/physical/size element in metadata. Return error if not matching.986986Examining the entity size is a method for checking that this is the correct entity.Check the entity size.
16databaseTableCreatedvalid
Type:metadata
System:knb
On failure:error
Database table createdStatus of creating a database tableA database table is expected to be generated from the EML attributes.A database table was generated from the attributes description<![CDATA[CREATE TABLE _d0b670b8cad6e27ff149815d2f46e0f0("Year" FLOAT,"Index" FLOAT,"Yr_type" TEXT);]]>
17onlineURLsvalid
Type:congruency
System:knb
On failure:error
Online URLs are liveCheck that online URLs return somethingtruetrueSucceeded in accessing URL: <![CDATA[file:///home/pasta/local/data/edi.1337.3/d0b670b8cad6e27ff149815d2f46e0f0]]>
18examineRecordDelimitervalid
Type:congruency
System:knb
On failure:warn
Data are examined and possible record delimiters are displayedIf no record delimiter was specified, we assume that \r\n is the delimiter. Search the first row for other record delimiters and see if other delimiters are found.No other potential record delimiters expected in the first row.No other potential record delimiters were detected. A valid record delimiter was previously detectedhttp://knb.ecoinformatics.org/software/eml/eml-2.1.0/eml-physical.html#recordDelimiter
19displayFirstInsertRowinfo
Type:data
System:knb
On failure:info
Display first insert rowDisplay the first row of data values to be inserted into the database tableThe first row of data values should be displayed<![CDATA[1970, 10.4, Wet]]>
20tooFewFieldsvalid
Type:congruency
System:knb
On failure:error
Data does not have fewer fields than metadata attributesCompare number of fields specified in metadata to number of fields found in a data recordNo errors detectedhttp://knb.ecoinformatics.org/software/eml/eml-2.1.0/eml-physical.html#dataFormat
21tooManyFieldsvalid
Type:congruency
System:knb
On failure:error
Data does not have more fields than metadata attributesCompare number of fields specified in metadata to number of fields found in a data recordNo errors detectedhttp://knb.ecoinformatics.org/software/eml/eml-2.1.0/eml-physical.html#dataFormat
22dataLoadStatusvalid
Type:congruency
System:knb
On failure:warn
Data can be loaded into the databaseStatus of loading the data table into a databaseNo errors expected during data loading or data loading was not attempted for this data entityThe data table loaded successfully into a database
23numberOfRecordsvalid
Type:congruency
System:knb
On failure:warn
Number of records in metadata matches number of rows loadedCompare number of records specified in metadata to number of records found in data5252The expected number of records (52) was found in the data table.
24headerRowAttributeNamesinfo
Type:congruency
System:lter
On failure:info
Header row is displayed alongside attribute namesCompare the content of the data header row to the content of EML attribute names.No expectation, information only Customer should evaluate the findings
25dateFormatMatchesvalid
Type:congruency
System:lter
On failure:warn
Date format in metadata matches datadateTime/formatString in attribute metadata is from the preferred list, and the data matches. A non-match generates only a warn.Format string is preferred, and all data values match the format stringData values matched the specified formatString.Dates should be consistently formatted and match the formatString in metadata.
Entity Report
Entity Name: Supplemental figures for HABsWeeds
Entity Identifier:
# Identifier Status Quality Check Name Description Expected Found Explanation Suggestion Reference
1entityNameLengthvalid
Type:metadata
System:knb
On failure:warn
Length of entityName is not excessive (less than 100 char)length of entity name is less than 100 charactersentityName value is 100 characters or less34
2entityDescriptionPresentvalid
Type:metadata
System:lter
On failure:warn
An entity description is presentCheck for presence of an entity description.EML Best practices pp. 32-33, "...should have enough information for a user..."trueWith entityName sometimes serving as a file name rather than a title, it is important to be very descriptive here.
3numHeaderLinesPresentinfo
Type:metadata
System:knb
On failure:info
'numHeaderLines' element is presentCheck for presence of the 'numHeaderLines' element.Document contains 'numHeaderLines' element.No 'numHeaderLines' element foundIf data file contains header lines, &#39;numHeaderLines&#39; must be specified.Add 'numHeaderLines' element if needed.
4numFooterLinesPresentinfo
Type:metadata
System:knb
On failure:info
'numFooterLines' element is presentCheck for presence of the 'numFooterLines' element.Document contains 'numFooterLines' element.No 'numFooterLines' element foundIf data file contains footer lines, &#39;numFooterLines&#39; must be specified.Add 'numFooterLines' element if needed.
5fieldDelimiterValidinfo
Type:metadata
System:knb
On failure:error
Field delimiter is a single characterField delimiters should be one character onlyA single character is expectednullA fieldDelimiter value is not checked for binary entities or entities with an externally defined formathttp://knb.ecoinformatics.org/software/eml/eml-2.1.0/eml-physical.html#fieldDelimiter
6recordDelimiterPresentinfo
Type:metadata
System:knb
On failure:warn
Record delimiter is presentCheck presence of record delimiter. Check that the record delimiter is one of the suggested values.A record delimiter from a list of suggested values: \n, \r, \r\n, #x0A, #x0D, #x0D#x0AnullA recordDelimiter value is not checked for binary entities or entities with an externally defined formathttp://knb.ecoinformatics.org/software/eml/eml-2.1.0/eml-physical.html#recordDelimiter
7entitySizePresencevalid
Type:metadata
System:knb
On failure:warn
Check for presence of an entity size elementLook for entity size element as a prep for checking congruence, and if not present, generate a warn. Note that to be most useful (i.e, to check congruence), entity size should contain the most precise measure of size, which is "byte" (the default unit); however, the presence or name of the entity size unit is NOT checked.Entity size is present. If unit="byte" or unit is omitted (default = byte), then congruence can be checked.Found entity size element with value of 2309202 and size unit specified as 'byte'.Examining the entity size is prep for checking congruence. Including the element is best practice, and if not present, a warn is generated. To be most useful, entity size should contain the most precise measure of size, which is &#34;byte&#34; (the default unit).Include an entity size in bytes Example success: knb-lter-sbc.3.12. Example of size in units other than byte: knb-lter-mcr.6.56.
8integrityChecksumPresencevalid
Type:metadata
System:lter
On failure:warn
A physical/authentication element is present and specifies a method attribute with a value of MD5 or SHA-1Check for presence of a physical/authentication element containing a checksum or hash value for an integrity check (e.g. MD5, SHA-1). Warn if an entity does not have a physical/authentication element, or if none of the physical/authentication elements specify a method attribute with a value of MD5 or SHA-1.At least one physical/authentication element with a method attribute specifying MD5 or SHA-1 and containing a checksum or hash value that can be used to perform an integrity check on the data.truePASTA will use this value to check the integrity of the data it downloads from your site. In addition, PASTA is planning to compare the contributor-supplied checksum/hash value documented in the physical/authentication element to the checksum/hash value of this entity downloaded from previous revisions of this data package. If PASTA already has a copy of this entity, it will be able to avoid an unnecessary download of the entity from your site, resulting in faster processing of the new data package revision when you update it in PASTA.Add a physical/authentication element and store the entity checksum or hash value in it using a method such as MD5 or SHA-1.
9displayDownloadDatainfo
Type:data
System:knb
On failure:info
Display downloaded dataDisplay the first kilobyte of data that is downloadedUp to one kilobyte of data should be displayedCannot display NON-PLAIN TEXT DATA
10urlReturnsDatavalid
Type:congruency
System:knb
On failure:error
URL returns dataChecks whether a URL returns data. Unless the URL is specified to be function="information", the URL should return the resource for download.A data entity that matches the metadatatruehttp://knb.ecoinformatics.org/software/eml/eml-2.1.0/eml-resource.html#UrlType
11onlineURLsvalid
Type:congruency
System:knb
On failure:error
Online URLs are liveCheck that online URLs return somethingtruetrueSucceeded in accessing URL: <![CDATA[https://ezeml.edirepository.org/user-data/iep-6f022aeb59daaf04006d61b9f2d3a887/uploads/Impact%20of%202021%20Drought%20Management%20on%20Harmful%20Algal%20Blooms%20and%20Aquatic%20Weeds%20in%20the%20Delta/Supplemental%20figures%20for%20HABsWeeds.pdf]]>
12integrityChecksumvalid
Type:congruency
System:lter
On failure:error
Compare the metadata checksum for an entity to the checksum of the downloaded entityTwo possible responses: valid if checksums match; error if checksums do not match.7a20c0ec5c6e6d2ccbffc7b209c1c4177a20c0ec5c6e6d2ccbffc7b209c1c417Matching checksums will ensure data integrity during upload to the repository.If the found integrity hash value does not match the expected integrity hash value, there may have been a loss of integrity in the data download. Check that the hash method and hash value documented in the metadata are the correct values.
13entitySizeCongruencevalid
Type:congruency
System:knb
On failure:error
Check that the entity size in the Level 0 metadata matches the one PASTA+ generates.Compare raw file size of file to [entity]/physical/size element in metadata. Return error if not matching.23092022309202Examining the entity size is a method for checking that this is the correct entity.Check the entity size.
Entity Report
Entity Name: HAB-Weed_Report_2022_10_14
Entity Identifier:
# Identifier Status Quality Check Name Description Expected Found Explanation Suggestion Reference
1entityNameLengthvalid
Type:metadata
System:knb
On failure:warn
Length of entityName is not excessive (less than 100 char)length of entity name is less than 100 charactersentityName value is 100 characters or less26
2entityDescriptionPresentvalid
Type:metadata
System:lter
On failure:warn
An entity description is presentCheck for presence of an entity description.EML Best practices pp. 32-33, "...should have enough information for a user..."trueWith entityName sometimes serving as a file name rather than a title, it is important to be very descriptive here.
3numHeaderLinesPresentinfo
Type:metadata
System:knb
On failure:info
'numHeaderLines' element is presentCheck for presence of the 'numHeaderLines' element.Document contains 'numHeaderLines' element.No 'numHeaderLines' element foundIf data file contains header lines, &#39;numHeaderLines&#39; must be specified.Add 'numHeaderLines' element if needed.
4numFooterLinesPresentinfo
Type:metadata
System:knb
On failure:info
'numFooterLines' element is presentCheck for presence of the 'numFooterLines' element.Document contains 'numFooterLines' element.No 'numFooterLines' element foundIf data file contains footer lines, &#39;numFooterLines&#39; must be specified.Add 'numFooterLines' element if needed.
5fieldDelimiterValidinfo
Type:metadata
System:knb
On failure:error
Field delimiter is a single characterField delimiters should be one character onlyA single character is expectednullA fieldDelimiter value is not checked for binary entities or entities with an externally defined formathttp://knb.ecoinformatics.org/software/eml/eml-2.1.0/eml-physical.html#fieldDelimiter
6recordDelimiterPresentinfo
Type:metadata
System:knb
On failure:warn
Record delimiter is presentCheck presence of record delimiter. Check that the record delimiter is one of the suggested values.A record delimiter from a list of suggested values: \n, \r, \r\n, #x0A, #x0D, #x0D#x0AnullA recordDelimiter value is not checked for binary entities or entities with an externally defined formathttp://knb.ecoinformatics.org/software/eml/eml-2.1.0/eml-physical.html#recordDelimiter
7entitySizePresencevalid
Type:metadata
System:knb
On failure:warn
Check for presence of an entity size elementLook for entity size element as a prep for checking congruence, and if not present, generate a warn. Note that to be most useful (i.e, to check congruence), entity size should contain the most precise measure of size, which is "byte" (the default unit); however, the presence or name of the entity size unit is NOT checked.Entity size is present. If unit="byte" or unit is omitted (default = byte), then congruence can be checked.Found entity size element with value of 18325518 and size unit specified as 'byte'.Examining the entity size is prep for checking congruence. Including the element is best practice, and if not present, a warn is generated. To be most useful, entity size should contain the most precise measure of size, which is &#34;byte&#34; (the default unit).Include an entity size in bytes Example success: knb-lter-sbc.3.12. Example of size in units other than byte: knb-lter-mcr.6.56.
8integrityChecksumPresencevalid
Type:metadata
System:lter
On failure:warn
A physical/authentication element is present and specifies a method attribute with a value of MD5 or SHA-1Check for presence of a physical/authentication element containing a checksum or hash value for an integrity check (e.g. MD5, SHA-1). Warn if an entity does not have a physical/authentication element, or if none of the physical/authentication elements specify a method attribute with a value of MD5 or SHA-1.At least one physical/authentication element with a method attribute specifying MD5 or SHA-1 and containing a checksum or hash value that can be used to perform an integrity check on the data.truePASTA will use this value to check the integrity of the data it downloads from your site. In addition, PASTA is planning to compare the contributor-supplied checksum/hash value documented in the physical/authentication element to the checksum/hash value of this entity downloaded from previous revisions of this data package. If PASTA already has a copy of this entity, it will be able to avoid an unnecessary download of the entity from your site, resulting in faster processing of the new data package revision when you update it in PASTA.Add a physical/authentication element and store the entity checksum or hash value in it using a method such as MD5 or SHA-1.
9displayDownloadDatainfo
Type:data
System:knb
On failure:info
Display downloaded dataDisplay the first kilobyte of data that is downloadedUp to one kilobyte of data should be displayedCannot display NON-PLAIN TEXT DATA
10urlReturnsDatavalid
Type:congruency
System:knb
On failure:error
URL returns dataChecks whether a URL returns data. Unless the URL is specified to be function="information", the URL should return the resource for download.A data entity that matches the metadatatruehttp://knb.ecoinformatics.org/software/eml/eml-2.1.0/eml-resource.html#UrlType
11onlineURLsvalid
Type:congruency
System:knb
On failure:error
Online URLs are liveCheck that online URLs return somethingtruetrueSucceeded in accessing URL: <![CDATA[https://ezeml.edirepository.org/user-data/iep-6f022aeb59daaf04006d61b9f2d3a887/uploads/Impact%20of%202021%20Drought%20Management%20on%20Harmful%20Algal%20Blooms%20and%20Aquatic%20Weeds%20in%20the%20Delta/HAB-Weed_Report_2022_10_14.pdf]]>
12integrityChecksumvalid
Type:congruency
System:lter
On failure:error
Compare the metadata checksum for an entity to the checksum of the downloaded entityTwo possible responses: valid if checksums match; error if checksums do not match.002643fd10700a8a597dd29c0d5a67fe002643fd10700a8a597dd29c0d5a67feMatching checksums will ensure data integrity during upload to the repository.If the found integrity hash value does not match the expected integrity hash value, there may have been a loss of integrity in the data download. Check that the hash method and hash value documented in the metadata are the correct values.
13entitySizeCongruencevalid
Type:congruency
System:knb
On failure:error
Check that the entity size in the Level 0 metadata matches the one PASTA+ generates.Compare raw file size of file to [entity]/physical/size element in metadata. Return error if not matching.1832551818325518Examining the entity size is a method for checking that this is the correct entity.Check the entity size.
Entity Report
Entity Name: HABRegions
Entity Identifier:
# Identifier Status Quality Check Name Description Expected Found Explanation Suggestion Reference
1entityNameLengthvalid
Type:metadata
System:knb
On failure:warn
Length of entityName is not excessive (less than 100 char)length of entity name is less than 100 charactersentityName value is 100 characters or less10
2entityDescriptionPresentvalid
Type:metadata
System:lter
On failure:warn
An entity description is presentCheck for presence of an entity description.EML Best practices pp. 32-33, "...should have enough information for a user..."trueWith entityName sometimes serving as a file name rather than a title, it is important to be very descriptive here.
3numHeaderLinesPresentinfo
Type:metadata
System:knb
On failure:info
'numHeaderLines' element is presentCheck for presence of the 'numHeaderLines' element.Document contains 'numHeaderLines' element.No 'numHeaderLines' element foundIf data file contains header lines, &#39;numHeaderLines&#39; must be specified.Add 'numHeaderLines' element if needed.
4numFooterLinesPresentinfo
Type:metadata
System:knb
On failure:info
'numFooterLines' element is presentCheck for presence of the 'numFooterLines' element.Document contains 'numFooterLines' element.No 'numFooterLines' element foundIf data file contains footer lines, &#39;numFooterLines&#39; must be specified.Add 'numFooterLines' element if needed.
5fieldDelimiterValidinfo
Type:metadata
System:knb
On failure:error
Field delimiter is a single characterField delimiters should be one character onlyA single character is expectednullA fieldDelimiter value is not checked for binary entities or entities with an externally defined formathttp://knb.ecoinformatics.org/software/eml/eml-2.1.0/eml-physical.html#fieldDelimiter
6recordDelimiterPresentinfo
Type:metadata
System:knb
On failure:warn
Record delimiter is presentCheck presence of record delimiter. Check that the record delimiter is one of the suggested values.A record delimiter from a list of suggested values: \n, \r, \r\n, #x0A, #x0D, #x0D#x0AnullA recordDelimiter value is not checked for binary entities or entities with an externally defined formathttp://knb.ecoinformatics.org/software/eml/eml-2.1.0/eml-physical.html#recordDelimiter
7entitySizePresencevalid
Type:metadata
System:knb
On failure:warn
Check for presence of an entity size elementLook for entity size element as a prep for checking congruence, and if not present, generate a warn. Note that to be most useful (i.e, to check congruence), entity size should contain the most precise measure of size, which is "byte" (the default unit); however, the presence or name of the entity size unit is NOT checked.Entity size is present. If unit="byte" or unit is omitted (default = byte), then congruence can be checked.Found entity size element with value of 6331 and size unit specified as 'byte'.Examining the entity size is prep for checking congruence. Including the element is best practice, and if not present, a warn is generated. To be most useful, entity size should contain the most precise measure of size, which is &#34;byte&#34; (the default unit).Include an entity size in bytes Example success: knb-lter-sbc.3.12. Example of size in units other than byte: knb-lter-mcr.6.56.
8integrityChecksumPresencevalid
Type:metadata
System:lter
On failure:warn
A physical/authentication element is present and specifies a method attribute with a value of MD5 or SHA-1Check for presence of a physical/authentication element containing a checksum or hash value for an integrity check (e.g. MD5, SHA-1). Warn if an entity does not have a physical/authentication element, or if none of the physical/authentication elements specify a method attribute with a value of MD5 or SHA-1.At least one physical/authentication element with a method attribute specifying MD5 or SHA-1 and containing a checksum or hash value that can be used to perform an integrity check on the data.truePASTA will use this value to check the integrity of the data it downloads from your site. In addition, PASTA is planning to compare the contributor-supplied checksum/hash value documented in the physical/authentication element to the checksum/hash value of this entity downloaded from previous revisions of this data package. If PASTA already has a copy of this entity, it will be able to avoid an unnecessary download of the entity from your site, resulting in faster processing of the new data package revision when you update it in PASTA.Add a physical/authentication element and store the entity checksum or hash value in it using a method such as MD5 or SHA-1.
9displayDownloadDatainfo
Type:data
System:knb
On failure:info
Display downloaded dataDisplay the first kilobyte of data that is downloadedUp to one kilobyte of data should be displayedCannot display NON-PLAIN TEXT DATA
10urlReturnsDatavalid
Type:congruency
System:knb
On failure:error
URL returns dataChecks whether a URL returns data. Unless the URL is specified to be function="information", the URL should return the resource for download.A data entity that matches the metadatatruehttp://knb.ecoinformatics.org/software/eml/eml-2.1.0/eml-resource.html#UrlType
11onlineURLsvalid
Type:congruency
System:knb
On failure:error
Online URLs are liveCheck that online URLs return somethingtruetrueSucceeded in accessing URL: <![CDATA[https://ezeml.edirepository.org/user-data/iep-6f022aeb59daaf04006d61b9f2d3a887/uploads/Impact%20of%202021%20Drought%20Management%20on%20Harmful%20Algal%20Blooms%20and%20Aquatic%20Weeds%20in%20the%20Delta/HABRegions.zip]]>
12integrityChecksumvalid
Type:congruency
System:lter
On failure:error
Compare the metadata checksum for an entity to the checksum of the downloaded entityTwo possible responses: valid if checksums match; error if checksums do not match.9a4d78daa63c4132a8484a65723f5cb29a4d78daa63c4132a8484a65723f5cb2Matching checksums will ensure data integrity during upload to the repository.If the found integrity hash value does not match the expected integrity hash value, there may have been a loss of integrity in the data download. Check that the hash method and hash value documented in the metadata are the correct values.
13entitySizeCongruencevalid
Type:congruency
System:knb
On failure:error
Check that the entity size in the Level 0 metadata matches the one PASTA+ generates.Compare raw file size of file to [entity]/physical/size element in metadata. Return error if not matching.63316331Examining the entity size is a method for checking that this is the correct entity.Check the entity size.