The repository guarantees the integrity and authenticity of the data.
The dataset content hosted by SEDOO consists of one or several files containing geo-time-referenced tabular data, mainly in netCDF format or CSV format.
netCDF is self-describing: a file includes information about the data it contains through variable and/or global attributes.
SEDOO data also comes from recognized “authorities” such as institutional partners within common scientific projects. Each data depositor has to be a registered and validated user within SEDOO system. Only validated users can deposit and/or access data. The SEDOO does not to set up a protocol for verifying the authenticity of the data, which would be redundant with the work carried out upstream.
The use of Unix groups allows write disk access to be delegated in an organized manner.
In addition, the ingestion process, described in R12, computes checksums (md5 or sha256) for each incoming file or dataset. Checksums are controlled only when data is transferred.
All datasets from SEDOO data archive are accessible to users through read-only mounts. The data cannot therefore be modified or altered by the users. SEDOO staff is in charge of data conformance to the standards for metadata (e.g., the Climate and Forecast Convention) and applies the appropriate data reference syntaxes (DRS, when available) and prepares the datasets with all required data provenance information through:
- the directory structure;
- a metadata card;
- a netCDF attribute that redirects to a dedicated documentation page (e.g. the Earth System Documentation for climate modeling data).
Data provenance information from filename syntax and metadata are also checked to:
- guarantee the authenticity of the replicated data;
- and report to the depositors any issue discovered by SEDOO users.
In the case of the depositors publishing a new version of a dataset, the ESPRI staff: - replicates the new version,
- verifies the checksum is different from the previous one,
- updates the directory structure accordingly.
Data traceability can be guaranteed:
- by assigning a Digital Object Identifier (DOI) or a Persistent IDentifier (PID) to a file or a dataset, at least when requested by the DRS.
- SEDOO is registered with CNRS-INIST which is DataCite’s French research correspondent which therefore authorizes SEDOO to provide DOIs for DataCite.
Links: