Direkt zum Inhalt | Direkt zur Navigation

Personal tools

Sektionen
You are here: Home » Data » Support Services on Data and Metadata » Search and Download Model Data via ESGF » Data Access and Synchronization with Synda

Data Access and Synchronization with Synda

last modified Feb 11, 2016 08:04 PM
The Synda tool to download and (one-way) synchronize local data repositories with data hosted in the ENES data infrastructure

Synda, previously known as Synchro-data, is intended for users and data managers who repeatedly download large amounts of data hosted by ESGF data nodes.

This software application for files download is hosted by the distributed digital repositories of the ESGF data infrastructure. It has been developed at the IPSL.

Installation

Please see the Synda homepage for detailed installation instructions.

Tool Configuration

The download of files is achieved through exploration of the ESGF data repositories governed by the configuration files, in which the user defines the search criteria for the file selection. These criteria pertain to metadata attributes used for discovery of climate data defined by Data Reference Syntax (DRS). Thus, the user can enter lists of values for variables, frequencies, experiments and ensemble numbers into a configuration file and list of models into separate files as directed by already provided templates. Before running the application, the user also needs to enter the ESGF OpenID and password that can be obtained by registering at any of the ESGF portals. This OpenID is required for the data download.

Output

  • Files. The downloaded files are stored in the directory structure compliant with the DRS (see above). This repository is updated as search criteria are being modified - only files not already stored are downloaded.
  • Log Files. The tool creates log files protocolling the progress of downloads.
  • SQLite database. This database contains information about metadata related to downloaded files as well as the download history.

 

For questions on how to use Synda, please contact:

sebastien.denvil(at)ipsl.jussieu.fr or   jerome.raciazek(at)ipsl.jussieu.fr.

Related content
Script Based Download