Skip to main content
Publication

Coordinating an operational data distribution network for CMIP6 data

Authors

Petrie, Ruth; Denvil, Sebastien; Ames, Sasha; Levavasseur, Guillaume; Fiore, Sandro; Allen, Chris; Antonio, Fabrizio; Berger, Katharina; Bretonniere, Pierre-Antoine ; Lacinski, Lukasz; Wagner, Rick

Abstract

The distribution of data contributed to the CoupledModel Intercomparison Project Phase 6 (CMIP6) is via theEarth System Grid Federation (ESGF). The ESGF is a network of internationally distributed sites that together workas a federated data archive. Data records from climate modelling institutes are published to the ESGF and then sharedaround the world. It is anticipated that CMIP6 will produceapproximately 20 PB of data to be published and distributedvia the ESGF. In addition to this large volume of data a number of value-added CMIP6 services are required to interactwith the ESGF; for example the citation and errata services both interact with the ESGF but are not a core part of itsinfrastructure. With a number of interacting services and alarge volume of data anticipated for CMIP6, the CMIP DataNode Operations Team (CDNOT) was formed. The CDNOTcoordinated and implemented a series of CMIP6 preparationdata challenges to test all the interacting components in theESGF CMIP6 software ecosystem. This ensured that whenCMIP6 data were released they could be reliably distributed.