导航|地址|刷新
Background - Climate Data Store

Login - Register

Web portal menu

Climate Data Store

User menu

Datasets

User guide

Applications

Forum

Live status

Login ‒ Register

What has been modernised?

The modernized data access to Copernicus services implemented by ECMWF build on the same vision, architectural principles and functional layers as the former CDS whilst relying on open-source and cutting-edge technologies. Modernized Data Stores deploy and run on the ECMWF Common Cloud Infrastructure (CCI).

Even though challenging, this modernization is cornerstone to overcome the obsolescence of former components and allow the system to continue evolving in a changing and highly demanding environment where it plays a central role as an efficient, versatile and trusted transmission link between big, distributed and heterogeneous data sources and highly demanding and sophisticated user requirements.

Modernization has encompassed all the different layers of the technical architecture.

Data layer: The foundational base of the Services:

External Data (hosted outside the CCI), ranging from federated and brokered datasets supported by third party organizations to the ECMWF MARS Archive, where flagship datasets, such as Global Reanalysis, are primarily hosted.

Internal Data (hosted within CCI). The most representative is the on-line MARS where a subset of the most requested variables from the core MARS archive are regularly uploaded. It also includes an Observations repository, other small on-disk datasets, and an experimental ARCO (Analysis Ready, Cloud Optimized) data lake.

System layer (core engine): Software components which deploy and run together to support the seamless user journey for searching, discovering, sub-setting and retrieving data via interactive and programmatic interfaces. Components of this layer:

Oversees the full life cycle of incoming data requests;

Hosts the catalogues, including datasets metadata and configuration;

Implements quality of service rules (QoS) to regulate user traffic and system resources;

Dispatch requests to the Data Layer via dedicated adaptors;

Exposes interactive and programmatic interfaces (APIs) highly configurable and compliant with standards;

Business Layer: Combination of operational deployments of the System Layer with tailored catalogue content and configuration. This layer split in two:

Fully operational system;

"Branded by" (eg. Climate DS, Atmosphere DS).

The detachment between the System Layer and the Business Layer provides great flexibility to instantiate for multiple purposes, deploy in different platforms or run as backend engine powering other platforms.

Catalogue content and configuration are populated via automatic deployment tools following strict integration and stewardship procedures where simplicity and consistency are key factors.

On the periphery of the core components, but closely interlinked with them, there are other layers which are "powered by" or complementary to them. Of special relevance are the following:

Earthkit: The open evolution of the CDS Toolbox. ECMWF open-source Python code repository offering a broad set of expert libraries optimised to work with ECMWF and Copernicus data resources.

Visual Interactive Content (VICs): this includes a broad set of user-oriented applications and training material that showcase or make combined use of the full range of resources and capabilities of the Data Layer and earthkit.

External platforms: Platforms and infrastructures "powered by" the different layers. These platforms may interact with or consume data resources via the exposed interfaces, embed technical components or integrate VICs as part of their portfolio. The WEkEO DIAS Platform, a partnership of ECMWF, EUMETSAT, Mercator Ocean and EUMETSAT and EEA, can be cited as a representative example of an external platform "powered by" the Data Stores.

Atmosphere Data Store

CEMS Early Warning Data Store

About C3S Help Privacy Terms of Use Cookies Background

------
导航页打开网址