Contents
Scope
The overall objective of the PAE Data processing, visualisation and management is the development of standards and infrastructure for data processing, data archiving and data exchange in Earth system modelling and more general Earth system research (ESR). The huge amounts of data in ESR do not allow for centralised data archiving. Networking between geographically distributed archives is required. Ideally the geographical distribution of federated data archives is hidden to the user by an integrative graphical, WWW-based interface. Standards are required in order to establish a data federation and to work in a reticulation.
In order to achieve these objectives international cooperation between existing data management systems and international initiatives as well as cross-cutting interaction with the other PAEs are required. Specific topics for the near future are:
- Collaboration with PAE Metadata and international initiatives in development and implementation of metadata standards for experiment/model set-up and for description of numerical grids
- Coordination with PRISM Community in definition of experiment monitoring and integration in the Standard Run Environment (SRE)
- Coordination with PRISM Community in definition of SRE data archive structures
- Collaboration with international projects for Grid enabling SRE
- Collaboration with international initiatives in the improvement of standard data storage formats, e.g. reorganisation to the standard variables list in NetCDF/CF
- Collaboration with PSI related data archives in the development of data networking and federated archive architectures
This PAE interacts strongly with the PAE "Integration and modelling environments" to incorporate data management in the compiling and running environments, and also with the PAE "Metadata" for the automatic description of experiments, models, and numerical grids.
News & Meetings
| PSI Data Workshop, Hamburg | Feb 13/14, 2006 |
|---|---|
| Minutes and Presentations can be obtained from M&D's webserver ( http://www.mad.zmaw.de/service-support/workshops/psi-dataworkshop-2006/ ) |
|
Software
- CDAT
(Climate Data Analysis Tools)
Climate Data Analysis Tools (CDAT) is a software infrastructure that uses an object-oriented scripting language to link together separate software subsystems and packages thus forming an integrated environment for solving model diagnosis problems. The power of the system comes from Python and its ability to seamlessly interconnect software. Python provides a general purpose and full-featured scripting language with a variety of user interfaces including command-line interaction, stand-alone scripts (applications) and graphical user interfaces (GUI). The CDAT subsystems, implemented as modules, provide access to and management of gridded data (Climate Data Management System or CDMS); large-array numerical operations (Numerical Python); and visualization (Visualization and Control System or VCS). CDAT is developed at and documented by PCMDI.
- CDO (Climate Data Operator)
This package is a development at the Max-Planck-Insitut for Meteorology by Uwe Schulzweida. It's able to read GRIB, NetCDF, HDF, ieg (REMO), service and extra formatted files and process or convert them. The cdos will run on every UNIX/Linux machine and MacOS X Version 10.3 or later.
- CERA-2 Data Model (Climate and Environmental data Retrieval and Archiving)
CERA-2 is a database model that has been designed by PIK, M&D, and AWI to enable interchange of meta information on geo-referenced data. A detailed database model description is available from M&D's Technical Report No.15
People
Michael Lautenschlager(lead), Frank Toussaint, Jörg Wegner
Max-Planck-Institut für Meteorologie
Gruppe Modelle & Daten
Bundesstrasse 53
20146 Hamburg
GermanySébastien Denvil, Sébastien Masson, Jean-Yves Peterschmitt
IPSL - Institut Pierre Simon Laplace
Tour 26/16 - 4. etage - 4 place Jussieu Case 102
75252 Paris Cedex 5
FranceAg Stephens (BADC Cooperation)
Met Office
FitzRoy Road
Exeter, EX1 3PB
UK