Project

General

Profile

Adding DWD ICON-EU data to ADAGUC » History » Version 4

« Previous - Version 4/7 (diff) - Next » - Current version
Ernst de Vreede, 11/22/2018 07:11 AM


Adding DWD ICON-EU data to ADAGUC

In this tutorial we will add some fields from DWD's public ICON-EU model to ADAGUC. The data will be retrieved from an AWS S3 bucket, converted to NetCDF with FIMEX (http://fimex.met.no) and then added to the ADAGUC AutoWMS service.

For retrieving the data we will use the AWS client program, which you can install by running
<PRE>
sudo apt install python-pip
pip install aws-cli
</PRE>

The script copyICON.sh (attached below) uses the aws client program to retrieve data files for a number of parameters and is called like this:

<PRE>
mkdir $HOME/ICON_data
cd $HOME/ICON_data
bash copyICON.sh 2018112200
</PRE>
The ICO files should appear in a subdirectory named 2018112200

For conversion to NetCDF we will use fimex, installed in a Docker container.
Download the attached Dockerfile and use it to build a Docker image for fimex.
<PRE>
docker build -t fimex .
</PRE>

This Docker image can be run as followed:
<PRE>
docker run --mount type=bind,source=`pwd`,target=/app -w /app fimex fimex --input.config cdmGribReaderConfig_DWD_ICON_EU.xml --input.file "glob:2018112200/*grib2" --input.type grib2 --input.printNcML --ncml.config DWD_ICON_EU.ncml --output.type nc4 --output.file ICON_2018112200.nc
</PRE>

FIMEX needs a few configuration files to describe the conversion:
  • cdmGribReaderConfig_DWD_ICON_EU.xml - describes the grib parameters
  • DWD_ICON_EU.ncml - describes some changes to be made to the NetCDF parameters for removing unwanted dimensions

We can then copy the file the AutoWMS directory for previewing:
<PRE>
cp ICON_2018112200.nc $HOME/data/adaguc-autowms
</PRE>

URL: http://localhost:3382/adaguc-services/adagucserver?source=ICON_2018112109.nc&service=wms&request=getcapabilities

cdmGribReaderConfig_DWD_ICON_EU.xml View (27.5 KB) Ernst de Vreede, 11/22/2018 07:14 AM

copyIcon (851 Bytes) Ernst de Vreede, 11/22/2018 07:15 AM

DWD_ICON_EU.ncml (1.06 KB) Ernst de Vreede, 11/22/2018 07:15 AM

Dockerfile - Dockerfile for fimex (423 Bytes) Ernst de Vreede, 11/22/2018 07:15 AM