Adding Météo-France radar precipitation dataset

CHANGELOG.md

@@ -30,6 +30,7 @@ This release includes three new radar precipitation datasets from the UK, Denmar
 - UK Met Office C-band rain radar 1 km composite (2005-2025, 5min, OSGB 1 km) [\#17](https://github.com/mlcast-community/mlcast-datasets/issues/17), @franchg
 - Danish radar precipitation dataset covering 2016-2025 at 10min, 0.5km resolution, [\#21](https://github.com/mlcast-community/mlcast-datasets/pull/21), @arjj8
 - Italian DPC SRI radar precipitation dataset (2010-2025, 1km, 5min) [\#14](https://github.com/mlcast-community/mlcast-datasets/issues/14), @franchg
+- Météo-France radar precipitation dataset (from 2020-01-01 to 2024-12-31, 5min, 1km grid-size) [\#49](https://github.com/mlcast-community/mlcast-datasets/issues/49), @gzemo
 
 ### Maintenance
 

docs/_toc.yml

@@ -9,3 +9,4 @@ chapters:
 - file: it_dpc_precipitation
 - file: uk_metoffice_precipitation
 - file: be_rmi_precipitation
+- file: fr_mf_precipitation

docs/fr_mf_precipitation.ipynb

@@ -0,0 +1,140 @@
+{
+ "cells": [
+  {
+   "cell_type": "markdown",
+   "id": "0",
+   "metadata": {},
+   "source": [
+    "# FR-MF - Rainfall rate over France mainland\n",
+    "\n",
+    "### Description\n",
+    "\n",
+    "This notebook describes how to access and use the zarr-version of the French radar data provided by [Météo-France](https://meteofrance.com/). \n",
+    "The dataset includes aproximately ~500.000 5 min timesteps covering a 1536 x 1536 resolution with 1km grid-size. The original radar.npz files are stored in (mm x 10^-2) and the .zarr dataset is in precipitation rate (mm/h).\n",
+    "\n",
+    "### Related repositories\n",
+    "- The conversion of the radar data was done by the code hosted on [https://github.com/mlcast-community/mlcast-dataset-FR-MF](https://github.com/mlcast-community/mlcast-dataset-FR-MF).\n",
+    "\n",
+    "- The radar dataset can be directly downloaded from Météo-France [Hugging Face](https://huggingface.co/datasets/meteofrance/fr-radar-rainfall/tree/main) repository.\n",
+    "\n",
+    "The `v0.1.0` zarr dataset covers the temporal period of `2020-01-01` to `2024-12-31`.\n",
+    "\n",
+    "### Citation\n",
+    "\n",
+    "Data provided by Météo-France. Processed and distributed by Météo-France AI Lab for open research and development purposes.\n",
+    "Please cite as:\n",
+    "```tex\n",
+    "@misc{radar_rainfall_france,\n",
+    "  title        = {5 Minutes Radar Rainfall over French Mainland Territory},\n",
+    "  author       = {Météo-France},\n",
+    "  year         = {2025},\n",
+    "  howpublished = {\\url{https://huggingface.co/datasets/meteofrance/radar-rainfall}},\n",
+    "  note         = {Distributed under Etalab 2.0 License}\n",
+    "}\n",
+    "```\n",
+    "\n",
+    "Licence: [CC-BY-4.0](https://creativecommons.org/licenses/by/4.0/)\n",
+    "\n"
+   ]
+  },
+  {
+   "cell_type": "code",
+   "execution_count": null,
+   "id": "1",
+   "metadata": {},
+   "outputs": [],
+   "source": [
+    "import matplotlib.pyplot as plt\n",
+    "import xarray as xr\n",
+    "\n",
+    "import cartopy.feature as cfeature\n",
+    "import cartopy.crs as ccrs\n",
+    "import mlcast_datasets"
+   ]
+  },
+  {
+   "cell_type": "code",
+   "execution_count": null,
+   "id": "2",
+   "metadata": {},
+   "outputs": [],
+   "source": [
+    "cat = mlcast_datasets.open_catalog()\n",
+    "list(cat.precipitation)"
+   ]
+  },
+  {
+   "cell_type": "markdown",
+   "id": "3",
+   "metadata": {},
+   "source": [
+    "# FR-MF - 5-min Rainfall rate\n",
+    "\n",
+    "The French MF SRI dataset is available in the intake catalog as `fr_mf_prate_5min`."
+   ]
+  },
+  {
+   "cell_type": "code",
+   "execution_count": null,
+   "id": "4",
+   "metadata": {},
+   "outputs": [],
+   "source": [
+    "ds = cat.precipitation.fr_mf_prate_5min.to_dask()\n",
+    "ds"
+   ]
+  },
+  {
+   "cell_type": "code",
+   "execution_count": null,
+   "id": "5",
+   "metadata": {},
+   "outputs": [],
+   "source": [
+    "var_name = \"prate\"\n",
+    "crs_name = ds[var_name].grid_mapping\n",
+    "data_crs = ccrs.Projection(ds[crs_name].crs_wkt)\n",
+    "\n",
+    "g = (\n",
+    "    ds[var_name]\n",
+    "    .sel(time=\"2023-11-17\")\n",
+    "    .isel(time=slice(None, 3))\n",
+    "    .plot(\n",
+    "        transform=data_crs,\n",
+    "        cmap=\"viridis\",\n",
+    "        add_colorbar=True,\n",
+    "        col=\"time\",\n",
+    "        robust=True,\n",
+    "        subplot_kws=dict(projection=data_crs),\n",
+    "        vmin=0,\n",
+    "    )\n",
+    ")\n",
+    "\n",
+    "for ax in g.axes.flat:\n",
+    "    ax.coastlines()\n",
+    "    ax.gridlines(draw_labels=[\"top\", \"left\"])"
+   ]
+  }
+ ],
+ "metadata": {
+  "kernelspec": {
+   "display_name": "mlcast-datasets (3.12.3)",
+   "language": "python",
+   "name": "python3"
+  },
+  "language_info": {
+   "codemirror_mode": {
+    "name": "ipython",
+    "version": 3
+   },
+   "file_extension": ".py",
+   "mimetype": "text/x-python",
+   "name": "python",
+   "nbconvert_exporter": "python",
+   "pygments_lexer": "ipython3",
+   "version": "3.12.3"
+  }
+ },
+ "nbformat": 4,
+ "nbformat_minor": 5
+}

src/mlcast_datasets/catalog/catalog.yml

@@ -6,7 +6,7 @@ metadata:
 
 sources:
   precipitation:
-    description: "Precipitation-related datasets from RADKLIM, IT-DPC and other sources"
+    description: "Precipitation-related datasets from RADKLIM, IT-DPC, Météo-France and other sources"
     driver: intake.catalog.local.YAMLFileCatalog
     args:
       path: "{{ CATALOG_DIR }}/precipitation/catalog.yml"

src/mlcast_datasets/catalog/precipitation/catalog.yml

@@ -62,3 +62,13 @@ sources:
       storage_options:
         anon: true
         endpoint_url: "https://object-store.os-api.cci2.ecmwf.int"
+
+  fr_mf_prate_5min:
+    description: "Météo-France 1 km radar rainfall amount dataset (mm*10^-2) converted in precipitation rate (mm/h)"
+    driver: zarr
+    args:
+      urlpath: "s3://mlcast-source-datasets/FR-MF-prate/v0.1.0/fr-mf-prate-5min.zarr/"
+      consolidated: true
+      storage_options:
+        anon: true
+        endpoint_url: "https://object-store.os-api.cci2.ecmwf.int"