-
Notifications
You must be signed in to change notification settings - Fork 22
Description
Hi ESGF team,
I'm encountering repeated access issues with the esg1.umr-cnrm.fr node while working with CNRM-ESM2-1 6hrLev ScenarioMIP data (ssp370, r1i1p1f2). This is affecting both OpenDAP access and direct file downloads via wget.
🔍 Dataset context
I am using the following 6-hourly variables:
ua,va,hus
✅ Historical data (1985–2015) — works fine:
OpenDAP via CEDA:
https://esgf.ceda.ac.uk/thredds/dodsC/esg_cmip6/CMIP6/CMIP/CNRM-CERFACS/CNRM-ESM2-1/historical/r1i1p1f2/6hrLev/
❌ ScenarioMIP (2019–2100) — unstable:
Forced to switch to:
http://esg1.umr-cnrm.fr/thredds/dodsC/CMIP6_CNRM/ScenarioMIP/CNRM-CERFACS/CNRM-ESM2-1/ssp370/r1i1p1f2/6hrLev/
OpenDAP access to this node fails in multiple ways:
- Datasets appear in ESGF search but OpenDAP access returns partial or corrupt data
- I switched to
wgetfrom the THREDDS fileServer endpoint, but download attempts still fail intermittently with:wget exit status 8— server error- Incomplete or zero-byte
.ncfiles
These failures are non-deterministic: different files fail at different times, but the node is generally unstable.
🧪 Reproducibility
My pipeline reproduces this issue consistently:
ua_6hrLev_CNRM-ESM2-1_ssp370_r1i1p1f2_gr_201901010600-201905010000.ncis just one recent example, but other dates and variables have failed the same way
🧰 Pipeline + Code
GitHub project:
🔗 https://github.com/UtrechtUniversity/ivt-pipeline-cnrm-arctic_cordex
Relevant download script:
🔗 https://github.com/UtrechtUniversity/ivt-pipeline-cnrm-arctic_cordex/blob/main/Download_wget_process_cmip6.py
🙏 Request
Could the esg1.umr-cnrm.fr node be reviewed for:
- OpenDAP compatibility
- File availability and THREDDS stability for CNRM ScenarioMIP
6hrLev - Mirroring to more reliable ESGF nodes (e.g., CEDA or DKRZ)
This issue is blocking reproducible access to a key dataset used for Arctic IVT projections and regridding.
Thanks in advance for your time and help!
Best regards,
Linda Gavras-van Garderen
UU-IMAU