Skip to content

esg1.umr-cnrm.fr fails for OpenDAP and wget downloads of CNRM-ESM2-1 6hrLev (ssp370) #116

@Linimie

Description

@Linimie

Hi ESGF team,

I'm encountering repeated access issues with the esg1.umr-cnrm.fr node while working with CNRM-ESM2-1 6hrLev ScenarioMIP data (ssp370, r1i1p1f2). This is affecting both OpenDAP access and direct file downloads via wget.


🔍 Dataset context

I am using the following 6-hourly variables:

  • ua, va, hus

✅ Historical data (1985–2015) — works fine:

OpenDAP via CEDA:
https://esgf.ceda.ac.uk/thredds/dodsC/esg_cmip6/CMIP6/CMIP/CNRM-CERFACS/CNRM-ESM2-1/historical/r1i1p1f2/6hrLev/

❌ ScenarioMIP (2019–2100) — unstable:

Forced to switch to:
http://esg1.umr-cnrm.fr/thredds/dodsC/CMIP6_CNRM/ScenarioMIP/CNRM-CERFACS/CNRM-ESM2-1/ssp370/r1i1p1f2/6hrLev/

OpenDAP access to this node fails in multiple ways:

  • Datasets appear in ESGF search but OpenDAP access returns partial or corrupt data
  • I switched to wget from the THREDDS fileServer endpoint, but download attempts still fail intermittently with:
    • wget exit status 8 — server error
    • Incomplete or zero-byte .nc files

These failures are non-deterministic: different files fail at different times, but the node is generally unstable.


🧪 Reproducibility

My pipeline reproduces this issue consistently:

  • ua_6hrLev_CNRM-ESM2-1_ssp370_r1i1p1f2_gr_201901010600-201905010000.nc is just one recent example, but other dates and variables have failed the same way

🧰 Pipeline + Code

GitHub project:
🔗 https://github.com/UtrechtUniversity/ivt-pipeline-cnrm-arctic_cordex

Relevant download script:
🔗 https://github.com/UtrechtUniversity/ivt-pipeline-cnrm-arctic_cordex/blob/main/Download_wget_process_cmip6.py


🙏 Request

Could the esg1.umr-cnrm.fr node be reviewed for:

  • OpenDAP compatibility
  • File availability and THREDDS stability for CNRM ScenarioMIP 6hrLev
  • Mirroring to more reliable ESGF nodes (e.g., CEDA or DKRZ)

This issue is blocking reproducible access to a key dataset used for Arctic IVT projections and regridding.

Thanks in advance for your time and help!

Best regards,
Linda Gavras-van Garderen
UU-IMAU

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions