Timeout error when using llcreader to download subsets of LLC4320 data

[rcmusgrave]

In the past I have successfully been able to use code as pasted below to download tiles from the LLC4320 simulation. However, when I tried again this morning it no longer seems to work, the issue being that when I go to download the data and write the file, I seem to be downloading "everything" and getting a timeout. In reality I'm not sure what "everything" is, other than it is far more than the one timeslice of one tile (i.e. many minutes of 10Mb/s download for what should be a 70Mb file).

I am no python/xmitgcm expert, so looking for help here.

Thanks in advance.

import xarray as xr
from xmitgcm import llcreader
model = llcreader.ECCOPortalLLC4320Model()

ds = model.get_dataset(varnames=['Eta'],k_levels=[1]) #,type='latlon')
region_slice = {'face': slice(7,8)}
region = ds.isel(**region_slice,k=0,time=1)
iters, datasets = zip(*region.groupby('k_l'))
        
fname= 'test.nc'
xr.save_mfdataset(datasets, [fname], engine='netcdf4')

[cspencerjones]

Hi Ruth,

After I updated my environment, I could get this code to work on my server, and it indeed leads to a (fairly) large download of multiple GB. Part of this is that you are downloading the grid information, which is large. If you set read_grid=False in get_dataset, the amount of data downloaded will be a lot smaller, though still about 10 times bigger than your ultimate filesize of ~70MB, because at the moment you cannot download individual faces of data from the ECCO data portal.

[rcmusgrave]

Ok thanks Spencer, good to know it's not just me. I'll miss the ability to download faces (or specific grid indices) from the ECCO data portal using xmitgcm.

[shu-storm]

Hello, I've encountered the same problem - time ran out. I'd like to ask how you solved this problem. I'm truly grateful for any assistance you can offer me.The following is my code.
code:
import xarray as xr
from xmitgcm import llcreader
model = llcreader.ECCOPortalLLC4320Model()
dsu = model.get_dataset(varnames=['U'],k_levels=[28],read_grid=False,grid_vars_to_coords=False)
region_slice = {'time':slice(3720,3721),'face': slice(8,9)}
dsu_day = dsu.isel(**region_slice)
import time
max_attempts=20
retry_delay = 5
for attempt in range(max_attempts):
try:
dsu_day.to_netcdf('D:/UVW/u_2012_2_15_200.nc')
print("数据下载成功！")
break
except Exception as e:
print(f"第 {attempt + 1} 次尝试失败，错误信息: {e}")
if attempt < max_attempts - 1:
time.sleep(retry_delay)
else:
print("达到最大尝试次数，下载失败。")