Re: [ferret_users] Memory question

[Paul Young <Paul.J.Young@xxxxxxxx>]

Hi Jonathan,

Check out Jaison Kurian's email on "memory tricks" in the archives:

http://www.pmel.noaa.gov/maillists/tmap/ferret_users/fu_2007/msg00489.html

Basically you loop over an axis and keep appending data to the file,  
rather than ask ferret to write out the all the grid in one go.

Good luck!

Paul


On Mar 19, 2010, at 10:11 AM, Jonathan Winter wrote:

> Hi all,
>
> I am trying to regrid a 0.5 deg dataset to 5-min and then write it  
> out as a NetCDF file.  I use the following commands:
>
> use 030410_init_wsoi.nc
> use vegtype_5min.nc
> show grid vegtype[d=2]
> show grid wsoi_lay[d=1]
> define grid/X=GJR1/Y=GJR1/Z=GOL1/L=GOL1 veg_grid
> let wsoi =  wsoi_lay[d=1,G=veg_grid]
> set variable/title="Soil Moisture" wsoi
> set region/X=-179.96:179.96/Y=-89.958:89.958N/Z=0.1:4/T=6941:7275
> save/file=wsoi.nc wsoi
>
> At that point I get:
> **ERROR: insufficient memory: 18662400 words were requested.
> *** NOTE: You can use SET MEMORY/SIZE=xxx to increase memory.
> *** NOTE: The "Memory use" section of the FERRET Users Guide has  
> further tips.
>
> So I:
> set memory/size=20000000
>
> And I get:
> *** NOTE: internal overflow expressing =20000000 Mwords as words.  
> Restoring previous memory size.
> Cached data cleared from memory
>
> If I try to set memory/size=1000000000 FERRET says it has done it,  
> but then I run out of memory again if I try to write out:
> **ERROR: insufficient memory: 671846400 words were requested.
> *** NOTE: You can use SET MEMORY/SIZE=xxx to increase memory.
> *** NOTE: The "Memory use" section of the FERRET Users Guide has  
> further tips
>
> Any thoughts on what is going on or how I may be able to do this?   
> Thank you in advance for the assistance.
>
> Best,
>
> Jonathan