[Thread Prev][Thread Next][Index]

Re: [ferret_users] Memory allocation problem




There may be a hard limit on memory allocation: about 500 "words".

In that case, an alternate way to SAVE large time series files using smaller amounts of memory is to append (along the time axis only):

save/file=filename.cdf/l=1 temperature
repeat/l=2:NPTS/file=filename.cdf/append temperature

Where NPTS is the total number of timesteps.
To avoid screen spew, you could do it in chunks by hand:

save/l=1:500/file=filename.cdf/clobber temperature
save/l=501:1000/file=filename.cdf/append temperature
save/l=1001:1500/file=filename.cdf/append temperature
...etc...

But this can only be done along the time axis, which is expandable in netcdf. Appending along other axes requires predefining the length of the axis and the grid. There is a discussion of this in the documentation under netcdf.

Billy K

On 9 Jan 10, at 10:28 AM, steeven paul yerraguntla wrote:

Dear ferreters,
I am using the a nc file of size 1GB, which is in external hard disc. when my Jnl file is being executed, an error message is appearing saying insufficient memory. Jnl file is meant for to define time axis of weekly data. Execution of jnl file can be seen in the following lines.

I hope somebody can help me with some idea. Thanks in advance.

---------------------------------------------------------------
NOAA/PMEL TMAP
FERRET v6

Linux(g77) 2.4.21-32 - 08/23/06

9-Jan-10 23:18


set mem/size=600

Cached data cleared from memory

cancel da/all

use temp_8609.cdf

define axis/t=07-JUL-1986:27-dec-2009/npoints=1430/units=days tweekly

let temperature = temp[gt=tweekly@asn]

save/file=temp_raghu_8609.cdf/clobber temperature

**ERROR: insufficient memory: 314263950 words were requested.

LIST/FORMAT=CDF/file=temp_raghu_8609.cdf/clobber temperature

Command file, command group, or REPEAT execution aborted

*** NOTE: You can use SET MEMORY/SIZE=xxx to increase memory.

*** NOTE: The "Memory use" section of the FERRET Users Guide has further tips

---------------------------------------------------------------------- -----------------------------------------------------------


--
Steeven Paul Y
Research Fellow
NIO RC Vizag
176 Lawsons Bay Colony
Visakhapatnam - 530017



[Thread Prev][Thread Next][Index]

Contact Us
Dept of Commerce / NOAA / OAR / PMEL / TMAP

Privacy Policy | Disclaimer | Accessibility Statement