[Thread Prev][Thread Next][Index]
Re: netcdf MC file and memory problem
Dear Brent
I think the exact form of the descriptor file is depending on the
operating system you are running. In my case two points were important
(for sun solaris 7):
1) use ' ' and not ` ' (as given in the html manual)
2) use a space before $
$FORMAT_RECORD
and not
$FORMAT_RECORD
An other point was that the D_TIME_UNIT needs to be given in second.
Anyway the attached descriptor file is for ncep reanalysis data files
such as air.1957.nc air.1958.nc etc.
Regards Christof
Brent A McDaniel wrote:
>
> Hi again. Sorry to be sending so much to the list but I'm having a few
> problems that are preventing me from going foward and I can't find the
> answers in the documentation.
>
> First problem: I'm trying to open a string of ncep reanalysis data
> files. air.1957.nc air.1958.nc etc. I read through the manual and some
> of the files in /doc and pieced one together (there were still lots of
> things I was unsure of. I try to open it and I get the error:
> yes? set data_set "/data/ncep/test.des"
> **TMAP ERR: Error in namelist record
> Error in: FORMAT_RECORD; or file not descriptor file
> Data set: /data/ncep/test.des
>
> I also tried opening the existing sample one in fer_dsets/descr and it
> returned the same error as did the sample one in the manual.
>
> Does anyone have a descriptor file for working with reanalysis data?
> Or have an idea what I'm doing wrong?
>
> Problem 2:
>
> In the FAQ it's mentioned that you can concat time series together to form
> one long axis. Well, I decided to try this as I'm stuck on the
> descriptor.
> here's an example:
>
> yes? use "/data/ncep/air.1961.nc"
> yes? save/file=test.nc air
> **ERROR: insufficient memory: 65226960 words were requested.
> *** NOTE: You can use SET MEMORY/SIZE=xxx to increase memory.
> *** NOTE: The "Memory use" section of the FERRET Users Guide has further
> tips.
> yes? show memory
> Current size of FERRET memory cache: 3.2 MegaWords (1 word = 4 bytes)
> yes? set memory/size=100
> Cached data cleared from memory
> yes? show memory
> Current size of FERRET memory cache: 100 MegaWords (1 word = 4 bytes)
> yes? save/file=test.nc air
> **ERROR: insufficient memory: 65226960 words were requested.
> *** NOTE: You can use SET MEMORY/SIZE=xxx to increase memory.
> *** NOTE: The "Memory use" section of the FERRET Users Guide has further
> tips.
>
> Any idea why this isn't working? Some back ground info. air.1961.nc is
> ~131mb. The computer that I'm running this on has 512mb physical ram and
> swap 128mb. Looking at the memory states before I tried this, I had
> ~470mb free. The system is an p3 800mhz running linux.
>
> Thanks for all the help.
>
> Frustratedly your,
>
> Brent
>
> Brent A. McDaniel
>
> Dept of Earth and Atmospheric Sciences
> Georgia Institute of Technology
> Atlanta, Ga. USA
--
Dr. Christof Appenzeller Phone +41 1 256-9388,
MeteoSwiss Fax +41 1 256-9278,
Kraehbuehlstr. 58, mailto:apc@meteoswiss.ch
CH-8044 Zuerich, Switzerland http://www.meteoswiss.ch/
$FORMAT_RECORD
D_TYPE = ' MC',
D_FORMAT = ' 1A',
$END
$BACKGROUND_RECORD
D_TITLE = ' mean daily Air temperature 2m, NCEP Reanalysis',
D_T0TIME = '30-DEC-0000 12:00:00',
D_TIME_UNIT = 3600,
D_TIME_MODULO = .FALSE.,
$END
$MESSAGE_RECORD
$END
$EXTRA_RECORD
$END
$STEPFILE_RECORD
s_filename = 'air.2m.gauss.1948.nc',
S_AUX_SET_NUM = 0,
S_START = 17067072,
S_END = 17075832.,
S_DELTA = 24.0,
S_NUM_OF_FILES = 1,
S_REGVARFLAG = ' ',
$END
$STEPFILE_RECORD
s_filename = 'air.2m.gauss.1949.nc',
S_AUX_SET_NUM = 0,
S_START = 17075856.,
S_END = 17084592.,
S_DELTA = 24.0,
S_NUM_OF_FILES = 1,
S_REGVARFLAG = ' ',
$END
$STEPFILE_RECORD
s_filename = 'air.2m.gauss.1950.nc',
S_AUX_SET_NUM = 0,
S_START = 17084616.,
S_END = 17093352.,
S_DELTA = 24.0,
S_NUM_OF_FILES = 1,
S_REGVARFLAG = ' ',
$END
$STEPFILE_RECORD
s_filename = 'air.2m.gauss.1951.nc',
S_AUX_SET_NUM = 0,
S_START = 17093376.,
S_END = 17102112.,
S_DELTA = 24.0,
S_NUM_OF_FILES = 1,
S_REGVARFLAG = ' ',
$END
$STEPFILE_RECORD
s_filename = 'air.2m.gauss.1952.nc',
S_AUX_SET_NUM = 0,
S_START = 17102136.,
S_END = 17110896.,
S_DELTA = 24.0,
S_NUM_OF_FILES = 1,
S_REGVARFLAG = ' ',
$END
$STEPFILE_RECORD
s_filename = 'air.2m.gauss.1953.nc',
S_AUX_SET_NUM = 0,
S_START = 17110920.,
S_END = 17119656.,
S_DELTA = 24.0,
S_NUM_OF_FILES = 1,
S_REGVARFLAG = ' ',
$END
$STEPFILE_RECORD
s_filename = 'air.2m.gauss.1954.nc',
S_AUX_SET_NUM = 0,
S_START = 17119680.,
S_END = 17128416.,
S_DELTA = 24.0,
S_NUM_OF_FILES = 1,
S_REGVARFLAG = ' ',
$END
$STEPFILE_RECORD
s_filename = 'air.2m.gauss.1955.nc',
S_AUX_SET_NUM = 0,
S_START = 17128440.,
S_END = 17137176.,
S_DELTA = 24.0,
S_NUM_OF_FILES = 1,
S_REGVARFLAG = ' ',
$END
$STEPFILE_RECORD
s_filename = 'air.2m.gauss.1956.nc',
S_AUX_SET_NUM = 0,
S_START = 17137200.,
S_END = 17145960.,
S_DELTA = 24.0,
S_NUM_OF_FILES = 1,
S_REGVARFLAG = ' ',
$END
$STEPFILE_RECORD
s_filename = 'air.2m.gauss.1957.nc',
S_AUX_SET_NUM = 0,
S_START = 17145984.,
S_END = 17154720.,
S_DELTA = 24.0,
S_NUM_OF_FILES = 1,
S_REGVARFLAG = ' ',
$END
$STEPFILE_RECORD
s_filename = 'air.2m.gauss.1958.nc',
S_AUX_SET_NUM = 0,
S_START = 17154744.,
S_END = 17163480.,
S_DELTA = 24.0,
S_NUM_OF_FILES = 1,
S_REGVARFLAG = ' ',
$END
$STEPFILE_RECORD
s_filename = 'air.2m.gauss.1959.nc',
S_AUX_SET_NUM = 0,
S_START = 17163504.,
S_END = 17172240.,
S_DELTA = 24.0,
S_NUM_OF_FILES = 1,
S_REGVARFLAG = ' ',
$END
$STEPFILE_RECORD
s_filename = 'air.2m.gauss.1960.nc',
S_AUX_SET_NUM = 0,
S_START = 17172264.,
S_END = 17181024.,
S_DELTA = 24.0,
S_NUM_OF_FILES = 1,
S_REGVARFLAG = ' ',
$END
$STEPFILE_RECORD
s_filename = 'air.2m.gauss.1961.nc',
S_AUX_SET_NUM = 0,
S_START = 17181048.,
S_END = 17189784.,
S_DELTA = 24.0,
S_NUM_OF_FILES = 1,
S_REGVARFLAG = ' ',
$END
$STEPFILE_RECORD
s_filename = 'air.2m.gauss.1962.nc',
S_AUX_SET_NUM = 0,
S_START = 17189808.,
S_END = 17198544.,
S_DELTA = 24.0,
S_NUM_OF_FILES = 1,
S_REGVARFLAG = ' ',
$END
$STEPFILE_RECORD
s_filename = 'air.2m.gauss.1963.nc',
S_AUX_SET_NUM = 0,
S_START = 17198568.,
S_END = 17207304.,
S_DELTA = 24.0,
S_NUM_OF_FILES = 1,
S_REGVARFLAG = ' ',
$END
$STEPFILE_RECORD
s_filename = 'air.2m.gauss.1964.nc',
S_AUX_SET_NUM = 0,
S_START = 17207328.,
S_END = 17216088.,
S_DELTA = 24.0,
S_NUM_OF_FILES = 1,
S_REGVARFLAG = ' ',
$END
$STEPFILE_RECORD
s_filename = 'air.2m.gauss.1965.nc',
S_AUX_SET_NUM = 0,
S_START = 17216112.,
S_END = 17224848.,
S_DELTA = 24.0,
S_NUM_OF_FILES = 1,
S_REGVARFLAG = ' ',
$END
$STEPFILE_RECORD
s_filename = 'air.2m.gauss.1966.nc',
S_AUX_SET_NUM = 0,
S_START = 17224872.,
S_END = 17233608.,
S_DELTA = 24.0,
S_NUM_OF_FILES = 1,
S_REGVARFLAG = ' ',
$END
$STEPFILE_RECORD
s_filename = 'air.2m.gauss.1967.nc',
S_AUX_SET_NUM = 0,
S_START = 17233632.,
S_END = 17242368.,
S_DELTA = 24.0,
S_NUM_OF_FILES = 1,
S_REGVARFLAG = ' ',
$END
$STEPFILE_RECORD
s_filename = 'air.2m.gauss.1968.nc',
S_AUX_SET_NUM = 0,
S_START = 17242392.,
S_END = 17251152.,
S_DELTA = 24.0,
S_NUM_OF_FILES = 1,
S_REGVARFLAG = ' ',
$END
$STEPFILE_RECORD
s_filename = 'air.2m.gauss.1969.nc',
S_AUX_SET_NUM = 0,
S_START = 17251176.,
S_END = 17259912.,
S_DELTA = 24.0,
S_NUM_OF_FILES = 1,
S_REGVARFLAG = ' ',
$END
$STEPFILE_RECORD
s_filename = 'air.2m.gauss.1970.nc',
S_AUX_SET_NUM = 0,
S_START = 17259936.,
S_END = 17268672.,
S_DELTA = 24.0,
S_NUM_OF_FILES = 1,
S_REGVARFLAG = ' ',
$END
$STEPFILE_RECORD
s_filename = 'air.2m.gauss.1971.nc',
S_AUX_SET_NUM = 0,
S_START = 17268696.,
S_END = 17277432.,
S_DELTA = 24.0,
S_NUM_OF_FILES = 1,
S_REGVARFLAG = ' ',
$END
$STEPFILE_RECORD
s_filename = 'air.2m.gauss.1972.nc',
S_AUX_SET_NUM = 0,
S_START = 17277456.,
S_END = 17286216.,
S_DELTA = 24.0,
S_NUM_OF_FILES = 1,
S_REGVARFLAG = ' ',
$END
$STEPFILE_RECORD
s_filename = 'air.2m.gauss.1973.nc',
S_AUX_SET_NUM = 0,
S_START = 17286240.,
S_END = 17294976.,
S_DELTA = 24.0,
S_NUM_OF_FILES = 1,
S_REGVARFLAG = ' ',
$END
$STEPFILE_RECORD
s_filename = 'air.2m.gauss.1974.nc',
S_AUX_SET_NUM = 0,
S_START = 17295000.,
S_END = 17303736.,
S_DELTA = 24.0,
S_NUM_OF_FILES = 1,
S_REGVARFLAG = ' ',
$END
$STEPFILE_RECORD
s_filename = 'air.2m.gauss.1975.nc',
S_AUX_SET_NUM = 0,
S_START = 17303760.,
S_END = 17312496.,
S_DELTA = 24.0,
S_NUM_OF_FILES = 1,
S_REGVARFLAG = ' ',
$END
$STEPFILE_RECORD
s_filename = 'air.2m.gauss.1976.nc',
S_AUX_SET_NUM = 0,
S_START = 17312520.,
S_END = 17321280.,
S_DELTA = 24.0,
S_NUM_OF_FILES = 1,
S_REGVARFLAG = ' ',
$END
$STEPFILE_RECORD
s_filename = 'air.2m.gauss.1977.nc',
S_AUX_SET_NUM = 0,
S_START = 17321304.,
S_END = 17330040.,
S_DELTA = 24.0,
S_NUM_OF_FILES = 1,
S_REGVARFLAG = ' ',
$END
$STEPFILE_RECORD
s_filename = 'air.2m.gauss.1978.nc',
S_AUX_SET_NUM = 0,
S_START = 17330064.,
S_END = 17338800.,
S_DELTA = 24.0,
S_NUM_OF_FILES = 1,
S_REGVARFLAG = ' ',
$END
$STEPFILE_RECORD
s_filename = 'air.2m.gauss.1979.nc',
S_AUX_SET_NUM = 0,
S_START = 17338824.,
S_END = 17347560.,
S_DELTA = 24.0,
S_NUM_OF_FILES = 1,
S_REGVARFLAG = ' ',
$END
$STEPFILE_RECORD
s_filename = 'air.2m.gauss.1980.nc',
S_AUX_SET_NUM = 0,
S_START = 17347584.,
S_END = 17356344.,
S_DELTA = 24.0,
S_NUM_OF_FILES = 1,
S_REGVARFLAG = ' ',
$END
$STEPFILE_RECORD
s_filename = 'air.2m.gauss.1981.nc',
S_AUX_SET_NUM = 0,
S_START = 17356368.,
S_END = 17365104.,
S_DELTA = 24.0,
S_NUM_OF_FILES = 1,
S_REGVARFLAG = ' ',
$END
$STEPFILE_RECORD
s_filename = 'air.2m.gauss.1982.nc',
S_AUX_SET_NUM = 0,
S_START = 17365128.,
S_END = 17373864.,
S_DELTA = 24.0,
S_NUM_OF_FILES = 1,
S_REGVARFLAG = ' ',
$END
$STEPFILE_RECORD
s_filename = 'air.2m.gauss.1983.nc',
S_AUX_SET_NUM = 0,
S_START = 17373888.,
S_END = 17382624.,
S_DELTA = 24.0,
S_NUM_OF_FILES = 1,
S_REGVARFLAG = ' ',
$END
$STEPFILE_RECORD
s_filename = 'air.2m.gauss.1984.nc',
S_AUX_SET_NUM = 0,
S_START = 17382648.,
S_END = 17391408.,
S_DELTA = 24.0,
S_NUM_OF_FILES = 1,
S_REGVARFLAG = ' ',
$END
$STEPFILE_RECORD
s_filename = 'air.2m.gauss.1985.nc',
S_AUX_SET_NUM = 0,
S_START = 17391432.,
S_END = 17400168.,
S_DELTA = 24.0,
S_NUM_OF_FILES = 1,
S_REGVARFLAG = ' ',
$END
$STEPFILE_RECORD
s_filename = 'air.2m.gauss.1986.nc',
S_AUX_SET_NUM = 0,
S_START = 17400192.,
S_END = 17408928.,
S_DELTA = 24.0,
S_NUM_OF_FILES = 1,
S_REGVARFLAG = ' ',
$END
$STEPFILE_RECORD
s_filename = 'air.2m.gauss.1987.nc',
S_AUX_SET_NUM = 0,
S_START = 17408952.,
S_END = 17417688.,
S_DELTA = 24.0,
S_NUM_OF_FILES = 1,
S_REGVARFLAG = ' ',
$END
$STEPFILE_RECORD
s_filename = 'air.2m.gauss.1988.nc',
S_AUX_SET_NUM = 0,
S_START = 17417712.,
S_END = 17426472.,
S_DELTA = 24.0,
S_NUM_OF_FILES = 1,
S_REGVARFLAG = ' ',
$END
$STEPFILE_RECORD
s_filename = 'air.2m.gauss.1989.nc',
S_AUX_SET_NUM = 0,
S_START = 17426496.,
S_END = 17435232.,
S_DELTA = 24.0,
S_NUM_OF_FILES = 1,
S_REGVARFLAG = ' ',
$END
$STEPFILE_RECORD
s_filename = 'air.2m.gauss.1990.nc',
S_AUX_SET_NUM = 0,
S_START = 17435256.,
S_END = 17443992.,
S_DELTA = 24.0,
S_NUM_OF_FILES = 1,
S_REGVARFLAG = ' ',
$END
$STEPFILE_RECORD
s_filename = 'air.2m.gauss.1991.nc',
S_AUX_SET_NUM = 0,
S_START = 17444016.,
S_END = 17452752.,
S_DELTA = 24.0,
S_NUM_OF_FILES = 1,
S_REGVARFLAG = ' ',
$END
$STEPFILE_RECORD
s_filename = 'air.2m.gauss.1992.nc',
S_AUX_SET_NUM = 0,
S_START = 17452776.,
S_END = 17461536.,
S_DELTA = 24.0,
S_NUM_OF_FILES = 1,
S_REGVARFLAG = ' ',
$END
$STEPFILE_RECORD
s_filename = 'air.2m.gauss.1993.nc',
S_AUX_SET_NUM = 0,
S_START = 17461560.,
S_END = 17470296.,
S_DELTA = 24.0,
S_NUM_OF_FILES = 1,
S_REGVARFLAG = ' ',
$END
$STEPFILE_RECORD
s_filename = 'air.2m.gauss.1994.nc',
S_AUX_SET_NUM = 0,
S_START = 17470320.,
S_END = 17479056.,
S_DELTA = 24.0,
S_NUM_OF_FILES = 1,
S_REGVARFLAG = ' ',
$END
$STEPFILE_RECORD
s_filename = 'air.2m.gauss.1995.nc',
S_AUX_SET_NUM = 0,
S_START = 17479080.,
S_END = 17487816.,
S_DELTA = 24.0,
S_NUM_OF_FILES = 1,
S_REGVARFLAG = ' ',
$END
$STEPFILE_RECORD
s_filename = 'air.2m.gauss.1996.nc',
S_AUX_SET_NUM = 0,
S_START = 17487840.,
S_END = 17496600.,
S_DELTA = 24.0,
S_NUM_OF_FILES = 1,
S_REGVARFLAG = ' ',
$END
$STEPFILE_RECORD
s_filename = 'air.2m.gauss.1997.nc',
S_AUX_SET_NUM = 0,
S_START = 17496624.,
S_END = 17505360.,
S_DELTA = 24.0,
S_NUM_OF_FILES = 1,
S_REGVARFLAG = ' ',
$END
$STEPFILE_RECORD
s_filename = 'air.2m.gauss.1998.nc',
S_AUX_SET_NUM = 0,
S_START = 17505384.,
S_END = 17514120.,
S_DELTA = 24.0,
S_NUM_OF_FILES = 1,
S_REGVARFLAG = ' ',
$END
$STEPFILE_RECORD
s_filename = 'air.2m.gauss.1999.nc',
S_AUX_SET_NUM = 0,
S_START = 17514144.,
S_END = 17522880.,
S_DELTA = 24.0,
S_NUM_OF_FILES = 1,
S_REGVARFLAG = ' ',
$END
$STEPFILE_RECORD
s_filename = 'air.2m.gauss.2000.nc',
S_AUX_SET_NUM = 0,
S_START = 17522904.,
S_END = 17531664.,
S_DELTA = 24.0,
S_NUM_OF_FILES = 1,
S_REGVARFLAG = ' ',
$END
$STEPFILE_RECORD
s_filename = '**END OF STEPFILES**'
$END
[Thread Prev][Thread Next][Index]
Dept of Commerce /
NOAA /
OAR /
PMEL /
TMAP
Contact Us | Privacy Policy | Disclaimer | Accessibility Statement