[Thread Prev][Thread Next][Index]

Re: [ferret_users] ferret memory problem



Hi Patrick

For the larger file, Ferret is breaking up the calculation along the T axis, using the split/gather capability described here,
https://ferret.pmel.noaa.gov/Ferret/documentation/users-guide/computing-environment/MEMORY-USE

You can see this in action if you wish, with the setting "SET MODE DIAGNOSTIC" before running the script.

For the smaller file, it is not doing that but instead always reports that the grid is too big.  I don't know why this is.  I tried setting the memory to smaller and larger values to see if I could force it to do the splitting but without success.  I think this must be a bug, and I'll write up a report.

Ansley

On 5/18/2022 9:19 AM, Patrick Brockmann wrote:
Hi, 

I have encountered a problem when applying a calcul on files.
The strange thing is that the problem occurs with the smaller file.

ferret -script p1.jnl ORCHIDEE-SH0_17000101_18701231_1M_N2O_EMISSION.nc
-->  **ERROR: request exceeds memory setting

ferret -script p1.jnl ORCHIDEE-SH0_17000101_20191231_1M_N2O_EMISSION.nc
--> OK

$ ls -lh ORCHIDEE-SH0_17000101*N2O_EMISSION.nc
-rw-r--r-- 1 brock lsce 3,5G 17 mai   18:15 ORCHIDEE-SH0_17000101_18701231_1M_N2O_EMISSION.nc
-rw-r--r-- 1 brock lsce 6,6G 17 mai   18:19 ORCHIDEE-SH0_17000101_20191231_1M_N2O_EMISSION.nc

I have reduced the problem to a minimal script
$ cat p1.jnl
!===========================================================
use ($01)

DEFINE VARIABLE var=N2O_EMISSION
DEFINE VARIABLE var1=var[x=@sum,y=@sum,k=@sum]

LIST/FORMAT=CDF/file="tyty.nc"/clobber var1
!===========================================================

Tested with a FERRET v7.6.
The 2 files are strictly (in my investigation so far) identical. Except the dimension
of the time_counter.

Files are available from:
https://thredds-su.ipsl.fr/thredds/catalog/ipsl_thredds/brocksce/ferret_bugs_2022/catalog.html

Regards
Patrick

--
Data Analytics and Visualization Engineer / Project Manager
LSCE/IPSL, CEA-CNRS-UVSQ laboratory
LSCE - Climate and Environment Sciences Laboratory
IPSL - Institut Pierre Simon Laplace
--

[Thread Prev][Thread Next][Index]
Contact Us
Dept of Commerce / NOAA / OAR / PMEL / Ferret

Privacy Policy | Disclaimer | Accessibility Statement