[Thread Prev][Thread Next][Index]
[ferret_users] Double precision calculations in ferret
Hi,
I did not check the manual, but I remember a statement that ferret is
doing calculations double precision now.
Under this point of view, I cannot understand the following example:
ferret
NOAA/PMEL TMAP
PyFERRET v7 (opt)
Linux 3.19.0-64-generic - 07/01/16
19-Feb-17 13:28
yes? let a=1+1e-12
yes? list a-1
VARIABLE : A-1
1.000E-12
is correct.
yes? let a={`1+1e-1`,`1+1e-8`}
!-> DEFINE VARIABLE a={1.1,1}
yes? list/prec=12 (a-1)
VARIABLE : (A-1)
SUBSET : 2 points (X)
1 / 1: 0.100000000000
2 / 2: 0.000000000000
is not correct. There may be examples, where double precision is needed.
Could it be that the `a` operator to evaluate reals still gives single
precision results?
Best,
Martin
[Thread Prev][Thread Next][Index]
Contact Us
Dept of Commerce /
NOAA /
OAR /
PMEL /
Ferret
Privacy Policy | Disclaimer | Accessibility Statement