Re: [ferret_users] Not a valid data type or _FillValue

["Ansley C. Manke" <ansley.b.manke@xxxxxxxx>]

Hi,
The best method to treat a set of separate files as one time series is to create a descriptor file, which lets you treat the files as a virtual single dataset without rewriting the data.
http://ferret.pmel.noaa.gov/Ferret/documentation/users-guide/converting-to-netcdf/CREATING-A-MULTI-FILE-NETCDF-DATA-SET

There are a couple of tools for creating descriptor files:
http://ferret.pmel.noaa.gov/Ferret/documentation/users-guide/converting-to-netcdf/CREATING-A-MULTI-FILE-NETCDF-DATA-SET#_VPINDEXENTRY_1144

There sometimes good reasons to to write a single file however. To append all of this data, first use Ferret to open the first timestep file, and write out the first data to a new file, and then append the other timesteps to that file.

Ansley

On 2/9/2016 5:35 AM, Nanda Kishore Reddy wrote:

Hi,

       I have a two years of files like this (per day one file). I would like to append all the sea surface temperature files into a single file and then plot the time series of SST. How could I change the data type of all the files and make it as a single netcdf file 

Thanks & Regards

Nanda Kishore reddy. B

On Tue, Feb 9, 2016 at 2:38 AM, Ansley C. Manke <ansley.b.manke@xxxxxxxx> wrote:

Hi,
This is an error from the netCDF library; error code -45 translates to "Not a valid data type or _FillValue type mismatch", and then Ferret is saying this occurred trying to write the TIME coordinate variable.

yes? save/file=test.nc/append SEA_SURFACE_TEMPERATURE
 LISTing to file test.nc
NetCDF: Not a valid data type or _FillValue type mismatch (OPeNDAP/netCDF Error code -45)
 Failed creating coord variable TIME

This is saying that there is a SEA_SURFACE_TEMPERATURE variable in the file test.nc, and that file already has a TIME axis.  It is fine to append to a file in the T direction, but Ferret/PyFerret writes coordinate data using double precision and apparently your existing test.nc has its TIME axis written with another data type.

Did you intend to append to the file?  If not then use /CLOBBER. 

If you do want to append more timesteps to the existing file then I think you'll need to change the data type of the time coordinate variable.  You could open the file with Ferret and re-write it, or you could use NCO to change the data type of TIME.  Ferret/PyFerret does not have an option to set the data type of coordinate variables.

Ansley

On 2/8/2016 6:14 AM, Nanda Kishore Reddy wrote:

Hi ferret users,

                I have a netcdf file which is having the sea surface temperature and other variables on it. I would like to save the SST variable alone, but when I tried it in a pyferret it shows the following error. 

              

nandu@nandu:~/Downloads$ pyferret -nojnl

  NOAA/PMEL TMAP

  FERRET v6.96 (PyFerret 1.2)

  Linux 3.19.0-33-generic - 11/23/15

  8-Feb-16 19:31     

yes? use 20130101000000-JAXA-L3C_GHRSST-SSTsubskin-AMSR2-v1a_A-v02.0-fv01.0.nc

yes? sh da/f

     currently SET data sets:

    1> ./20130101000000-JAXA-L3C_GHRSST-SSTsubskin-AMSR2-v1a_A-v02.0-fv01.0.nc  (default)

     Sea Surface Temperature from AMSR2 onboard GCOM-W

 name     title                             I         J         K         L         M         N

 SEA_SURFACE_TEMPERATURE

          sea surface subskin temperature  1:1440    1:720     ...       1:1       ...       ...

             kelvin on grid GFH1 with -54.53 for missing data

             X=180E(-180):180E  Y=90S:90N  

 SST_DTIME

          time difference from reference   1:1440    1:720     ...       1:1       ...       ...

             seconds on grid GFH1 with -32768 for missing data

             X=180E(-180):180E  Y=90S:90N  

 SSES_BIAS

          SSES bias estimate               1:1440    1:720     ...       1:1       ...       ...

             kelvin on grid GFH1 with -2.56 for missing data

             X=180E(-180):180E  Y=90S:90N  

 SSES_STANDARD_DEVIATION

          SSES standard deviation          1:1440    1:720     ...       1:1       ...       ...

             kelvin on grid GFH1 with -0.01999998 for missing data

             X=180E(-180):180E  Y=90S:90N  

 DT_ANALYSIS

          Deviation from last SST analysi  1:1440    1:720     ...       1:1       ...       ...

             kelvin on grid GFH1 with -12.8 for missing data

             X=180E(-180):180E  Y=90S:90N  

 WIND_SPEED

          sea surface wind speed           1:1440    1:720     ...       1:1       ...       ...

             m s-1 on grid GFH1 with -128 for missing data

             X=180E(-180):180E  Y=90S:90N  

 WIND_SPEED_DTIME_FROM_SST

          time difference of wind speed m  1:1440    1:720     ...       1:1       ...       ...

             hour on grid GFH1 with -12.8 for missing data

             X=180E(-180):180E  Y=90S:90N  

 SOURCES_OF_WIND_SPEED

          sources of wind speed            1:1440    1:720     ...       1:1       ...       ...

               on grid GFH1 with -128 for missing data

             X=180E(-180):180E  Y=90S:90N  

 SEA_ICE_FRACTION

          sea ice fraction                 1:1440    1:720     ...       1:1       ...       ...

             1 on grid GFH1 with -1.28 for missing data

             X=180E(-180):180E  Y=90S:90N  

 SEA_ICE_FRACTION_DTIME_FROM_SST

          time difference of sea ice frac  1:1440    1:720     ...       1:1       ...       ...

             hour on grid GFH1 with -12.8 for missing data

             X=180E(-180):180E  Y=90S:90N  

 SOURCES_OF_SEA_ICE_FRACTION

          sources of sea ice fraction      1:1440    1:720     ...       1:1       ...       ...

               on grid GFH1 with -128 for missing data

             X=180E(-180):180E  Y=90S:90N  

 L2P_FLAGS

          L2P flags                        1:1440    1:720     ...       1:1       ...       ...

               on grid GFH1 with -32768 for missing data

             X=180E(-180):180E  Y=90S:90N  

 QUALITY_LEVEL

          quality level of SST pixel       1:1440    1:720     ...       1:1       ...       ...

               on grid GFH1 with -128 for missing data

             X=180E(-180):180E  Y=90S:90N  

 PROXIMITY_CONFIDENCE

          proximity confidence value       1:1440    1:720     ...       1:1       ...       ...

               on grid GFH1 with -128 for missing data

             X=180E(-180):180E  Y=90S:90N  

 

  time range: 01-JAN-2013 00:00

 

yes? save/file=test.nc/append SEA_SURFACE_TEMPERATURE

 LISTing to file test.nc

NetCDF: Not a valid data type or _FillValue type mismatch (OPeNDAP/netCDF Error code -45)

 Failed creating coord variable TIME

Thanks & Regards

Nanda Kishore reddy. B