Re: [ExternalEmail] RE: [ferret_users] Compressed ferret output incompatibe with netcdf java apps

[Russ Fiedler <russell.fiedler@xxxxxxxx>]

Hi,

Further to this, I found that it also fails with versions 6.8.4.2 (RH6) 
and V6.82 Mac

[raf599@vdi-n2 ~]$ ferret -nojnl
     NOAA/PMEL TMAP
     FERRET v6.842
     Linux 2.6.32-279.19.1.el6.x86_64 64-bit - 02/01/13

yes? sho sym netcdf_version
NETCDF_VERSION = "4.2.1.1 of Jan 31 2013 16:14:40 $"


So it looks like it's unrelated to the netcdf library version.

Russ


On 31/01/16 15:26, Russell.Fiedler@xxxxxxxx wrote:
> Hi Ansley,
>
> I mention that it's V6.95 and V6.96 down at the bottom of the post.  I think it might be a problem for at least one earlier version. That will have to wait till I get back to work...
>
> Cheers,
> Russ
>
>
> ________________________________________
> From: owner-ferret_users@xxxxxxxx [owner-ferret_users@xxxxxxxx] on behalf of Ansley C. Manke [ansley.b.manke@xxxxxxxx]
> Sent: Saturday, 30 January 2016 5:04 AM
> To: ferret_users@xxxxxxxx
> Subject: Re: [ferret_users] Compressed ferret output incompatibe with netcdf java apps
>
> Hi Russ,
> No, this is not a known issue.  What version of Ferret are you running?
> If it's an older one, it might be worth updating. Ferret currently links
> with netCDF 4.3.3.1.  (Upon starting Ferret, SHOW SYMBOL netcdf_version
> lists the version number).
>
> Ansley
>
> On 1/28/2016 10:52 PM, Russ Fiedler wrote:
> > Hi,
> >
> > This is possibly a problem with netcdf java rather than ferret but
> > anyway...
> >
> > If we make a variable and save it in compressed netcdf4 format it
> > appears that java based netcdf software han't handle it.
> >
> > e.g.
> >
> > yes? let v=i[i=1:20]+j[j=1:20]
> > yes? save/file=cmp.nc/ncformat=netcdf4/def v    ! compressed (actually
> > it's larger but just an example)
> > yes? save/file=uncmp.nc/ncformat=netcdf4 v      ! uncompressed
> >
> > Now loading up in Panopoly (and another of our in house apps which is
> > where we spotted the problem).When we try to operate on v
> > we get a message about an an unknown filter type being zero for the
> > compressed version
> >
> > java.lang.RuntimeException: Unknown filter type=0
> >      at
> > ucar.nc2.iosp.hdf5.H5tiledLayoutBB$DataChunk.getByteBuffer(H5tiledLayoutBB.java:198)
> > etc
> >
> > The uncompressed version is fine since there are no filters being
> > applied.
> >
> > Now, here's where it gets weird. If nccopy is used to convert the two
> > files to compressed netcdf4 style the originally compressed file is
> > still giving Panopoly grief but the newly compress file is handled
> > just fine!
> >
> >
> > xwing-hf% nccopy -k 3 -d 1 cmp.nc cmp_ncopy.nc          ! Still no good
> > xwing-hf% nccopy -k 3 -d 1 uncmp.nc uncmp_ncopy.nc  ! compressed file
> > is fine!!!
> >
> > Any clues? A known issue?
> >
> > Occurs for V6.95, V6.96 and earlier by the looks.
> >
> > Cheers,
> > Russ