Re: [las_users] LAS 8.6.3 issues with large aggregations

To: Ansley Manke <ansley.b.manke@xxxxxxxx>

Subject: Re: [las_users] LAS 8.6.3 issues with large aggregations

From: Ajay Krishnan - NOAA Affiliate <ajay.krishnan@xxxxxxxx>

Date: Tue, 20 Nov 2018 13:24:35 -0500

Arc-authentication-results: i=2; mx.google.com; dkim=pass header.i=@noaa.gov header.s=google header.b=brvpcvm2; spf=pass (google.com: domain of ajay.krishnan@xxxxxxxx designates 209.85.220.41 as permitted sender) smtp.mailfrom=ajay.krishnan@xxxxxxxx; dmarc=pass (p=REJECT sp=NONE dis=NONE) header.from=noaa.gov

Arc-authentication-results: i=1; mx.google.com; dkim=pass header.i=@noaa.gov header.s=google header.b=brvpcvm2; spf=pass (google.com: domain of ajay.krishnan@xxxxxxxx designates 209.85.220.41 as permitted sender) smtp.mailfrom=ajay.krishnan@xxxxxxxx; dmarc=pass (p=REJECT sp=NONE dis=NONE) header.from=noaa.gov

Arc-message-signature: i=2; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=list-archive:list-help:list-post:list-id:mailing-list:precedence:cc :to:subject:message-id:date:from:in-reply-to:references:mime-version :dkim-signature; bh=kgiZnEt20NCHWtoZ0XBHWoDHDSNggSS2KFd1n1Fg7bg=; b=RMrQ7rl5T/XhvVMhoopfurvh7EEkhJ4taXgGoO+qGsxZV9Si8zPHh8l5LfiBBGWuOZ QHcKYshALPusPCur/XGdtyfVmB9/EMSVwynrZb8C73ximYFQSzj8G2SbuKoEiaTkDlqX hVAUQOJyNZFcacAneTHzRt5KPdJwA3zX3s05mo/DgQD59HcmaMtUqcl5EZAu4YkOjQ8y ZbiXRCywxmN0SmXkvLwQbE/YbIYsPT+fyKICWbVk5iGIK+PGrFx/siBIci+Db3T8GRzH hExowSdwHITdeoGQV79y1QxumJL3GlTguXrEfaIY9LKIvX4d7HBr7JpDv324XUhoto14 va/A==

Arc-message-signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=cc:to:subject:message-id:date:from:in-reply-to:references :mime-version:dkim-signature; bh=kgiZnEt20NCHWtoZ0XBHWoDHDSNggSS2KFd1n1Fg7bg=; b=g1G5YCbXUt9L/W6IID/VRLjhw3OBRYIIM6Qr1FaxNqSerlb3NL/FktsG3ar0TM2vVk jWIQADQbfOmAAl14XDIXiswNVqTpyff5nBxCcAWMh4iBIzdrl/p1ws1C+3r8UFNziUXZ RozMFqb4bIKscSMo72SIkoe+soZa9bR7poYEwx3iypIdWGSDeBKQ66C5EV6hGqIo9NEq JTevZESrLUdVril/31uK4nba5o/9BY0mwU97/xdu5nzP+GdinD0bqHTFkHVsvoQ9T540 Tqxj0No6PHsInOgFlGvA1xGD/RfrynmtACIvqS+F2UUP+wk1dA2cjkIuU1MRHzfZ/QnS MeNA==

Arc-seal: i=2; a=rsa-sha256; t=1542738288; cv=pass; d=google.com; s=arc-20160816; b=joYwJwCrTQ/BNUQj7gcW38XbifJbvlbNHPjoiOpa+CxH/7oHT/hgLkkcjj7NUbtP4r n+U4wubQ4g1gIJZXk8cHOUP3MDmd6jEI0IT7HK4QfSWSTAXLiwFKufuafpLHYmfIrvB+ 4BLKEs/XQOrH6He4q9C7wMOG41e6KnNzm/YcDNEL2GJFhv7czfph4ghZ2GnERqYvNN5z 3OUnkWTUS1ls6epueRnyAl8EOuDY8XUJH2sNpCDqsJ2zxQ18T1Al3+4aXCf9cB1uC0ia ez4cUw0JDH5CjB3o4o+bIPcHUvd+b6gQf05tudw6qlEcrqgeUclBQZ41i0sB2IrviY3y M7CQ==

Arc-seal: i=1; a=rsa-sha256; t=1542738287; cv=none; d=google.com; s=arc-20160816; b=RHLLBgISLdHWtSVYLOWphkVxvkVUL06sHissq1GnmzVASYkHV8XIYRGXFXIoJM/s1T 3y6fn+/xtE/EmLYCsoVeRCZXygJQHr7vgC0sPUWD/TPKUwxYVwkvKrzsZO9xLRKfqtf3 vgj6i7i4S/PfAWfI5EkKljA6tcHbW1dRkzA4AxRgELmGLnrEFNYCN3yOKSnKoP4RA9jE /CiPJgF/x5hLG4N+ZzjLCv81PioGraWyE04CRdCmb78MhyA24OgAyp4SgCQrAcFXOkkE r/6N5SGWIsCcmPXiuh5cOH/Ui+NaJCoPILNv1kHhb7Xxt+uvNvjZHq2rlx2xXtGW6w2H KSmw==

Cc: las_users@xxxxxxxx

Dkim-signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=noaa.gov; s=google; h=mime-version:references:in-reply-to:from:date:message-id:subject:to :cc:x-original-sender:x-original-authentication-results:precedence :mailing-list:list-id:list-post:list-help:list-archive; bh=kgiZnEt20NCHWtoZ0XBHWoDHDSNggSS2KFd1n1Fg7bg=; b=GhMBG3f9UDnW+gyH9LBjJfmwy6vtusvh29Z4KeiqA5vJaStGRNGNG6c5HxW6sNZQhG 6dUoHFEDM+t9U6Rrv5rfjI3jL1yfqp0nu4SkikoM/4273NZhJDwdQdnUC5N14zmGHok4 nTljJwMcaEL1odFFmhZ0rLXxO8kAYsDxYf2RiCJk6pDGjJukpwM2blchjwvRKecQW7fN +CeaWZj6IoCelTsWQcyQvARgFq22x9Y1p+6GCxVscTqq+B7x+Dp4Q7NZLnSceyMZWOle pl6T9RDBW0qxHe5eAZ8BDEIuYlLbaqRJTSf/e5l7hob2yMyzTn0w/DPHDB1CXCHk4a7M ZtRA==

In-reply-to: <85adba1f-65a8-54b6-4ca1-317ad05cd59a@noaa.gov>

List-archive: <https://groups.google.com/a/noaa.gov/group/las_users/>

List-help: <https://support.google.com/a/noaa.gov/bin/topic.py?topic=25838>, <mailto:las_users+help@noaa.gov>

List-id: <las_users.noaa.gov>

List-post: <https://groups.google.com/a/noaa.gov/group/las_users/post>, <mailto:las_users@noaa.gov>

Mailing-list: list las_users@xxxxxxxx; contact las_users+owners@xxxxxxxx

References: <CAA9eyS4c7w=m3MeZ+ecSw9C781x1Z85aN3HvsdLiixghqztguQ@mail.gmail.com> <85adba1f-65a8-54b6-4ca1-317ad05cd59a@noaa.gov>

Sender: owner-las_users@xxxxxxxx

Martin,

Thank you for your response! It's good to know that other users are experiencing the same issues.

Ansley,

Yes I agree. Was wondering which of these issues are related to the NetCDF-C libraries. Since I am not well versed in Ferret, how do we link to a different version of the NetCDF-C library without having to upgrade Ferret?

On Tue, Nov 20, 2018 at 12:46 PM Ansley C. Manke <ansley.b.manke@xxxxxxxx> wrote:

Hi Ajay,

This doesn't have to do with LAS but with the netCDF libraries linked with the Ferret/Pyferret executable. We've seen it reported this to Unidata earlier this month, and they've said they're looking into it.

Ansley

On 11/19/2018 8:53 AM, Ajay Krishnan - NOAA Affiliate wrote:
Ever since we upgraded our LAS to 8.6.3, some of our large aggregations which ran perfectly fine on the old instance (v7.2) keep breaking with very generic OPeNDAP errors.

For e.g.:

Unfortunately, we cannot provide what you have asked for.

A remote server was unable to deliver the data LAS needs to make your product.

LAS was trying to access these servers:

https://data.nodc.noaa.gov/thredds/dodsC/las/id-a074156616/data_https___data.nodc.noaa.gov_thredds_dodsC_ncml_ghrsst_ncml_fullAgg_aggregate__ghrsst_L4_GLOB_UKMO_OSTIA_20170605.ncml.jnl

Advanced users may see more technical information.
url error details: 
 **netCDF error
             NetCDF: I/O failure (OPeNDAP/netCDF Error code -68)
             Data set: https://data.nodc.noaa.gov/thredds/dodsC/ncml/ghrsst_ncml/fullAgg/aggregate__ghrsst_L4_GLOB_UKMO_OSTIA_20170605.ncml
SET DATA "https://data.nodc.noaa.gov/thredds/dodsC/ncml/ghrsst_ncml/fullAgg/aggregate__ghrsst_L4_GLOB_UKMO_OSTIA_20170605.ncml"
Command file, command group, or REPEAT execution aborted
ERROR RUNNING SCRIPT
Nothing in the THREDDS logs seem to indicate any issues with the NCML file. Anyone else experience such issues? Any solution?
Thanks!
-- 
Ajay Krishnan
Geospatial Data Developer | Science & Technology Corporation - Federal Government Contractor
NOAA National Centers for Environmental Information (NCEI)
SSMC3 - 1315 East West Hwy Silver Spring MD 20910
ajay.krishnan@xxxxxxxx
Phone: 301-713-4864
Customer Support:  1-301-713-3277 or ncei.info@xxxxxxxx

Ajay Krishnan

Geospatial Data Developer | Science & Technology Corporation - Federal Government Contractor
NOAA National Centers for Environmental Information (NCEI)
SSMC3 - 1315 East West Hwy Silver Spring MD 20910
ajay.krishnan@xxxxxxxx
Phone: 301-713-4864
Customer Support:  1-301-713-3277 or ncei.info@xxxxxxxx