[ferret_users] opendap access and error "Invalid character found in the request target"

To: ferret users <ferret_users@xxxxxxxx>

Subject: [ferret_users] opendap access and error "Invalid character found in the request target"

From: Patrick Brockmann <patrick.brockmann@xxxxxxxxxxxx>

Date: Wed, 25 Jan 2023 14:02:19 +0100 (CET)

Arc-authentication-results: i=4; mx.google.com; dkim=pass header.i=@lsce.ipsl.fr header.s=E682C68A-A940-4689-9079-2ADB5A360654 header.b=UViC29vL; arc=pass (i=2 spf=pass spfdomain=lsce.ipsl.fr dkim=pass dkdomain=lsce.ipsl.fr); spf=softfail (google.com: domain of transitioning patrick.brockmann@xxxxxxxxxxxx does not designate 209.85.219.72 as permitted sender) smtp.mailfrom=patrick.brockmann@xxxxxxxxxxxx

Arc-authentication-results: i=3; mx.google.com; dkim=pass header.i=@lsce.ipsl.fr header.s=E682C68A-A940-4689-9079-2ADB5A360654 header.b=UViC29vL; arc=pass (i=2 spf=pass spfdomain=lsce.ipsl.fr dkim=pass dkdomain=lsce.ipsl.fr); spf=softfail (google.com: domain of transitioning patrick.brockmann@xxxxxxxxxxxx does not designate 209.85.219.72 as permitted sender) smtp.mailfrom=patrick.brockmann@xxxxxxxxxxxx

Arc-authentication-results: i=2; mx.google.com; dkim=pass header.i=@lsce.ipsl.fr header.s=E682C68A-A940-4689-9079-2ADB5A360654 header.b=UViC29vL; arc=pass (i=1 spf=pass spfdomain=lsce.ipsl.fr dkim=pass dkdomain=lsce.ipsl.fr dmarc=pass fromdomain=ipsl.fr); spf=pass (google.com: domain of patrick.brockmann@xxxxxxxxxxxx designates 194.254.240.33 as permitted sender) smtp.mailfrom=patrick.brockmann@xxxxxxxxxxxx

Arc-authentication-results: i=1; mx.google.com; dkim=pass header.i=@lsce.ipsl.fr header.s=E682C68A-A940-4689-9079-2ADB5A360654 header.b=UViC29vL; spf=pass (google.com: domain of patrick.brockmann@xxxxxxxxxxxx designates 194.254.240.33 as permitted sender) smtp.mailfrom=patrick.brockmann@xxxxxxxxxxxx; dmarc=pass (p=NONE sp=NONE dis=NONE) header.from=ipsl.fr

Arc-message-signature: i=4; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=list-archive:list-help:list-post:list-id:mailing-list:precedence :thread-topic:thread-index:mime-version:subject:message-id:to:from :date:dkim-filter:sender:dkim-signature; bh=ZlZMVzqzRVNcuATrUMkSx4C3ZP3RZ/0St0ZT1r3S+oA=; b=cL7q9v67zs4C/8tTX4gUrizVQrZZ4/yEUkPvQW0MdOwTl52R3fF9kLZjDJM+7NPZHY 9tcNr4lB8kO9ebkskK43k3CfNWGABkmkCAoN7hLL3k7mVe/fVl+N2IQDuCldcDMlXqUq mS2DmsdHXXE1li5BYjUSFYqh/H7GOiNQXf0krNbDrO6SYKYNAH9YVEnV5aWhHtfC2+A3 8unOu1aH4mKJl4FOtG8GvNgWtvsUb/sFoNZZhB5RgTDBr4sM4URK5zUt5SoCrbupVCHn lTVO7w3rIZaKdVY8EVeDkV0aHF7RzBQRum99Llt/zh3IDzoYoZtgCwt1vIXU3KA/REwE 2eRw==

Arc-message-signature: i=3; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=thread-topic:thread-index:mime-version:subject:message-id:to:from :date:dkim-signature:dkim-filter; bh=ZlZMVzqzRVNcuATrUMkSx4C3ZP3RZ/0St0ZT1r3S+oA=; b=fi0BTf443MGP3WnRnbrYHGYVdj3XE5pJ/4x5s0lxeS4A8PkBZwuD5yizuF50dLvx9d qbRwLeEIexXBM6n3JZ3LY8h3/JaK2q+ixfDAmsN9kNZ0QgQQ3QLvKENG7IrAhnqCQZe3 48ohLGxqTKnRf4B7YRbQELjzRc1C28htXB6YRoK2stZd8tpefKidw2+lfdyZ9wc1aeo5 yQGVwzCgaOqtrimDwpUiuPkjkYHPhuYWxmMxKUxNrxhp8PX1K+6B8e0aw8jse+JIq4KJ D5dd4MjStbycUGgOP4OlNoSAzjOkBrL9x4yE/zCRmFzUNCEUyF80THCo4fFaCNegkLtx E0BA==

Arc-message-signature: i=2; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=thread-topic:thread-index:mime-version:subject:message-id:to:from :date:dkim-signature:dkim-filter; bh=ZlZMVzqzRVNcuATrUMkSx4C3ZP3RZ/0St0ZT1r3S+oA=; b=B12jqgt0bS8/3pvgfdTv35B9ZxhAkzRLu5qncz+AHb52YHiOp8p2yulQPCGG2gIjDe gJkugzymc55A8jhP17lFWx2O7Eq6F7i/8P7tokox5szwNMTRCK8mfGQhTaWhy6rWoTJH 09WNSKDjb9z9eQN+IEBxZcKevvoMq5Ib0raaaduGFKs45jfStlfFxu7oXs3Mn291BW60 2fPbdvmzoDmzc7ItVtbtxCIEgcJ1pQMuR2zPZuDg/YSgzOLpUhweQjtGZ5VfIXiJOCNO oPjPg21PNljgxUiA10Iv+krxLS75p8tO2FPaF5WeMWETAbM6h6RXIxzg2Y8pG7rHarCr yz+w==

Arc-message-signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=thread-topic:thread-index:mime-version:subject:message-id:to:from :date:dkim-signature:dkim-filter; bh=ZlZMVzqzRVNcuATrUMkSx4C3ZP3RZ/0St0ZT1r3S+oA=; b=NXu+riDDzHKamuSf5EnD/JX18DzTB6tmm5VUecMXxAzMH8HJi/AlmZzT22G98wPfaH 4ApFeV9Ht/12wwVdZFIzt3LsKu2GnrjoLFJgQRGX7czSUVqsRJjkzvbOBvTzThO+dti6 hpUUCRyq4wglKaomIvLc3gvWUlqZE1co4s3b1ZLVeHpXULU4a5Zm7OKV3+gdXwhSnaZz lg1TAANhtsq0N24+Rm6oxt3AcDZU1MVCCPqrd6YcL7JgG3I02f1y/wvha8moH1Yj5PA+ /zspkOU755GZcKtq++C6av0VOmaH5mp6cczs3rIXSfhhvENpKVFPt4PVbObwdGOLTPTZ 1eng==

Arc-seal: i=4; a=rsa-sha256; t=1674651772; cv=pass; d=google.com; s=arc-20160816; b=FnQ75J2bs0IWZ07xlqnl0t1Mqko5qMw/0SqhUs4WYT6vH6jw2iS0MOJTPUWpMyPaLR QkOyIjEQJcbMuscku7RqFhrvxtN73NKljyZ2VajHDeYdl14DMkcYahTiH12eL6Zzhtrr VemWRLBlg3l+lcbInSvhEg4dbTq2lCp7/e0+BwsJh0raySvpTqptqXzEtJSlSh+zjcmS V9D7heuqJ2HtciBBmamWZ7iLn3lXp4SiTiz86zfkymH/Q7R6RQzMv/Fr+VDtKd5gWdbv ajgN1eARba59IX/dWQjlbNZ24BKwdHWOWIPGWr+ew2QjOK3Ig3DEz2/6gVM7CZIXbVj5 l9+g==

Arc-seal: i=3; a=rsa-sha256; t=1674651771; cv=pass; d=google.com; s=arc-20160816; b=tSGJTVDfZjask1vqe8sHTYCxm01IQh7R+1FXaYNAdglktOhl+CLeCsGVTR/3ReQg3S aPSyiy1ZgK10Qi49crju6uhZk/icy3L03MZ2WFqTIyJI8UwJRflAuQ4zdYsZvF6lO6b9 IvprNRxVZmkw1kUb/fndLCSQLxO4NdjW3S65UWLEsauode3u/6IXkqw48b+hwezE5PTT +90mvf8PD0Yyx5nmtby+4NpEP4sSqWBZJDQLavnje86jivv+OuqnNJGyXCMyOGSY87Jh +XqWDd6Hj5ds+iG9ZDL6PJFIhPABHLYO67cjy8Do3Emc3FDLFL+oxN2d3uwsiF8bSCkR mDQw==

Arc-seal: i=2; a=rsa-sha256; t=1674651746; cv=pass; d=google.com; s=arc-20160816; b=0H2CQKA0dlPDYwEY6tPaCfZ+5zzB9HlwX1NNaPd8wGGYde8ymumafpwlTJ4590xuDs LMTzSjTWnxTU2UgXJAkAKrRUqsGU29yhlOA6I5t9BA1pZVjL/Cr98aR5IJE2+Bk0gBIz gDq+CEH9ao3UCdlrYHxZiJ3bsh1DAlduSsAHR0wdZOpWfc2rbE+rhZ5efhIpuVbGEVH+ DXgV8tr+/a+WkemCEreD1rFUCIi/WvvX7vQfTUUar4euyL3TgnUMBVQ/qCv/wYAEh1vy zHoBXYhKgGyaMszMhM8AFd/W1Xob1TRwLl5hQBEe6n3qHofdvxv2uzitfpAJUlIz/sZh F5NQ==

Arc-seal: i=1; a=rsa-sha256; t=1674651742; cv=none; d=google.com; s=arc-20160816; b=ISk1htf83OYDrXKjeYfhTWyijCxpkqw1fov57grS3vC2rt/OvRpgkjG/M+S/kruFtC RW4IrMOGBQWVX9PI6RtyqSw6bOxFwG0Lj8tgSds/q3hMp1V02wNUIddL1OoTLTms3cUO iKlkp2zNoB1pV5SdIuNYYwWIgLsADhK/uWAjQjzgm0tp8SD2rOBEMTWuovbcys/Y/soj 8JEHDzM9WEQ4xupeuebi2FcVNTunala6vYClyKnwanXiF+uPKEwEXxAODMhexh/nvpvX wmxxzn7yjnz3vWp89HScyhjv1hmDxZOJbUGsuNUAp8OZ1gUyCqeC8ZkwUg5IZFQpY5tZ jRRw==

Dkim-filter: OpenDKIM Filter v2.10.3 zmtaout03.partage.renater.fr EB1D740093

Dkim-signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=noaa.gov; s=google; h=list-archive:list-help:list-post:list-id:mailing-list:precedence :x-original-authentication-results:x-original-sender:thread-topic :thread-index:mime-version:subject:message-id:to:from:date :dkim-filter:sender:from:to:cc:subject:date:message-id:reply-to; bh=ZlZMVzqzRVNcuATrUMkSx4C3ZP3RZ/0St0ZT1r3S+oA=; b=WSPLTY4f2u5cXCIfSp7oxz0KEPW+fBT0YCx7lR2Zm/q7TSr9az6SMWhrwCmIBe3zLF lUwyE/xB6hvvQaF53Wzv3bwGzpuU3UckXENrRicIE8Qn2r7Kls8SI2uAg1YnPSMZ8LeU HInEmxVS6Q9u0quhTWpS8FT24WW3/s2Njq38rqNdCcVpVYbzbmBe/dScSa3bvGEO5E0t FG25kKGGESgwFl3OPJ+AHv5yWSMoDyCmgARRyjytJGLmEuzylQCWCAxnkHYtGPAG9Afk XV7plW5LRRa7Lspr9YZVml1pbu3FmHyxLx/diPz94qGMIDndJ4JPX5Mss+/KpmmnyrUh 97Xw==

List-archive: <https://groups.google.com/a/noaa.gov/group/ferret_users/>

List-help: <https://support.google.com/a/noaa.gov/bin/topic.py?topic=25838>, <mailto:ferret_users+help@noaa.gov>

List-id: <ferret_users.noaa.gov>

List-post: <https://groups.google.com/a/noaa.gov/group/ferret_users/post>, <mailto:ferret_users@noaa.gov>

Mailing-list: list ferret_users@xxxxxxxx; contact ferret_users+owners@xxxxxxxx

Sender: owner-ferret_users@xxxxxxxx

Thread-index: LcXW07hdxKKga7qY77BGrHA1dvLl6g==

Thread-topic: opendap access and error "Invalid character found in the request target"

Hi,

I have encountered a strange error when I have opened a remote ressource from my thredds server.

A simple list of a element throws an error that comes from the thredds server.

It appears only with ferret and not pyferret (I found quicker ferret for displaying).

I have made some investigation from the mailing list and have found this thread

https://www.pmel.noaa.gov/maillists/tmap/ferret_users/fu_2011/msg00723.html

Not clear on what to do.

Tested with ferret 7.6.0

yes? use https://thredds-su.ipsl.fr/thredds/dodsC/ipsl_thredds/brocksce/tmp/ORCHIDEEv3_S2_cVegpft_corrected.nc

yes? show data

yes? list CVEGPFT[i=1,j=1,k=1,l=1]

HTTP Status 400 – Bad Request

Type Exception Report

Message Invalid character found in the request target [/thredds/dodsC/ipsl_thredds/brocksce/tmp/ORCHIDEEv3_S2_cVegpft_corrected.nc.dods?cVegpft.cVegpft[0][0][0:359][0:719] ]. The valid characters are defined in RFC 7230 and RFC 3986

Description The server cannot or will not process the request due to something that is perceived to be a client error (e.g., malformed request syntax, invalid request message framing, or deceptive request routing).

Exception

java.lang.IllegalArgumentException: Invalid character found in the request target [/thredds/dodsC/ipsl_thredds/brocksce/tmp/ORCHIDEEv3_S2_cVegpft_corrected.nc.dods?cVegpft.cVegpft[0][0][0:359][0:719] ]. The valid characters are defined in RFC 7230 and RFC 3986 org.apache.coyote.http11.Http11InputBuffer.parseRequestLine(Http11InputBuffer.java:509) org.apache.coyote.http11.Http11Processor.service(Http11Processor.java:511) org.apache.coyote.AbstractProcessorLight.process(AbstractProcessorLight.java:65) org.apache.coyote.AbstractProtocol$ConnectionHandler.process(AbstractProtocol.java:831) org.apache.tomcat.util.net.NioEndpoint$SocketProcessor.doRun(NioEndpoint.java:1650) org.apache.tomcat.util.net.SocketProcessorBase.run(SocketProcessorBase.java:49) org.apache.tomcat.util.threads.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1191) org.apache.tomcat.util.threads.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:659) org.apache.tomcat.util.threads.TaskThread$WrappingRunnable.run(TaskThread.java:61) java.base/java.lang.Thread.run(Thread.java:829)

Note The full stack trace of the root cause is available in the server logs.

Apache Tomcat/8.5.72

Any idea ?

Regards

Patrick

--
Data Analytics and Visualization Engineer / Project Manager
LSCE/IPSL, CEA-CNRS-UVSQ laboratory
LSCE - Climate and Environment Sciences Laboratory
IPSL - Institut Pierre Simon Laplace
--