From solr-user-return-141841-archive-asf-public=cust-asf.ponee.io@lucene.apache.org Thu Jun 14 18:54:05 2018 Return-Path: X-Original-To: archive-asf-public@cust-asf.ponee.io Delivered-To: archive-asf-public@cust-asf.ponee.io Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by mx-eu-01.ponee.io (Postfix) with SMTP id B46D4180600 for ; Thu, 14 Jun 2018 18:54:04 +0200 (CEST) Received: (qmail 15926 invoked by uid 500); 14 Jun 2018 16:54:02 -0000 Mailing-List: contact solr-user-help@lucene.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: solr-user@lucene.apache.org Delivered-To: mailing list solr-user@lucene.apache.org Received: (qmail 15905 invoked by uid 99); 14 Jun 2018 16:54:02 -0000 Received: from pnap-us-west-generic-nat.apache.org (HELO spamd4-us-west.apache.org) (209.188.14.142) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 14 Jun 2018 16:54:02 +0000 Received: from localhost (localhost [127.0.0.1]) by spamd4-us-west.apache.org (ASF Mail Server at spamd4-us-west.apache.org) with ESMTP id 920C2C05DA for ; Thu, 14 Jun 2018 16:54:01 +0000 (UTC) X-Virus-Scanned: Debian amavisd-new at spamd4-us-west.apache.org X-Spam-Flag: NO X-Spam-Score: 2.422 X-Spam-Level: ** X-Spam-Status: No, score=2.422 tagged_above=-999 required=6.31 tests=[DKIM_SIGNED=0.1, KAM_LIVE=1, SPF_PASS=-0.001, T_DKIM_INVALID=0.01, URI_HEX=1.313] autolearn=disabled Authentication-Results: spamd4-us-west.apache.org (amavisd-new); dkim=neutral reason="invalid (public key: not available)" header.d=biologis.com Received: from mx1-lw-eu.apache.org ([10.40.0.8]) by localhost (spamd4-us-west.apache.org [10.40.0.11]) (amavisd-new, port 10024) with ESMTP id icxht_5mHgck for ; Thu, 14 Jun 2018 16:53:57 +0000 (UTC) Received: from mail.biologis.com (gim.biologis.com [213.83.10.100]) by mx1-lw-eu.apache.org (ASF Mail Server at mx1-lw-eu.apache.org) with ESMTPS id 2CE5F5F23F for ; Thu, 14 Jun 2018 16:53:57 +0000 (UTC) Received: from mail.biologis.com (mail.biologis.com [127.0.0.1]) by mail.biologis.com (Postfix) with ESMTP id 32A4658095A for ; Thu, 14 Jun 2018 18:53:51 +0200 (CEST) Authentication-Results: mail.biologis.com (amavisd-new); dkim=pass reason="pass (just generated, assumed good)" header.d=biologis.com DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple; d=biologis.com; h= x-mailer:to:references:message-id:content-transfer-encoding:date :date:in-reply-to:from:from:subject:subject:mime-version :content-type:content-type; s=dkim; t=1528995230; x=1529859231; bh=ZuUvneFKXTFOhDAiA4Jg/Q/JVk8WtFU+u9uRtB+PtOk=; b=cyyWMW4qjJxe urmICf8jI61NIUPN40CsNR9Ko6/tIdrjQ3GzW9DAbN9I480CefDHX9kEpjbTmW8J KcdHEtPLK3wVGsxoqiE20vBRywsV4zAmqsyZJB3/2txfcpWfPNV1ZiW2vHc/Ex6e 6GIHuA0HB1pSjEcsvH7wbBoc9skHes4= X-Virus-Scanned: Debian amavisd-new at mail.biologis.com Received: from mail.biologis.com ([127.0.0.1]) by mail.biologis.com (mail.biologis.com [127.0.0.1]) (amavisd-new, port 10026) with ESMTP id UGpHYqMfC-YT for ; Thu, 14 Jun 2018 18:53:50 +0200 (CEST) Received: from [172.27.10.122] (unknown [172.27.10.122]) by mail.biologis.com (Postfix) with ESMTPSA id 9A8C45804DF; Thu, 14 Jun 2018 18:53:50 +0200 (CEST) Content-Type: text/plain; charset=utf-8 Mime-Version: 1.0 (Mac OS X Mail 11.4 \(3445.8.2\)) Subject: Re: Exception when processing streaming expression From: Christian Spitzlay In-Reply-To: Date: Thu, 14 Jun 2018 18:53:50 +0200 Content-Transfer-Encoding: quoted-printable Message-Id: <3C16515C-9838-4765-AD86-9F07B6F1568C@biologis.com> References: <08F1EB02-C378-45AF-9136-C6BD65CF7BC4@biologis.com> To: solr-user@lucene.apache.org X-Mailer: Apple Mail (2.3445.8.2) Here ist one I stripped down as far as I could: innerJoin(sort(search(kmm, = q=3D"sds_endpoint_uuid:(2f927a0b\-fe38\-451e\-9103\-580914a77e82)", = fl=3D"sds_endpoint_uuid,sds_to_endpoint_uuid", = sort=3D"sds_to_endpoint_uuid ASC", qt=3D"/export"), = by=3D"sds_endpoint_uuid ASC"), search(kmm, = q=3Dss_search_api_datasource:entity\:as_metadata, = fl=3D"sds_metadata_of_uuid", sort=3D"sds_metadata_of_uuid ASC", = qt=3D"/select", rows=3D10000), = on=3D"sds_endpoint_uuid=3Dsds_metadata_of_uuid") The exception happens both via PHP (search_api_solr / Solarium) and via = the Solr admin UI. (version: Solr 7.3.1 on macOS High Sierra 10.13.5) It seems to be related to the fact that the second stream uses = "select=E2=80=9C.=20 - If I use "export=E2=80=9C the exception doesn=E2=80=99t occur. - If I set the rows parameter "low enough=E2=80=9C so I do not get any = results the exception doesn=E2=80=99t occur either. BTW: Do you know of any tool for formatting and/or syntax highlighting=20= these expressions? Christian Spitzlay > Am 13.06.2018 um 23:02 schrieb Joel Bernstein : >=20 > Can your provide some example expressions that are causing these = exceptions? >=20 > Joel Bernstein > http://joelsolr.blogspot.com/ >=20 > On Wed, Jun 13, 2018 at 9:02 AM, Christian Spitzlay < > christian.spitzlay@biologis.com> wrote: >=20 >> Hi, >>=20 >> I am seeing a lot of (reproducible) exceptions in my solr log file >> when I execute streaming expressions: >>=20 >> o.a.s.s.HttpSolrCall Unable to write response, client closed = connection >> or we are shutting down >> org.eclipse.jetty.io.EofException >> at org.eclipse.jetty.io.ChannelEndPoint.flush( >> ChannelEndPoint.java:292) >> at = org.eclipse.jetty.io.WriteFlusher.flush(WriteFlusher.java:429) >> at = org.eclipse.jetty.io.WriteFlusher.write(WriteFlusher.java:322) >> at org.eclipse.jetty.io.AbstractEndPoint.write( >> AbstractEndPoint.java:372) >> at org.eclipse.jetty.server.HttpConnection$SendCallback. >> process(HttpConnection.java:794) >> [=E2=80=A6] >> at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run( >> EatWhatYouKill.java:131) >> at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ >> ReservedThread.run(ReservedThreadExecutor.java:382) >> at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob( >> QueuedThreadPool.java:708) >> at org.eclipse.jetty.util.thread.QueuedThreadPool$2.run( >> QueuedThreadPool.java:626) >> at java.base/java.lang.Thread.run(Thread.java:844) >> Caused by: java.io.IOException: Broken pipe >> at java.base/sun.nio.ch.FileDispatcherImpl.writev0(Native = Method) >> at java.base/sun.nio.ch.SocketDispatcher.writev( >> SocketDispatcher.java:51) >> at java.base/sun.nio.ch.IOUtil.write(IOUtil.java:148) >> at java.base/sun.nio.ch.SocketChannelImpl.write( >> SocketChannelImpl.java:506) >> at org.eclipse.jetty.io.ChannelEndPoint.flush( >> ChannelEndPoint.java:272) >> ... 69 more >>=20 >>=20 >> I have read up on the exception message and found >> = http://lucene.472066.n3.nabble.com/Unable-to-write-response-client-closed-= >> connection-or-we-are-shutting-down-tt4350349.html#a4350947 >> but I don=E2=80=99t understand how an early client connect can cause = what I am >> seeing: >>=20 >> What puzzles me is that the response has been delivered in full to = the >> client library, including the document with EOF. >>=20 >> So Solr must have already processed the streaming expression and = returned >> the result. >> It=E2=80=99s just that the log is filled with stacktraces of this = exception that >> suggests something went wrong. >> I don=E2=80=99t understand why this happens when the query seems to = have succeeded. >>=20 >>=20 >> Best regards, >> Christian >>=20 >>=20 >>=20