From dev-return-19419-archive-asf-public=cust-asf.ponee.io@manifoldcf.apache.org Tue Apr 9 13:12:02 2019 Return-Path: X-Original-To: archive-asf-public@cust-asf.ponee.io Delivered-To: archive-asf-public@cust-asf.ponee.io Received: from mail.apache.org (hermes.apache.org [207.244.88.153]) by mx-eu-01.ponee.io (Postfix) with SMTP id 291DD180763 for ; Tue, 9 Apr 2019 15:12:02 +0200 (CEST) Received: (qmail 48283 invoked by uid 500); 9 Apr 2019 12:52:24 -0000 Mailing-List: contact dev-help@manifoldcf.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: dev@manifoldcf.apache.org Delivered-To: mailing list dev@manifoldcf.apache.org Received: (qmail 48229 invoked by uid 99); 9 Apr 2019 12:52:23 -0000 Received: from mailrelay1-us-west.apache.org (HELO mailrelay1-us-west.apache.org) (209.188.14.139) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 09 Apr 2019 12:52:23 +0000 Received: from jira-lw-us.apache.org (unknown [207.244.88.139]) by mailrelay1-us-west.apache.org (ASF Mail Server at mailrelay1-us-west.apache.org) with ESMTP id BB90DE29D2 for ; Tue, 9 Apr 2019 13:12:00 +0000 (UTC) Received: from jira-lw-us.apache.org (localhost [127.0.0.1]) by jira-lw-us.apache.org (ASF Mail Server at jira-lw-us.apache.org) with ESMTP id 42F9424593 for ; Tue, 9 Apr 2019 13:12:00 +0000 (UTC) Date: Tue, 9 Apr 2019 13:12:00 +0000 (UTC) From: "roel goovaerts (JIRA)" To: dev@manifoldcf.apache.org Message-ID: In-Reply-To: References: Subject: [jira] [Updated] (CONNECTORS-1592) Found long running query in manifold scheduled job MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 [ https://issues.apache.org/jira/browse/CONNECTORS-1592?page=3Dcom.atl= assian.jira.plugin.system.issuetabpanels:all-tabpanel ] roel goovaerts updated CONNECTORS-1592: --------------------------------------- Attachment: postgresql.conf SELECT_blocked_queries.txt properties.xml 0904debug > Found long running query in manifold scheduled job > -------------------------------------------------- > > Key: CONNECTORS-1592 > URL: https://issues.apache.org/jira/browse/CONNECTORS-159= 2 > Project: ManifoldCF > Issue Type: Bug > Affects Versions: ManifoldCF 2.12 > Reporter: Subasini Rath > Priority: Major > Attachments: 0904debug, LongRunningWithPlan_thread39.txt, SELECT_= blocked_queries.txt, postgresql.conf, properties.xml > > > Hi Karl, > =C2=A0 =C2=A0I am also facing the above mentioned issue. (Similar to Conn= ector-880) > I am using manifold2.12 binary version. I am using Solr output connector = and Web repository connection. Manifold is using all default configuration. > When I am running the jobs manually, it runs fine. Same jobs have been sc= heduled to run everyday. > I am getting below exceptions and the job gets hanged/ going to waiting s= tage. > Could you please help me in resolving the same. > I am getting the below error - > Scenario-1 > WARN 2019-03-08T23:58:20,338 (qtp550147359-413) - Found a long-running qu= ery (2706114 ms): [SELECT t0.id,t0.description,t0.status,t0.starttime,t0.en= dtime,t0.errortext FROM jobs t0 ORDER BY description ASC] > WARN 2019-03-08T23:58:20,337 (Document delete stuffer thread) - Found a = long-running query (2737370 ms): [SELECT id FROM jobs WHERE status=3D? LIMI= T 1] > WARN 2019-03-08T23:58:20,339 (Job reset thread) - Found a long-running q= uery (2770133 ms): [SELECT id FROM jobs WHERE status IN (?,?)] > WARN 2019-03-08T23:58:20,386 (Document delete stuffer thread) - Paramete= r 0: 'e' > WARN 2019-03-08T23:58:20,337 (Set priority thread) - Found a long-runnin= g query (2732379 ms): [SELECT id,dochash,docid,jobid FROM jobqueue WHERE ne= edpriority=3D? LIMIT 1000] > WARN 2019-03-08T23:58:20,386 (Set priority thread) - Parameter 0: 'T' > WARN 2019-03-08T23:58:20,386 (Job reset thread) - Parameter 0: 'I' > WARN 2019-03-08T23:58:20,386 (Job reset thread) - Parameter 1: 'i' > WARN 2019-03-08T23:58:20,372 (Seeding thread) - Parameter 2: '1552047176= 062' > WARN 2019-03-08T23:58:20,474 (Document cleanup stuffer thread) - Found a= long-running query (2737524 ms): [SELECT id FROM jobs WHERE status=3D? LIM= IT 1] > WARN 2019-03-08T23:58:20,474 (Document cleanup stuffer thread) - Paramet= er 0: 'S' > WARN 2019-03-08T23:58:20,474 (Finisher thread) - Found a long-running qu= ery (2752034 ms): [SELECT id FROM jobs WHERE status IN (?,?,?) FOR UPDATE] > WARN 2019-03-08T23:58:20,474 (Finisher thread) - Parameter 0: 'A' > WARN 2019-03-08T23:58:20,475 (Finisher thread) - Parameter 1: 'W' > WARN 2019-03-08T23:58:20,475 (Finisher thread) - Parameter 2: 'R' > WARN 2019-03-08T23:58:20,475 (Delete startup thread) - Found a long-runn= ing query (2752036 ms): [SELECT id FROM jobs WHERE status=3D? FOR UPDATE] > WARN 2019-03-08T23:58:20,475 (Delete startup thread) - Parameter 0: 'E' > WARN 2019-03-08T23:58:20,483 (qtp550147359-4339) - Found a long-running = query (2496641 ms): [SELECT t0.id,t0.description,t0.status,t0.starttime,t0.= endtime,t0.errortext FROM jobs t0 ORDER BY description ASC] > WARN 2019-03-08T23:58:20,492 (Finisher thread) - Plan: isDistinctSelect= =3D[false] > WARN 2019-03-08T23:58:20,492 (Finisher thread) - Plan: isGrouped=3D[fals= e] > WARN 2019-03-08T23:58:20,492 (Finisher thread) - Plan: isAggregated=3D[f= alse] > WARN 2019-03-08T23:58:20,492 (Finisher thread) - Plan: columns=3D[ COLUM= N: PUBLIC.JOBS.ID not nullable > WARN 2019-03-08T23:58:20,492 (qtp550147359-4346) - Found a long-running = query (2435908 ms): [SELECT t0.id,t0.description,t0.status,t0.starttime,t0.= endtime,t0.errortext FROM jobs t0 ORDER BY description ASC] > WARN 2019-03-08T23:58:20,492 (Finisher thread) - Plan:=C2=A0 > WARN 2019-03-08T23:58:20,492 (Finisher thread) - Plan: ] > WARN 2019-03-08T23:58:20,499 (Finisher thread) - Plan: [range variable 1 > WARN 2019-03-08T23:58:20,499 (Finisher thread) - Plan: join type=3DINNER > WARN 2019-03-08T23:58:20,499 (Finisher thread) - Plan: table=3DSYSTEM_SU= BQUERY > WARN 2019-03-08T23:58:20,499 (Finisher thread) - Plan: cardinality=3D0 > WARN 2019-03-08T23:58:20,499 (Finisher thread) - Plan: access=3DFULL SCA= N > WARN 2019-03-08T23:58:20,500 (Finisher thread) - Plan: join condition = =3D [index=3DSYS_IDX_13329 > WARN 2019-03-08T23:58:20,500 (Finisher thread) - Plan: ] > WARN 2019-03-08T23:58:20,500 (Finisher thread) - Plan: ][range variable = 2 > WARN 2019-03-08T23:58:20,500 (Finisher thread) - Plan: join type=3DINNER > WARN 2019-03-08T23:58:20,500 (Finisher thread) - Plan: table=3DJOBS > WARN 2019-03-08T23:58:20,500 (Finisher thread) - Plan: cardinality=3D3 > WARN 2019-03-08T23:58:20,500 (Finisher thread) - Plan: access=3DINDEX PR= ED > WARN 2019-03-08T23:58:20,500 (Finisher thread) - Plan: join condition = =3D [index=3DI1549955498033 > WARN 2019-03-08T23:58:20,500 (Finisher thread) - Plan: start conditions= =3D[ > WARN 2019-03-08T23:58:20,500 (Finisher thread) - Plan: EQUAL arg_left=3D= [ COLUMN: PUBLIC.JOBS.STATUS > WARN 2019-03-08T23:58:20,500 (Finisher thread) - Plan: ] arg_right=3D[ C= OLUMN: C1 > WARN 2019-03-08T23:58:20,500 (Finisher thread) - Plan: ]] > WARN 2019-03-08T23:58:20,500 (Finisher thread) - Plan: end condition=3D[ > WARN 2019-03-08T23:58:20,500 (Finisher thread) - Plan: EQUAL arg_left=3D= [ COLUMN: PUBLIC.JOBS.STATUS > WARN 2019-03-08T23:58:20,501 (Finisher thread) - Plan: ] arg_right=3D[ C= OLUMN: C1 > WARN 2019-03-08T23:58:20,501 (Finisher thread) - Plan: ]] > WARN 2019-03-08T23:58:20,501 (Finisher thread) - Plan: other condition= =3D[ > WARN 2019-03-08T23:58:20,501 (Finisher thread) - Plan: EQUAL arg_left=3D= [ COLUMN: PUBLIC.JOBS.STATUS > WARN 2019-03-08T23:58:20,501 (Finisher thread) - Plan: ] arg_right=3D[ C= OLUMN: C1 > WARN 2019-03-08T23:58:20,501 (Finisher thread) - Plan: ]] > WARN 2019-03-08T23:58:20,501 (Finisher thread) - Plan: ] > WARN 2019-03-08T23:58:20,501 (Finisher thread) - Plan: ]] > WARN 2019-03-08T23:58:20,501 (Finisher thread) - Plan: PARAMETERS=3D[ > WARN 2019-03-08T23:58:20,501 (Finisher thread) - Plan: @0[DYNAMIC PARAM:= , TYPE =3D VARCHAR > WARN 2019-03-08T23:58:20,501 (Finisher thread) - Plan: ] > WARN 2019-03-08T23:58:20,501 (Finisher thread) - Plan: @1[DYNAMIC PARAM:= , TYPE =3D VARCHAR > WARN 2019-03-08T23:58:20,501 (Finisher thread) - Plan: ] > WARN 2019-03-08T23:58:20,501 (Finisher thread) - Plan: @2[DYNAMIC PARAM:= , TYPE =3D VARCHAR > WARN 2019-03-08T23:58:20,501 (Finisher thread) - Plan: ]] > WARN 2019-03-08T23:58:20,501 (Finisher thread) - Plan: SUBQUERIES[ > WARN 2019-03-08T23:58:20,501 (Finisher thread) - Plan: [level=3D1 > WARN 2019-03-08T23:58:20,502 (Finisher thread) - Plan: value expression]= ] > WARN 2019-03-08T23:58:20,502 (Finisher thread) -=C2=A0 > WARN 2019-03-08T23:58:20,504 (Delete startup thread) - Plan: isDistinctS= elect=3D[false] > WARN 2019-03-08T23:58:20,505 (Delete startup thread) - Plan: isGrouped= =3D[false] > WARN 2019-03-08T23:58:20,505 (Delete startup thread) - Plan: isAggregate= d=3D[false] > WARN 2019-03-08T23:58:20,505 (Delete startup thread) - Plan: columns=3D[= COLUMN: PUBLIC.JOBS.ID not nullable > WARN 2019-03-08T23:58:20,505 (Delete startup thread) - Plan:=C2=A0 > WARN 2019-03-08T23:58:20,505 (Delete startup thread) - Plan: ] > WARN 2019-03-08T23:58:20,505 (Delete startup thread) - Plan: [range vari= able 1 > WARN 2019-03-08T23:58:20,505 (Delete startup thread) - Plan: join type= =3DINNER > WARN 2019-03-08T23:58:20,505 (Delete startup thread) - Plan: table=3DJOB= S > WARN 2019-03-08T23:58:20,505 (Delete startup thread) - Plan: cardinality= =3D3 > WARN 2019-03-08T23:58:20,505 (Delete startup thread) - Plan: access=3DIN= DEX PRED > WARN 2019-03-08T23:58:20,505 (Delete startup thread) - Plan: join condit= ion =3D [index=3DI1549955498033 > WARN 2019-03-08T23:58:20,505 (Delete startup thread) - Plan: start condi= tions=3D[ > WARN 2019-03-08T23:58:20,505 (Delete startup thread) - Plan: EQUAL arg_l= eft=3D[ COLUMN: PUBLIC.JOBS.STATUS > WARN 2019-03-08T23:58:20,505 (Delete startup thread) - Plan: ] arg_right= =3D[ DYNAMIC PARAM: , TYPE =3D CHARACTER > WARN 2019-03-08T23:58:20,507 (Delete startup thread) - Plan: ]] > WARN 2019-03-08T23:58:20,507 (Document cleanup stuffer thread) - Plan: i= sDistinctSelect=3D[false] > WARN 2019-03-08T23:58:20,507 (Document cleanup stuffer thread) - Plan: i= sGrouped=3D[false] > WARN 2019-03-08T23:58:20,507 (Document cleanup stuffer thread) - Plan: i= sAggregated=3D[false] > WARN 2019-03-08T23:58:20,507 (Document cleanup stuffer thread) - Plan: c= olumns=3D[ COLUMN: PUBLIC.JOBS.ID not nullable > WARN 2019-03-08T23:58:20,507 (Document cleanup stuffer thread) - Plan:= =C2=A0 > WARN 2019-03-08T23:58:20,507 (Document cleanup stuffer thread) - Plan: ] > WARN 2019-03-08T23:58:20,507 (Document cleanup stuffer thread) - Plan: [= range variable 1 > WARN 2019-03-08T23:58:20,507 (Document cleanup stuffer thread) - Plan: j= oin type=3DINNER > WARN 2019-03-08T23:58:20,507 (Document cleanup stuffer thread) - Plan: t= able=3DJOBS > WARN 2019-03-08T23:58:20,507 (Document cleanup stuffer thread) - Plan: c= ardinality=3D3 > WARN 2019-03-08T23:58:20,507 (Document cleanup stuffer thread) - Plan: a= ccess=3DINDEX PRED > WARN 2019-03-08T23:58:20,507 (Document cleanup stuffer thread) - Plan: j= oin condition =3D [index=3DI1549955498033 > WARN 2019-03-08T23:58:20,507 (Document cleanup stuffer thread) - Plan: s= tart conditions=3D[ > WARN 2019-03-08T23:58:20,507 (Document cleanup stuffer thread) - Plan: E= QUAL arg_left=3D[ COLUMN: PUBLIC.JOBS.STATUS > WARN 2019-03-08T23:58:20,507 (Delete startup thread) - Plan: end conditi= on=3D[ > WARN 2019-03-08T23:58:20,507 (Document cleanup stuffer thread) - Plan: ]= arg_right=3D[ DYNAMIC PARAM: , TYPE =3D CHARACTER > WARN 2019-03-08T23:58:20,507 (Document cleanup stuffer thread) - Plan: ]= ] > WARN 2019-03-08T23:58:20,507 (Delete startup thread) - Plan: EQUAL arg_l= eft=3D[ COLUMN: PUBLIC.JOBS.STATUS > WARN 2019-03-08T23:58:20,508 (Document cleanup stuffer thread) - Plan: e= nd condition=3D[ > WARN 2019-03-08T23:58:20,508 (Delete startup thread) - Plan: ] arg_right= =3D[ DYNAMIC PARAM: , TYPE =3D CHARACTER > WARN 2019-03-08T23:58:20,508 (Document cleanup stuffer thread) - Plan: E= QUAL arg_left=3D[ COLUMN: PUBLIC.JOBS.STATUS > =C2=A0 > Scenario-2 > WEB: Illegal seed URL 'http://intranet.abcde.com/wps/wcm/connect/xxx/xxxw= ebsite/home -- This message was sent by Atlassian JIRA (v7.6.3#76005)