Mailing-List: contact dev-help@manifoldcf.apache.org; run by ezmlm
Precedence: bulk
Reply-To: dev@manifoldcf.apache.org
Date: Thu, 9 Mar 2017 13:41:38 +0000 (UTC)
From: "Karl Wright (JIRA)" <jira@apache.org>
To: dev@manifoldcf.apache.org
Message-ID: <JIRA.13049254.1488975475000.22339.1489066898081@Atlassian.JIRA>
In-Reply-To: <JIRA.13049254.1488975475000@Atlassian.JIRA>
References: <JIRA.13049254.1488975475000@Atlassian.JIRA> <JIRA.13049254.1488975475554@jira-lw-us.apache.org>
Subject: [jira] [Commented] (CONNECTORS-1395) Unexpected jobqueue status -
 record id 1488898668325, expecting active status, saw 4
MIME-Version: 1.0
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: quoted-printable
archived-at: Thu, 09 Mar 2017 13:41:46 -0000


    [ https://issues.apache.org/jira/browse/CONNECTORS-1395?page=3Dcom.atla=
ssian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=
=3D15903063#comment-15903063 ]=20

Karl Wright commented on CONNECTORS-1395:
-----------------------------------------

[~guystanden]: Can you include the "errors" you are seeing?  Normally, runn=
ing with Zookeeper is pretty noisy; haven't figured out how to reduce that.=
  As for having increased logging for the Zookeeper client, the only way to=
 do that is figure out what zookeeper classes you want to log and add entri=
es in the logging.ini file.  There's no explicit zookeeper logger in MCF; j=
ust logging of locks in general, which you already know about.

The zookeeper console is pretty noisy normally so I bet everything is now O=
K.  But let's see what kinds of errors you are getting.

Thanks!


> Unexpected jobqueue status - record id 1488898668325, expecting active st=
atus, saw 4
> -------------------------------------------------------------------------=
-----------
>
>                 Key: CONNECTORS-1395
>                 URL: https://issues.apache.org/jira/browse/CONNECTORS-139=
5
>             Project: ManifoldCF
>          Issue Type: Bug
>          Components: Framework core
>    Affects Versions: ManifoldCF 2.6
>            Reporter: Karl Wright
>            Assignee: Karl Wright
>             Fix For: ManifoldCF 2.7
>
>         Attachments: ZK Console Output.txt
>
>
> User saw this in the log, after which the system hung:
> {code}
> ERROR 2017-03-08 00:25:30,433 (Worker thread '14') - Exception tossed: Un=
expected jobqueue status - record id 1488898668325, expecting active status=
, saw 4
> org.apache.manifoldcf.core.interfaces.ManifoldCFException: Unexpected job=
queue status - record id 1488898668325, expecting active status, saw 4
>                 at org.apache.manifoldcf.crawler.jobs.JobQueue.updateComp=
letedRecord(JobQueue.java:1019)
>                 at org.apache.manifoldcf.crawler.jobs.JobManager.markDocu=
mentCompletedMultiple(JobManager.java:3271)
>                 at org.apache.manifoldcf.crawler.system.WorkerThread.run(=
WorkerThread.java:710)
> WARN 2017-03-08 00:25:30,449 (Worker thread '23') - Service interruption =
reported for job 1488898090224 connection 'web': Job no longer active
> WARN 2017-03-08 00:25:30,449 (Worker thread '24') - Service interruption =
reported for job 1488898090224 connection 'web': Job no longer active
> WARN 2017-03-08 00:25:30,464 (Worker thread '9') - Service interruption r=
eported for job 1488898090224 connection 'web': Job no longer active
> WARN 2017-03-08 00:25:30,464 (Worker thread '0') - Service interruption r=
eported for job 1488898090224 connection 'web': Job no longer active
> WARN 2017-03-08 00:25:31,900 (Worker thread '11') - Service interruption =
reported for job 1488898090224 connection 'web': Job no longer active
> WARN 2017-03-08 00:25:31,900 (Worker thread '29') - Service interruption =
reported for job 1488898090224 connection 'web': Job no longer active
> WARN 2017-03-08 00:25:32,867 (Worker thread '10') - Service interruption =
reported for job 1488898090224 connection 'web': Job no longer active
> WARN 2017-03-08 00:25:32,867 (Worker thread '2') - Service interruption r=
eported for job 1488898090224 connection 'web': Job no longer active
> WARN 2017-03-08 00:25:33,335 (Worker thread '8') - Service interruption r=
eported for job 1488898090224 connection 'web': Job no longer active
> WARN 2017-03-08 00:25:36,642 (Worker thread '20') - Service interruption =
reported for job 1488898090224 connection 'web': Job no longer active
> WARN 2017-03-08 00:25:37,422 (Worker thread '21') - Service interruption =
reported for job 1488898090224 connection 'web': Job no longer active
> WARN 2017-03-08 00:25:38,280 (Worker thread '22') - Service interruption =
reported for job 1488898090224 connection 'web': Job no longer active
> WARN 2017-03-08 00:25:38,280 (Worker thread '3') - Service interruption r=
eported for job 1488898090224 connection 'web': Job no longer active
> WARN 2017-03-08 00:25:38,280 (Worker thread '5') - Service interruption r=
eported for job 1488898090224 connection 'web': Job no longer active
> WARN 2017-03-08 00:25:38,826 (Worker thread '28') - Service interruption =
reported for job 1488898090224 connection 'web': Job no longer active
> WARN 2017-03-08 00:25:39,045 (Worker thread '13') - Service interruption =
reported for job 1488898090224 connection 'web': Job no longer active
> WARN 2017-03-08 00:25:45,425 (Worker thread '4') - Service interruption r=
eported for job 1488898090224 connection 'web': Job no longer active
> WARN 2017-03-08 00:25:45,425 (Worker thread '15') - Service interruption =
reported for job 1488898090224 connection 'web': Job no longer active
> WARN 2017-03-08 00:25:45,425 (Worker thread '17') - Service interruption =
reported for job 1488898090224 connection 'web': Job no longer active
> WARN 2017-03-08 00:25:46,392 (Worker thread '25') - Service interruption =
reported for job 1488898090224 connection 'web': Job no longer active
> WARN 2017-03-08 00:25:46,392 (Worker thread '27') - Service interruption =
reported for job 1488898090224 connection 'web': Job no longer active
> WARN 2017-03-08 00:26:11,043 (Worker thread '1') - Service interruption r=
eported for job 1488898090224 connection 'web': Job no longer active
> WARN 2017-03-08 00:26:35,817 (Worker thread '19') - Service interruption =
reported for job 1488898090224 connection 'web': Job no longer active
> WARN 2017-03-08 00:26:35,817 (Worker thread '26') - Service interruption =
reported for job 1488898090224 connection 'web': Job no longer active
> WARN 2017-03-08 00:26:36,753 (Worker thread '7') - Service interruption r=
eported for job 1488898090224 connection 'web': Job no longer active
> WARN 2017-03-08 00:26:39,248 (Worker thread '6') - Service interruption r=
eported for job 1488898090224 connection 'web': Job no longer active
> WARN 2017-03-08 00:26:39,248 (Worker thread '18') - Service interruption =
reported for job 1488898090224 connection 'web': Job no longer active
> WARN 2017-03-08 00:26:43,129 (Worker thread '16') - Service interruption =
reported for job 1488898090224 connection 'web': Job no longer active
> FATAL 2017-03-08 00:32:24,819 (Idle cleanup thread) - Error tossed: Can't=
 release lock we don't hold
> java.lang.IllegalStateException: Can't release lock we don't hold=E2=80=
=9D
> {code}


--
This message was sent by Atlassian JIRA
(v6.3.15#6346)