Mailing-List: contact dev-help@manifoldcf.apache.org; run by ezmlm
Precedence: bulk
Reply-To: dev@manifoldcf.apache.org
Date: Thu, 4 Jun 2015 23:40:39 +0000 (UTC)
From: "Karl Wright (JIRA)" <jira@apache.org>
To: dev@manifoldcf.apache.org
Message-ID: <JIRA.12824047.1430012957000.17619.1433461239505@Atlassian.JIRA>
In-Reply-To: <JIRA.12824047.1430012957000@Atlassian.JIRA>
References: <JIRA.12824047.1430012957000@Atlassian.JIRA>
 <JIRA.12824047.1430012957361@arcas>
Subject: [jira] [Commented] (CONNECTORS-1191) ManifoldCFException:
 Unexpected job status encountered
MIME-Version: 1.0
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: 7bit


    [ https://issues.apache.org/jira/browse/CONNECTORS-1191?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14573817#comment-14573817 ] 

Karl Wright commented on CONNECTORS-1191:
-----------------------------------------

bq. BTW: Some jobs (see screenshot) have status "Waiting" ... I wonder what that means.

Waiting just means it is outside the scheduling window.

bq. Is it possible that another instance of the jobs is scheduled while one is already running?

No, because jobs don't run that way; they're either active or not.

bq. This clearly shows that we have thread 99 and 82 processing the very same document.

So, in order for this to happen, the stuffer thread has to pick up the document twice.  The stuffer thread finds documents and then sets their state to "active" so that they cannot be picked up a second time.  But clearly that's not working properly on your setup.  That is consistent with what I've seen before with some versions of MySQL: you can write to the database all you like and once in a while the write says it happened but a later read does not see that last-written result.  It's a transactional integrity problem.

I don't know why it is affecting you so strongly, but it clearly is happening a lot on your system.


> ManifoldCFException: Unexpected job status encountered
> ------------------------------------------------------
>
>                 Key: CONNECTORS-1191
>                 URL: https://issues.apache.org/jira/browse/CONNECTORS-1191
>             Project: ManifoldCF
>          Issue Type: Bug
>          Components: Web connector
>    Affects Versions: ManifoldCF 2.0.2
>         Environment: - Debian 7.8 x86_64 GNU/Linux
> - Java HotSpot(TM) 64-Bit Server VM (build 25.40-b25, mixed mode)
> - Server version: 5.5.41-0+wheezy1 (Debian)
>            Reporter: Arcadius Ahouansou
>            Assignee: Karl Wright
>            Priority: Critical
>             Fix For: ManifoldCF 1.9, ManifoldCF 2.1
>
>         Attachments: 1433374857580-jobs.png, 1433374857580-schedule.png, CONNECTORS-1191-2.patch, CONNECTORS-1191.patch, manifoldcf2.0.2.log, stuffer-thread-manifoldcf.log, unexpected-jobqueue.png
>
>
> Hello.
> I am running the latest ManifoldCF 2.0.2 and my log is filled of 
> {code}
> org.apache.manifoldcf.core.interfaces.ManifoldCFException: Unexpected job status encountered: 34
> 	at org.apache.manifoldcf.crawler.jobs.Jobs.returnJobToActive(Jobs.java:2073)
> 	at org.apache.manifoldcf.crawler.jobs.JobManager.resetJobs(JobManager.java:8261)
> 	at org.apache.manifoldcf.crawler.system.JobResetThread.run(JobResetThread.java:91)
> {code}
> I have attached full log for more detail.
> Note that I am running against MySQL.
> Thanks.


--
This message was sent by Atlassian JIRA
(v6.3.4#6332)