manifoldcf-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Arcadius Ahouansou (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (CONNECTORS-1191) ManifoldCFException: Unexpected job status encountered
Date Fri, 29 May 2015 00:07:26 GMT

    [ https://issues.apache.org/jira/browse/CONNECTORS-1191?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14563947#comment-14563947
] 

Arcadius Ahouansou commented on CONNECTORS-1191:
------------------------------------------------

Hello [~kwright@metacarta.com]
The error I am receiving now is also about "Unexpected jobqueue status", so it's a bit different
from the origibal one.

The log enty is
{code}
 WARN 2015-04-26 23:03:05,799 (Worker thread '10') - Server dropped connection during indexing
https://mysite.com/site/url001: Broken pipe
java.net.SocketException: Broken pipe
	at java.net.SocketOutputStream.socketWrite0(Native Method)
	at java.net.SocketOutputStream.socketWrite(SocketOutputStream.java:109)
	at java.net.SocketOutputStream.write(SocketOutputStream.java:153)
	at org.apache.http.impl.io.SessionOutputBufferImpl.streamWrite(SessionOutputBufferImpl.java:126)
	at org.apache.http.impl.io.SessionOutputBufferImpl.flushBuffer(SessionOutputBufferImpl.java:138)
	at org.apache.http.impl.io.SessionOutputBufferImpl.flush(SessionOutputBufferImpl.java:146)
	at org.apache.http.impl.io.ChunkedOutputStream.flush(ChunkedOutputStream.java:194)
	at org.apache.http.entity.mime.content.StringBody.writeTo(StringBody.java:176)
	at org.apache.manifoldcf.agents.output.solr.ModifiedHttpMultipart.doWriteTo(ModifiedHttpMultipart.java:211)
	at org.apache.manifoldcf.agents.output.solr.ModifiedHttpMultipart.writeTo(ModifiedHttpMultipart.java:229)
	at org.apache.manifoldcf.agents.output.solr.ModifiedMultipartEntity.writeTo(ModifiedMultipartEntity.java:187)
	at org.apache.http.impl.execchain.RequestEntityProxy.writeTo(RequestEntityProxy.java:123)
	at org.apache.http.impl.DefaultBHttpClientConnection.sendRequestEntity(DefaultBHttpClientConnection.java:158)
	at org.apache.http.impl.conn.CPoolProxy.sendRequestEntity(CPoolProxy.java:162)
	at org.apache.http.protocol.HttpRequestExecutor.doSendRequest(HttpRequestExecutor.java:237)
	at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:122)
	at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:271)
	at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:184)
	at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110)
	at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:184)
	at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:82)
	at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:107)
	at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:55)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:462)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:233)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:225)
	at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:135)
	at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:152)
	at org.apache.manifoldcf.agents.output.solr.HttpPoster$IngestThread.run(HttpPoster.java:901)
 WARN 2015-04-26 23:03:05,801 (Worker thread '10') - Service interruption reported for job
1430004534318 connection 'web': Server dropped connection during 
WARN 2015-04-26 23:03:05,801 (Worker thread '10') - Service interruption reported for job
1430004534318 connection 'web': Server dropped connection during indexing https://mysite.com/site/url001:
Broken pipe
ERROR 2015-04-26 23:03:12,737 (Worker thread '299') - Exception tossed: Unexpected jobqueue
status - record id 1430010071313, expecting active status, saw 4
org.apache.manifoldcf.core.interfaces.ManifoldCFException: Unexpected jobqueue status - record
id 1430010071313, expecting active status, saw 4
	at org.apache.manifoldcf.crawler.jobs.JobQueue.updateCompletedRecord(JobQueue.java:1019)
	at org.apache.manifoldcf.crawler.jobs.JobManager.markDocumentCompletedMultiple(JobManager.java:3260)
	at org.apache.manifoldcf.crawler.system.WorkerThread.run(WorkerThread.java:661)
ERROR 2015-04-26 23:03:24,497 (Worker thread '42') - Exception tossed: Unexpected jobqueue
status - record id 1430010108864, expecting active status, saw 4
org.apache.manifoldcf.core.interfaces.ManifoldCFException: Unexpected jobqueue status - record
id 1430010108864, expecting active status, saw 4
	at org.apache.manifoldcf.crawler.jobs.JobQueue.updateCompletedRecord(JobQueue.java:1019)
	at org.apache.manifoldcf.crawler.jobs.JobManager.markDocumentCompletedMultiple(JobManager.java:3260)
	at org.apache.manifoldcf.crawler.system.WorkerThread.run(WorkerThread.java:661)
 WARN 2015-04-26 23:03:24,731 (Worker thread '32') - Service interruption reported for job
1430004534313 connection 'web': Job no longer active
 WARN 2015-04-26 23:03:25,122 (Worker thread '251') - Service interruption reported for job
1430004534313 connection 'web': Job no longer active
ERROR 2015-04-26 23:06:13,829 (Worker thread '106') - Exception tossed: Unexpected jobqueue
status - record id 1430008208328, expecting active status, saw 2
org.apache.manifoldcf.core.interfaces.ManifoldCFException: Unexpected jobqueue status - record
id 1430008208328, expecting active status, saw 2
	at org.apache.manifoldcf.crawler.jobs.JobQueue.updateCompletedRecord(JobQueue.java:1019)
	at org.apache.manifoldcf.crawler.jobs.JobManager.markDocumentCompletedMultiple(JobManager.java:3260)
	at org.apache.manifoldcf.crawler.system.WorkerThread.run(WorkerThread.java:661)
ERROR 2015-04-26 23:06:53,846 (Worker thread '12') - Exception tossed: Unexpected jobqueue
status - record id 1430088908800, expecting active status, saw 2
org.apache.manifoldcf.core.interfaces.ManifoldCFException: Unexpected jobqueue status - record
id 1430088908800, expecting active status, saw 2
	at org.apache.manifoldcf.crawler.jobs.JobQueue.updateCompletedRecord(JobQueue.java:1019)
	at org.apache.manifoldcf.crawler.jobs.JobManager.markDocumentCompletedMultiple(JobManager.java:3260)
	at org.apache.manifoldcf.crawler.system.WorkerThread.run(WorkerThread.java:661)
 WARN 2015-04-26 23:08:06,278 (Worker thread '174') - Server dropped connection during indexing
https://mysite.com/site/url002: Broken pipe

{code}

> ManifoldCFException: Unexpected job status encountered
> ------------------------------------------------------
>
>                 Key: CONNECTORS-1191
>                 URL: https://issues.apache.org/jira/browse/CONNECTORS-1191
>             Project: ManifoldCF
>          Issue Type: Bug
>          Components: Web connector
>    Affects Versions: ManifoldCF 2.0.2
>         Environment: - Debian 7.8 x86_64 GNU/Linux
> - Java HotSpot(TM) 64-Bit Server VM (build 25.40-b25, mixed mode)
> - Server version: 5.5.41-0+wheezy1 (Debian)
>            Reporter: Arcadius Ahouansou
>            Assignee: Karl Wright
>            Priority: Critical
>             Fix For: ManifoldCF 1.9, ManifoldCF 2.1
>
>         Attachments: CONNECTORS-1191.patch, manifoldcf2.0.2.log
>
>
> Hello.
> I am running the latest ManifoldCF 2.0.2 and my log is filled of 
> {code}
> org.apache.manifoldcf.core.interfaces.ManifoldCFException: Unexpected job status encountered:
34
> 	at org.apache.manifoldcf.crawler.jobs.Jobs.returnJobToActive(Jobs.java:2073)
> 	at org.apache.manifoldcf.crawler.jobs.JobManager.resetJobs(JobManager.java:8261)
> 	at org.apache.manifoldcf.crawler.system.JobResetThread.run(JobResetThread.java:91)
> {code}
> I have attached full log for more detail.
> Note that I am running against MySQL.
> Thanks.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message