manifoldcf-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Karl Wright (JIRA)" <j...@apache.org>
Subject [jira] [Comment Edited] (CONNECTORS-1070) Agents thread exception loop
Date Thu, 09 Oct 2014 15:09:33 GMT

    [ https://issues.apache.org/jira/browse/CONNECTORS-1070?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14165174#comment-14165174
] 

Karl Wright edited comment on CONNECTORS-1070 at 10/9/14 3:08 PM:
------------------------------------------------------------------

bq. I use external postgresql db, maybe there are some records for 'active' crawler workers?

No, there is no lock storage whatsoever in the database.

So you claim that on a fresh check/source of MCF 1.7.1, if you do the following, it will fail:

(1) Build
(2) Go to dist/multiprocess-zk-example
(3) change properties-global.xml to point to Postgresql
(4) start zookeeper
(5) run setglobalproperties
(6) run initialize
(7) start agents

I can definitely say I do not see that behavior here.  In fact we would never ship anything
that failed in so obvious a way.






was (Author: kwright@metacarta.com):
bq. I use external postgresql db, maybe there are some records for 'active' crawler workers?

No, there is no lock storage whatsoever in the database.

So you claim that on a fresh check/source of MCF 1.7.1, if you do the following, it will fail:

(1) Build
(2) Go to dist/multiprocess-zk-example
(3) change properties.xml to point to Postgresql
(4) start zookeeper
(5) start agents

I can definitely say I do not see that behavior here.  In fact we would never ship anything
that failed in so obvious a way.





> Agents thread exception loop
> ----------------------------
>
>                 Key: CONNECTORS-1070
>                 URL: https://issues.apache.org/jira/browse/CONNECTORS-1070
>             Project: ManifoldCF
>          Issue Type: Bug
>    Affects Versions: ManifoldCF 1.7
>            Reporter: Kamil ┼╗yta
>            Assignee: Karl Wright
>
> occasionally when I stop&start crawler agents they fall into infinite loop.
> I don't know how to stop this exception. stop agents, ui, clean lock do not help.
> Log growing fast with messages
> ------------------------------------------------------------------------------------------
> ERROR 2014-10-09 13:58:44,206 (Agents thread) - Exception tossed: Service 'A' of type
'AGENT_org.apache.manifoldcf.crawler.system.CrawlerAgent' is already active
> org.apache.manifoldcf.core.interfaces.ManifoldCFException: Service 'A' of type 'AGENT_org.apache.manifoldcf.crawler.system.CrawlerAgent'
is already active
>         at org.apache.manifoldcf.core.lockmanager.BaseLockManager.registerServiceBeginServiceActivity(BaseLockManager.java:162)
>         at org.apache.manifoldcf.core.lockmanager.BaseLockManager.registerServiceBeginServiceActivity(BaseLockManager.java:126)
>         at org.apache.manifoldcf.core.lockmanager.LockManager.registerServiceBeginServiceActivity(LockManager.java:69)
>         at org.apache.manifoldcf.agents.system.AgentsDaemon.checkAgents(AgentsDaemon.java:271)
>         at org.apache.manifoldcf.agents.system.AgentsDaemon$AgentsThread.run(AgentsDaemon.java:209)
> ERROR 2014-10-09 13:58:44,210 (Agents thread) - Exception tossed: Service 'A' of type
'AGENT_org.apache.manifoldcf.crawler.system.CrawlerAgent' is already active
> org.apache.manifoldcf.core.interfaces.ManifoldCFException: Service 'A' of type 'AGENT_org.apache.manifoldcf.crawler.system.CrawlerAgent'
is already active
>         at org.apache.manifoldcf.core.lockmanager.BaseLockManager.registerServiceBeginServiceActivity(BaseLockManager.java:162)
>         at org.apache.manifoldcf.core.lockmanager.BaseLockManager.registerServiceBeginServiceActivity(BaseLockManager.java:126)
>         at org.apache.manifoldcf.core.lockmanager.LockManager.registerServiceBeginServiceActivity(LockManager.java:69)
>         at org.apache.manifoldcf.agents.system.AgentsDaemon.checkAgents(AgentsDaemon.java:271)
>         at org.apache.manifoldcf.agents.system.AgentsDaemon$AgentsThread.run(AgentsDaemon.java:209)
> ERROR 2014-10-09 13:58:44,214 (Agents thread) - Exception tossed: Service 'A' of type
'AGENT_org.apache.manifoldcf.crawler.system.CrawlerAgent' is already active
> org.apache.manifoldcf.core.interfaces.ManifoldCFException: Service 'A' of type 'AGENT_org.apache.manifoldcf.crawler.system.CrawlerAgent'
is already active
>         at org.apache.manifoldcf.core.lockmanager.BaseLockManager.registerServiceBeginServiceActivity(BaseLockManager.java:162)
>         at org.apache.manifoldcf.core.lockmanager.BaseLockManager.registerServiceBeginServiceActivity(BaseLockManager.java:126)
>         at org.apache.manifoldcf.core.lockmanager.LockManager.registerServiceBeginServiceActivity(LockManager.java:69)
>         at org.apache.manifoldcf.agents.system.AgentsDaemon.checkAgents(AgentsDaemon.java:271)
>         at org.apache.manifoldcf.agents.system.AgentsDaemon$AgentsThread.run(AgentsDaemon.java:209)
> ------------------------------------------------------------------------------------------



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message