manifoldcf-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Luca Stancapiano (Commented) (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (CONNECTORS-288) An ElasticSearch connector would be helpful
Date Sat, 03 Mar 2012 16:45:57 GMT

    [ https://issues.apache.org/jira/browse/CONNECTORS-288?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13221632#comment-13221632
] 

Luca Stancapiano commented on CONNECTORS-288:
---------------------------------------------

I continue to get the problem of WorkerThread. It never starts so the test never calls the
api of elasticsearch connector. I expose my last running of the test

In the org.apache.manifoldcf.crawler.tests.BaseITDerby there is:

{code}
  @Before
  public void setUp()
    throws Exception
  {
    super.setUp();
    mcfInstance.start();
  }
{code}

The setUp method starts a clean of the services. In this clean is started the org.apache.manifoldcf.agents.system.ManifoldCF.doCleanup()
method:

{code}
    public void doCleanup()
      throws ManifoldCFException
    {
      // Shutting down in this way must prevent startup from taking place.
      synchronized (runningHash)
      {
        stopAgentsRun = true;
      }
      IThreadContext tc = ThreadContextFactory.make();
      stopAgents(tc);
    }
{code}

since this time the stopAgentsRun variable is true!!

So , when Manifold starts we have this control in the org.apache.manifoldcf.agents.system.ManifoldCF
class:

{code}
  public static void startAgents(IThreadContext threadContext)
    throws ManifoldCFException
  {
    // Get agent manager
    IAgentManager manager = AgentManagerFactory.make(threadContext);
    String[] classes = manager.getAllAgents();
    ManifoldCFException problem = null;
    synchronized (runningHash)
    {
      // DO NOT permit this method to do anything if stopAgents() has ever been called for
this JVM! 
      // (If it has, it means that the JVM is trying to shut down.)
      if (stopAgentsRun)
        return;
      .............
{code}

stopAgentsRun is always true so the agents never be launched!!!
                
> An ElasticSearch connector would be helpful
> -------------------------------------------
>
>                 Key: CONNECTORS-288
>                 URL: https://issues.apache.org/jira/browse/CONNECTORS-288
>             Project: ManifoldCF
>          Issue Type: New Feature
>    Affects Versions: ManifoldCF 0.5
>            Reporter: Piergiorgio Lucidi
>            Assignee: Piergiorgio Lucidi
>              Labels: elasticsearch
>             Fix For: ManifoldCF next
>
>         Attachments: manifold-elasticsearch-patch, manifold-elasticsearch-patch, manifold-elasticsearch-patch,
manifold-elasticsearch-patch, manifold-elasticsearch-patch, manifold-elasticsearch-patch,
manifold-elasticsearch-patch, manifold-elasticsearch-velocity-patch, manifoldcf-elasticsearch-project-patct
>
>   Original Estimate: 120h
>  Remaining Estimate: 120h
>
> An ElasticSearch connector could be very useful to spread the use of ManifoldCF

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

Mime
View raw message