incubator-connectors-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Karl Wright (JIRA)" <j...@apache.org>
Subject [jira] Created: (CONNECTORS-13) We should move to eliminate process synchronization via shared file system, and use a process/service instead
Date Mon, 22 Feb 2010 16:52:27 GMT
We should move to eliminate process synchronization via shared file system, and use a process/service
instead
-------------------------------------------------------------------------------------------------------------

                 Key: CONNECTORS-13
                 URL: https://issues.apache.org/jira/browse/CONNECTORS-13
             Project: Lucene Connector Framework
          Issue Type: Improvement
            Reporter: Karl Wright


The current implementation relies on the file system to synchronize activity between various
LCF processes.  This has several downsides: first, it is possible to get the file system into
a state that is corrupted (by killing processes); second, this limits the future ability to
spread crawler workload over multiple machines.

It should be reasonably straightforward, and probably more resilient, to introduce a "synchronization
process", which all other LCF processes talk to in order to manage locks, shared data, and
other synchronization activities.


-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


Mime
View raw message