incubator-blur-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Aaron McCurry (JIRA)" <j...@apache.org>
Subject [jira] [Created] (BLUR-105) Index Import rollback
Date Fri, 24 May 2013 20:17:19 GMT
Aaron McCurry created BLUR-105:
----------------------------------

             Summary: Index Import rollback
                 Key: BLUR-105
                 URL: https://issues.apache.org/jira/browse/BLUR-105
             Project: Apache Blur
          Issue Type: Improvement
    Affects Versions: 0.1.5, 0.1.6
            Reporter: Aaron McCurry
             Fix For: 0.1.6


During the index import (after a map reduce job) if there is an exception thrown or a server
shutdown the imported (and committed data from the MapReduce job) could be lost.  This is
because instead of copying the segments from the import directories into the main index. 
The index importer merely renames them and the reason for this is to improve performance.

I suggest that we create a import logger to log what files have moved where so that in the
event that the import fails, the files that have been moved into the main index and can be
saved.  I may need to create a diagram to illustrate the potential problem.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

Mime
View raw message