lucene-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Noble Paul (JIRA)" <j...@apache.org>
Subject [jira] Commented: (SOLR-2156) Solr Replication - SnapPuller fails to clean Old Index Directories on Full Copy
Date Fri, 05 Nov 2010 14:24:42 GMT

    [ https://issues.apache.org/jira/browse/SOLR-2156?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12928601#action_12928601
] 

Noble Paul commented on SOLR-2156:
----------------------------------

The patch looks good..

> Solr Replication - SnapPuller fails to clean Old Index Directories on Full Copy
> -------------------------------------------------------------------------------
>
>                 Key: SOLR-2156
>                 URL: https://issues.apache.org/jira/browse/SOLR-2156
>             Project: Solr
>          Issue Type: Improvement
>          Components: replication (java)
>    Affects Versions: 4.0
>            Reporter: Jayendra Patil
>         Attachments: Solr-2156_SnapPuller.patch
>
>
> We are working on the Solr trunk ....and have a Master and Two slaves configuration .....

> Our indexing consists of Periodic Full and Incremental index building on the master and
replication on the slaves.
> When a Full indexing (clean and rebuild) is performed, we always end with an extra index
folder copy, which holds the complete index and hence the size just grows on, on the slaves.
> e.g.
> drwxr-xr-x 2 tomcat     tomcat 4096 2010-10-09 12:10 index
> drwxr-xr-x 2 tomcat     tomcat 4096 2010-10-11 09:43 index.20101009120649
> drwxr-xr-x 2 tomcat     tomcat 4096 2010-10-12 10:27 index.20101011094043
> -rw-r--r-- 1 tomcat        tomcat   75 2010-10-11 09:43  index.properties
> -rw-r--r-- 1 tomcat        tomcat  422 2010-10-12 10:26 replication.properties
> drwxr-xr-x 2 tomcat     tomcat   68 2010-10-12 10:27 spellchecker
> Where index.20101011094043 is the active index and the other index.xxx directories are
no more used.
> The SnapPuller deletes the temporary Index directory, but does not delete the old one
when the switch is performed for the full copy.
> The below code should do the trick.
>  boolean fetchLatestIndex(SolrCore core) throws IOException {
>     ..........
>       } finally {
>         if(deleteTmpIdxDir) {
>             delTree(tmpIndexDir);
>         } else {
>             // Delete the old index directory, as the flag is set only after the full
copy is performed
>             delTree(indexDir);
>         }
>       }
>     .........
>   }

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: dev-help@lucene.apache.org


Mime
View raw message