lucene-solr-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From escher2k <esche...@yahoo.com>
Subject RE: Incremental replication...
Date Tue, 13 Feb 2007 20:44:35 GMT


Graham Stead-2 wrote:
> 
> We have used replication for a few weeks now and it generally works well.
> 
> I believe you'll find that commit operations cause only new segments to be
> transferred, whereas optimize operations cause the entire index to be
> transferred. Therefore, the amount of data transferred really depends on
> how
> frequently you index new data and how often you call <commit/> and
> <optimize/>.
> 
> Hope this helps,
> -Graham
> 
> 
> 
> 

Thanks Graham. Atleast from looking at the snapshooter script, it doesn't
seem to be doing anything specific.  The following is a fragment from the
script -

snap_name=snapshot.`date +"%Y%m%d%H%M%S"`
name=${data_dir}/${snap_name}
temp=${data_dir}/temp-${snap_name}

if [[ -d ${name} ]]
then
    logMessage snapshot directory ${name} already exists
    logExit aborted 1
fi

if [[ -d ${temp} ]]
then
    logMessage snapshoting of ${name} in progress
    logExit aborted 1
fi

# clean up after INT/TERM
trap 'echo cleaning up, please wait ...;/bin/rm -rf ${name} ${temp};logExit
aborted 13' INT TERM

logMessage taking snapshot ${name}

# take a snapshot using hard links into temporary location
# then move it into place atomically
cp -lr ${data_dir}/index ${temp}
mv ${temp} ${name}
-- 
View this message in context: http://www.nabble.com/Incremental-replication...-tf3222946.html#a8952716
Sent from the Solr - User mailing list archive at Nabble.com.


Mime
View raw message