Return-Path: 
 <solr-user-return-12129-apmail-lucene-solr-user-archive=lucene.apache.org@lucene.apache.org>
Delivered-To: apmail-lucene-solr-user-archive@locus.apache.org
Received: (qmail 13378 invoked from network); 8 Jul 2008 17:09:40 -0000
Received: from hermes.apache.org (HELO mail.apache.org) (140.211.11.2)
  by minotaur.apache.org with SMTP; 8 Jul 2008 17:09:40 -0000
Received: (qmail 11928 invoked by uid 500); 8 Jul 2008 17:09:37 -0000
Delivered-To: apmail-lucene-solr-user-archive@lucene.apache.org
Received: (qmail 11822 invoked by uid 500); 8 Jul 2008 17:09:36 -0000
Mailing-List: contact solr-user-help@lucene.apache.org; run by ezmlm
Precedence: bulk
List-Help: <mailto:solr-user-help@lucene.apache.org>
List-Unsubscribe: <mailto:solr-user-unsubscribe@lucene.apache.org>
List-Post: <mailto:solr-user@lucene.apache.org>
List-Id: <solr-user.lucene.apache.org>
Reply-To: solr-user@lucene.apache.org
Delivered-To: mailing list solr-user@lucene.apache.org
Received: (qmail 11811 invoked by uid 99); 8 Jul 2008 17:09:36 -0000
Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136)
    by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 08 Jul 2008 10:09:36 -0700
X-ASF-Spam-Status: No, hits=-0.0 required=10.0
	tests=SPF_PASS
X-Spam-Check-By: apache.org
Received-SPF: pass (athena.apache.org: domain of ryantxu@gmail.com designates
 209.85.132.242 as permitted sender)
Received: from [209.85.132.242] (HELO an-out-0708.google.com) (209.85.132.242)
    by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 08 Jul 2008 17:08:44 +0000
Received: by an-out-0708.google.com with SMTP id c37so549116anc.49
        for <solr-user@lucene.apache.org>;
 Tue, 08 Jul 2008 10:09:05 -0700 (PDT)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed;
        d=gmail.com; s=gamma;
        h=domainkey-signature:received:received:message-id:from:to
         :in-reply-to:content-type:content-transfer-encoding:mime-version
         :subject:date:references:x-mailer;
        bh=TRmvQrLU2FuIeTqqIPQ115+s1V6v36/HddyvjRqmjeI=;
        b=ZsTbkWcZS76fTW4raUHeLY3ETIfiS345Kxvx6PMmBXHr/6lXTJTr3xUdCTT7ILANFc
         oOjM6juxr88MIvpUqcOzwy8D17zuza5ygYnh9CA99iy4X6Yq5zHdE9q7vsHZcYc9UVtC
         TuiDAMiwqE3khfr6fZlM3weTPq1jZ5MdAXID4=
DomainKey-Signature: a=rsa-sha1; c=nofws;
        d=gmail.com; s=gamma;
        h=message-id:from:to:in-reply-to:content-type
         :content-transfer-encoding:mime-version:subject:date:references
         :x-mailer;
        b=ubKG1nRjpePk5ZRKheYU5kWzOyox0cgQ6dlv7zItBUmLWz50jwHMWRlUJa5z6b6wSO
         aGgLsdz6AUZ1wi5NFnzj48uZ/UnW49Dcr7CzRIglnWBxHXUr8FQLdBHTHPKZKRYKTZkY
         MafMmMnpQ3esVuUWhF0fJDD3Lrt7kIkamqgPc=
Received: by 10.100.140.12 with SMTP id n12mr5289065and.147.1215536944670;
        Tue, 08 Jul 2008 10:09:04 -0700 (PDT)
Received: from ?192.168.1.2? ( [66.92.161.165])
        by mx.google.com with ESMTPS id h14sm5684152wxd.0.2008.07.08.10.09.03
        (version=TLSv1/SSLv3 cipher=RC4-MD5);
        Tue, 08 Jul 2008 10:09:04 -0700 (PDT)
Message-Id: <9CBFF6F6-5237-426A-93E6-1EC0793FD892@gmail.com>
From: Ryan McKinley <ryantxu@gmail.com>
To: solr-user@lucene.apache.org
In-Reply-To: 
 <OF3CA79C31.46AF65B4-ON85257480.0057067C-85257480.00586A50@metalogic-inc.com>
Content-Type: text/plain; charset=US-ASCII; format=flowed; delsp=yes
Content-Transfer-Encoding: 7bit
Mime-Version: 1.0 (Apple Message framework v919.2)
Subject: Re: Automated Index Creation
Date: Tue, 8 Jul 2008 13:09:01 -0400
References: 
 <OF3CA79C31.46AF65B4-ON85257480.0057067C-85257480.00586A50@metalogic-inc.com>
X-Mailer: Apple Mail (2.919.2)
X-Virus-Checked: Checked by ClamAV on apache.org


<delete><query>*:*</query></delete>

will wipe all data in the index...


On Jul 8, 2008, at 12:05 PM, Willie Wong wrote:
> Thanks Sahlin and Ryan for your posts...
>
> I think the snapshooter will work fine for creating the indexes and  
> then I
> can use the multicore capabilities to make them available to  
> users.... one
> final question though, after snapshot has been created is there a  
> way to
> totally clear out the contents in the master index - or have solr  
> recreate
> the data directory?
>
>
>
> Thanks,
>
> Willie
>
>
>
>
> Ryan McKinley <ryantxu@gmail.com>
> 08/07/2008 11:17 AM
> Please respond to
> solr-user@lucene.apache.org
>
>
> To
> solr-user@lucene.apache.org
> cc
>
> Subject
> Re: Automated Index Creation
>
>
>
>
>
>
> re-reading your post...
>
> Shalin is correct, just use the snapshooter script to create a point-
> in-time snapshot of the index.  The multicore stuff will not help with
> this.
>
> ryan
>
>
> On Jul 8, 2008, at 11:09 AM, Shalin Shekhar Mangar wrote:
>> Hi Willie,
>>
>> If you want to have backups (point-in-time snapshots) then you'd need
>> something similar to the snapshooter script used in replication. I
>> believe
>> it creates hard links to files of the current index in a new  
>> directory
>> marked with the timestamp. You can either use snapshooter itself or
>> create
>> your own script by modifying snapshooter to create copies instead of
>> hardlinks if you want. You can use the RunExecutableListener to run
>> your
>> script on every commit or optimize and use the snapshots for backup
>> purposes.
>>
>> On Tue, Jul 8, 2008 at 7:55 PM, Willie Wong
> <Willie_Wong@metalogic-inc.com
>>>
>> wrote:
>>
>>> Hi,
>>>
>>> Sorry if this question sounds daft.... but I was wondering if there
>>> was
>>> anything built into Solr that allows you to automate the creation
>>> of new
>>> indexes once they reach a certain size or point in time.  I looked
>>> briefly
>>> at the documentation on CollectionDestribution, but it seems more
>>> geared
>>> to towards replicatting to other production servers...    I'm
>>> looking for
>>> something that is more along the lines of archiving indexes for  
>>> later
>>> use...
>>>
>>>
>>> Thanks,
>>>
>>> Willie
>>>
>>>
>>
>>
>> -- 
>> Regards,
>> Shalin Shekhar Mangar.
>
>
>