Mailing-List: contact java-user-help@lucene.apache.org; run by ezmlm
Precedence: bulk
Reply-To: java-user@lucene.apache.org
Received-SPF: pass (athena.apache.org: domain of ian.lea@gmail.com designates
 209.85.221.20 as permitted sender)
DomainKey-Signature: a=rsa-sha1; c=nofws;
        d=gmail.com; s=gamma;
        h=message-id:date:from:to:subject:in-reply-to:mime-version
         :content-type:content-transfer-encoding:content-disposition
         :references;
        b=sj5KJnLOpDqoImBnEuoF5ziGzZx2+iVQlMX+ki3yke2ZZGx/lQVo1nmZjG/oMH1UCR
         PrASHuVmwc2MBLrMeB9iDOgOPH5xTYjQx+JIbjIthavZ/IJVGJeR/eUCkWNit096SCqV
         S3uazEPDVkv9R+AIqwFRZkJAHh7yYaZIvD7+k=
Message-ID: <8c4e68610811280421l58656d71n58a90b09456e47a7@mail.gmail.com>
Date: Fri, 28 Nov 2008 12:21:53 +0000
From: "Ian Lea" <ian.lea@gmail.com>
To: java-user@lucene.apache.org
Subject: Re: Maintain last indexed information in a file or DB
In-Reply-To: <0dd401c95152$1fbdcb70$330bc30a@sv.us.sonicwall.com>
MIME-Version: 1.0
Content-Type: text/plain; charset=ISO-8859-1
Content-Transfer-Encoding: 7bit
Content-Disposition: inline
References: <0dd401c95152$1fbdcb70$330bc30a@sv.us.sonicwall.com>

I'm a bit confused about what exactly is stored in folder and index
and database, but how about you store the bookmark information in the
same lucene index that you are using for the file data.  One lucene
document per folder, with fields something like

folder: /some/dir/somewhere
bookmark: some_bookmark_value

That way the bookmark info should always be in line with the indexed data.


Oh, and I'd also try and stop the application from crashing!


--
Ian.


On Fri, Nov 28, 2008 at 12:09 PM, Ganesh <emailgane@yahoo.co.in> wrote:
> I am using Lucene v2.4. I am indexing files from various folder and i have
> to maintain a bookmark of what i have last indexed in each folder.
>
> Initially i thought to save the state in each  respective folder. Index
> Wrtier always has documents in memory and it commits in a intervals. In an
> unexpected application crash, sometimes the last saved bookmark and the last
> indexed document in the database is not matching.
>
> One another option is to keep the information in a same or different
> database.
>
> I think many might have faced this situitation.
>
> Regards
> Ganesh

---------------------------------------------------------------------
To unsubscribe, e-mail: java-user-unsubscribe@lucene.apache.org
For additional commands, e-mail: java-user-help@lucene.apache.org