Mailing-List: contact java-user-help@lucene.apache.org; run by ezmlm
Precedence: bulk
Reply-To: java-user@lucene.apache.org
Received-SPF: pass (asf.osuosl.org: local policy)
Message-ID: <44282169.8070800@getopt.org>
Date: Mon, 27 Mar 2006 19:31:21 +0200
From: Andrzej Bialecki <ab@getopt.org>
User-Agent: Thunderbird 1.5 (Windows/20051201)
MIME-Version: 1.0
To: java-user@lucene.apache.org
Subject: Re: Lucene indexing on Hadoop distributed file system
References: <158e71710603252353uace38b4k810589d80745d6ad@mail.gmail.com>
 <44280FEF.30100@apache.org>
In-Reply-To: <44280FEF.30100@apache.org>
Content-Type: text/plain; charset=UTF-8; format=flowed
Content-Transfer-Encoding: 7bit

Doug Cutting wrote:
> Igor Bolotin wrote:
>> If somebody is interested - I can post our changes in TermInfosWriter 
>> and
>> SegmentTermEnum code, although they are pretty trivial.
>
> Please submit this as a patch attached to a bug report.
>
> I contemplated making this change to Lucene myself, when writing 
> Nutch's FsDirectory, but thought that no one else would ever be 
> interested in using it.  Now that's been proven wrong!
>
> Note that any change to the file format must be back-compatible.

This could be solved by putting a marker value in the first 8 bytes (== 
-1L), which would indicate that the real length is at the end. This way 
the new implementation will be able to read old indexes.

-- 
Best regards,
Andrzej Bialecki     <><
 ___. ___ ___ ___ _ _   __________________________________
[__ || __|__/|__||\/|  Information Retrieval, Semantic Web
___|||__||  \|  ||  |  Embedded Unix, System Integration
http://www.sigram.com  Contact: info at sigram dot com


---------------------------------------------------------------------
To unsubscribe, e-mail: java-user-unsubscribe@lucene.apache.org
For additional commands, e-mail: java-user-help@lucene.apache.org