Return-Path: Delivered-To: apmail-lucene-java-user-archive@www.apache.org Received: (qmail 52735 invoked from network); 15 Jul 2005 07:48:03 -0000 Received: from hermes.apache.org (HELO mail.apache.org) (209.237.227.199) by minotaur.apache.org with SMTP; 15 Jul 2005 07:48:03 -0000 Received: (qmail 9187 invoked by uid 500); 15 Jul 2005 07:47:45 -0000 Delivered-To: apmail-lucene-java-user-archive@lucene.apache.org Received: (qmail 9100 invoked by uid 500); 15 Jul 2005 07:47:45 -0000 Mailing-List: contact java-user-help@lucene.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: java-user@lucene.apache.org Delivered-To: mailing list java-user@lucene.apache.org Received: (qmail 9065 invoked by uid 99); 15 Jul 2005 07:47:44 -0000 Received: from asf.osuosl.org (HELO asf.osuosl.org) (140.211.166.49) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 15 Jul 2005 00:47:44 -0700 X-ASF-Spam-Status: No, hits=0.0 required=10.0 tests= X-Spam-Check-By: apache.org Received-SPF: pass (asf.osuosl.org: local policy) Received: from [69.44.16.11] (HELO getopt.org) (69.44.16.11) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 15 Jul 2005 00:47:39 -0700 Received: from [192.168.0.252] (75-mo3-2.acn.waw.pl [62.121.105.75]) (authenticated) by getopt.org (8.11.6/8.11.6) with ESMTP id j6F7lfd31056 for ; Fri, 15 Jul 2005 02:47:41 -0500 Message-ID: <42D76A1A.1080603@getopt.org> Date: Fri, 15 Jul 2005 09:47:38 +0200 From: Andrzej Bialecki User-Agent: Mozilla Thunderbird 1.0 (Windows/20041206) X-Accept-Language: en-us, en MIME-Version: 1.0 To: java-user@lucene.apache.org Subject: Re: Best Practices for Distributing Lucene Indexing and Searching References: <20050715055743.4018.qmail@web31110.mail.mud.yahoo.com> In-Reply-To: Content-Type: text/plain; charset=ISO-8859-1; format=flowed Content-Transfer-Encoding: 7bit X-Virus-Checked: Checked by ClamAV on apache.org X-Spam-Rating: minotaur.apache.org 1.6.2 0/1000/N Paul Smith wrote: >> I'm not sure how generic or Nutch-specific Doug and Mike's MapReduce >> code is in Nutch, I haven't been paying close enough attention. >> > > Me too.. :) I didn't even know Nutch was now fully in the ASF, and I'm > a Member... :-$ Let me pipe in on behalf of the Nutch project... The work that Doug and Mike are doing is on a branch, so you will want to check out the following: svn co http://svn.apache.org/repos/asf/lucene/nutch/branches/mapred The distributed work units are performed by arbitrary implementations of appropriate interfaces, so it should be possible to provide implementations that handle just Lucene indices. The MapReduce code is still under heavy development, but it will provide the core of Nutch for the next version. Any pair of hands (and eyes) interested in this work will definitely help! -- Best regards, Andrzej Bialecki <>< ___. ___ ___ ___ _ _ __________________________________ [__ || __|__/|__||\/| Information Retrieval, Semantic Web ___|||__|| \| || | Embedded Unix, System Integration http://www.sigram.com Contact: info at sigram dot com --------------------------------------------------------------------- To unsubscribe, e-mail: java-user-unsubscribe@lucene.apache.org For additional commands, e-mail: java-user-help@lucene.apache.org