Return-Path: Delivered-To: apmail-lucene-java-user-archive@www.apache.org Received: (qmail 32964 invoked from network); 22 Jul 2009 08:39:47 -0000 Received: from hermes.apache.org (HELO mail.apache.org) (140.211.11.3) by minotaur.apache.org with SMTP; 22 Jul 2009 08:39:47 -0000 Received: (qmail 95040 invoked by uid 500); 22 Jul 2009 08:40:50 -0000 Delivered-To: apmail-lucene-java-user-archive@lucene.apache.org Received: (qmail 94964 invoked by uid 500); 22 Jul 2009 08:40:50 -0000 Mailing-List: contact java-user-help@lucene.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: java-user@lucene.apache.org Delivered-To: mailing list java-user@lucene.apache.org Received: (qmail 94954 invoked by uid 99); 22 Jul 2009 08:40:50 -0000 Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 22 Jul 2009 08:40:50 +0000 X-ASF-Spam-Status: No, hits=2.2 required=10.0 tests=HTML_MESSAGE,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (nike.apache.org: domain of prashullegaddi@gmail.com designates 209.85.198.233 as permitted sender) Received: from [209.85.198.233] (HELO rv-out-0506.google.com) (209.85.198.233) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 22 Jul 2009 08:40:40 +0000 Received: by rv-out-0506.google.com with SMTP id b25so11375rvf.5 for ; Wed, 22 Jul 2009 01:40:19 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=domainkey-signature:mime-version:received:in-reply-to:references :date:message-id:subject:from:to:content-type; bh=7pQx33UP9VgZR9jrSD9EHl+32jybwNeM5gRp77waJkw=; b=PCbdoLxsevPN3bKwBhW8H4j0NmFGQry4MrhJyX+bvTWr1nmhbvJB51Uj76iXZuhJOx qAszjsxVVge+O7VjTCKL3BEmKx/K6snjnzAcWGdKmVu4mTW6hHwdl5tNUJQPVwBEIu2x AOdCLvLZufZpG4LNxn/76ZSWNKEuHuLWFxbl0= DomainKey-Signature: a=rsa-sha1; c=nofws; d=gmail.com; s=gamma; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :content-type; b=hNvEYtltgutRo3RuDY4bAIWptY+cv+lup0Yw+p0D/PSdT8vWay/zQKJhML09y4pUst I3r7talp17O7Cu5fCDd1fVY1tAcT9hT3VAr90YzxkfYsDzJXnXNPrQpVitFR95oRaU2Y 7fnyAA0hC/srGqDMDwQT0rHohl/y025o4Yz78= MIME-Version: 1.0 Received: by 10.140.127.13 with SMTP id z13mr392646rvc.235.1248252019038; Wed, 22 Jul 2009 01:40:19 -0700 (PDT) In-Reply-To: <24602064.post@talk.nabble.com> References: <24600563.post@talk.nabble.com> <786fde50907220026y125d9a2ctc80a45d05039be46@mail.gmail.com> <24602064.post@talk.nabble.com> Date: Wed, 22 Jul 2009 14:10:19 +0530 Message-ID: Subject: Re: indexing 100GB of data From: prashant ullegaddi To: java-user@lucene.apache.org Content-Type: multipart/alternative; boundary=000e0cd29d9c2f5c28046f475288 X-Virus-Checked: Checked by ClamAV on apache.org --000e0cd29d9c2f5c28046f475288 Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: 7bit Yes you can use Hadoop with Lucene. Borrow some code from Nutch. Look at org.apache.nutch.indexer.IndexerMapReduce and org.apache.nutch.indexer. Indexer. Prashant. On Wed, Jul 22, 2009 at 2:00 PM, m.harig wrote: > > Thanks Shai > > So there won't be problem when searching that kind of large index > . am i right? > > Can anyone tell me is it possible to use hadoop with lucene?? > -- > View this message in context: > http://www.nabble.com/indexing-100GB-of-data-tp24600563p24602064.html > Sent from the Lucene - Java Users mailing list archive at Nabble.com. > > > --------------------------------------------------------------------- > To unsubscribe, e-mail: java-user-unsubscribe@lucene.apache.org > For additional commands, e-mail: java-user-help@lucene.apache.org > > --000e0cd29d9c2f5c28046f475288--