Return-Path: Delivered-To: apmail-lucene-mahout-dev-archive@minotaur.apache.org Received: (qmail 57831 invoked from network); 25 Feb 2010 20:49:59 -0000 Received: from hermes.apache.org (HELO mail.apache.org) (140.211.11.3) by minotaur.apache.org with SMTP; 25 Feb 2010 20:49:59 -0000 Received: (qmail 19998 invoked by uid 500); 25 Feb 2010 20:49:59 -0000 Delivered-To: apmail-lucene-mahout-dev-archive@lucene.apache.org Received: (qmail 19862 invoked by uid 500); 25 Feb 2010 20:49:59 -0000 Mailing-List: contact mahout-dev-help@lucene.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: mahout-dev@lucene.apache.org Delivered-To: mailing list mahout-dev@lucene.apache.org Received: (qmail 19852 invoked by uid 99); 25 Feb 2010 20:49:59 -0000 Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 25 Feb 2010 20:49:59 +0000 X-ASF-Spam-Status: No, hits=2.2 required=10.0 tests=HTML_MESSAGE,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (nike.apache.org: domain of robin.anil@gmail.com designates 74.125.83.176 as permitted sender) Received: from [74.125.83.176] (HELO mail-pv0-f176.google.com) (74.125.83.176) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 25 Feb 2010 20:49:51 +0000 Received: by pvd12 with SMTP id 12so1272118pvd.35 for ; Thu, 25 Feb 2010 12:49:30 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=domainkey-signature:mime-version:received:in-reply-to:references :from:date:message-id:subject:to:content-type; bh=GAU76JnwAq9mktyKyzeiW5GAiSZXFhdpBl0yQhnk3YQ=; b=SgqJonD98C1A9zly0pfyQDmWuLxg8ixa3ZWs840GHxAxqFfDimms/NpNZU9qo5fDtM ljPSLGvaYhl4cMc7dZ9lMpxmaBpbJWfOkuPod238+X9L5tq4kSeOx3AWPVXH9cNYsBsw DY6N/rXcWW+23SijPRNlsdLW4m0+tUnA8fhuk= DomainKey-Signature: a=rsa-sha1; c=nofws; d=gmail.com; s=gamma; h=mime-version:in-reply-to:references:from:date:message-id:subject:to :content-type; b=wPsxgMc+fwUxip8jvtI1uVr/wDEPxn3ncmmwARZlmo6ldINFs6hLO9Tvihh675AhDQ jBWp8VR92JYY3IysMuyFx2jY4fdjaN4u7NW+BO1L5kLh6VBBM3QRWtsEos03bgDxdZOu 3pXAnbwunHm+YgbfYE32vWK1p9JB2WmMwERKs= MIME-Version: 1.0 Received: by 10.141.125.9 with SMTP id c9mr92316rvn.36.1267130970226; Thu, 25 Feb 2010 12:49:30 -0800 (PST) In-Reply-To: <4b124c311002251241t62449ef5k2632859372bcad8a@mail.gmail.com> References: <7d7600c51002251211n2a40e814y5a80ce923aaf2554@mail.gmail.com> <8f8e14c41002251218i19c4437x81cc184eb65b9666@mail.gmail.com> <4b124c311002251230s8006a26xcf00a9579315b26e@mail.gmail.com> <7d7600c51002251236x38f550bdje4c665094dab8bf4@mail.gmail.com> <7d7600c51002251238m76ee7b95o2170ebc9b4793d52@mail.gmail.com> <4b124c311002251241t62449ef5k2632859372bcad8a@mail.gmail.com> From: Robin Anil Date: Fri, 26 Feb 2010 02:19:10 +0530 Message-ID: <7d7600c51002251249g55dffa82kb9d5d31a651b12d7@mail.gmail.com> Subject: Re: anybody want to set a record with Mahout? To: mahout-dev@lucene.apache.org Content-Type: multipart/alternative; boundary=0003255617625d4073048072eb05 X-Virus-Checked: Checked by ClamAV on apache.org --0003255617625d4073048072eb05 Content-Type: text/plain; charset=UTF-8 unigrams > 3 = 384 MB dictionary... with all ngrams(pruned by llr >1) we might hit some 5-10GB of entries. With some 25 char average for 5 grams it might be safe to say that we might say hit 100 million rows easily ? Robin --0003255617625d4073048072eb05--