From mahout-user-return-364-apmail-lucene-mahout-user-archive=lucene.apache.org@lucene.apache.org Sat Apr 04 01:44:05 2009 Return-Path: Delivered-To: apmail-lucene-mahout-user-archive@minotaur.apache.org Received: (qmail 91625 invoked from network); 4 Apr 2009 01:44:05 -0000 Received: from hermes.apache.org (HELO mail.apache.org) (140.211.11.3) by minotaur.apache.org with SMTP; 4 Apr 2009 01:44:05 -0000 Received: (qmail 10985 invoked by uid 500); 4 Apr 2009 01:44:04 -0000 Delivered-To: apmail-lucene-mahout-user-archive@lucene.apache.org Received: (qmail 10914 invoked by uid 500); 4 Apr 2009 01:44:04 -0000 Mailing-List: contact mahout-user-help@lucene.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: mahout-user@lucene.apache.org Delivered-To: mailing list mahout-user@lucene.apache.org Received: (qmail 10904 invoked by uid 99); 4 Apr 2009 01:44:04 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Sat, 04 Apr 2009 01:44:04 +0000 X-ASF-Spam-Status: No, hits=-0.0 required=10.0 tests=SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (athena.apache.org: domain of srowen@gmail.com designates 209.85.219.179 as permitted sender) Received: from [209.85.219.179] (HELO mail-ew0-f179.google.com) (209.85.219.179) by apache.org (qpsmtpd/0.29) with ESMTP; Sat, 04 Apr 2009 01:43:57 +0000 Received: by ewy27 with SMTP id 27so1319235ewy.5 for ; Fri, 03 Apr 2009 18:43:36 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=domainkey-signature:mime-version:received:in-reply-to:references :date:message-id:subject:from:to:content-type :content-transfer-encoding; bh=wCO6ivelkzRJPzWyZTQaZCJk86AjicuMaGjRb9/1a0I=; b=BPidkjBmg4XJ5ZvZq4AedNZDKwMxd3DJ5BfmLAR00wwsahO9z8kiTDM3yLCCuS3za6 +Wo5VZF6GTjLaLjtCOlxTpdC7VY8wLn7pjT+ZB2vOOGAs4OZjbtDb8th2+G2gK3jYdvo mCgnT9XnM2xz92J2sOtJMfpBmOWFYTDLAT0gE= DomainKey-Signature: a=rsa-sha1; c=nofws; d=gmail.com; s=gamma; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :content-type:content-transfer-encoding; b=wB23MXmQjjNISBm9cbgLTNxwmHvQwcTvgYbrkwhENuc8UuEcCyVBwWxz5oVHDsoB3w 0rUe3O5O7PmT2vYW+fehAdVS6aDPHos+iBvCUGU/xCM/mAVz5ENtlXWyb+rrlLlyKY2K CPitlxDbA1Q6XZMnKBHldYILzGtLen4TAYJVw= MIME-Version: 1.0 Received: by 10.216.28.15 with SMTP id f15mr620081wea.30.1238809416244; Fri, 03 Apr 2009 18:43:36 -0700 (PDT) In-Reply-To: References: <00163646d11a23af8204668e38ac@google.com> <9bbe83bc0904020924u1fe512fehb5af85c0534d1766@mail.gmail.com> Date: Sat, 4 Apr 2009 02:43:36 +0100 Message-ID: Subject: Re: Announcing Amazon Elastic MapReduce From: Sean Owen To: mahout-user@lucene.apache.org Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: 7bit X-Virus-Checked: Checked by ClamAV on apache.org Yes all cores are used and the heap is allowed to grow as large as possible, and is utilized for speed. On 4/3/09, Markus Weimer wrote: > Hello, > > On 03.04.2009, at 16:59, Sean Owen wrote: > >> As a benchmark I ran the 10 million rating GroupLens data set, on a >> high CPU >> extra large instance. It generated recommendations for all 71K users >> in >> about 10 hours, costing a bit more than $8. That is a kind of worst >> case; >> you can recommend for only a subset of users or trade some accuracy >> for >> speed. > > Thanks for that benachmark data! Does taste make use of all of the > cores and memory in the extra big instance? > > Cheers, > > Markus >