Return-Path: Delivered-To: apmail-mahout-user-archive@www.apache.org Received: (qmail 90532 invoked from network); 25 Jan 2011 05:48:42 -0000 Received: from hermes.apache.org (HELO mail.apache.org) (140.211.11.3) by minotaur.apache.org with SMTP; 25 Jan 2011 05:48:42 -0000 Received: (qmail 31896 invoked by uid 500); 25 Jan 2011 05:48:42 -0000 Delivered-To: apmail-mahout-user-archive@mahout.apache.org Received: (qmail 31744 invoked by uid 500); 25 Jan 2011 05:48:39 -0000 Mailing-List: contact user-help@mahout.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@mahout.apache.org Delivered-To: mailing list user@mahout.apache.org Received: (qmail 31736 invoked by uid 99); 25 Jan 2011 05:48:38 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 25 Jan 2011 05:48:38 +0000 X-ASF-Spam-Status: No, hits=1.5 required=10.0 tests=FREEMAIL_FROM,HTML_MESSAGE,RCVD_IN_DNSWL_LOW,SPF_PASS,T_TO_NO_BRKTS_FREEMAIL X-Spam-Check-By: apache.org Received-SPF: pass (athena.apache.org: domain of rickenrao@gmail.com designates 209.85.214.42 as permitted sender) Received: from [209.85.214.42] (HELO mail-bw0-f42.google.com) (209.85.214.42) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 25 Jan 2011 05:48:32 +0000 Received: by bwz13 with SMTP id 13so26731bwz.1 for ; Mon, 24 Jan 2011 21:48:11 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=domainkey-signature:mime-version:in-reply-to:references:date :message-id:subject:from:to:content-type; bh=Uh/m9VCCxPj26z62FrK6cyiFjx1vsW0VfGRBSzDLHDM=; b=Q+iB65PFhr9k9o8LI6136tjpIYdaA4h/jpUAR/yfm4uMQP8UJBmvMMGlqj3io4hTh+ Wxw2n2G0AOiLhEMFxqooM7ppjkZkMHqrtURzxwWxnGRrSEF+Ui2x1FrVSWwN8HGvImtI f29FA1YDJFsoImFnWXfLym6JTbuk9s6Z3xj24= DomainKey-Signature: a=rsa-sha1; c=nofws; d=gmail.com; s=gamma; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :content-type; b=TINhQ9RpWgy5fJgRHoLKeMJdxxCCpwEmtYMCW/ZC8QyX9YPe+LqLgrDxpcsJvTP56X 7FxuSUhrkiokc55Ze5ewufrR2RI6PXb+xtAWkRbklHLU/b6z2N2IzNkETOXdP8ho1lo0 hVo4ltoZPf9WLM0LqsoYzMubcozOyPGn9Toio= MIME-Version: 1.0 Received: by 10.204.76.18 with SMTP id a18mr4630945bkk.9.1295934491019; Mon, 24 Jan 2011 21:48:11 -0800 (PST) Received: by 10.204.55.71 with HTTP; Mon, 24 Jan 2011 21:48:10 -0800 (PST) In-Reply-To: References: Date: Tue, 25 Jan 2011 00:48:10 -0500 Message-ID: Subject: Re: Problem running twenty newsgroup example in a hadoop cluster From: Jia Rao To: user@mahout.apache.org Content-Type: multipart/alternative; boundary=001485f46e5afd5412049aa5421e --001485f46e5afd5412049aa5421e Content-Type: text/plain; charset=ISO-8859-1 Sorry, 3200m On Tue, Jan 25, 2011 at 12:40 AM, Ted Dunning wrote: > 3200? > > or 3200m? > > > On Mon, Jan 24, 2011 at 6:54 PM, Jia Rao wrote: > > > Hi all, > > > > I am having a problem running the 20 newsgroup example in a hadoop > cluster. > > The trainclassifier worked fine but I got "out of memory java heap" > problem > > in the testclassifier. > > > > The following is the configuration of the hadoop cluster. > > > > Physical machines: 4 nodes, each with 6GB memory. > > > > Hadoop: 0.20.2, HADOOP_HEAP_SIZE=3200 in hadoop-env.sh, > > mapred.child.java.opts=-Xmx1024M in mapred-site.xml. > > > > mahout: tried release 0.4 and the latest source, same problem. > > > > Command line arguments used: > > > > $MAHOUT_HOME/bin/mahout testclassifier \ > > -m newsmodel \ > > -d 20news-input \ > > -type bayes \ > > -ng 3 \ > > -source hdfs \ > > -method mapreduce > > > > > > Any ideas ? > > Thanks ! > > > --001485f46e5afd5412049aa5421e--