Return-Path: Delivered-To: apmail-hadoop-mapreduce-user-archive@minotaur.apache.org Received: (qmail 43149 invoked from network); 14 Sep 2010 10:11:58 -0000 Received: from unknown (HELO mail.apache.org) (140.211.11.3) by 140.211.11.9 with SMTP; 14 Sep 2010 10:11:58 -0000 Received: (qmail 69221 invoked by uid 500); 14 Sep 2010 10:11:57 -0000 Delivered-To: apmail-hadoop-mapreduce-user-archive@hadoop.apache.org Received: (qmail 68998 invoked by uid 500); 14 Sep 2010 10:11:54 -0000 Mailing-List: contact mapreduce-user-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: mapreduce-user@hadoop.apache.org Delivered-To: mailing list mapreduce-user@hadoop.apache.org Received: (qmail 68988 invoked by uid 99); 14 Sep 2010 10:11:53 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 14 Sep 2010 10:11:53 +0000 X-ASF-Spam-Status: No, hits=0.7 required=10.0 tests=SPF_NEUTRAL X-Spam-Check-By: apache.org Received-SPF: neutral (athena.apache.org: local policy) Received: from [69.147.107.21] (HELO mrout2-b.corp.re1.yahoo.com) (69.147.107.21) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 14 Sep 2010 10:11:49 +0000 Received: from dishnailfind-dx.eglbp.corp.yahoo.com (dishnailfind-dx.eglbp.corp.yahoo.com [10.66.77.50]) by mrout2-b.corp.re1.yahoo.com (8.13.8/8.13.8/y.out) with ESMTP id o8EAAtmv023881; Tue, 14 Sep 2010 03:10:56 -0700 (PDT) DomainKey-Signature: a=rsa-sha1; s=serpent; d=yahoo-inc.com; c=nofws; q=dns; h=message-id:date:from:organization:user-agent:mime-version:to:cc: subject:references:in-reply-to:content-type:content-transfer-encoding; b=I4RxW810FQ0/XqoT+c3sxoLBRDgUyxonbCF0dSc915PrLHQWoM0vGUooa0z6yxfg Message-ID: <4C8F4A2F.7020501@yahoo-inc.com> Date: Tue, 14 Sep 2010 15:40:55 +0530 From: Ranjit Mathew Organization: Yahoo User-Agent: Mozilla/5.0 (X11; U; Linux i686; en-GB; rv:1.9.2.9) Gecko/20100825 Lightning/1.0b2 Thunderbird/3.1.3 MIME-Version: 1.0 To: "mapreduce-user@hadoop.apache.org" CC: Harold Lim Subject: Re: How to use Rumen? References: <517503.37954.qm@web51004.mail.re2.yahoo.com> In-Reply-To: <517503.37954.qm@web51004.mail.re2.yahoo.com> Content-Type: text/plain; charset=ISO-8859-1; format=flowed Content-Transfer-Encoding: 7bit On Tuesday 14 September 2010 02:00 AM, Harold Lim wrote: > Is there an instruction on how to use rumen? Yes, the documentation was recently added to trunk via MAPREDUCE-1918: https://issues.apache.org/jira/browse/MAPREDUCE-1918 > I tried the following command: > > java -cp hadoop-mapred-0.21.0.jar:hadoop-common-0.21.0.jar:hadoop-hdfs-0.21.0.jar:hadoop-mapred-tools-0.21.0.jar:commons-logging-1.1.1.jar:commons-cli-1.2.jar:log4j-1.2.15.jar:jackson-mapper-asl-1.4.2.jar:jackson-core-asl-1.4.2.jar org.apache.hadoop.tools.rumen.TraceBuilder traceout topologyout > 10/09/13 16:26:09 INFO security.Groups: Group mapping impl=org.apache.hadoop.security.ShellBasedUnixGroupsMapping; cacheTimeout=300000 > 10/09/13 16:26:10 WARN rumen.TraceBuilder: No job found in traces: > > How do I set the input jobtracker log file? Depending on the setting for "fs.default.name", this might be searching in your HDFS home folder. It's better to specify the complete URL (using "file:" or "hdfs:"). For example, suppose you want to create "jh.json" from the Job history files in the "jobhistory" folder (all within the current directory). You can then invoke Rumen like this: $HADOOP_HOME/bin/hadoop jar $HADOOP_HOME/hadoop-mapred-tools-0.22.0-SNAPSHOT.jar \ org.apache.hadoop.tools.rumen.TraceBuilder file://$PWD/jh.json file://$PWD/topo.out \ file://$PWD/jobhistory HTH, Ranjit