Return-Path: X-Original-To: apmail-hadoop-mapreduce-issues-archive@minotaur.apache.org Delivered-To: apmail-hadoop-mapreduce-issues-archive@minotaur.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 03F964F80 for ; Fri, 27 May 2011 04:49:34 +0000 (UTC) Received: (qmail 69143 invoked by uid 500); 27 May 2011 04:49:33 -0000 Delivered-To: apmail-hadoop-mapreduce-issues-archive@hadoop.apache.org Received: (qmail 68981 invoked by uid 500); 27 May 2011 04:49:31 -0000 Mailing-List: contact mapreduce-issues-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: mapreduce-issues@hadoop.apache.org Delivered-To: mailing list mapreduce-issues@hadoop.apache.org Received: (qmail 68963 invoked by uid 99); 27 May 2011 04:49:29 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 27 May 2011 04:49:29 +0000 X-ASF-Spam-Status: No, hits=-2000.0 required=5.0 tests=ALL_TRUSTED,T_RP_MATCHES_RCVD X-Spam-Check-By: apache.org Received: from [140.211.11.116] (HELO hel.zones.apache.org) (140.211.11.116) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 27 May 2011 04:49:27 +0000 Received: from hel.zones.apache.org (hel.zones.apache.org [140.211.11.116]) by hel.zones.apache.org (Postfix) with ESMTP id B74CEE19A4 for ; Fri, 27 May 2011 04:48:47 +0000 (UTC) Date: Fri, 27 May 2011 04:48:47 +0000 (UTC) From: "Hudson (JIRA)" To: mapreduce-issues@hadoop.apache.org Message-ID: <984186097.47746.1306471727747.JavaMail.tomcat@hel.zones.apache.org> Subject: [jira] [Commented] (MAPREDUCE-2137) Mapping between Gridmix jobs and the corresponding original MR jobs is needed MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 [ https://issues.apache.org/jira/browse/MAPREDUCE-2137?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13040054#comment-13040054 ] Hudson commented on MAPREDUCE-2137: ----------------------------------- Integrated in Hadoop-Mapreduce-trunk-Commit #702 (See [https://builds.apache.org/hudson/job/Hadoop-Mapreduce-trunk-Commit/702/]) MAPREDUCE-2137. Provide mapping between jobs of trace file and the corresponding simulated cluster's jobs in Gridmix. ravigummadi : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1128147 Files : * /hadoop/mapreduce/trunk/src/contrib/gridmix/src/java/org/apache/hadoop/mapred/gridmix/Gridmix.java * /hadoop/mapreduce/trunk/src/docs/src/documentation/content/xdocs/gridmix.xml * /hadoop/mapreduce/trunk/src/contrib/gridmix/src/test/org/apache/hadoop/mapred/gridmix/DebugJobProducer.java * /hadoop/mapreduce/trunk/src/contrib/gridmix/src/test/org/apache/hadoop/mapred/gridmix/TestGridmixSubmission.java * /hadoop/mapreduce/trunk/src/contrib/gridmix/src/java/org/apache/hadoop/mapred/gridmix/GridmixJob.java > Mapping between Gridmix jobs and the corresponding original MR jobs is needed > ----------------------------------------------------------------------------- > > Key: MAPREDUCE-2137 > URL: https://issues.apache.org/jira/browse/MAPREDUCE-2137 > Project: Hadoop Map/Reduce > Issue Type: Bug > Components: contrib/gridmix > Affects Versions: 0.23.0 > Reporter: Ravi Gummadi > Assignee: Ravi Gummadi > Fix For: 0.23.0 > > Attachments: 2137.patch, 2137.v1.patch, 2137.v2.1.patch > > > Consider a trace file "trace1" obtained by running Rumen on a set of MR jobs' history logs. When gridmix runs simulated jobs from "trace1", it may skip some of the jobs from the trace file for some reason like out-of-order-jobs. Now use Rumen to generate trace2 from the history logs of gridmix's simulated jobs. > Now, to compare and analyze the gridmix's simulated jobs with original MR jobs, we need a mapping between them. -- This message is automatically generated by JIRA. For more information on JIRA, see: http://www.atlassian.com/software/jira