Return-Path: 
 <issues-return-56204-apmail-hbase-issues-archive=hbase.apache.org@hbase.apache.org>
X-Original-To: apmail-hbase-issues-archive@www.apache.org
Delivered-To: apmail-hbase-issues-archive@www.apache.org
Received: from mail.apache.org (hermes.apache.org [140.211.11.3])
	by minotaur.apache.org (Postfix) with SMTP id EB566CEED
	for <apmail-hbase-issues-archive@www.apache.org>;
 Thu, 26 Jul 2012 00:32:36 +0000 (UTC)
Received: (qmail 3386 invoked by uid 500); 26 Jul 2012 00:32:35 -0000
Delivered-To: apmail-hbase-issues-archive@hbase.apache.org
Received: (qmail 3322 invoked by uid 500); 26 Jul 2012 00:32:35 -0000
Mailing-List: contact issues-help@hbase.apache.org; run by ezmlm
Precedence: bulk
List-Help: <mailto:issues-help@hbase.apache.org>
List-Unsubscribe: <mailto:issues-unsubscribe@hbase.apache.org>
List-Post: <mailto:issues@hbase.apache.org>
List-Id: <issues.hbase.apache.org>
Delivered-To: mailing list issues@hbase.apache.org
Received: (qmail 3091 invoked by uid 99); 26 Jul 2012 00:32:35 -0000
Received: from issues-vm.apache.org (HELO issues-vm) (140.211.11.160)
    by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 26 Jul 2012 00:32:35 +0000
Received: from isssues-vm.apache.org (localhost [127.0.0.1])
	by issues-vm (Postfix) with ESMTP id AA55714285A
	for <issues@hbase.apache.org>; Thu, 26 Jul 2012 00:32:34 +0000 (UTC)
Date: Thu, 26 Jul 2012 00:32:34 +0000 (UTC)
From: "Aditya Kishore (JIRA)" <jira@apache.org>
To: issues@hbase.apache.org
Message-ID: <1508272288.104030.1343262754699.JavaMail.jiratomcat@issues-vm>
In-Reply-To: <1924451208.104025.1343262754560.JavaMail.jiratomcat@issues-vm>
Subject: [jira] [Updated] (HBASE-6455)
 org.apache.hadoop.hbase.PerformanceEvaluation sets the map reduce output
 path as a child of input path
MIME-Version: 1.0
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: 7bit
X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394


     [ https://issues.apache.org/jira/browse/HBASE-6455?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Aditya Kishore updated HBASE-6455:
----------------------------------

    Attachment: HBASE-6455_trunk.patch

Patch attached for trunk
                
> org.apache.hadoop.hbase.PerformanceEvaluation sets the map reduce output path as a child of input path
> ------------------------------------------------------------------------------------------------------
>
>                 Key: HBASE-6455
>                 URL: https://issues.apache.org/jira/browse/HBASE-6455
>             Project: HBase
>          Issue Type: Bug
>          Components: performance
>    Affects Versions: 0.94.0, 0.96.0
>            Reporter: Aditya Kishore
>            Assignee: Aditya Kishore
>            Priority: Minor
>              Labels: benchmark
>         Attachments: HBASE-6455_trunk.patch
>
>
> I was the running PerformanceEvaluation test with a modified job configuration where the job output path is created before the splits and that unmasked the issue because the the PeInputFormat.getSplits() function expects to find only files under the input path.
> The attached patch addresses both the issues.
> # Creates separate input and output path rooted under a single folder e.g. "<user_home>/performance_evaluation/<yyyyMMddHHmmss>/inputs" and  "<user_home>/performance_evaluation/<yyyyMMddHHmmss>/outputs", and
> # The PeInputFormat.getSplits(), now skips any folder found under the input path and process only files.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira