hbase-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Hudson (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HBASE-6455) org.apache.hadoop.hbase.PerformanceEvaluation sets the map reduce output path as a child of input path
Date Thu, 26 Jul 2012 22:26:35 GMT

    [ https://issues.apache.org/jira/browse/HBASE-6455?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13423510#comment-13423510
] 

Hudson commented on HBASE-6455:
-------------------------------

Integrated in HBase-TRUNK #3173 (See [https://builds.apache.org/job/HBase-TRUNK/3173/])
    HBASE-6455 org.apache.hadoop.hbase.PerformanceEvaluation sets the map reduce output path
as a child of input path (Aditya) (Revision 1366034)

     Result = FAILURE
tedyu : 
Files : 
* /hbase/trunk/hbase-server/src/test/java/org/apache/hadoop/hbase/PerformanceEvaluation.java

                
> org.apache.hadoop.hbase.PerformanceEvaluation sets the map reduce output path as a child
of input path
> ------------------------------------------------------------------------------------------------------
>
>                 Key: HBASE-6455
>                 URL: https://issues.apache.org/jira/browse/HBASE-6455
>             Project: HBase
>          Issue Type: Bug
>          Components: performance
>    Affects Versions: 0.94.0, 0.96.0
>            Reporter: Aditya Kishore
>            Assignee: Aditya Kishore
>            Priority: Minor
>              Labels: benchmark
>             Fix For: 0.96.0
>
>         Attachments: HBASE-6455_trunk.patch
>
>
> I was the running PerformanceEvaluation test with a modified job configuration where
the job output path is created before the splits and that unmasked the issue because the the
PeInputFormat.getSplits() function expects to find only files under the input path.
> The attached patch addresses both the issues.
> # Creates separate input and output path rooted under a single folder e.g. "<user_home>/performance_evaluation/<yyyyMMddHHmmss>/inputs"
and  "<user_home>/performance_evaluation/<yyyyMMddHHmmss>/outputs", and
> # The PeInputFormat.getSplits(), now skips any folder found under the input path and
process only files.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

Mime
View raw message