hbase-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Aditya Kishore (JIRA)" <j...@apache.org>
Subject [jira] [Created] (HBASE-6455) org.apache.hadoop.hbase.PerformanceEvaluation sets the map reduce output path as a child of input path
Date Thu, 26 Jul 2012 00:32:33 GMT
Aditya Kishore created HBASE-6455:
-------------------------------------

             Summary: org.apache.hadoop.hbase.PerformanceEvaluation sets the map reduce output
path as a child of input path
                 Key: HBASE-6455
                 URL: https://issues.apache.org/jira/browse/HBASE-6455
             Project: HBase
          Issue Type: Bug
          Components: performance
    Affects Versions: 0.94.0, 0.96.0
            Reporter: Aditya Kishore
            Assignee: Aditya Kishore
            Priority: Minor
         Attachments: HBASE-6455_trunk.patch

I was the running PerformanceEvaluation test with a modified job configuration where the job
output path is created before the splits and that unmasked the issue because the the PeInputFormat.getSplits()
function expects to find only files under the input path.

The attached patch addresses both the issues.

# Creates separate input and output path rooted under a single folder e.g. "<user_home>/performance_evaluation/<yyyyMMddHHmmss>/inputs"
and  "<user_home>/performance_evaluation/<yyyyMMddHHmmss>/outputs", and
# The PeInputFormat.getSplits(), now skips any folder found under the input path and process
only files.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

Mime
View raw message