hbase-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Rishit Shroff (JIRA)" <j...@apache.org>
Subject [jira] [Created] (HBASE-9896) Add an option to have strict number of mapper per job in HBase Streaming
Date Tue, 05 Nov 2013 19:34:17 GMT
Rishit Shroff created HBASE-9896:
------------------------------------

             Summary: Add an option to have strict number of mapper per job in HBase Streaming
                 Key: HBASE-9896
                 URL: https://issues.apache.org/jira/browse/HBASE-9896
             Project: HBase
          Issue Type: New Feature
          Components: mapreduce
    Affects Versions: 0.89-fb
            Reporter: Rishit Shroff
            Assignee: Rishit Shroff
            Priority: Minor
             Fix For: 0.89-fb


Currently there is only one configuration knob available for controlling the number of mappers
per job in HBase Streaming. The current option is number of mappers per region. This options
tries to maintain the locality for the mapper and the region servers.

However, in certain certain scenarios where the table has a higher number of regions, the
number of mapper/region can lead to explosion of the number of mappers. Hence, we need one
more option to control the strict number of mappers per job.



--
This message was sent by Atlassian JIRA
(v6.1#6144)

Mime
View raw message