hbase-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Yun Zhao (JIRA)" <j...@apache.org>
Subject [jira] [Created] (HBASE-19226) Limit the reduce tasks number of incremental load
Date Thu, 09 Nov 2017 14:37:00 GMT
Yun Zhao created HBASE-19226:
--------------------------------

             Summary: Limit the reduce tasks number of incremental load
                 Key: HBASE-19226
                 URL: https://issues.apache.org/jira/browse/HBASE-19226
             Project: HBase
          Issue Type: Improvement
            Reporter: Yun Zhao
            Priority: Minor


When using MapReduce job to perform an incremental load into a table,the number of reduce
tasks is the current number of regions. If there are too many regions, will lead to network+disk
I/O is too large, affecting the real-time request.
Need to use a configuration to set a number or ratio?

Limit running reduce tasks since [https://issues.apache.org/jira/browse/MAPREDUCE-5583], the
old version can only be set reduce number.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

Mime
View raw message