hbase-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Hudson (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HBASE-18090) Improve TableSnapshotInputFormat to allow more multiple mappers per region
Date Sat, 30 Sep 2017 09:48:00 GMT

    [ https://issues.apache.org/jira/browse/HBASE-18090?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16187006#comment-16187006
] 

Hudson commented on HBASE-18090:
--------------------------------

FAILURE: Integrated in Jenkins build HBase-2.0 #603 (See [https://builds.apache.org/job/HBase-2.0/603/])
HBASE-18090 Improve TableSnapshotInputFormat to allow more multiple (ashu: rev 7ee44a820f74eeeb587c50a42c104f64a58175e3)
* (edit) hbase-mapreduce/src/main/java/org/apache/hadoop/hbase/mapreduce/TableSnapshotInputFormatImpl.java
* (edit) hbase-mapreduce/src/test/java/org/apache/hadoop/hbase/mapreduce/TableSnapshotInputFormatTestBase.java
* (edit) hbase-mapreduce/src/main/java/org/apache/hadoop/hbase/mapreduce/TableSnapshotInputFormat.java
* (edit) hbase-server/src/main/java/org/apache/hadoop/hbase/util/RegionSplitter.java
* (edit) hbase-mapreduce/src/main/java/org/apache/hadoop/hbase/mapreduce/TableMapReduceUtil.java
* (edit) hbase-it/src/test/java/org/apache/hadoop/hbase/mapreduce/IntegrationTestTableSnapshotInputFormat.java
* (edit) hbase-mapreduce/src/main/java/org/apache/hadoop/hbase/mapred/TableSnapshotInputFormat.java
* (edit) hbase-mapreduce/src/test/java/org/apache/hadoop/hbase/mapred/TestTableSnapshotInputFormat.java
* (edit) hbase-mapreduce/src/test/java/org/apache/hadoop/hbase/mapreduce/TestTableSnapshotInputFormat.java
* (edit) hbase-server/src/test/java/org/apache/hadoop/hbase/util/TestRegionSplitter.java
* (edit) hbase-mapreduce/src/main/java/org/apache/hadoop/hbase/mapred/TableMapReduceUtil.java
* (edit) hbase-server/src/main/java/org/apache/hadoop/hbase/client/ClientSideRegionScanner.java


> Improve TableSnapshotInputFormat to allow more multiple mappers per region
> --------------------------------------------------------------------------
>
>                 Key: HBASE-18090
>                 URL: https://issues.apache.org/jira/browse/HBASE-18090
>             Project: HBase
>          Issue Type: Improvement
>          Components: mapreduce
>    Affects Versions: 3.0.0
>            Reporter: Mikhail Antonov
>            Assignee: xinxin fan
>             Fix For: 3.0.0, 2.0.0-alpha-4
>
>         Attachments: HBASE-18090-branch-1.3-v1.patch, HBASE-18090-branch-1.3-v2.patch,
HBASE-18090-V3-master.patch, HBASE-18090-V4-master.patch, HBASE-18090-V5-master.patch
>
>
> TableSnapshotInputFormat runs one map task per region in the table snapshot. This places
unnecessary restriction that the region layout of the original table needs to take the processing
resources available to MR job into consideration. Allowing to run multiple mappers per region
(assuming reasonably even key distribution) would be useful.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

Mime
View raw message