hbase-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "huaxiang sun (JIRA)" <j...@apache.org>
Subject [jira] [Created] (HBASE-17043) parallelize select() work in mob compaction
Date Tue, 08 Nov 2016 00:20:58 GMT
huaxiang sun created HBASE-17043:

             Summary: parallelize select() work in mob compaction
                 Key: HBASE-17043
                 URL: https://issues.apache.org/jira/browse/HBASE-17043
             Project: HBase
          Issue Type: Improvement
          Components: mob
    Affects Versions: 2.0.0
            Reporter: huaxiang sun
            Assignee: huaxiang sun
            Priority: Minor

Today in https://github.com/apache/hbase/blob/master/hbase-server/src/main/java/org/apache/hadoop/hbase/mob/compactions/PartitionedMobCompactor.java#L141,
 the select() is single-threaded. Give a large number of files, it will take several seconds
to finish the job. Will see how this work can be divided and speed up the processing.

This message was sent by Atlassian JIRA

View raw message