hbase-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Clara Xiong (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HBASE-15389) Write out multiple files when compaction
Date Sun, 06 Mar 2016 18:39:40 GMT

    [ https://issues.apache.org/jira/browse/HBASE-15389?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15182264#comment-15182264
] 

Clara Xiong commented on HBASE-15389:
-------------------------------------

What do you think if we keep HBASE-15389 and HBASE-15400 as two separate patches and work
in parallel?    For HBASE-15389,  we can have:
.../regionserver/AbstractMultiFileWriter.java 
 .../regionserver/DateTieredMultiFileWriter.java 
  .../hbase/regionserver/StripeMultiFileWriter.java 
 .../hbase/regionserver/StripeStoreFlusher.java    
 .../compactions/DateTieredCompactor.java 
 .../regionserver/TestDateTieredCompaction.java

These files has no dependencies on the other part and can be checked in independently. 

For HBASE-15400, we can have:
.../hbase/regionserver/DateTieredStoreEngine.java
 .../hadoop/hbase/regionserver/StoreFile.java
 .../compactions/DateTieredCompactionPolicy.java
  .../regionserver/TestDateTieredCompactionPolicy.java

I can work on them and add more unit test cases. It will be appreciated if you can add input
too. HBASE-15400 can be checked in after HBASE-15389 is checked in.  I have patches for master
and 98 now but will hold off on uploading the older versions since DateTieredCompactor doesn't
work on 98 yet.

These two patches together will work end to end. We can test in staging and production at
Xiaomi and Flurry/Yahoo in parallel later. 

What do you think? 





> Write out multiple files when compaction
> ----------------------------------------
>
>                 Key: HBASE-15389
>                 URL: https://issues.apache.org/jira/browse/HBASE-15389
>             Project: HBase
>          Issue Type: Sub-task
>          Components: Compaction
>    Affects Versions: 2.0.0, 1.3.0, 0.98.19
>            Reporter: Duo Zhang
>         Attachments: HBASE-15389-uc.patch
>
>




--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message