hbase-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Ted Yu (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (HBASE-19432) Roll the specified writer in HFileOutputFormat2
Date Wed, 06 Dec 2017 06:31:00 GMT

     [ https://issues.apache.org/jira/browse/HBASE-19432?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Ted Yu updated HBASE-19432:
---------------------------
       Resolution: Fixed
     Hadoop Flags: Reviewed
    Fix Version/s: 2.0.0-beta-1
           Status: Resolved  (was: Patch Available)

Thanks for the patch, Guangxu

> Roll the specified writer in HFileOutputFormat2
> -----------------------------------------------
>
>                 Key: HBASE-19432
>                 URL: https://issues.apache.org/jira/browse/HBASE-19432
>             Project: HBase
>          Issue Type: Improvement
>    Affects Versions: 3.0.0, 2.0.0-beta-1
>            Reporter: Guangxu Cheng
>            Assignee: Guangxu Cheng
>             Fix For: 2.0.0-beta-1
>
>         Attachments: HBASE-19432.master.001.patch, HBASE-19432.master.002.patch
>
>
> {code}
> 	// If any of the HFiles for the column families has reached
> 	// maxsize, we need to roll all the writers
> 	if (wl != null && wl.written + length >= maxsize) {
> 	  this.rollRequested = true;
> 	}
> {code}
> If we always roll all the writers, a large number of small files will be generated in
the multi family or multi table scene.
> So we should only roll the specified writer which HFile has reached maxsize.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

Mime
View raw message