hbase-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Guangxu Cheng (JIRA)" <j...@apache.org>
Subject [jira] [Created] (HBASE-19432) Roll the specified writer in HFileOutputFormat2
Date Tue, 05 Dec 2017 12:51:00 GMT
Guangxu Cheng created HBASE-19432:
-------------------------------------

             Summary: Roll the specified writer in HFileOutputFormat2
                 Key: HBASE-19432
                 URL: https://issues.apache.org/jira/browse/HBASE-19432
             Project: HBase
          Issue Type: Improvement
    Affects Versions: 3.0.0, 2.0.0-beta-1
            Reporter: Guangxu Cheng
            Assignee: Guangxu Cheng


{code}
	// If any of the HFiles for the column families has reached
	// maxsize, we need to roll all the writers
	if (wl != null && wl.written + length >= maxsize) {
	  this.rollRequested = true;
	}
{code}
If we always roll all the writers, a large number of small files will be generated in the
multi family or multi table scene.
So we should only roll the specified writer which HFile has reached maxsize.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

Mime
View raw message