hbase-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Guangxu Cheng (JIRA)" <j...@apache.org>
Subject [jira] [Created] (HBASE-19432) Roll the specified writer in HFileOutputFormat2
Date Tue, 05 Dec 2017 12:51:00 GMT
Guangxu Cheng created HBASE-19432:

             Summary: Roll the specified writer in HFileOutputFormat2
                 Key: HBASE-19432
                 URL: https://issues.apache.org/jira/browse/HBASE-19432
             Project: HBase
          Issue Type: Improvement
    Affects Versions: 3.0.0, 2.0.0-beta-1
            Reporter: Guangxu Cheng
            Assignee: Guangxu Cheng

	// If any of the HFiles for the column families has reached
	// maxsize, we need to roll all the writers
	if (wl != null && wl.written + length >= maxsize) {
	  this.rollRequested = true;
If we always roll all the writers, a large number of small files will be generated in the
multi family or multi table scene.
So we should only roll the specified writer which HFile has reached maxsize.

This message was sent by Atlassian JIRA

View raw message