Return-Path: X-Original-To: apmail-hbase-issues-archive@www.apache.org Delivered-To: apmail-hbase-issues-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id A7A21D579 for ; Tue, 23 Oct 2012 18:29:14 +0000 (UTC) Received: (qmail 86794 invoked by uid 500); 23 Oct 2012 18:29:14 -0000 Delivered-To: apmail-hbase-issues-archive@hbase.apache.org Received: (qmail 86743 invoked by uid 500); 23 Oct 2012 18:29:14 -0000 Mailing-List: contact issues-help@hbase.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Delivered-To: mailing list issues@hbase.apache.org Received: (qmail 86681 invoked by uid 99); 23 Oct 2012 18:29:14 -0000 Received: from arcas.apache.org (HELO arcas.apache.org) (140.211.11.28) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 23 Oct 2012 18:29:14 +0000 Date: Tue, 23 Oct 2012 18:29:14 +0000 (UTC) From: "Phabricator (JIRA)" To: issues@hbase.apache.org Message-ID: <1657947016.17257.1351016954147.JavaMail.jiratomcat@arcas> In-Reply-To: <1134820870.20186.1345141178200.JavaMail.jiratomcat@arcas> Subject: [jira] [Updated] (HBASE-6597) Block Encoding Size Estimation MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 [ https://issues.apache.org/jira/browse/HBASE-6597?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Phabricator updated HBASE-6597: ------------------------------- Attachment: D5895.5.patch mbautin updated the revision "[jira] [HBASE-6597] [89-fb] Incremental data block encoding". Reviewers: Kannan, Karthik, Liyin, aaiyer, avf, JIRA Addressing Kannan's comments and rebasing. REVISION DETAIL https://reviews.facebook.net/D5895 AFFECTED FILES src/main/java/org/apache/hadoop/hbase/KeyValue.java src/main/java/org/apache/hadoop/hbase/io/encoding/BufferedDataBlockEncoder.java src/main/java/org/apache/hadoop/hbase/io/encoding/CopyKeyDataBlockEncoder.java src/main/java/org/apache/hadoop/hbase/io/encoding/DataBlockEncoder.java src/main/java/org/apache/hadoop/hbase/io/encoding/DataBlockEncoding.java src/main/java/org/apache/hadoop/hbase/io/encoding/DiffKeyDeltaEncoder.java src/main/java/org/apache/hadoop/hbase/io/encoding/EncodedDataBlock.java src/main/java/org/apache/hadoop/hbase/io/encoding/EncodingState.java src/main/java/org/apache/hadoop/hbase/io/encoding/CompressionState.java src/main/java/org/apache/hadoop/hbase/io/encoding/FastDiffDeltaEncoder.java src/main/java/org/apache/hadoop/hbase/io/encoding/PrefixKeyDeltaEncoder.java src/main/java/org/apache/hadoop/hbase/io/hfile/HFileBlock.java src/main/java/org/apache/hadoop/hbase/io/hfile/HFileDataBlockEncoder.java src/main/java/org/apache/hadoop/hbase/io/hfile/HFileDataBlockEncoderImpl.java src/main/java/org/apache/hadoop/hbase/io/hfile/HFileReaderV2.java src/main/java/org/apache/hadoop/hbase/io/hfile/HFileWriterV2.java src/main/java/org/apache/hadoop/hbase/io/hfile/NoOpDataBlockEncoder.java src/main/java/org/apache/hadoop/hbase/util/ByteBufferUtils.java src/test/java/org/apache/hadoop/hbase/io/encoding/TestDataBlockEncoders.java src/test/java/org/apache/hadoop/hbase/io/hfile/TestCacheOnWrite.java src/test/java/org/apache/hadoop/hbase/io/hfile/TestHFile.java src/test/java/org/apache/hadoop/hbase/io/hfile/TestHFileBlock.java src/test/java/org/apache/hadoop/hbase/io/hfile/TestHFileBlockIndex.java src/test/java/org/apache/hadoop/hbase/io/hfile/TestIncrementalEncoding.java src/test/java/org/apache/hadoop/hbase/util/TestByteBufferUtils.java To: Kannan, Karthik, Liyin, aaiyer, avf, JIRA, mbautin Cc: tedyu > Block Encoding Size Estimation > ------------------------------ > > Key: HBASE-6597 > URL: https://issues.apache.org/jira/browse/HBASE-6597 > Project: HBase > Issue Type: Improvement > Components: io > Affects Versions: 0.89-fb > Reporter: Brian Nixon > Assignee: Mikhail Bautin > Priority: Minor > Attachments: D5895.1.patch, D5895.2.patch, D5895.3.patch, D5895.4.patch, D5895.5.patch > > > Blocks boundaries as created by current writers are determined by the size of the unencoded data. However, blocks in memory are kept encoded. By using an estimate for the encoded size of the block, we can get greater consistency in size. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira