hbase-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Vladimir Rodionov (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HBASE-15509) Avoid copy of block data in HFileBlock$Writer.finishBlock
Date Wed, 30 Mar 2016 06:03:25 GMT

    [ https://issues.apache.org/jira/browse/HBASE-15509?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15217460#comment-15217460
] 

Vladimir Rodionov commented on HBASE-15509:
-------------------------------------------

This patch + 4 more in HBASE-15542 will allow us, potentially, reduce memory allocation during
compaction by  more than 90% (10x times).  That, in turn, will allow us to run compactions
more aggressively, without throughput controller and with 5-10 threads in parallel. This is
the eventual goal. 



> Avoid copy of block data in HFileBlock$Writer.finishBlock
> ---------------------------------------------------------
>
>                 Key: HBASE-15509
>                 URL: https://issues.apache.org/jira/browse/HBASE-15509
>             Project: HBase
>          Issue Type: Sub-task
>          Components: HFile
>            Reporter: Vladimir Rodionov
>            Assignee: Vladimir Rodionov
>         Attachments: HBASE-15509-v1.patch, HBASE-15509-v2.patch
>
>
> This calls ByteArrayOutputStream.toByteArray() which creates a copy of data block. 



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message