hbase-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Matteo Bertozzi (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HBASE-8034) record on-disk data size for store file and make it available during writing
Date Fri, 15 Mar 2013 21:26:15 GMT

    [ https://issues.apache.org/jira/browse/HBASE-8034?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13603874#comment-13603874

Matteo Bertozzi commented on HBASE-8034:

{quote}Can you please point me at what headers are written before data?{quote}
HFileBlock.Writer.finishBlock() and finishBlockAndWriteHeaderAndData()

{quote}...that means KVs will have to be used for detecting imbalance for fixed-count scheme
(size and KV balance may be different)/splitting out new stripe for sequential data/etc. Do
you think it's acceptable?{quote}
yeah, splitting and some other sort of tuning can be the first use case
> record on-disk data size for store file and make it available during writing
> ----------------------------------------------------------------------------
>                 Key: HBASE-8034
>                 URL: https://issues.apache.org/jira/browse/HBASE-8034
>             Project: HBase
>          Issue Type: Task
>            Reporter: Sergey Shelukhin
>            Assignee: Sergey Shelukhin
>            Priority: Minor
>         Attachments: HBASE-8034-v0.patch, HBASE-8034-v1.patch, HBASE-8034-v2.patch
> To better estimate the size of data in the file, and to be able to split files intelligently
during any multi-file compactor like stripe or level.

This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

View raw message