hbase-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "stack (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HBASE-12282) Ensure Cells and its implementations work with Buffers also
Date Tue, 21 Oct 2014 16:49:34 GMT

    [ https://issues.apache.org/jira/browse/HBASE-12282?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14178619#comment-14178619

stack commented on HBASE-12282:

bq. BBs may have more index and position management internally. BR may come handy here.

What you thinking here?

bq.  Can our HFileBlock be bigger than that?

2G is max? int?  Else we need to do aggregate of BBs.

Thanks for posting patch.  Looking at the Cell changes, my immediate thought is that a BB-backed
Cell is just a particular implementation of Cell but I think what we are finding is that we
are bumping into limitations of a byte-array only based Cell; it won't work if the Cell references
DBBs?  Is that what you fellas are seeing?  And what about BR?  Where does it fall down? 
What are limitations of BR over a BB.

Can we write up a doc?  It is hard to keep account of all the issues around off-heaping at
this stage.  Doc could be an offheap read-path and/or an off-heap write-path?

Good work lads.

> Ensure Cells and its implementations work with Buffers also
> -----------------------------------------------------------
>                 Key: HBASE-12282
>                 URL: https://issues.apache.org/jira/browse/HBASE-12282
>             Project: HBase
>          Issue Type: Sub-task
>          Components: regionserver, Scanners
>    Affects Versions: 0.99.1
>            Reporter: ramkrishna.s.vasudevan
>            Assignee: ramkrishna.s.vasudevan
>             Fix For: 2.0.0, 0.99.2
>         Attachments: HBASE-12224_2.patch
> This issue can be used to brainstorm and then do the necessary changes for the offheap
work.  All impl of cells deal with byte[] but when we change the Hfileblocks/Readers to work
purely with Buffers then the byte[] usage would mean that always the data is copied to the
onheap.  Cell may need some interface change to implement this.

This message was sent by Atlassian JIRA

View raw message