hbase-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Andrew Purtell (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HBASE-1197) IPC of large cells should transfer in chunks not via naive full copy
Date Mon, 12 May 2014 07:54:15 GMT

    [ https://issues.apache.org/jira/browse/HBASE-1197?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13994910#comment-13994910
] 

Andrew Purtell commented on HBASE-1197:
---------------------------------------

This issue was particular to something I was working on a while back. :-) It was the wild
west. Today I would break up content destined for large cells into smaller values and keep
metadata around to reconstruct, or store in HDFS and put the path into HBase instead. 

bq. May be this jira is partially superseded by the ones on of the offheap stuff?

We could get some code reuse, depending. But that work doesn't have any provision for clients
and servers being smart enough to break up a large cell into "packets".  I was thinking resolving
as 'Not A Problem' or 'Later' given storing large cells is discouraged. 

> IPC of large cells should transfer in chunks not via naive full copy
> --------------------------------------------------------------------
>
>                 Key: HBASE-1197
>                 URL: https://issues.apache.org/jira/browse/HBASE-1197
>             Project: HBase
>          Issue Type: Improvement
>            Reporter: Andrew Purtell
>
> Several instances of OOME when trying to serve up large cells to clients have been observed.
IPC should send large cell content in chunks instead of as one large naive copy. 



--
This message was sent by Atlassian JIRA
(v6.2#6252)

Mime
View raw message