hbase-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Andrew Purtell (JIRA)" <j...@apache.org>
Subject [jira] Commented: (HBASE-1197) IPC of large cells should transfer in chunks not via naive full copy
Date Thu, 12 Feb 2009 09:07:59 GMT

    [ https://issues.apache.org/jira/browse/HBASE-1197?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12672922#action_12672922
] 

Andrew Purtell commented on HBASE-1197:
---------------------------------------

I wonder if storing Web content into HBase isn't a canonical use case. Certainly the Heritrix
hbase-writer makes it easy enough. The example Bigtable schema on the HBase Architecture page
implies a use case of storing views of Web data snapshotted over time. Podcasts and large
software packages can exceed 100MB. They are outliers certainly but with the current scheme
where they are copied multiple times on the heap it is not only inefficient but also occasionally
fatal via OOME.

> IPC of large cells should transfer in chunks not via naive full copy
> --------------------------------------------------------------------
>
>                 Key: HBASE-1197
>                 URL: https://issues.apache.org/jira/browse/HBASE-1197
>             Project: Hadoop HBase
>          Issue Type: Sub-task
>            Reporter: Andrew Purtell
>             Fix For: 0.20.0
>
>
> Several instances of OOME when trying to serve up large cells to clients have been observed.
IPC should send large cell content in chunks instead of as one large naive copy. 

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


Mime
View raw message