Return-Path: X-Original-To: apmail-hbase-issues-archive@www.apache.org Delivered-To: apmail-hbase-issues-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 5C10510977 for ; Mon, 12 May 2014 07:54:15 +0000 (UTC) Received: (qmail 87225 invoked by uid 500); 12 May 2014 07:54:15 -0000 Delivered-To: apmail-hbase-issues-archive@hbase.apache.org Received: (qmail 87181 invoked by uid 500); 12 May 2014 07:54:15 -0000 Mailing-List: contact issues-help@hbase.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Delivered-To: mailing list issues@hbase.apache.org Received: (qmail 87172 invoked by uid 99); 12 May 2014 07:54:15 -0000 Received: from arcas.apache.org (HELO arcas.apache.org) (140.211.11.28) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 12 May 2014 07:54:15 +0000 Date: Mon, 12 May 2014 07:54:15 +0000 (UTC) From: "Andrew Purtell (JIRA)" To: issues@hbase.apache.org Message-ID: In-Reply-To: References: Subject: [jira] [Commented] (HBASE-1197) IPC of large cells should transfer in chunks not via naive full copy MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 [ https://issues.apache.org/jira/browse/HBASE-1197?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13994910#comment-13994910 ] Andrew Purtell commented on HBASE-1197: --------------------------------------- This issue was particular to something I was working on a while back. :-) It was the wild west. Today I would break up content destined for large cells into smaller values and keep metadata around to reconstruct, or store in HDFS and put the path into HBase instead. bq. May be this jira is partially superseded by the ones on of the offheap stuff? We could get some code reuse, depending. But that work doesn't have any provision for clients and servers being smart enough to break up a large cell into "packets". I was thinking resolving as 'Not A Problem' or 'Later' given storing large cells is discouraged. > IPC of large cells should transfer in chunks not via naive full copy > -------------------------------------------------------------------- > > Key: HBASE-1197 > URL: https://issues.apache.org/jira/browse/HBASE-1197 > Project: HBase > Issue Type: Improvement > Reporter: Andrew Purtell > > Several instances of OOME when trying to serve up large cells to clients have been observed. IPC should send large cell content in chunks instead of as one large naive copy. -- This message was sent by Atlassian JIRA (v6.2#6252)