Return-Path: X-Original-To: apmail-hbase-issues-archive@www.apache.org Delivered-To: apmail-hbase-issues-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id C7814F9F3 for ; Wed, 17 Jul 2013 06:24:51 +0000 (UTC) Received: (qmail 87035 invoked by uid 500); 17 Jul 2013 06:24:51 -0000 Delivered-To: apmail-hbase-issues-archive@hbase.apache.org Received: (qmail 86943 invoked by uid 500); 17 Jul 2013 06:24:51 -0000 Mailing-List: contact issues-help@hbase.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Delivered-To: mailing list issues@hbase.apache.org Received: (qmail 86834 invoked by uid 99); 17 Jul 2013 06:24:50 -0000 Received: from arcas.apache.org (HELO arcas.apache.org) (140.211.11.28) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 17 Jul 2013 06:24:50 +0000 Date: Wed, 17 Jul 2013 06:24:50 +0000 (UTC) From: "Harsh J (JIRA)" To: issues@hbase.apache.org Message-ID: In-Reply-To: References: Subject: [jira] [Commented] (HBASE-3732) New configuration option for client-side compression MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 [ https://issues.apache.org/jira/browse/HBASE-3732?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13710773#comment-13710773 ] Harsh J commented on HBASE-3732: -------------------------------- Pradeep, Does Stack's comment not address your need? bq. You can achieve compression of KVs via other means now, by specifying client should do a compressioncodec on cellblocks on set up of connection. > New configuration option for client-side compression > ---------------------------------------------------- > > Key: HBASE-3732 > URL: https://issues.apache.org/jira/browse/HBASE-3732 > Project: HBase > Issue Type: New Feature > Reporter: Jean-Daniel Cryans > Attachments: compressed_streams.jar > > > We have a case here where we have to store very fat cells (arrays of integers) which can amount into the hundreds of KBs that we need to read often, concurrently, and possibly keep in cache. Compressing the values on the client using java.util.zip's Deflater before sending them to HBase proved to be in our case almost an order of magnitude faster. > There reasons are evident: less data sent to hbase, memstore contains compressed data, block cache contains compressed data too, etc. > I was thinking that it might be something useful to add to a family schema, so that Put/Result do the conversion for you. The actual compression algo should also be configurable. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira