hbase-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Jean-Daniel Cryans <jdcry...@apache.org>
Subject Compressing values before inserting them
Date Mon, 04 Apr 2011 22:55:17 GMT
Hi users,

I just want to share a useful tip when storing very fat values into
HBase, we were able to get some of our MR jobs an order of magnitude
faster by simply using Java's Deflater and then passing the byte[] to
Put (and the equivalent when retrieving the values with Inflator). We
also use LZO compression on top of that.

I created this jira in order to ingrate that into HBase's client layer
as a configuration option for families:
https://issues.apache.org/jira/browse/HBASE-3732

Hope that can be useful to someone,

J-D

Mime
View raw message