hadoop-general mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Jean-Daniel Cryans <jdcry...@apache.org>
Subject Re: google snappy
Date Wed, 23 Mar 2011 17:03:21 GMT
(Please don't cross-post like that, it only adds confusion. I put
everything in bcc and posted to general instead)

Their README says the following:

Snappy usually is faster than algorithms in the same class (e.g. LZO,
LZF, FastLZ, QuickLZ, etc.) while achieving comparable compression
ratios.

Somebody obviously needs to publish some benchmarks, but knowing
Snappy's origin I can believe that claim.

Relevant jiras:

HADOOP-7206 Integrate Snappy compression
HBASE-3691   Add compressor support for 'snappy', google's compressor

J-D

On Wed, Mar 23, 2011 at 9:52 AM, Weishung Chung <weishung@gmail.com> wrote:
> Hey my fellow hadoop/hbase developers,
>
> I just came across this google compression/decompression package yesterday,
> could we make a good use of this compression scheme in hadoop? It's written
> in C++ though.
>
> http://code.google.com/p/snappy/
>
> <http://code.google.com/p/snappy/>I haven't looked close into this snappy
> package yet but i would love to know about the differences compared to LZO.
>
> Thank you,
> Wei Shung
>

Mime
View raw message