Mailing-List: contact issues-help@hbase.apache.org; run by ezmlm
Precedence: bulk
Message-ID: <32959579.133321275493182166.JavaMail.jira@thor>
Date: Wed, 2 Jun 2010 11:39:42 -0400 (EDT)
From: "Michele (@pirroh) Catasta (JIRA)" <jira@apache.org>
To: issues@hbase.apache.org
Subject: [jira] Commented: (HBASE-2655) 2-pass compression support
In-Reply-To: <9890646.131731275486459397.JavaMail.jira@thor>
MIME-Version: 1.0
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: quoted-printable


    [ https://issues.apache.org/jira/browse/HBASE-2655?page=3Dcom.atlassian=
.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=3D1287=
4616#action_12874616 ]=20

Michele (@pirroh) Catasta commented on HBASE-2655:
--------------------------------------------------

Right, {NAME=3D>'cfamily', COMPRESSION=3D>'BMZ'} will do the job.

w.r.t. runtime exception: at the moment, it's happening the same for LZO. I=
 just reproduced the behavior I found in that class *smile*
Default fallback to NONE might be an option as well, but it would let you c=
reate the table anyway - so people that are using hbase shell SCRIPT to cre=
ate tables might experience some regressions. Matter of tastes I'd say!
Anyway, if you agree on that I'll create another jira to deal with Compress=
ion.java and update this patch as well.


> 2-pass compression support
> --------------------------
>
>                 Key: HBASE-2655
>                 URL: https://issues.apache.org/jira/browse/HBASE-2655
>             Project: HBase
>          Issue Type: New Feature
>          Components: io
>            Reporter: Michele (@pirroh) Catasta
>            Priority: Minor
>             Fix For: 0.21.0
>
>         Attachments: HBASE-2655.diff
>
>
> Quoting from BigTable paper: "Many clients use a two-pass custom compress=
ion scheme. The first pass uses Bentley and McIlroy's scheme, which compres=
ses long common strings across a large window. The second pass uses a fast =
compression algorithm that looks for repetitions in a small 16 KB window of=
 the data. Both compression passes are very fast=E2=80=94they encode at 100=
-200 MB/s, and decode at 400-1000 MB/s on modern machines."
> The goal of this patch is to integrate a similar compression scheme in HB=
ase.

--=20
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.