hbase-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Andrew Purtell (JIRA)" <j...@apache.org>
Subject [jira] [Resolved] (HBASE-2655) 2-pass compression support
Date Sun, 08 Jun 2014 21:59:02 GMT

     [ https://issues.apache.org/jira/browse/HBASE-2655?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel

Andrew Purtell resolved HBASE-2655.

    Resolution: Won't Fix

Stale issue. Reopen if still relevant (if there's new activity)

> 2-pass compression support
> --------------------------
>                 Key: HBASE-2655
>                 URL: https://issues.apache.org/jira/browse/HBASE-2655
>             Project: HBase
>          Issue Type: New Feature
>          Components: io
>            Reporter: Michele Catasta
>            Priority: Minor
>         Attachments: HBASE-2655.patch
> Quoting from BigTable paper: "Many clients use a two-pass custom compression scheme.
The first pass uses Bentley and McIlroy's scheme, which compresses long common strings across
a large window. The second pass uses a fast compression algorithm that looks for repetitions
in a small 16 KB window of the data. Both compression passes are very fast—they encode at
100-200 MB/s, and decode at 400-1000 MB/s on modern machines."
> The goal of this patch is to integrate a similar compression scheme in HBase.

This message was sent by Atlassian JIRA

View raw message