hbase-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Stack <st...@duboce.net>
Subject Re: Bulk upload an LZO compression
Date Mon, 24 Jan 2011 17:50:37 GMT
In HFileOutputFormat it says this near top:

    // Invented config.  Add to hbase-*.xml if other than default compression.
    final String compression = conf.get("hfile.compression",
      Compression.Algorithm.NONE.getName());

You might try messing with this config?

St.Ack

On Sun, Jan 23, 2011 at 9:38 PM, Ashish Shinde <ashish@strandls.com> wrote:
> Hi,
>
> I have been importing data to hbase 0.90.0 using the code from the bulk
> uploader (ImportTsv.java). The table has LZO compression set, however
> unless major compaction is run the table it does not get compressed.
>
> Is there a way to compress the table as the bulk uploader creates the
> HFile. This is important for us because we don't want to have a burst
> increase in our disk usage.
>
> Thanks and regards,
>  - Ashish
>

Mime
View raw message