hbase-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Ashish Shinde (JIRA)" <j...@apache.org>
Subject [jira] Updated: (HBASE-3474) HFileOutputFormat to use column family's compression algorithm
Date Fri, 28 Jan 2011 06:12:45 GMT

     [ https://issues.apache.org/jira/browse/HBASE-3474?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel

Ashish Shinde updated HBASE-3474:

    Attachment: patch3474.txt

Incorporated Todd's comments on javadoc and use of URL encoder for serializing family compression

> HFileOutputFormat to use column family's compression algorithm
> --------------------------------------------------------------
>                 Key: HBASE-3474
>                 URL: https://issues.apache.org/jira/browse/HBASE-3474
>             Project: HBase
>          Issue Type: Improvement
>          Components: mapreduce
>    Affects Versions: 0.92.0
>         Environment: All
>            Reporter: Ashish Shinde
>             Fix For: 0.92.0
>         Attachments: patch3474.txt, patch3474.txt
>   Original Estimate: 48h
>  Remaining Estimate: 48h
> HFileOutputFormat  currently creates HFile writer's using a compression algorithm set
as configuration "hbase.hregion.max.filesize" with default as no compression. The code does
not take into account the compression algorithm configured for the table's column family.
 As a result bulk uploaded tables are not compressed until a major compaction is run on them.
This could be fixed by using the column family descriptors while creating HFile writers.

This message is automatically generated by JIRA.
You can reply to this email to add a comment to the issue online.

View raw message