hbase-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Hudson (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HBASE-3474) HFileOutputFormat to use column family's compression algorithm
Date Fri, 25 Mar 2011 23:11:06 GMT

    [ https://issues.apache.org/jira/browse/HBASE-3474?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13011479#comment-13011479

Hudson commented on HBASE-3474:

Integrated in HBase-TRUNK #1814 (See [https://hudson.apache.org/hudson/job/HBase-TRUNK/1814/])

> HFileOutputFormat to use column family's compression algorithm
> --------------------------------------------------------------
>                 Key: HBASE-3474
>                 URL: https://issues.apache.org/jira/browse/HBASE-3474
>             Project: HBase
>          Issue Type: Improvement
>          Components: mapreduce
>    Affects Versions: 0.92.0
>         Environment: All
>            Reporter: Ashish Shinde
>             Fix For: 0.92.0
>         Attachments: hbase-3474.txt, hbase-3474.txt, patch3474.txt, patch3474.txt, patch3474.txt
>   Original Estimate: 48h
>  Remaining Estimate: 48h
> HFileOutputFormat  currently creates HFile writer's using a compression algorithm set
as configuration "hbase.hregion.max.filesize" with default as no compression. The code does
not take into account the compression algorithm configured for the table's column family.
 As a result bulk uploaded tables are not compressed until a major compaction is run on them.
This could be fixed by using the column family descriptors while creating HFile writers.

This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

View raw message