orc-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Gopal V (JIRA)" <j...@apache.org>
Subject [jira] [Created] (ORC-91) Use hdfs v-blocks instead of zero-padding stripes
Date Fri, 05 Aug 2016 23:45:20 GMT
Gopal V created ORC-91:
--------------------------

             Summary: Use hdfs v-blocks instead of zero-padding stripes
                 Key: ORC-91
                 URL: https://issues.apache.org/jira/browse/ORC-91
             Project: Orc
          Issue Type: Improvement
            Reporter: Gopal V


HDFS-3689 added variable length blocks to HDFS as a core feature.

hsync(SyncFlag.END_BLOCK) 

can now end an HDFS block on disk without padding it out with zeros. 

The current space wasted in ORC to padding is 5%.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message