hive-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Prasanth Jayachandran (JIRA)" <j...@apache.org>
Subject [jira] [Created] (HIVE-12450) OrcFileMergeOperator does not use correct compression buffer size
Date Wed, 18 Nov 2015 01:09:10 GMT
Prasanth Jayachandran created HIVE-12450:
--------------------------------------------

             Summary: OrcFileMergeOperator does not use correct compression buffer size
                 Key: HIVE-12450
                 URL: https://issues.apache.org/jira/browse/HIVE-12450
             Project: Hive
          Issue Type: Bug
    Affects Versions: 1.2.1, 1.2.0, 1.3.0, 2.0.0
            Reporter: Prasanth Jayachandran
            Assignee: Prasanth Jayachandran


OrcFileMergeOperator checks for compatibility before merging orc files. This compatibility
check include checking compression buffer size. But the output file that is created does not
honor the compression buffer size and always defaults to 256KB. This will not be a problem
when reading the orc file but can create unwanted memory pressure because of wasted space
within compression buffer.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message