hive-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Sushanth Sowmyan (JIRA)" <>
Subject [jira] [Commented] (HIVE-5504) OrcOutputFormat honors compression properties only from within hive
Date Thu, 13 Feb 2014 21:12:24 GMT


Sushanth Sowmyan commented on HIVE-5504:

Yeah, some parameters that were depended upon in OrcFile moved to HiveConf, so at the very
least, this patch requires regeneration.

One good thing at least is that OrcOutputFormat itself did not change, so that is still an
easy merge.

The one weird thing is that HIVE-5728 introduces logic to override the default behaviour using
hive-site.xml based parameters, and removes certain default parameters from OrcFile. We need
to change this patch to respect that.

> OrcOutputFormat honors  compression  properties only from within hive
> ---------------------------------------------------------------------
>                 Key: HIVE-5504
>                 URL:
>             Project: Hive
>          Issue Type: Bug
>          Components: HCatalog
>    Affects Versions: 0.11.0, 0.12.0
>            Reporter: Venkat Ranganathan
>            Assignee: Sushanth Sowmyan
>         Attachments: HIVE-5504.patch
> When we import data into a HCatalog table created with the following storage  description
> .. stored as orc tblproperties ("orc.compress"="SNAPPY") 
> the resultant orc file still uses the default zlib compression
> It looks like HCatOutputFormat is ignoring the tblproperties specified.   show tblproperties
shows that the table indeed has the properties properly saved.
> An insert/select into the table has the resulting orc file honor the tbl property.

This message was sent by Atlassian JIRA

View raw message