hive-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Brock Noland (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HIVE-7858) Parquet compression should be configurable via table property
Date Wed, 05 Nov 2014 16:51:35 GMT

    [ https://issues.apache.org/jira/browse/HIVE-7858?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14198635#comment-14198635
] 

Brock Noland commented on HIVE-7858:
------------------------------------

Hi,

This change doesn't really have anything to do with internal or external tables. Parquet stores
the compression algo used in the footer as such it's possible to have a mix of snappy, gzip,
etc compression types within the same table. This change was to allow users to say "when I
insert overwrite this table, I want to use compression format x". Before this change they
could only use the global setting at a session or hive-site.xml level.

> Parquet compression should be configurable via table property
> -------------------------------------------------------------
>
>                 Key: HIVE-7858
>                 URL: https://issues.apache.org/jira/browse/HIVE-7858
>             Project: Hive
>          Issue Type: Improvement
>            Reporter: Brock Noland
>            Assignee: Ferdinand Xu
>              Labels: TODOC15
>             Fix For: 0.15.0
>
>         Attachments: HIVE-7858.1.patch, HIVE-7858.patch, HIVE-7858.patch
>
>
> ORC supports the orc.compress table property:
> https://cwiki.apache.org/confluence/display/Hive/LanguageManual+ORC
> {noformat}
> create table Addresses (
>   name string,
>   street string,
>   city string,
>   state string,
>   zip int
> ) stored as orc tblproperties ("orc.compress"="NONE");
> {noformat}
> I think it'd be great to support the same for Parquet.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message