hive-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Dong Chen (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (HIVE-9490) [Parquet] Support Alter Table/Partition Concatenate
Date Wed, 28 Jan 2015 02:41:34 GMT

     [ https://issues.apache.org/jira/browse/HIVE-9490?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Dong Chen updated HIVE-9490:
----------------------------
    Attachment: HIVE-9490.patch-testcase

Add a test for parquet alter table/partition merge. Will update patch with fixing later.

> [Parquet] Support Alter Table/Partition Concatenate
> ---------------------------------------------------
>
>                 Key: HIVE-9490
>                 URL: https://issues.apache.org/jira/browse/HIVE-9490
>             Project: Hive
>          Issue Type: Sub-task
>            Reporter: Dong Chen
>            Assignee: Dong Chen
>         Attachments: HIVE-9490.patch-testcase
>
>
> Parquet should support 
> {{ALTER TABLE table_name \[PARTITION (partition_key = 'partition_value')\] CONCATENATE;}}
> If the table or partition contains many small Parquet files, then the above command will
merge them into larger files. The merge should happen at row group level thereby avoiding
the overhead of decompressing and decoding the data. 
> It is only supported by RCFiles or ORCFiles now.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message