pig-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Sushanth Sowmyan (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (PIG-5079) HCatalog - overwrite
Date Tue, 03 Jan 2017 22:17:58 GMT

    [ https://issues.apache.org/jira/browse/PIG-5079?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15796371#comment-15796371
] 

Sushanth Sowmyan commented on PIG-5079:
---------------------------------------

The change was made on HCatalog to be consistent with how hive works, to append-by-default.
To make it overwrite instead, you will need to set a TBLPROPERTIES on the hive table in question,
to set "immutable"="true". If you do this, all "inserts" into the table(for unptn table) or
partitions in the table (for ptned tables), whether they be from hive or hcatalog will overwrite
instead.

> HCatalog - overwrite
> --------------------
>
>                 Key: PIG-5079
>                 URL: https://issues.apache.org/jira/browse/PIG-5079
>             Project: Pig
>          Issue Type: Improvement
>          Components: build, data
>    Affects Versions: 0.15.0
>            Reporter: Praveen PentaReddy
>            Priority: Minor
>
> In HCatalog, i am using hive table and doing transformation and after completing the
transformation i want to overwrite the data back to the same hive table.however, while writing
back the data to the same table, the transformed data is getting appended rather not getting
overwrite.
> It would be good if we have option like overwrite so that if need we can use overwrite
or append as we have this kind of feature in hive while importing the data into a hive table.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message