hive-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Sushanth Sowmyan (JIRA)" <>
Subject [jira] [Updated] (HIVE-6475) Implement support for appending to mutable tables in HCatalog
Date Thu, 20 Feb 2014 19:35:20 GMT


Sushanth Sowmyan updated HIVE-6475:

    Release Note: 
Introduces append feature for HCatalog writes.

Previously, if an unpartitioned table had data in it, or if a partition in a partitioned table
had data in it, or if the partition even existed, HCat would fail if a user attempted to write
to them. Now, that behaviour is extended so that the strict behaviour exists only if the table
in question has a parameter "immutable" set to "true" (see HIVE-6406).

With this patch, we can append to existing partitions or non-partitioned tables that already
have data in them, as long as the new data being written is compatible to the old data (i.e.
one cannot mix fileformats when attempting an append)

As a further note, append is currently not compatible with dynamic partitioning, and a dynamic
partitioning job is still unable to append to a table, even if it is a mutable table.
          Status: Patch Available  (was: Open)

> Implement support for appending to mutable tables in HCatalog
> -------------------------------------------------------------
>                 Key: HIVE-6475
>                 URL:
>             Project: Hive
>          Issue Type: Sub-task
>          Components: HCatalog, Metastore, Query Processor, Thrift API
>            Reporter: Sushanth Sowmyan
>            Assignee: Sushanth Sowmyan
>         Attachments: HIVE-6475.patch
> Part of HIVE-6405, this is the implementation of the append feature on the HCatalog side.
If a table is mutable, we must support being able to append to existing data instead of erroring
out as  a duplicate publish.

This message was sent by Atlassian JIRA

View raw message