hive-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Stan Rosenberg (JIRA)" <>
Subject [jira] [Commented] (HIVE-6476) Support Append with Dynamic Partitioning
Date Tue, 06 Jan 2015 02:59:35 GMT


Stan Rosenberg commented on HIVE-6476:

It's been almost a year since last update.  Could someone please elaborate on what sort of
corner cases must be considered?  I would imagine that writing output of pig script into a
_mutable_ partitioned hive table is a fairly standard and quite required feature of hcatalog,
but perhaps I am missing something.

> Support Append with Dynamic Partitioning
> ----------------------------------------
>                 Key: HIVE-6476
>                 URL:
>             Project: Hive
>          Issue Type: Sub-task
>          Components: HCatalog, Metastore, Query Processor, Thrift API
>            Reporter: Sushanth Sowmyan
> Currently, we do not support mixing dynamic partitioning and append in the same job.
One reason is that we need exhaustive testing of corner cases for that, and a second reason
is the behaviour of add_partitions. To support dynamic partitioning with append, we'd have
to have a add_partitions_if_not_exist call, rather than an add_partitions call.
> Thus, the current implementation in HIVE-6475 assumes immutability for all dynamic partitioning
jobs, irrespective of whether or not the table is marked as mutable or not.

This message was sent by Atlassian JIRA

View raw message