hive-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Mithun Radhakrishnan (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (HIVE-3938) Hive MetaStore should send a single AddPartitionEvent for atomically added partition-set.
Date Mon, 06 May 2013 02:04:15 GMT

     [ https://issues.apache.org/jira/browse/HIVE-3938?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Mithun Radhakrishnan updated HIVE-3938:
---------------------------------------

    Attachment: Hive-3938-Support_for_Multi-table-insert.patch

Modified AddPartitionEvent to support multi-table-insert. Partitions added to multiple-tables
atomically are now specified in the same event.

I've also combined the changes to HCatalog-609 herewith (since we're in the same code-base).
HCatalog's NotificationListener continues to notify only per-table events. So each AddPartitionEvent
has potential to launch multiple JMS Notifications, with multi-table inserts.
                
> Hive MetaStore should send a single AddPartitionEvent for atomically added partition-set.
> -----------------------------------------------------------------------------------------
>
>                 Key: HIVE-3938
>                 URL: https://issues.apache.org/jira/browse/HIVE-3938
>             Project: Hive
>          Issue Type: Bug
>          Components: Metastore
>    Affects Versions: 0.10.0
>            Reporter: Mithun Radhakrishnan
>            Assignee: Mithun Radhakrishnan
>         Attachments: Hive-3938-Support_for_Multi-table-insert.patch
>
>
> HiveMetaStore::add_partitions() currently adds all partitions specified in one call using
a single meta-store transaction. This acts correctly. However, there's one AddPartitionEvent
created per partition specified.
> Ideally, the set of partitions added atomically can be communicated using a single AddPartitionEvent,
such that they are consumed together.
> I'll post a patch that does this.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

Mime
View raw message