hive-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Sergey Shelukhin (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HIVE-6256) add batch dropping of partitions to Hive metastore (as well as to dropTable)
Date Tue, 04 Feb 2014 01:23:08 GMT

    [ https://issues.apache.org/jira/browse/HIVE-6256?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13890245#comment-13890245
] 

Sergey Shelukhin commented on HIVE-6256:
----------------------------------------

Oh. this patch incorporates heavily changed HIVE-6342. The approach used is sending expressions
to metastore. Unfortunately, to populate results if semantic analyzer (which seems to be of
dubious value) we still need to fetch partitions from client also.
Also, JDO requires fetching objects to delete them, which is sad... we may need to do followup
patch to do direct SQL deletes, but that may not be safe wrt other code going thru DN.

> add batch dropping of partitions to Hive metastore (as well as to dropTable)
> ----------------------------------------------------------------------------
>
>                 Key: HIVE-6256
>                 URL: https://issues.apache.org/jira/browse/HIVE-6256
>             Project: Hive
>          Issue Type: Improvement
>          Components: Metastore
>            Reporter: Sergey Shelukhin
>            Assignee: Sergey Shelukhin
>            Priority: Minor
>         Attachments: HIVE-6256.nogen.patch, HIVE-6256.patch
>
>
> Metastore drop partitions call drops one partition; when many are being dropped this
can be slow. Partitions could be dropped in batch instead, if multiple are dropped via one
command. Drop table can also use that.



--
This message was sent by Atlassian JIRA
(v6.1.5#6160)

Mime
View raw message