hive-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Sohan Jain (JIRA)" <>
Subject [jira] [Updated] (HIVE-2219) Make "alter table drop partition" more efficient
Date Tue, 14 Jun 2011 21:08:47 GMT


Sohan Jain updated HIVE-2219:

    Attachment: HIVE-2219.1.patch

Improves the time it takes to check whether a partition to delete exists in the lists of partitions.
 Overall improves the complexity to _O(m + n)_

> Make "alter table drop partition" more efficient
> ------------------------------------------------
>                 Key: HIVE-2219
>                 URL:
>             Project: Hive
>          Issue Type: Improvement
>          Components: Query Processor
>            Reporter: Sohan Jain
>            Assignee: Sohan Jain
>         Attachments: HIVE-2219.1.patch
> The current function dropTable() that handles dropping multiple partitions is somewhat
inefficient.  For each partition you want to drop, it loops through each partition in the
table to see if the partition exists.  This is an _O(mn)_ operation, where _m_ is the number
of partitions to drop, and _n_ is the number of partitions in the table.  The running time
of this function can be improved, which is useful for tables with many partitions.

This message is automatically generated by JIRA.
For more information on JIRA, see:


View raw message