hive-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Sohan Jain" <sohanj...@fb.com>
Subject Review Request: HIVE-2219: Improve efficiency of dropping multiple partitions
Date Tue, 21 Jun 2011 23:40:05 GMT

-----------------------------------------------------------
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/941/
-----------------------------------------------------------

Review request for hive and Paul Yang.


Summary
-------

Improve the efficiency of the function that handles dropping multiple partitions by finding
the partitions to drop at the JDO level instead of iterating through all given partitions
and existing partitions.


This addresses bug HIVE-2219.
    https://issues.apache.org/jira/browse/HIVE-2219


Diffs
-----

  trunk/ql/src/java/org/apache/hadoop/hive/ql/exec/DDLTask.java 1138144 

Diff: https://reviews.apache.org/r/941/diff


Testing
-------

Still passes drop_multi_partitions.q.  Tested speed on dropping ~10k partitions in a table
with ~400k partitions.  This section of code took ~10 minutes after the change, and some amount
> 30 minutes before.


Thanks,

Sohan


Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message