hive-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Phabricator (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (HIVE-5220) Add option for removing intermediate directory for partition, which is empty
Date Thu, 05 Sep 2013 09:24:52 GMT

     [ https://issues.apache.org/jira/browse/HIVE-5220?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Phabricator updated HIVE-5220:
------------------------------

    Attachment: HIVE-5220.D12729.1.patch

navis requested code review of "HIVE-5220 [jira] Add option for removing intermediate directory
for partition, which is empty".

Reviewers: JIRA

HIVE-5220 Add option for removing intermediate directory for partition, which is empty

For deeply nested partitioned table, intermediate directories are not removed even if there
is no partitions in it by removing them.

/deep_part/c=09/d=01
/deep_part/c=09/d=01/e=01
/deep_part/c=09/d=01/e=02
/deep_part/c=09/d=02
/deep_part/c=09/d=02/e=01
/deep_part/c=09/d=02/e=02

After removing partition (c='09'), directory remains like this,

/deep_part/c=09/d=01
/deep_part/c=09/d=02

TEST PLAN
  EMPTY

REVISION DETAIL
  https://reviews.facebook.net/D12729

AFFECTED FILES
  common/src/java/org/apache/hadoop/hive/conf/HiveConf.java
  metastore/src/java/org/apache/hadoop/hive/metastore/HiveMetaStore.java
  metastore/src/java/org/apache/hadoop/hive/metastore/Warehouse.java

MANAGE HERALD RULES
  https://reviews.facebook.net/herald/view/differential/

WHY DID I GET THIS EMAIL?
  https://reviews.facebook.net/herald/transcript/30519/

To: JIRA, navis

                
> Add option for removing intermediate directory for partition, which is empty
> ----------------------------------------------------------------------------
>
>                 Key: HIVE-5220
>                 URL: https://issues.apache.org/jira/browse/HIVE-5220
>             Project: Hive
>          Issue Type: Improvement
>          Components: Query Processor
>            Reporter: Navis
>            Assignee: Navis
>            Priority: Minor
>         Attachments: HIVE-5220.D12729.1.patch
>
>
> For deeply nested partitioned table, intermediate directories are not removed even if
there is no partitions in it by removing them.
> {noformat}
> /deep_part/c=09/d=01
> /deep_part/c=09/d=01/e=01
> /deep_part/c=09/d=01/e=02
> /deep_part/c=09/d=02
> /deep_part/c=09/d=02/e=01
> /deep_part/c=09/d=02/e=02
> {noformat}
> After removing partition (c='09'), directory remains like this, 
> {noformat}
> /deep_part/c=09/d=01
> /deep_part/c=09/d=02
> {noformat}

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

Mime
View raw message