hive-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "ASF GitHub Bot (Jira)" <j...@apache.org>
Subject [jira] [Work logged] (HIVE-23467) Add a skip.trash config for HMS to skip trash when deleting external table data
Date Wed, 17 Jun 2020 19:12:00 GMT

     [ https://issues.apache.org/jira/browse/HIVE-23467?focusedWorklogId=447466&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-447466
]

ASF GitHub Bot logged work on HIVE-23467:
-----------------------------------------

                Author: ASF GitHub Bot
            Created on: 17/Jun/20 19:11
            Start Date: 17/Jun/20 19:11
    Worklog Time Spent: 10m 
      Work Description: nrg4878 commented on pull request #1133:
URL: https://github.com/apache/hive/pull/1133#issuecomment-645567880


   so if the goal is to deprecate "external.table.purge" going forward in favor of "external.table.autodelete",
can we remove all the current references in the code as well and convert them to the new property.
so all the new tables should be creating using the new property.


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


Issue Time Tracking
-------------------

    Worklog Id:     (was: 447466)
    Time Spent: 20m  (was: 10m)

> Add a skip.trash config for HMS to skip trash when deleting external table data
> -------------------------------------------------------------------------------
>
>                 Key: HIVE-23467
>                 URL: https://issues.apache.org/jira/browse/HIVE-23467
>             Project: Hive
>          Issue Type: Improvement
>          Components: Hive
>            Reporter: Sam An
>            Assignee: Yu-Wen Lai
>            Priority: Trivial
>              Labels: pull-request-available
>          Time Spent: 20m
>  Remaining Estimate: 0h
>
> We have an auto.purge flag, which means skip trash. It can be confusing as we have 'external.table.purge'='true'
to indicate delete table data when this tblproperties is set. 
> We should make the meaning clearer by introducing a skip trash alias/option. 
> Additionally, we shall add an alias for external.table.purge, and name it external.table.autodelete,
and document it more prominently, so as to maintain backward compatibility, and make the meaning
of auto deletion of data more obvious. 
> The net effect of these 2 changes will be. If the user sets 
> 'external.table.autodelete'='true'
> the table data will be removed when table is dropped. and if 
> 'skip.trash'='true' 
> is set, HMS will not move the table data to trash folder when removing the files. This
will result in faster removal, especially when underlying FS is S3. 



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

Mime
View raw message