hive-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Chaoyu Tang (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (HIVE-14909) Preserve the "parent location" of the table when an "alter table <table> rename to <newname>" is submitted (the case when the db location is not specified and the Hive defult db is outside the same encrypted zone).
Date Sat, 22 Oct 2016 04:02:59 GMT

     [ https://issues.apache.org/jira/browse/HIVE-14909?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Chaoyu Tang updated HIVE-14909:
-------------------------------
    Attachment: HIVE-14909.patch

All four new failed tests were caused by the errors like:
{code}
2016-10-21T19:08:51,810 ERROR [ccc0909e-6764-441b-9eee-10b73d4ca198 main] exec.DDLTask: org.apache.hadoop.hive.ql.metadata.HiveException:
Unable to alter table. java.lang.IllegalArgumentException: Can not create a Path from a null
string
	at org.apache.hadoop.hive.ql.metadata.Hive.alterTable(Hive.java:620)
	at org.apache.hadoop.hive.ql.exec.DDLTask.alterTable(DDLTask.java:3373)
	at org.apache.hadoop.hive.ql.exec.DDLTask.execute(DDLTask.java:376)
{code}
But interestingly, I was not able to reproduce the issue in my local env. 
Reattach the patch to kick off another run to see if they can be reproduced.

> Preserve the "parent location" of the table when an "alter table <table> rename
to <newname>" is submitted (the case when the db location is not specified and the Hive
defult db is outside the same encrypted zone).
> ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
>
>                 Key: HIVE-14909
>                 URL: https://issues.apache.org/jira/browse/HIVE-14909
>             Project: Hive
>          Issue Type: Improvement
>          Components: Hive
>    Affects Versions: 1.1.0
>            Reporter: Adriano
>            Assignee: Chaoyu Tang
>         Attachments: HIVE-14909.patch, HIVE-14909.patch
>
>
> Alter Table operation for db_enc.rename_test failed to move data due to: '/hdfs/encrypted_path/db_enc/rename_test
can't be moved from an encryption zone.'
> When Hive renames a managed table, it always creates the new renamed table directory
under its database directory in order to keep a db/table hierarchy. In this case, the renamed
table directory is created under "default db" directory "hive/warehouse/". When Hive renames
a managed table, it always creates the new renamed table directory under its database directory
in order to keep a db/table hierarchy. In this case, the renamed table directory is created
under "default' db directory typically set as /hive/warehouse/ . 
> This error doesn't appear if first create a database which points to a directory outside
/hive/warehouse/, say '/hdfs/encrypted_path', you won't have this problem. For example, 
> create database db_enc location '/hdfs/encrypted_path/db_enc; 
> use db_enc; 
> create table rename_test (...) location '/hdfs/encrypted_path/db_enc/rename_test'; 
> alter table rename_test rename to test_rename; 
> The renamed test_rename directory is created under /hdfs/encrypted_path/db_enc. 
> Considering that the encryption of a filesystem is part of the evolution hardening of
a system (where the system and the data contained can already exists) and a db can be already
created without location set (because it is not strictly required)and the default db is outside
the same encryption zone (or in a no-encryption zone) the alter table rename operation will
fail.
> Improvement:
> Preserve the "parent location" of the table when an "alter table <table> rename
to <newname>" is submitted (the case when the db location is not specified and the Hive
defult db is outside the same encrypted zone).



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message