hive-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Ferdinand Xu (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HIVE-9284) The hdfsEncryptionShim does not handle the relative path well based on hadoop 2.6
Date Wed, 07 Jan 2015 07:17:35 GMT

    [ https://issues.apache.org/jira/browse/HIVE-9284?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14267351#comment-14267351
] 

Ferdinand Xu commented on HIVE-9284:
------------------------------------

Stack is as follows:
2015-01-07 12:50:38,565 ERROR [HiveServer2-Background-Pool: Thread-42]: exec.Task (SessionState.java:printError(857))
- Failed with exception Pathname target/warehouse/dest4.out from target/warehouse/dest4.out
is not a valid DFS filename.
java.lang.IllegalArgumentException: Pathname target/warehouse/dest4.out from target/warehouse/dest4.out
is not a valid DFS filename.
        at org.apache.hadoop.hdfs.DistributedFileSystem.getPathName(DistributedFileSystem.java:196)
        at org.apache.hadoop.hdfs.DistributedFileSystem.getEZForPath(DistributedFileSystem.java:1906)
        at org.apache.hadoop.hdfs.client.HdfsAdmin.getEncryptionZoneForPath(HdfsAdmin.java:262)
        at org.apache.hadoop.hive.shims.Hadoop23Shims$HdfsEncryptionShim.isPathEncrypted(Hadoop23Shims.java:1005)
        at org.apache.hadoop.hive.ql.metadata.Hive.moveFile(Hive.java:2418)
        at org.apache.hadoop.hive.ql.exec.MoveTask.moveFile(MoveTask.java:105)
        at org.apache.hadoop.hive.ql.exec.MoveTask.execute(MoveTask.java:222)
        at org.apache.hadoop.hive.ql.exec.Task.executeTask(Task.java:160)
        at org.apache.hadoop.hive.ql.exec.TaskRunner.runSequential(TaskRunner.java:88)
        at org.apache.hadoop.hive.ql.Driver.launchTask(Driver.java:1633)
        at org.apache.hadoop.hive.ql.Driver.execute(Driver.java:1392)
        at org.apache.hadoop.hive.ql.Driver.runInternal(Driver.java:1179)
        at org.apache.hadoop.hive.ql.Driver.run(Driver.java:1045)
        at org.apache.hadoop.hive.ql.Driver.run(Driver.java:1040)
        at org.apache.hive.service.cli.operation.SQLOperation.runQuery(SQLOperation.java:145)
        at org.apache.hive.service.cli.operation.SQLOperation.access$100(SQLOperation.java:70)
        at org.apache.hive.service.cli.operation.SQLOperation$1$1.run(SQLOperation.java:197)
        at java.security.AccessController.doPrivileged(Native Method)
        at javax.security.auth.Subject.doAs(Subject.java:

> The hdfsEncryptionShim does not handle the relative path well based on hadoop 2.6
> ---------------------------------------------------------------------------------
>
>                 Key: HIVE-9284
>                 URL: https://issues.apache.org/jira/browse/HIVE-9284
>             Project: Hive
>          Issue Type: Sub-task
>            Reporter: Ferdinand Xu
>            Assignee: Ferdinand Xu
>             Fix For: encryption-branch
>
>
> The method isPathEncrypted is not able to handle the relative path.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message