hive-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Chaoyu Tang (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HIVE-12365) Added resource path is sent to cluster as an empty string when externally removed
Date Sat, 07 Nov 2015 23:16:10 GMT

    [ https://issues.apache.org/jira/browse/HIVE-12365?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14995446#comment-14995446
] 

Chaoyu Tang commented on HIVE-12365:
------------------------------------

testAddJarDataNucleusUnCaching failure could not be reproduced. The three failures are not
related to this patch.

> Added resource path is sent to cluster as an empty string when externally removed
> ---------------------------------------------------------------------------------
>
>                 Key: HIVE-12365
>                 URL: https://issues.apache.org/jira/browse/HIVE-12365
>             Project: Hive
>          Issue Type: Bug
>          Components: Hive
>    Affects Versions: 1.2.1
>            Reporter: Chaoyu Tang
>            Assignee: Chaoyu Tang
>         Attachments: HIVE-12365.patch, HIVE-12365.patch
>
>
> Sometimes the resources (e.g. jar) added via command like "add jars <filepath>"
are removed externally from their filepath for some reasons. Their paths are sent to cluster
as empty strings which causes the failures to the query that even do not need these jars in
execution. The error look like as following:
> {code}
> 15/11/06 21:56:44 INFO mapreduce.JobSubmitter: Cleaning up the staging area file:/tmp/hadoop-ctang/mapred/staging/ctang734817191/.staging/job_local734817191_0003
> java.lang.IllegalArgumentException: Can not create a Path from an empty string
> 	at org.apache.hadoop.fs.Path.checkPathArg(Path.java:127)
> 	at org.apache.hadoop.fs.Path.<init>(Path.java:135)
> 	at org.apache.hadoop.mapreduce.JobSubmitter.copyAndConfigureFiles(JobSubmitter.java:215)
> 	at org.apache.hadoop.mapreduce.JobSubmitter.copyAndConfigureFiles(JobSubmitter.java:390)
> 	at org.apache.hadoop.mapreduce.JobSubmitter.submitJobInternal(JobSubmitter.java:483)
> 	at org.apache.hadoop.mapreduce.Job$10.run(Job.java:1296)
> 	at org.apache.hadoop.mapreduce.Job$10.run(Job.java:1293)
> 	at java.security.AccessController.doPrivileged(Native Method)
> 	at javax.security.auth.Subject.doAs(Subject.java:415)
> 	at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1628)
> 	at org.apache.hadoop.mapreduce.Job.submit(Job.java:1293)
> {code}



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message