hadoop-common-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Steve Loughran (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HADOOP-13372) MR jobs can not access Swift filesystem if Kerberos is enabled
Date Mon, 08 May 2017 09:22:04 GMT

    [ https://issues.apache.org/jira/browse/HADOOP-13372?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16000491#comment-16000491
] 

Steve Loughran commented on HADOOP-13372:
-----------------------------------------

I like the move; you should go back to assert. It's a bit confusing, but 

Assert: any exception fails the test
Assume: throws an AssumptionException which tells JUnit to report it as skipped. its how we
turn off tests which don't run on windows, if the object endpoint isn't set, etc. Using it
will stop failures being picked up.

I see the patch isn't applying. Try creating a patch against branch-2 & name the patch
file, "HADOOP-13372-branch-2-003.patch" to tell yetus which branch to apply against

thanks,

> MR jobs can not access Swift filesystem if Kerberos is enabled
> --------------------------------------------------------------
>
>                 Key: HADOOP-13372
>                 URL: https://issues.apache.org/jira/browse/HADOOP-13372
>             Project: Hadoop Common
>          Issue Type: Bug
>          Components: fs, fs/swift, security
>    Affects Versions: 2.7.2
>            Reporter: ramtin
>            Assignee: ramtin
>         Attachments: HADOOP-13372.001.patch, HADOOP-13372.002.patch
>
>
> {code}
> java.lang.IllegalArgumentException: java.net.UnknownHostException:
>     at org.apache.hadoop.security.SecurityUtil.buildTokenService(SecurityUtil.java:378)
>     at org.apache.hadoop.security.SecurityUtil.buildDTServiceName(SecurityUtil.java:262)
>     at org.apache.hadoop.fs.FileSystem.getCanonicalServiceName(FileSystem.java:303)
>     at org.apache.hadoop.fs.FileSystem.collectDelegationTokens(FileSystem.java:524)
>     at org.apache.hadoop.fs.FileSystem.addDelegationTokens(FileSystem.java:508)
>     at org.apache.hadoop.mapreduce.security.TokenCache.obtainTokensForNamenodesInternal(TokenCache.java:121)
>     at org.apache.hadoop.mapreduce.security.TokenCache.obtainTokensForNamenodesInternal(TokenCache.java:100)
>     at org.apache.hadoop.mapreduce.security.TokenCache.obtainTokensForNamenodes(TokenCache.java:80)
>     at org.apache.hadoop.tools.mapred.CopyOutputFormat.checkOutputSpecs(CopyOutputFormat.java:121)
>     at org.apache.hadoop.mapreduce.JobSubmitter.checkSpecs(JobSubmitter.java:266)
>     at org.apache.hadoop.mapreduce.JobSubmitter.submitJobInternal(JobSubmitter.java:139)
>     at org.apache.hadoop.mapreduce.Job$10.run(Job.java:1290)
>     at org.apache.hadoop.mapreduce.Job$10.run(Job.java:1287)
>     at java.security.AccessController.doPrivileged(Native Method)
>     at javax.security.auth.Subject.doAs(Subject.java:422)
>     at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1657)
>     at org.apache.hadoop.mapreduce.Job.submit(Job.java:1287)
>     at org.apache.hadoop.tools.DistCp.createAndSubmitJob(DistCp.java:183)
>     at org.apache.hadoop.tools.DistCp.execute(DistCp.java:153)
>     at org.apache.hadoop.tools.DistCp.run(DistCp.java:126)
>     at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:70)
>     at org.apache.hadoop.tools.DistCp.main(DistCp.java:430)
> Caused by: java.net.UnknownHostException:
> {code}



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

---------------------------------------------------------------------
To unsubscribe, e-mail: common-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: common-issues-help@hadoop.apache.org


Mime
View raw message