hadoop-common-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Steve Loughran (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HADOOP-13372) MR jobs can not access Swift filesystem if Kerberos is enabled
Date Thu, 14 Jul 2016 09:17:20 GMT

    [ https://issues.apache.org/jira/browse/HADOOP-13372?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15376646#comment-15376646
] 

Steve Loughran commented on HADOOP-13372:
-----------------------------------------

Patch seems reasonable, what s3 and s3a do (not azure, interestingly)

Because Jenkins doesn't test any of the object stores, we have to push a bit more work onto
everyone submitting patches for them.

Can you follow the instructions here and tell is which swift infrastructure you tested against?
If its local, just the OS and openstack versions. We have the rule to make sure everyone does
a full test run themselves
https://wiki.apache.org/hadoop/HowToContribute#Submitting_patches_against_object_stores_such_as_Amazon_S3.2C_OpenStack_Swift_and_Microsoft_Azure

> MR jobs can not access Swift filesystem if Kerberos is enabled
> --------------------------------------------------------------
>
>                 Key: HADOOP-13372
>                 URL: https://issues.apache.org/jira/browse/HADOOP-13372
>             Project: Hadoop Common
>          Issue Type: Bug
>          Components: fs, fs/swift, security
>            Reporter: ramtin
>         Attachments: HADOOP-13372.001.patch
>
>
> java.lang.IllegalArgumentException: java.net.UnknownHostException:
>     at org.apache.hadoop.security.SecurityUtil.buildTokenService(SecurityUtil.java:378)
>     at org.apache.hadoop.security.SecurityUtil.buildDTServiceName(SecurityUtil.java:262)
>     at org.apache.hadoop.fs.FileSystem.getCanonicalServiceName(FileSystem.java:303)
>     at org.apache.hadoop.fs.FileSystem.collectDelegationTokens(FileSystem.java:524)
>     at org.apache.hadoop.fs.FileSystem.addDelegationTokens(FileSystem.java:508)
>     at org.apache.hadoop.mapreduce.security.TokenCache.obtainTokensForNamenodesInternal(TokenCache.java:121)
>     at org.apache.hadoop.mapreduce.security.TokenCache.obtainTokensForNamenodesInternal(TokenCache.java:100)
>     at org.apache.hadoop.mapreduce.security.TokenCache.obtainTokensForNamenodes(TokenCache.java:80)
>     at org.apache.hadoop.tools.mapred.CopyOutputFormat.checkOutputSpecs(CopyOutputFormat.java:121)
>     at org.apache.hadoop.mapreduce.JobSubmitter.checkSpecs(JobSubmitter.java:266)
>     at org.apache.hadoop.mapreduce.JobSubmitter.submitJobInternal(JobSubmitter.java:139)
>     at org.apache.hadoop.mapreduce.Job$10.run(Job.java:1290)
>     at org.apache.hadoop.mapreduce.Job$10.run(Job.java:1287)
>     at java.security.AccessController.doPrivileged(Native Method)
>     at javax.security.auth.Subject.doAs(Subject.java:422)
>     at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1657)
>     at org.apache.hadoop.mapreduce.Job.submit(Job.java:1287)
>     at org.apache.hadoop.tools.DistCp.createAndSubmitJob(DistCp.java:183)
>     at org.apache.hadoop.tools.DistCp.execute(DistCp.java:153)
>     at org.apache.hadoop.tools.DistCp.run(DistCp.java:126)
>     at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:70)
>     at org.apache.hadoop.tools.DistCp.main(DistCp.java:430)
> Caused by: java.net.UnknownHostException:



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: common-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: common-issues-help@hadoop.apache.org


Mime
View raw message