hadoop-hdfs-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Vijay Srinivasaraghavan (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HDFS-9213) Minicluster with Kerberos generates some stacks when checking the ports
Date Mon, 11 Jul 2016 00:06:11 GMT

    [ https://issues.apache.org/jira/browse/HDFS-9213?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15370010#comment-15370010
] 

Vijay Srinivasaraghavan commented on HDFS-9213:
-----------------------------------------------

I am seeing same error while trying to secure MiniDFSCluster using MiniKDC setup. DataNode
is not starting and failing with the error message 

java.lang.RuntimeException: Unable to bind on specified streaming port in secure context.
Needed 0, got 39319
	at org.apache.hadoop.hdfs.server.datanode.SecureDataNodeStarter.getSecureResources(SecureDataNodeStarter.java:107)
	at org.apache.hadoop.hdfs.MiniDFSCluster.startDataNodes(MiniDFSCluster.java:1213)

I am setting below configurations to enable the secure cluster deployment. Are you also seeing
similar issue while starting miniDFSCluster with security enabled?

conf.set(DFS_NAMENODE_USER_NAME_KEY, testPrincipal);
conf.set(DFS_NAMENODE_KEYTAB_FILE_KEY, testKeytab);
conf.set(DFS_DATANODE_USER_NAME_KEY, testPrincipal);
conf.set(DFS_DATANODE_KEYTAB_FILE_KEY, testKeytab);
conf.set(DFS_WEB_AUTHENTICATION_KERBEROS_PRINCIPAL_KEY, testPrincipal);
conf.setBoolean(DFS_BLOCK_ACCESS_TOKEN_ENABLE_KEY, true);
conf.set("dfs.data.transfer.protection", dataTransferProtection);
conf.set(DFS_HTTP_POLICY_KEY, HttpConfig.Policy.HTTP_ONLY.name());
conf.set(DFS_ENCRYPT_DATA_TRANSFER_KEY,"false");

> Minicluster with Kerberos generates some stacks when checking the ports
> -----------------------------------------------------------------------
>
>                 Key: HDFS-9213
>                 URL: https://issues.apache.org/jira/browse/HDFS-9213
>             Project: Hadoop HDFS
>          Issue Type: Bug
>          Components: security
>    Affects Versions: 3.0.0-alpha1
>            Reporter: Nicolas Liochon
>            Assignee: Nicolas Liochon
>            Priority: Minor
>             Fix For: 3.0.0-alpha1
>
>         Attachments: hdfs-9213.v1.patch, hdfs-9213.v1.patch
>
>
> When using the minicluster with kerberos the various checks in SecureDataNodeStarter
fail because the ports are not fixed.
> Stacks like this one:
> {quote}
> java.lang.RuntimeException: Unable to bind on specified streaming port in secure context.
Needed 0, got 49670
> 	at org.apache.hadoop.hdfs.server.datanode.SecureDataNodeStarter.getSecureResources(SecureDataNodeStarter.java:108)
> {quote}
> There is already a setting to desactivate this type of check for testing, it could be
used here as well....



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: hdfs-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-help@hadoop.apache.org


Mime
View raw message