Return-Path: X-Original-To: apmail-hadoop-common-issues-archive@minotaur.apache.org Delivered-To: apmail-hadoop-common-issues-archive@minotaur.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 3EA329336 for ; Thu, 26 Jul 2012 13:34:23 +0000 (UTC) Received: (qmail 8770 invoked by uid 500); 26 Jul 2012 13:26:22 -0000 Delivered-To: apmail-hadoop-common-issues-archive@hadoop.apache.org Received: (qmail 52483 invoked by uid 500); 26 Jul 2012 13:24:30 -0000 Mailing-List: contact common-issues-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: common-issues@hadoop.apache.org Delivered-To: mailing list common-issues@hadoop.apache.org Received: (qmail 31205 invoked by uid 99); 26 Jul 2012 04:09:35 -0000 Received: from issues-vm.apache.org (HELO issues-vm) (140.211.11.160) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 26 Jul 2012 04:09:35 +0000 Received: from isssues-vm.apache.org (localhost [127.0.0.1]) by issues-vm (Postfix) with ESMTP id C33AC142856 for ; Thu, 26 Jul 2012 04:09:34 +0000 (UTC) Date: Thu, 26 Jul 2012 04:09:34 +0000 (UTC) From: "fujie (JIRA)" To: common-issues@hadoop.apache.org Message-ID: <411749071.104740.1343275774801.JavaMail.jiratomcat@issues-vm> In-Reply-To: <8129099.16258.1318636571930.JavaMail.tomcat@hel.zones.apache.org> Subject: [jira] [Commented] (HADOOP-7750) DataNode: Cannot start secure cluster without privileged resources | tags/release-0.20.205.0-rc2 MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 [ https://issues.apache.org/jira/browse/HADOOP-7750?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13422879#comment-13422879 ] fujie commented on HADOOP-7750: ------------------------------- i found this problem in 1.0.3-release > DataNode: Cannot start secure cluster without privileged resources | tags/release-0.20.205.0-rc2 > ------------------------------------------------------------------------------------------------- > > Key: HADOOP-7750 > URL: https://issues.apache.org/jira/browse/HADOOP-7750 > Project: Hadoop Common > Issue Type: Bug > Affects Versions: 1.0.0 > Environment: Linux RHEL5 64bit > sunjava2 1.6.0r14 > http://svn.apache.org/repos/asf/hadoop/common/tags/release-0.20.205.0-rc2/branch-0.20-security-205/src/hdfs/org/apache/hadoop/hdfs/server/datanode/DataNode.java > Reporter: Trevor Powell > Labels: hdfs > > This tag compiles just fine. But after configuring it, the datanode fails on startup with the below error: > TARTUP_MSG: Starting DataNode > STARTUP_MSG: host = hd3w94m7/10.152.94.111 > STARTUP_MSG: args = [] > STARTUP_MSG: version = 0.20.205.1 > STARTUP_MSG: build = http://svn.apache.org/repos/asf/hadoop/common/tags/release-0.20.205.0-rc2 -r 1179942; compiled by 'tpowell1' on Wed Oct 12 11:14:46 PDT 2011 > ************************************************************/ > 2011-10-14 15:24:56,028 INFO org.apache.hadoop.metrics2.impl.MetricsConfig: loaded properties from hadoop-metrics2.properties > 2011-10-14 15:24:56,043 INFO org.apache.hadoop.metrics2.impl.MetricsSourceAdapter: MBean for source MetricsSystem,sub=Stats registered. > 2011-10-14 15:24:56,044 INFO org.apache.hadoop.metrics2.impl.MetricsSystemImpl: Scheduled snapshot period at 10 second(s). > 2011-10-14 15:24:56,044 INFO org.apache.hadoop.metrics2.impl.MetricsSystemImpl: DataNode metrics system started > 2011-10-14 15:24:56,192 INFO org.apache.hadoop.metrics2.impl.MetricsSourceAdapter: MBean for source ugi registered. > 2011-10-14 15:24:56,421 INFO org.apache.hadoop.security.UserGroupInformation: Asked the TGT renewer thread to terminate > 2011-10-14 15:24:57,241 INFO org.apache.hadoop.security.UserGroupInformation: Login successful for user hdfs/hd3w94m7@XXX using keytab file /home/tpowell1/hadoop.tags.release-0.20.205.0-rc2/conf/hdfs.keytab > 2011-10-14 15:24:57,242 ERROR org.apache.hadoop.hdfs.server.datanode.DataNode: java.lang.RuntimeException: Cannot start secure cluster without privileged resources. > at org.apache.hadoop.hdfs.server.datanode.DataNode.startDataNode(DataNode.java:306) > at org.apache.hadoop.hdfs.server.datanode.DataNode.(DataNode.java:281) > at org.apache.hadoop.hdfs.server.datanode.DataNode.makeInstance(DataNode.java:1545) > at org.apache.hadoop.hdfs.server.datanode.DataNode.instantiateDataNode(DataNode.java:1484) > at org.apache.hadoop.hdfs.server.datanode.DataNode.createDataNode(DataNode.java:1502) > at org.apache.hadoop.hdfs.server.datanode.DataNode.secureMain(DataNode.java:1628) > at org.apache.hadoop.hdfs.server.datanode.DataNode.main(DataNode.java:1645) > 2011-10-14 15:24:57,243 INFO org.apache.hadoop.hdfs.server.datanode.DataNode: SHUTDOWN_MSG: > /************************************************************ > SHUTDOWN_MSG: Shutting down DataNode at hd3w94m7.XXX/10.152.94.111 > ************************************************************/ > Checking the Datanode.java code it is started with a null SecureResources . > public static void main(String args[]) { > secureMain(args, null); > } > This null resource seems to get passed all the way down to startDataNode() where there is a null check... which in turns throws the error we see. > void startDataNode(Configuration conf, > AbstractList dataDirs, SecureResources resources > ) throws IOException { > if(UserGroupInformation.isSecurityEnabled() && resources == null) > throw new RuntimeException("Cannot start secure cluster without " + > "privileged resources."); -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira