Mailing-List: contact user-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
Reply-To: user@hadoop.apache.org
Received-SPF: pass (nike.apache.org: local policy)
Subject: Re: Datanode: "Cannot start secure cluster without privileged
 resources"
Mime-Version: 1.0 (Apple Message framework v1085)
Content-Type: text/plain; charset=us-ascii
From: "ac@hsk.hk" <ac@hsk.hk>
In-Reply-To: 
 <CAOcnVr1UJ9STv9vh4_KXphG1M1xkokRtK-QRmrtt5ik_caSXwA@mail.gmail.com>
Date: Mon, 26 Nov 2012 22:05:27 +0800
Cc: "ac@hsk.hk" <ac@hsk.hk>,
 "<user@hadoop.apache.org>" <user@hadoop.apache.org>
Content-Transfer-Encoding: quoted-printable
Message-Id: <B93BC4CB-EB65-4505-A7DC-039D4B1E53A8@hsk.hk>
References: <C155E15D0707204885EB0BA11E54B1DF0A045CDA@XMBVAG72.northgrum.com>
 <CAMVC6RNgXPT03UdJt+s4K1b4XjX9wtE6so-Y7QLVFHxAEMKSoQ@mail.gmail.com>
 <C155E15D0707204885EB0BA11E54B1DF0A045D19@XMBVAG72.northgrum.com>
 <BLU0-SMTP129C8352B54A6AC8A9715FB8F5B0@phx.gbl>
 <C155E15D0707204885EB0BA11E54B1DF0A046127@XMBVAG72.northgrum.com>
 <BLU0-SMTP4754E0C6763037DFBD387D68F590@phx.gbl>
 <3E0C3F7B-50C9-44BC-9FDF-CED0F0A7DB91@hsk.hk>
 <CADcMMgHuW0+AivuANnt2yHXDQqQbQCuBnUpSpZonvHXmVSyXkw@mail.gmail.com>
 <B4C91CD3-4CE5-4ED5-A7F5-9ED44F7C278B@hsk.hk>
 <FE2387BB-4790-4045-AD95-A50903141706@hsk.hk>
 <CAOcnVr2Fd36-TBg0-PegCW3kPtf3D0tW7q4GJtSVLe5sGMB8Ag@mail.gmail.com>
 <57F21702-4E04-43C4-8896-0996630791C2@hsk.hk>
 <E10DC09F-E827-447A-8BFE-FBBD6F9DA59B@hsk.hk>
 <CAOcnVr1UJ9STv9vh4_KXphG1M1xkokRtK-QRmrtt5ik_caSXwA@mail.gmail.com>
To: Harsh J <harsh@cloudera.com>

Hi,

Thanks for your reply.

However, I think 16152 should not be the DN, since
1) my second try of "/usr/local/hadoop/bin/hadoop-daemon.sh start =
datanode" says 16117 (i.e. I ran start datanode twice), and=20
2) ps axu | grep 16117, I got
root     16117  0.0  0.0  17004   904 pts/2    S    21:34   0:00 =
jsvc.exec -Dproc_datanode -outfile /usr/local/hadoop-1.0.4/libexec/ ...

These are the two reasons that I think JPS is no longer a tool to check =
secure DN.

Thanks again!


On 26 Nov 2012, at 9:47 PM, Harsh J wrote:

> The 16152 should be the DN JVM I think. This is a jps limitation, as
> seen at =
http://docs.oracle.com/javase/1.5.0/docs/tooldocs/share/jps.html
> and jsvc (which secure mode DN uses) is such a custom launcher.
>=20
> "The jps command uses the java launcher to find the class name and
> arguments passed to the main method. If the target JVM is started with
> a custom launcher, the class name (or JAR file name) and the arguments
> to the main method will not be available. In this case, the jps
> command will output the string Unknownfor the class name or JAR file
> name and for the arguments to the main method."
>=20
> On Mon, Nov 26, 2012 at 7:11 PM, ac@hsk.hk <ac@hsk.hk> wrote:
>> Hi,
>>=20
>> A question:
>> I started Secure DN then ran JPS as root, I could not find any =
running DN:
>> 16152
>> 16195 Jps
>>=20
>> However, when I tried to start the secure DN again, I got:
>> Warning: $HADOOP_HOME is deprecated.
>> datanode running as process 16117. Stop it first.
>>=20
>> Does it mean JPS is no longer a tool to check DN in secure mode?
>>=20
>> Thanks
>>=20
>>=20
>> On 26 Nov 2012, at 9:03 PM, ac@hsk.hk wrote:
>>=20
>>> Hi Harsh,
>>>=20
>>> Thank you very much for your reply, got it!
>>>=20
>>> Thanks
>>> ac
>>>=20
>>> On 26 Nov 2012, at 8:32 PM, Harsh J wrote:
>>>=20
>>>> Secure DN needs to be started as root (it runs as proper user, but
>>>> needs to be started as root to grab reserved ports), and needs a
>>>> proper jsvc binary (for your arch/OS) available. Are you using
>>>> tarballs or packages (and if packages, are they from Bigtop)?
>>>>=20
>>>> On Mon, Nov 26, 2012 at 5:21 PM, ac@hsk.hk <ac@hsk.hk> wrote:
>>>>> Hi,
>>>>>=20
>>>>> I am setting up HDFS security with Kerberos:
>>>>> When I manually started the first datanode, I got the following =
messages (the namenode is started):
>>>>>=20
>>>>> 1) INFO org.apache.hadoop.security.UserGroupInformation: Login =
successful for user ....
>>>>> 2) ERROR org.apache.hadoop.hdfs.server.datanode.DataNode: =
java.lang.RuntimeException: Cannot start secure cluster without =
privileged resources.
>>>>>=20
>>>>> OS: Ubuntu 12.04
>>>>> Hadoop: 1.0.4
>>>>>=20
>>>>> It seems that it could login successfully but something is missing
>>>>> Please help!
>>>>>=20
>>>>> Thanks
>>>>>=20
>>>>>=20
>>>>>=20
>>>>>=20
>>>>=20
>>>>=20
>>>>=20
>>>> --
>>>> Harsh J
>>>=20
>>=20
>=20
>=20
>=20
> --=20
> Harsh J