hadoop-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Harsh J <ha...@cloudera.com>
Subject Re: Datanode: "Cannot start secure cluster without privileged resources"
Date Mon, 26 Nov 2012 14:30:01 GMT
Could you also check what 16152 is? The jsvc is a launcher process,
not the JVM itself.

As I mentioned, JPS is pretty reliable, just wont' show the name of
the JVM launched by a custom wrapper - and will show just PID.

On Mon, Nov 26, 2012 at 7:35 PM, ac@hsk.hk <ac@hsk.hk> wrote:
> Hi,
>
> Thanks for your reply.
>
> However, I think 16152 should not be the DN, since
> 1) my second try of "/usr/local/hadoop/bin/hadoop-daemon.sh start datanode" says 16117
(i.e. I ran start datanode twice), and
> 2) ps axu | grep 16117, I got
> root     16117  0.0  0.0  17004   904 pts/2    S    21:34   0:00 jsvc.exec -Dproc_datanode
-outfile /usr/local/hadoop-1.0.4/libexec/ ...
>
> These are the two reasons that I think JPS is no longer a tool to check secure DN.
>
> Thanks again!
>
>
> On 26 Nov 2012, at 9:47 PM, Harsh J wrote:
>
>> The 16152 should be the DN JVM I think. This is a jps limitation, as
>> seen at http://docs.oracle.com/javase/1.5.0/docs/tooldocs/share/jps.html
>> and jsvc (which secure mode DN uses) is such a custom launcher.
>>
>> "The jps command uses the java launcher to find the class name and
>> arguments passed to the main method. If the target JVM is started with
>> a custom launcher, the class name (or JAR file name) and the arguments
>> to the main method will not be available. In this case, the jps
>> command will output the string Unknownfor the class name or JAR file
>> name and for the arguments to the main method."
>>
>> On Mon, Nov 26, 2012 at 7:11 PM, ac@hsk.hk <ac@hsk.hk> wrote:
>>> Hi,
>>>
>>> A question:
>>> I started Secure DN then ran JPS as root, I could not find any running DN:
>>> 16152
>>> 16195 Jps
>>>
>>> However, when I tried to start the secure DN again, I got:
>>> Warning: $HADOOP_HOME is deprecated.
>>> datanode running as process 16117. Stop it first.
>>>
>>> Does it mean JPS is no longer a tool to check DN in secure mode?
>>>
>>> Thanks
>>>
>>>
>>> On 26 Nov 2012, at 9:03 PM, ac@hsk.hk wrote:
>>>
>>>> Hi Harsh,
>>>>
>>>> Thank you very much for your reply, got it!
>>>>
>>>> Thanks
>>>> ac
>>>>
>>>> On 26 Nov 2012, at 8:32 PM, Harsh J wrote:
>>>>
>>>>> Secure DN needs to be started as root (it runs as proper user, but
>>>>> needs to be started as root to grab reserved ports), and needs a
>>>>> proper jsvc binary (for your arch/OS) available. Are you using
>>>>> tarballs or packages (and if packages, are they from Bigtop)?
>>>>>
>>>>> On Mon, Nov 26, 2012 at 5:21 PM, ac@hsk.hk <ac@hsk.hk> wrote:
>>>>>> Hi,
>>>>>>
>>>>>> I am setting up HDFS security with Kerberos:
>>>>>> When I manually started the first datanode, I got the following messages
(the namenode is started):
>>>>>>
>>>>>> 1) INFO org.apache.hadoop.security.UserGroupInformation: Login successful
for user ....
>>>>>> 2) ERROR org.apache.hadoop.hdfs.server.datanode.DataNode: java.lang.RuntimeException:
Cannot start secure cluster without privileged resources.
>>>>>>
>>>>>> OS: Ubuntu 12.04
>>>>>> Hadoop: 1.0.4
>>>>>>
>>>>>> It seems that it could login successfully but something is missing
>>>>>> Please help!
>>>>>>
>>>>>> Thanks
>>>>>>
>>>>>>
>>>>>>
>>>>>>
>>>>>
>>>>>
>>>>>
>>>>> --
>>>>> Harsh J
>>>>
>>>
>>
>>
>>
>> --
>> Harsh J
>



-- 
Harsh J

Mime
View raw message