hadoop-common-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "mohit.kaushik" <mohit.kaus...@orkash.com>
Subject Re: Sharing single hadoop installation for multiple users on cluster
Date Mon, 18 Jan 2016 09:28:45 GMT
You should also set the dfs permissions
Simply run

  hadoop fs -chmod 777 /

or set the 'dfs.permissions' to 'false'.

- Mohit Kaushik

On 01/18/2016 02:43 PM, mohit.kaushik wrote:
> If you started Hadoop daemons with hduser, it will not be shown for 
> the user foo(or any other user) as hadoop daemons are just java 
> processes. But still you can run your jobs with any other user. Ensure 
> that the user foo has access to hadoop directories. And you also don't 
> have to create a directory in hdfs for the user. I hope this resolves 
> your problem.
> hduser $ start-all.sh
> hduser $ su - other
> other $ /home/hduser/hadoop203/bin/hadoop jar
> /home/hduser/hadoop203/hadoop-examples*.jar pi 1 1
> -Mohit Kasuhik
> On 01/18/2016 11:56 AM, Ravikant Dindokar wrote:
>> Hi Mohit,
>> Thanks for your reply.  Let me elaborate my problem in detail.
>> I have installed hadoop with user called 'hduser' and the HADOOP_HOME 
>> points to one folder in hduser's home directory . Now I have added 
>> another user foo in the cluster. I modified the access permissions 
>> for following directories to 777:
>> 1. Hadoop installation directory ( pointed by HADOOP_HOME)
>> 2. dfs.datanode.data.dir
>> 3. dfs.namenode.name.dir
>> 4. hadoop.tmp.dir
>> I have also created directory /user/foo inside hdfs
>> After starting hdfs and yarn daemons, I am not able to view these 
>> processes in foo user and so not able to submit jobs.
>> Can you point out what I am missing here?
>> Thanks
>> Ravikant
>> On Mon, Jan 18, 2016 at 10:39 AM, mohit.kaushik 
>> <mohit.kaushik@orkash.com <mailto:mohit.kaushik@orkash.com>> wrote:
>>     Hadoop uses the linux system users. I think, You don't have to
>>     make any changes, Just create a new user in your system and give
>>     it access to hadoop ie. provide permissions to hadoop
>>     installation and data directories.
>>     -Mohit Kaushik
>>     On 01/17/2016 04:06 PM, Ravikant Dindokar wrote:
>>>     Hi Hadoop user,
>>>     I have hadoop-2.6 installed on my cluster with 11 nodes. I have
>>>     installed it under one specific user. Now I want  to allow other
>>>     users on the cluster to share the same hadoop installation. What
>>>     changes I need to do in order to allow access to other users?
>>>     Thanks
>>>     Ravikant


*Mohit Kaushik*
Software Engineer
A Square,Plot No. 278, Udyog Vihar, Phase 2, Gurgaon 122016, India
*Tel:*+91 (124) 4969352 | *Fax:*+91 (124) 4033553

<http://politicomapper.orkash.com>interactive social intelligence at work...

<https://twitter.com/Orkash> <http://www.orkash.com/blog/> 
<http://www.orkash.com> ... ensuring Assurance in complexity and uncertainty

/This message including the attachments, if any, is a confidential 
business communication. If you are not the intended recipient it may be 
unlawful for you to read, copy, distribute, disclose or otherwise use 
the information in this e-mail. If you have received it in error or are 
not the intended recipient, please destroy it and notify the sender 
immediately. Thank you /

View raw message