Mailing-List: contact user-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
Message-ID: <569CACD5.5090400@orkash.com>
Date: Mon, 18 Jan 2016 14:43:57 +0530
From: "mohit.kaushik" <mohit.kaushik@orkash.com>
User-Agent: Mozilla/5.0 (X11; Linux x86_64;
 rv:31.0) Gecko/20100101 Thunderbird/31.4.0
MIME-Version: 1.0
To: user@hadoop.apache.org
Subject: Re: Sharing single hadoop installation for multiple users on cluster
References: 
 <CA+fHtaz0UMajqTptRWVo-Eps4WCw0_NsDCUY6cKmE+C0FK0F1Q@mail.gmail.com>
	<569C73A2.80002@orkash.com>
 <CA+fHtawb8-1KeGBDO7Eq1Hx6ZTjy8wmfrjzA0eFundqhwEqYGA@mail.gmail.com>
In-Reply-To: 
 <CA+fHtawb8-1KeGBDO7Eq1Hx6ZTjy8wmfrjzA0eFundqhwEqYGA@mail.gmail.com>
Content-Type: multipart/alternative;
 boundary="------------030905070303040408090302"

--------------030905070303040408090302
Content-Type: text/plain; charset=utf-8; format=flowed
Content-Transfer-Encoding: 7bit

If you started Hadoop daemons with hduser, it will not be shown for the 
user foo(or any other user) as hadoop daemons are just java processes. 
But still you can run your jobs with any other user. Ensure that the 
user foo has access to hadoop directories. And you also don't have to 
create a directory in hdfs for the user. I hope this resolves your problem.

hduser $ start-all.sh
hduser $ su - other
other $ /home/hduser/hadoop203/bin/hadoop jar
/home/hduser/hadoop203/hadoop-examples*.jar pi 1 1

-Mohit Kasuhik


On 01/18/2016 11:56 AM, Ravikant Dindokar wrote:
> Hi Mohit,
>
> Thanks for your reply.  Let me elaborate my problem in detail.
> I have installed hadoop with user called 'hduser' and the HADOOP_HOME 
> points to one folder in hduser's home directory . Now I have added 
> another user foo in the cluster. I modified the access permissions for 
> following directories to 777:
> 1. Hadoop installation directory ( pointed by HADOOP_HOME)
> 2. dfs.datanode.data.dir
> 3. dfs.namenode.name.dir
> 4. hadoop.tmp.dir
>
> I have also created directory /user/foo inside hdfs
>
> After starting hdfs and yarn daemons, I am not able to view these 
> processes in foo user and so not able to submit jobs.
>
> Can you point out what I am missing here?
>
> Thanks
> Ravikant
>
> On Mon, Jan 18, 2016 at 10:39 AM, mohit.kaushik 
> <mohit.kaushik@orkash.com <mailto:mohit.kaushik@orkash.com>> wrote:
>
>     Hadoop uses the linux system users. I think, You don't have to
>     make any changes, Just create a new user in your system and give
>     it access to hadoop ie. provide permissions to hadoop installation
>     and data directories.
>
>     -Mohit Kaushik
>
>
>     On 01/17/2016 04:06 PM, Ravikant Dindokar wrote:
>>     Hi Hadoop user,
>>
>>     I have hadoop-2.6 installed on my cluster with 11 nodes. I have
>>     installed it under one specific user. Now I want  to allow other
>>     users on the cluster to share the same hadoop installation. What
>>     changes I need to do in order to allow access to other users?
>>
>>     Thanks
>>     Ravikant
>
>

--------------030905070303040408090302
Content-Type: text/html; charset=utf-8
Content-Transfer-Encoding: 8bit

<html>
  <head>
    <meta content="text/html; charset=utf-8" http-equiv="Content-Type">
  </head>
  <body bgcolor="#FFFFFF" text="#000000">
    <div class="moz-cite-prefix">If you started Hadoop daemons with
      hduser, it will not be shown for the user foo(or any other user)
      as hadoop daemons are just java processes. But still you can run
      your jobs with any other user. Ensure that the user foo has access
      to hadoop directories. And you also don't have to create a
      directory in hdfs for the user. I hope this resolves your
      problem.  <br>
      <pre>hduser $ start-all.sh
hduser $ su - other
other $ /home/hduser/hadoop203/bin/hadoop jar
/home/hduser/hadoop203/hadoop-examples*.jar pi 1 1
</pre>
      -Mohit Kasuhik<br>
      <br>
      <br>
      On 01/18/2016 11:56 AM, Ravikant Dindokar wrote:<br>
    </div>
    <blockquote
cite="mid:CA+fHtawb8-1KeGBDO7Eq1Hx6ZTjy8wmfrjzA0eFundqhwEqYGA@mail.gmail.com"
      type="cite">
      <meta http-equiv="Context-Type" content="text/html; charset=UTF-8">
      <div dir="ltr">
        <div>
          <div>
            <div>
              <div>
                <div>
                  <div>Hi Mohit,<br>
                    <br>
                  </div>
                  Thanks for your reply.  Let me elaborate my problem in
                  detail.<br>
                  I have installed hadoop with user called 'hduser' and
                  the HADOOP_HOME points to one folder in hduser's home
                  directory . Now I have added another user foo in the
                  cluster. I modified the access permissions for
                  following directories to 777:<br>
                </div>
                1. Hadoop installation directory ( pointed by 
                HADOOP_HOME)<br>
                2. dfs.datanode.data.dir <br>
                3. dfs.namenode.name.dir<br>
                4. hadoop.tmp.dir<br>
                <br>
              </div>
              <div>I have also created directory /user/foo inside hdfs<br>
              </div>
              <div><br>
              </div>
              After starting hdfs and yarn daemons, I am not able to
              view these processes in foo user and so not able to submit
              jobs.<br>
              <br>
            </div>
            Can you point out what I am missing here?<br>
            <br>
          </div>
          Thanks<br>
        </div>
        Ravikant<br>
      </div>
      <div class="gmail_extra"><br>
        <div class="gmail_quote">On Mon, Jan 18, 2016 at 10:39 AM,
          mohit.kaushik <span dir="ltr">&lt;<a moz-do-not-send="true"
              href="mailto:mohit.kaushik@orkash.com" target="_blank">mohit.kaushik@orkash.com</a>&gt;</span>
          wrote:<br>
          <blockquote class="gmail_quote">
            <div>
              <div>Hadoop uses the linux system users. I think, You
                don't have to make any changes, Just create a new user
                in your system and give it access to hadoop ie. provide
                permissions to hadoop installation and data directories.<span
                  class="HOEnZb"><br>
                  <br>
                  -Mohit Kaushik</span>
                <div>
                  <div class="h5"><br>
                    <br>
                    On 01/17/2016 04:06 PM, Ravikant Dindokar wrote:<br>
                  </div>
                </div>
              </div>
              <div>
                <div class="h5">
                  <blockquote type="cite">
                    <div dir="ltr">
                      <div>
                        <div>
                          <div>Hi Hadoop user,<br>
                            <br>
                          </div>
                          I have hadoop-2.6 installed on my cluster with
                          11 nodes. I have installed it under one
                          specific user. Now I want  to allow other
                          users on the cluster to share the same hadoop
                          installation. What changes I need to do in
                          order to allow access to other users?<br>
                          <br>
                        </div>
                        Thanks<br>
                      </div>
                      Ravikant<br>
                    </div>
                  </blockquote>
                </div>
              </div>
            </div>
          </blockquote>
        </div>
        <br>
      </div>
    </blockquote>
    <font face="Arial">
      <script>function fbImageClick() {
window.open(<a class="moz-txt-link-rfc2396E" href="https://www.facebook.com/Orkash2012">"https://www.facebook.com/Orkash2012"</a>);
}
function twitterImageClick() {
window.open(<a class="moz-txt-link-rfc2396E" href="https://twitter.com/Orkash">"https://twitter.com/Orkash"</a>);
}
function blogImageClick() {
window.open(<a class="moz-txt-link-rfc2396E" href="http://www.orkash.com/blog/">"http://www.orkash.com/blog/"</a>);
}
//onclick="fbImageClick();" 
</script></font>
  </body>
</html>

--------------030905070303040408090302--