hadoop-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Jay Vyas <jayunit...@gmail.com>
Subject Re: Configuring SSH - is it required? for a psedo distriburted mode?
Date Thu, 16 May 2013 15:34:57 GMT
Actually, I should amend my statement -- SSH is required, but passwordless
ssh (i guess) you can live without if you are willing to enter your
password for each process that gets started.

But Why wouldn't you want to implement passwordless ssh in a pseudo
distributed cluster ?  Its very easy to implement on a single node:

cat ~/.ssh/id_rsa.pub /root/.ssh/authorized_keys

On Thu, May 16, 2013 at 11:31 AM, Jay Vyas <jayunit100@gmail.com> wrote:

> Yes it is required -- in psuedodistributed node the jobtracker is not
> necessarily aware that the task trackers  / data nodes are on the same
> machine, and will thus attempt to ssh into them when starting the
> respective deamons etc (i.e. start-all.sh)
> On Thu, May 16, 2013 at 11:21 AM, kishore alajangi <
> alajangikishore@gmail.com> wrote:
>> When you start the hadoop procecess, each process will ask the password
>> to start, to overcome this we will configure SSH if you use single node or
>> multiple nodes for each process, if you can enter the password for each
>> process Its not a mandatory even if you use multiple systems.
>> Thanks,
>> Kishore.
>> On Thu, May 16, 2013 at 8:24 PM, Raj Hadoop <hadoopraj@yahoo.com> wrote:
>>>  Hi,
>>> I have a dedicated user on Linux server for hadoop. I am installing it
>>> in psedo distributed mode on this box. I want to test my programs on this
>>> machine. But i see that in installation steps - they were mentioned that
>>> SSH needs to be configured. If it is single node, I dont require it
>>> ...right? Please advise.
>>> I was looking at this site
>>> http://www.michael-noll.com/tutorials/running-hadoop-on-ubuntu-linux-single-node-cluster/
>>> It menionted like this -
>>> "
>>> Hadoop requires SSH access to manage its nodes, i.e. remote machines
>>> plus your local machine if you want to use Hadoop on it (which is what we
>>> want to do in this short tutorial). For our single-node setup of Hadoop, we
>>> therefore need to configure SSH access to localhost for the hduser user
>>> we created in the previous section.
>>> "
>>> Thanks,
>>> Raj
> --
> Jay Vyas
> http://jayunit100.blogspot.com

Jay Vyas

View raw message