hadoop-general mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Eric Sammer <esam...@cloudera.com>
Subject Re: Hadoop on PlanetLab nodes
Date Wed, 03 Nov 2010 17:03:27 GMT
Better than passwordless ssh is to use ssh-agent and load your key
(providing the passphrase once). See 'man ssh-agent' for details,
although it's pretty straight forward.

Short version:

# See if ssh-agent is already running for your user by trying to list
# keys it knows about. That's a "dash-ell."
ssh-add -l

# Load an ssh key.
ssh-add ~/.ssh/id_rsa
<enter passphrase>

If your public key is already on all the nodes, watch as magically
start-all/stop-all work without requiring a password.

WARNING: When working with authentication, remote login, and anything
security related, *never* blindly take advice. Always take the time to
understand the ramifications. See man pages for ssh, ssh-agent,
ssh-add, and ssh_config.

Hope that helps.

On Wed, Nov 3, 2010 at 12:53 PM, Harsh J <qwertymaniac@gmail.com> wrote:
> Hi,
> On Wed, Nov 3, 2010 at 10:02 PM, Grandl Robert <rgrandl@yahoo.com> wrote:
>> Hi all,
>> I am trying to set up Hadoop  on PlanetLab nodes.
>> However, as far as I seen I need password less SSH login between master and slave
nodes in Hadoop.
> This is "needed" for ease of setup, but you can as well start all
> nodes manually yourselves without requiring SSH as a dependency. Just
> for your information (won't be the right way out, perhaps).
> For instance, you can ssh manually and issue "hadoop tasktracker" and
> "hadoop datanode" commands in the nodes to start those daemons.
>> My
>> main problem is for planet lab nodes I have a privatekey I always use
>> when connect to planet lab nodes. I am using  ssh -i ~/.ssh/privatekey
>> user@planet_lab_node
>> Also, the username on planet lab nodes is different from the user name I have on
my local cluster.
>> Is there any possibility to use hadoop on planet lab nodes ?
>> Any hints, suggestions or links will be valuable for me.
>> Thanks,
>> Robert
> --
> Harsh J
> www.harshj.com

Eric Sammer
twitter: esammer
data: www.cloudera.com

View raw message