hadoop-common-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Harsh J <ha...@cloudera.com>
Subject Re: hadoop cluster ssh username
Date Tue, 06 Mar 2012 18:48:17 GMT

Your question seems to be in multiple parts if am right?

1. How do you manage configuration so that switching between local and
wider-cluster mode both work?

My suggestion would be to create two git branches in your conf
directory and switch them as you need, with simple git checkouts.

2. How do you get the start/stop scripts to ssh as hadoop-user instead
of using your user name?

In your masters and slaves file, instead of placing just a list of
"hostnames", place "hadoop-user@hostnames". That should do the trick.

If you want your SSH itself to use a different username when being
asked to connect to a hostname, follow the per-host configuration to
specify a username to automatically pick when provided a hostname:

On Tue, Mar 6, 2012 at 11:42 PM, Pat Ferrel <pat@occamsmachete.com> wrote:
> I have a small cluster of servers that runs hadoop. I have a laptop that I'd
> like to use that cluster when it is available. I setup hadoop on the laptop
> so I can switch from running local to running on the cluster. Local works. I
> have setup passwordless ssh between all machines to work with 'hadoop-user'
> which is the linux username on the cluster machines so I can ssh from the
> laptop to the servers without a password thusly:
> ssh hadoop-user@master
> But my username on the laptop is pferrel, not hadoop-user so when running
> 'start-all.sh' it tries
> ssh pferrel@master
> How do I tell it to use the linux user 'hadoop-user'. I assume there is
> something in the config directory xml files that will do this?

Harsh J

View raw message