Return-Path: X-Original-To: apmail-hadoop-user-archive@minotaur.apache.org Delivered-To: apmail-hadoop-user-archive@minotaur.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id A2B42D66F for ; Thu, 25 Oct 2012 17:14:10 +0000 (UTC) Received: (qmail 35825 invoked by uid 500); 25 Oct 2012 17:14:04 -0000 Delivered-To: apmail-hadoop-user-archive@hadoop.apache.org Received: (qmail 35703 invoked by uid 500); 25 Oct 2012 17:14:04 -0000 Mailing-List: contact user-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@hadoop.apache.org Delivered-To: mailing list user@hadoop.apache.org Received: (qmail 35664 invoked by uid 99); 25 Oct 2012 17:14:04 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 25 Oct 2012 17:14:04 +0000 X-ASF-Spam-Status: No, hits=2.6 required=5.0 tests=FILL_THIS_FORM_FRAUD_PHISH,HTML_MESSAGE,RCVD_IN_DNSWL_NONE,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (athena.apache.org: domain of yogeshdhari@live.com designates 65.55.90.108 as permitted sender) Received: from [65.55.90.108] (HELO snt0-omc2-s33.snt0.hotmail.com) (65.55.90.108) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 25 Oct 2012 17:13:58 +0000 Received: from SNT117-W32 ([65.55.90.71]) by snt0-omc2-s33.snt0.hotmail.com with Microsoft SMTPSVC(6.0.3790.4675); Thu, 25 Oct 2012 10:13:37 -0700 Message-ID: Content-Type: multipart/alternative; boundary="_3650a51e-cb56-4d73-8a65-8f7ff4738028_" X-Originating-IP: [122.179.61.117] From: yogesh dhari To: hadoop helpforoum Subject: RE: ERROR:: SSH failour for distributed node hadoop cluster Date: Thu, 25 Oct 2012 22:43:35 +0530 Importance: Normal In-Reply-To: References: <2ADA1B0170E3434DA763D609DCD01EB54DF35CD1@BLR-EC-MBX7.wipro.com>,,, MIME-Version: 1.0 X-OriginalArrivalTime: 25 Oct 2012 17:13:37.0220 (UTC) FILETIME=[1239C840:01CDB2D4] X-Virus-Checked: Checked by ClamAV on apache.org --_3650a51e-cb56-4d73-8a65-8f7ff4738028_ Content-Type: text/plain; charset="windows-1256" Content-Transfer-Encoding: 8bit Thanks Andy, I got your point :-), What I have done earlier.. I have configured 1) One as a Master ( plays role of both Name node and Data Node) 2) Second as a Slave ( Only date node) I have give same name to both Machines and they have Admin access. pluto ( for both Master and Slave). and generated ssh key pair through this way Master:~ mediaadmin$ ssh-keygen -t rsa -P " " Generating public/private rsa key pair. Enter file in which to save the key (/Users/mediaadmin/.ssh/id_rsa): /Users/mediaadmin/.ssh/id_rsa already exists. Overwrite (y/n)? y Your identification has been saved in /Users/mediaadmin/.ssh/id_rsa. Your public key has been saved in /Users/mediaadmin/.ssh/id_rsa.pub. The key fingerprint is: 32:0f:be:7a:ea:44:a1:4a:b6:b1:85:3f:1f:56:48:4b mediaadmin@Master The key's randomart image is: +--[ RSA 2048]----+ | | | | | .E | | ..o.o | | =...o+.S | |o.*. ..= | |.o o.o. . | | .+ o. | | .+=. | +-----------------+ Copy to home Master:~ mediaadmin$ cat $HOME/.ssh/id_rsa.pub >> $HOME/.ssh/authorized_keys and copy to Slave Node as mediaadmin$ cat ~/.ssh/id_rsa.pub | ssh pluto@Slave 'cat >> ~/.ssh/authorized_keys' Login to Slave node Master:~ mediaadmin$ ssh pluto@Slave Last login: Thu Oct 25 18:54:15 2012 from 10.203.33.80 and Log out plutos-iMac:~ pluto$ exit logout Connection to Slave closed. Login to Master node (here it asks for password) Master:~ mediaadmin$ ssh Master Password: Last login: Thu Oct 25 19:03:27 2012 from master HERE COMES THE ISSUE when I run start-dfs.sh, its asks for password and I did enter the pass word of Master but i didn't accept. Master:~ mediaadmin$ start-dfs.sh starting namenode, logging to /HADOOP/hadoop-0.20.2/bin/../logs/hadoop-mediaadmin-namenode-Master.out Password:Password: Password: Password: Slave: Permission denied (publickey,keyboard-interactive). Password: Master: starting datanode, logging to /HADOOP/hadoop-0.20.2/bin/../logs/hadoop-mediaadmin-datanode-Master.out Password: Master: starting secondarynamenode, logging to /HADOOP/hadoop-0.20.2/bin/../logs/hadoop-mediaadmin-secondarynamenode-Master.out When I enter password of Slave then it again goes like this. Master:~ mediaadmin$ start-dfs.sh starting namenode, logging to /HADOOP/hadoop-0.20.2/bin/../logs/hadoop-mediaadmin-namenode-Master.out Password:Password: Password: Password: Password: Password: Master: Permission denied (publickey,keyboard-interactive). Slave: Permission denied (publickey,keyboard-interactive). Password: Password: Password: Master: Permission denied (publickey,keyboard-interactive). Please suggest me where I am going wrong, and why is asking for password when I configured it as password less SSH, where I doing mistake in SSH or some thing else. Thanks & Regards Yogesh Kumar Dhari From: Andy.Kartashov@mpac.ca To: user@hadoop.apache.org Subject: RE: ERROR:: SSH failour for distributed node hadoop cluster Date: Thu, 25 Oct 2012 16:37:36 +0000 Yogesh, One need to understand how passwordless ssh work. Say there is a user �yosh� He types ssh localhost and is prompted for a password. This is how to resolve this. 1. Type : ssh-keygen -t rsa -t stand for type and rsa (encryption) - another type will be dsa. Well, after you run above command, a pair of private and public keys is generated and stored in your /home/yosh/.ssh folder. �cd� in there and you will see two files. Id_rsa (private key) and id_rsa_pub (public key). If you create a file called �authorized_keys� and place your public key in there you will achieve psswdless access. How to do it? 2. cat ~/.ssh/id_rsa.pub >> ~/.ssh/authorized_keys The above command reads your PubKey and appends to the file. After that try �ssh localhost� again. Voila! No more password request. Now, imagine you are ssh-ing into this very same machine from another computer where u log-in as yosh. �ssh < ip>�. The machine will similarly let you in without password. p.s. If you do not know ip address of that machine, find out by simply typing �hostname �i�. Happy hadoop�ing. AK47 From: yogesh dhari [mailto:yogeshdhari@live.com] Sent: Thursday, October 25, 2012 12:12 PM To: hadoop helpforoum Subject: RE: ERROR:: SSH failour for distributed node hadoop cluster Hi Andy, I am still at that point, not able to solve it yet Please help, Same issue with all settings and commands I have raise by Subject ERROR: : Hadoop Installation in distributed mode.� to the mailing llist. Thanks & Regards Yogesh Kumar From: Andy.Kartashov@mpac.ca To: user@hadoop.apache.org Subject: RE: ERROR:: SSH failour for distributed node hadoop cluster Date: Thu, 25 Oct 2012 16:01:56 +0000 Yogesh, Have you figured it out? I had the same issue (needed passwordless ssh) and managed. Let me know if you are still stuck. AK47 From: yogesh.kumar13@wipro.com [mailto:yogesh.kumar13@wipro.com] Sent: Thursday, October 25, 2012 4:28 AM To: user@hadoop.apache.org Subject: ERROR:: SSH failour for distributed node hadoop cluster Importance: High Hi all, I am trying to run the command ssh Master it runs and shows after entering password. Password: abc Last login: Thu Oct 25 13:51:06 2012 from master But ssh for Slave through error. ssh Slave it asks for password ans denie Password: abc Password: abc Password: abc Permission denied (publickey,keyboard-interactive). Please suggest. Thanks & regards Yogesh Kumar Please do not print this email unless it is absolutely necessary. The information contained in this electronic message and any attachments to this message are intended for the exclusive use of the addressee(s) and may contain proprietary, confidential or privileged information. If you are not the intended recipient, you should not disseminate, distribute or copy this e-mail. Please notify the sender immediately and destroy all copies of this message and any attachments. WARNING: Computer viruses can be transmitted via email. The recipient should check this email and any attachments for the presence of viruses. The company accepts no liability for any damage caused by any virus transmitted by this email. www.wipro.com NOTICE: This e-mail message and any attachments are confidential, subject to copyright and may be privileged. Any unauthorized use, copying or disclosure is prohibited. If you are not the intended recipient, please delete and contact the sender immediately. Please consider the environment before printing this e-mail. AVIS : le pr�sent courriel et toute pi�ce jointe qui l'accompagne sont confidentiels, prot�g�s par le droit d'auteur et peuvent �tre couverts par le secret professionnel. Toute utilisation, copie ou divulgation non autoris�e est interdite. Si vous n'�tes pas le destinataire pr�vu de ce courriel, supprimez-le et contactez imm�diatement l'exp�diteur. Veuillez penser � l'environnement avant d'imprimer le pr�sent courriel NOTICE: This e-mail message and any attachments are confidential, subject to copyright and may be privileged. Any unauthorized use, copying or disclosure is prohibited. If you are not the intended recipient, please delete and contact the sender immediately. Please consider the environment before printing this e-mail. AVIS : le pr�sent courriel et toute pi�ce jointe qui l'accompagne sont confidentiels, prot�g�s par le droit d'auteur et peuvent �tre couverts par le secret professionnel. Toute utilisation, copie ou divulgation non autoris�e est interdite. Si vous n'�tes pas le destinataire pr�vu de ce courriel, supprimez-le et contactez imm�diatement l'exp�diteur. Veuillez penser � l'environnement avant d'imprimer le pr�sent courriel --_3650a51e-cb56-4d73-8a65-8f7ff4738028_ Content-Type: text/html; charset="windows-1256" Content-Transfer-Encoding: 8bit
Thanks Andy,

I got your point :-),

What I have done earlier..

I have configured
1) One as a Master ( plays role of both Name node and Data Node)
2) Second as a Slave ( Only date node)

I have give same name to both Machines and they have Admin access. pluto ( for both Master and Slave).

and generated ssh key pair through this way

Master:~ mediaadmin$ ssh-keygen -t rsa -P " "
Generating public/private rsa key pair.
Enter file in which to save the key (/Users/mediaadmin/.ssh/id_rsa):
/Users/mediaadmin/.ssh/id_rsa already exists.
Overwrite (y/n)? y
Your identification has been saved in /Users/mediaadmin/.ssh/id_rsa.
Your public key has been saved in /Users/mediaadmin/.ssh/id_rsa.pub.
The key fingerprint is:
32:0f:be:7a:ea:44:a1:4a:b6:b1:85:3f:1f:56:48:4b mediaadmin@Master
The key's randomart image is:
+--[ RSA 2048]----+
|                 |
|                 |
|    .E           |
|  ..o.o          |
| =...o+.S        |
|o.*. ..=         |
|.o o.o. .        |
|   .+ o.         |
|   .+=.          |
+-----------------+

Copy to home
Master:~ mediaadmin$ cat $HOME/.ssh/id_rsa.pub >> $HOME/.ssh/authorized_keys


and copy to Slave Node as
mediaadmin$ cat ~/.ssh/id_rsa.pub | ssh pluto@Slave 'cat >> ~/.ssh/authorized_keys'


Login to Slave node
Master:~ mediaadmin$ ssh pluto@Slave
Last login: Thu Oct 25 18:54:15 2012 from 10.203.33.80


and Log out
plutos-iMac:~ pluto$ exit
logout

Connection to Slave closed.


Login to Master node (here it asks for password)
Master:~ mediaadmin$ ssh Master
Password:
Last login: Thu Oct 25 19:03:27 2012 from master

HERE COMES THE ISSUE

when I run start-dfs.sh, its asks for password and I did enter the pass word of Master but i didn't accept.

Master:~ mediaadmin$ start-dfs.sh
starting namenode, logging to /HADOOP/hadoop-0.20.2/bin/../logs/hadoop-mediaadmin-namenode-Master.out
Password:Password:
Password:
Password:
Slave: Permission denied (publickey,keyboard-interactive).

Password:
Master: starting datanode, logging to /HADOOP/hadoop-0.20.2/bin/../logs/hadoop-mediaadmin-datanode-Master.out
Password:
Master: starting secondarynamenode, logging to /HADOOP/hadoop-0.20.2/bin/../logs/hadoop-mediaadmin-secondarynamenode-Master.out




When I enter password of Slave then it again goes like this.

Master:~ mediaadmin$ start-dfs.sh
starting namenode, logging to /HADOOP/hadoop-0.20.2/bin/../logs/hadoop-mediaadmin-namenode-Master.out
Password:Password:
Password:
Password:
Password:
Password:
Master: Permission denied (publickey,keyboard-interactive).


Slave: Permission denied (publickey,keyboard-interactive).
Password:
Password:
Password:
Master: Permission denied (publickey,keyboard-interactive).




Please suggest me where I am going wrong, and why is asking for password when I configured it as password less SSH,

where I doing mistake in SSH or some thing else.


Thanks & Regards
Yogesh Kumar Dhari


From: Andy.Kartashov@mpac.ca
To: user@hadoop.apache.org
Subject: RE: ERROR:: SSH failour for distributed node hadoop cluster
Date: Thu, 25 Oct 2012 16:37:36 +0000

Yogesh,

 

One need to understand how passwordless ssh work.

 

Say there is a user �yosh�

He types ssh localhost and is prompted for a password. This is how to resolve this.

 

1.

Type : ssh-keygen -t rsa

 

-t stand for type and rsa (encryption)  - another type will be dsa.

 

Well, after you run above command,  a pair of private and public keys is generated and stored in your /home/yosh/.ssh folder.

 

�cd� in there and you will see two files. Id_rsa (private key) and id_rsa_pub (public key).

 

If you create a file called �authorized_keys� and place your public key in there you will achieve psswdless access. How to do it?

 

2.

cat ~/.ssh/id_rsa.pub >> ~/.ssh/authorized_keys

 

The above command reads your PubKey and appends to the file. After that try �ssh localhost� again. Voila! No more password request.

 

Now, imagine you are ssh-ing into this very same machine from another computer where u  log-in as yosh. �ssh < ip>�.  The machine will similarly let you in without password.

 

p.s. If you do not know ip address of that machine, find out by simply typing �hostname �i�.

 

Happy hadoop�ing.

 

AK47

 

 

From: yogesh dhari [mailto:yogeshdhari@live.com]
Sent: Thursday, October 25, 2012 12:12 PM
To: hadoop helpforoum
Subject: RE: ERROR:: SSH failour for distributed node hadoop cluster

 


Hi Andy,

I am still at that point, not able to solve it yet

Please help, Same issue with all settings and commands I have raise by Subject

ERROR: : Hadoop Installation in distributed mode.�

to the mailing llist.


Thanks & Regards
Yogesh Kumar

From: Andy.Kartashov@mpac.ca
To: user@hadoop.apache.org
Subject: RE: ERROR:: SSH failour for distributed node hadoop cluster
Date: Thu, 25 Oct 2012 16:01:56 +0000

Yogesh,

 

Have you figured it out?  I had the same issue (needed passwordless ssh) and managed. Let me know if you are still stuck.

 

AK47

 

From: yogesh.kumar13@wipro.com [mailto:yogesh.kumar13@wipro.com]
Sent: Thursday, October 25, 2012 4:28 AM
To: user@hadoop.apache.org
Subject: ERROR:: SSH failour for distributed node hadoop cluster
Importance: High

 

Hi all,

I am trying to run the command

ssh Master

it runs and shows after entering password.
Password: abc
Last login: Thu Oct 25 13:51:06 2012 from master

But ssh for Slave through error.



ssh Slave

it asks for password ans denie

Password: abc
Password: abc
Password: abc
Permission denied (publickey,keyboard-interactive).

Please suggest.
Thanks & regards
Yogesh Kumar

Please do not print this email unless it is absolutely necessary.
The information contained in this electronic message and any attachments to this message are intended for the exclusive use of the addressee(s) and may contain proprietary, confidential or privileged information. If you are not the intended recipient, you should not disseminate, distribute or copy this e-mail. Please notify the sender immediately and destroy all copies of this message and any attachments.
WARNING: Computer viruses can be transmitted via email. The recipient should check this email and any attachments for the presence of viruses. The company accepts no liability for any damage caused by any virus transmitted by this email.
www.wipro.com

NOTICE: This e-mail message and any attachments are confidential, subject to copyright and may be privileged. Any unauthorized use, copying or disclosure is prohibited. If you are not the intended recipient, please delete and contact the sender immediately. Please consider the environment before printing this e-mail. AVIS : le pr�sent courriel et toute pi�ce jointe qui l'accompagne sont confidentiels, prot�g�s par le droit d'auteur et peuvent �tre couverts par le secret professionnel. Toute utilisation, copie ou divulgation non autoris�e est interdite. Si vous n'�tes pas le destinataire pr�vu de ce courriel, supprimez-le et contactez imm�diatement l'exp�diteur. Veuillez penser � l'environnement avant d'imprimer le pr�sent courriel

NOTICE: This e-mail message and any attachments are confidential, subject to copyright and may be privileged. Any unauthorized use, copying or disclosure is prohibited. If you are not the intended recipient, please delete and contact the sender immediately. Please consider the environment before printing this e-mail. AVIS : le pr�sent courriel et toute pi�ce jointe qui l'accompagne sont confidentiels, prot�g�s par le droit d'auteur et peuvent �tre couverts par le secret professionnel. Toute utilisation, copie ou divulgation non autoris�e est interdite. Si vous n'�tes pas le destinataire pr�vu de ce courriel, supprimez-le et contactez imm�diatement l'exp�diteur. Veuillez penser � l'environnement avant d'imprimer le pr�sent courriel
--_3650a51e-cb56-4d73-8a65-8f7ff4738028_--