Return-Path: X-Original-To: apmail-hadoop-common-user-archive@www.apache.org Delivered-To: apmail-hadoop-common-user-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id F29D79539 for ; Thu, 16 May 2013 17:02:45 +0000 (UTC) Received: (qmail 49205 invoked by uid 500); 16 May 2013 17:02:40 -0000 Delivered-To: apmail-hadoop-common-user-archive@hadoop.apache.org Received: (qmail 49078 invoked by uid 500); 16 May 2013 17:02:40 -0000 Mailing-List: contact user-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@hadoop.apache.org Delivered-To: mailing list user@hadoop.apache.org Received: (qmail 49071 invoked by uid 99); 16 May 2013 17:02:40 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 16 May 2013 17:02:40 +0000 X-ASF-Spam-Status: No, hits=1.5 required=5.0 tests=HTML_MESSAGE,RCVD_IN_DNSWL_LOW,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (athena.apache.org: domain of dontariq@gmail.com designates 209.85.220.176 as permitted sender) Received: from [209.85.220.176] (HELO mail-vc0-f176.google.com) (209.85.220.176) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 16 May 2013 17:02:36 +0000 Received: by mail-vc0-f176.google.com with SMTP id ib11so2958509vcb.35 for ; Thu, 16 May 2013 10:02:15 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=x-received:mime-version:in-reply-to:references:from:date:message-id :subject:to:content-type; bh=Y/vqQfvc1P3Sc6vf+fsPIIKkmNpZ/LOYARgpNHjJ0ts=; b=OGWJniv5Au4TFBHksoaXLyNs83+NBnnfaz4n3XbwD5vrBzfpPu8ev1+BjmHyD/vIuU Uk2SkKRgWeIbvKOE6EBy2Ojl1mAHrIZjzoFEYgTE8NngQ/83GL2CLBO1g8UQtQwVsg6g GOOL49i28c5vL7qBT83S+ZMrXUeB9uuZ3Mahp+bcClcWa0QpCtMcZRG5Wz0RWzqu5VNF C0+WtZzaioNkpiVKGQGWvl9tNnfeqhTyGG/MMwuIdOS6CRCvl9FBMmS8C5EuzmRI/sYL k1XHWn26I1G5wIOCPwqv2yR7jpBr3wdEG+I68FysugkljigP3ySmopJWoqzzsZyq09Gb mGgg== X-Received: by 10.220.66.212 with SMTP id o20mr4407245vci.2.1368723735704; Thu, 16 May 2013 10:02:15 -0700 (PDT) MIME-Version: 1.0 Received: by 10.58.136.65 with HTTP; Thu, 16 May 2013 10:01:35 -0700 (PDT) In-Reply-To: <1368722859.80920.YahooMailNeo@web162201.mail.bf1.yahoo.com> References: <1368716092.53861.YahooMailNeo@web162203.mail.bf1.yahoo.com> <1368719767.68889.YahooMailNeo@web162204.mail.bf1.yahoo.com> <1368722859.80920.YahooMailNeo@web162201.mail.bf1.yahoo.com> From: Mohammad Tariq Date: Thu, 16 May 2013 22:31:35 +0530 Message-ID: Subject: Re: Error while extracting hadoop tar To: "user@hadoop.apache.org" , Raj Hadoop Content-Type: multipart/alternative; boundary=047d7b33da860ffff504dcd8d49a X-Virus-Checked: Checked by ClamAV on apache.org --047d7b33da860ffff504dcd8d49a Content-Type: text/plain; charset=ISO-8859-1 It means the file is either truncated or not downloaded completely. Warm Regards, Tariq cloudfront.blogspot.com On Thu, May 16, 2013 at 10:17 PM, Raj Hadoop wrote: > I am getting the following error. Does this mean the tar file is > corrupted? Do i need to download it again? Please advise. > $ tar xzf hadoop-1.1.2.tar.gz > gzip: stdin: unexpected end of file > tar: Unexpected EOF in archive > tar: Unexpected EOF in archive > tar: Error is not recoverable: exiting now > > *From:* Mohammad Tariq > *To:* "user@hadoop.apache.org" ; Raj Hadoop < > hadoopraj@yahoo.com> > *Sent:* Thursday, May 16, 2013 12:02 PM > *Subject:* Re: Configuring SSH - is it required? for a psedo distriburted > mode? > > Hello Raj, > > ssh is actually 2 things : > 1- ssh : The command we use to connect to remote machines - the client. > 2- sshd : The daemon that is running on the server and allows clients to > connect to the server. > ssh is pre-enabled on Linux, but in order to start sshd daemon, we need to > install ssh first. > > To start the Hadoop daemons you have to make ssh passwordless and issue > bin/start-dfs.sh and bin/start-mapred.sh. > > You might find this link > useful. > > Warm Regards, > Tariq > cloudfront.blogspot.com > > > On Thu, May 16, 2013 at 9:26 PM, Raj Hadoop wrote: > > Hi, > > I am a bit confused here. I am planning to run on a single machine. > > So what should i do to start hadoop processes. How should I do an SSH? Can > you please breifly explain me what SSH is? > > Thanks, > Raj > *From:* Jay Vyas > *To:* "common-user@hadoop.apache.org" > *Cc:* Raj Hadoop > *Sent:* Thursday, May 16, 2013 11:34 AM > *Subject:* Re: Configuring SSH - is it required? for a psedo distriburted > mode? > > Actually, I should amend my statement -- SSH is required, but > passwordless ssh (i guess) you can live without if you are willing to enter > your password for each process that gets started. > > But Why wouldn't you want to implement passwordless ssh in a pseudo > distributed cluster ? Its very easy to implement on a single node: > > cat ~/.ssh/id_rsa.pub /root/.ssh/authorized_keys > > > > > On Thu, May 16, 2013 at 11:31 AM, Jay Vyas wrote: > > Yes it is required -- in psuedodistributed node the jobtracker is not > necessarily aware that the task trackers / data nodes are on the same > machine, and will thus attempt to ssh into them when starting the > respective deamons etc (i.e. start-all.sh) > > > On Thu, May 16, 2013 at 11:21 AM, kishore alajangi < > alajangikishore@gmail.com> wrote: > > When you start the hadoop procecess, each process will ask the password > to start, to overcome this we will configure SSH if you use single node or > multiple nodes for each process, if you can enter the password for each > process Its not a mandatory even if you use multiple systems. > > Thanks, > Kishore. > > > On Thu, May 16, 2013 at 8:24 PM, Raj Hadoop wrote: > > Hi, > > I have a dedicated user on Linux server for hadoop. I am installing it in > psedo distributed mode on this box. I want to test my programs on this > machine. But i see that in installation steps - they were mentioned that > SSH needs to be configured. If it is single node, I dont require it > ...right? Please advise. > > I was looking at this site > > http://www.michael-noll.com/tutorials/running-hadoop-on-ubuntu-linux-single-node-cluster/ > > It menionted like this - > " > Hadoop requires SSH access to manage its nodes, i.e. remote machines plus > your local machine if you want to use Hadoop on it (which is what we want > to do in this short tutorial). For our single-node setup of Hadoop, we > therefore need to configure SSH access to localhost for the hduser user > we created in the previous section. > " > > Thanks, > Raj > > > > > > > -- > Jay Vyas > http://jayunit100.blogspot.com/ > > > > > -- > Jay Vyas > http://jayunit100.blogspot.com/ > > > > > > --047d7b33da860ffff504dcd8d49a Content-Type: text/html; charset=ISO-8859-1 Content-Transfer-Encoding: quoted-printable
It means the file is either truncated or not downloaded co= mpletely.

Warm Regards,
Tariq


On Thu, May 16, 2013 at 10:17 PM, Raj Ha= doop <hadoopraj@yahoo.com> wrote:
I am getting the following error. Does this mean the ta= r file is corrupted? Do i need to download it again? Please advise.
$ tar xzf hadoop-1.1.2.tar.gz
gzip: stdin: unexp= ected end of file
tar: Unexpected EOF in archive
tar: Unexpected EOF = in archive
tar: Error is not recoverable: exiting now

From:= Mohammad Tariq <dontariq@gmail.com>
To:<= /span> "user@hadoop.apache.org" <user@hadoop.apache.org>; Raj Hadoop <hadoopraj@yahoo.com>
Sent: Thursday, May 16, 2013= 12:02 PM
Subject: Re: Co= nfiguring SSH - is it required? for a psedo distriburted mode?


Warm Regards,
Tariq


On Thu, May 16, 2013 at 9:26 PM, Raj Hadoop <hadoo= praj@yahoo.com> wrote:
Hi,
=A0
I am a bit confused here. I am planning to run on a single machine.
=A0
So what should i do to start hadoop processes. How should I do an SSH?= Can you please breifly explain me what SSH is?
=A0
Thanks,
Raj
From:= Jay Vyas <jayunit100@gmail.com>
To: "common-user@hadoop.apache.org&= quot; <user@hadoop.apache.org>
Cc: Raj Hadoop <hadoopra= j@yahoo.com>
Sent: Thursday, May 16, 2013 11:34 AM
Subject: Re: Configuring SSH= - is it required? for a psedo distriburted mode?

Actually, I should amend my statement -- SSH is required, but password= less ssh (i guess) you can live without if you are willing to enter your pa= ssword for each process that gets started.

But Why wouldn't you = want to implement passwordless ssh in a pseudo distributed cluster ?=A0 Its= very easy to implement on a single node:

cat ~/.ssh/id_rsa.pub /root/.ssh/authorized_keys




On Thu, May 16, 2013 at 11:31 AM, Jay Vyas <jayun= it100@gmail.com> wrote:
Yes it is required -- in psuedodistributed node the jobtra= cker is not necessarily aware that the task trackers=A0 / data nodes are on= the same machine, and will thus attempt to ssh into them when starting the= respective deamons etc (i.e. start-all.sh)


On Thu, May 16, 2013 at 11:21 AM, kishore alajangi &= lt;alajangikishore@gmail.com> wrote:
When you start the hadoop procecess, each process will ask the passwor= d to start, to overcome this we=A0will configure SSH=A0if you use single no= de or multiple nodes for each process,=A0if you can enter the password for = each process Its not a mandatory even if you use multiple systems.
=A0
Thanks,
Kishore.


On Thu, May 16, 2013 at 8:24 PM, Raj Hadoop <hadoo= praj@yahoo.com> wrote:
=A0Hi,
=A0
I have a dedicated= user on Linux server for hadoop. I am installing it in psedo distributed m= ode on this box. I want to test my programs on this machine. But i see that= in installation steps - they were mentioned that SSH needs to be configure= d. If it is single node, I dont require it ...right? Please advise. =
=A0
I was looking at t= his site
=A0
It menionted like = this -
"
Hadoop requires SSH access to manage its nodes, i.e. remote machines p= lus your local machine if you want to use Hadoop on it (which is what we wa= nt to do in this short tutorial). For our single-node setup of Hadoop, we t= herefore need to configure SSH access to localhost for the hduser user we created in the previous section.
"
=A0
Thanks,
Raj
=A0




--
Jay Vyas
http:/= /jayunit100.blogspot.com/



--
Jay Vyas
htt= p://jayunit100.blogspot.com/


=




--047d7b33da860ffff504dcd8d49a--