hadoop-common-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Vitthal \"Suhas\" Gogate" <gog...@hortonworks.com>
Subject Re: error for deploying hadoop on macbook pro
Date Tue, 04 Oct 2011 00:44:35 GMT
Steps worked in the following document worked for me, except

-- JAVA_HOME need to be set correctly in the conf/hadoop-env.sh
-- By default on Mac OS X,  sshd is not running, so need to start it using
"System Preferences/Sharing" and add users who are allowed to do ssh.

http://www.stanford.edu/class/cs246/cs246-11-mmds/hw_files/hadoop_install.pdf

--Suhas

On Mon, Oct 3, 2011 at 2:21 PM, Jignesh Patel <jignesh@websoft.com> wrote:

> Harsh thanks,
> It worked out now I am able to start the cluster but when I tried to see
> the jobConf history
>
> http://localhost:50030/jobconf_history.jsp
>
> I got the following message.
> Missing 'logFile' for fetching job configuration!
>
>
> On Sep 30, 2011, at 5:41 PM, Harsh J wrote:
>
> > Since you're only just beginning, and have unknowingly issued multiple
> > "namenode -format" commands, simply run the following and restart DN
> > alone:
> >
> > $ rm -r /private/tmp/hadoop-hadoop-user/dfs/data
> >
> > (And please do not reformat namenode, lest you go out of namespace ID
> > sync yet again -- You can instead `hadoop dfs -rmr /*` to rid yourself
> > of all HDFS files)
> >
> > On Sat, Oct 1, 2011 at 2:13 AM, Jignesh Patel <jignesh@websoft.com>
> wrote:
> >> Now I am able to make task tracker and job tracker running but I still
> have following problem with datanode.
> >>
> >> ERROR org.apache.hadoop.hdfs.server.datanode.DataNode:
> java.io.IOException: Incompatible namespaceIDs in
> /private/tmp/hadoop-hadoop-user/dfs/data: namenode namespaceID = 798142055;
> datanode namespaceID = 964022125
> >>
> >>
> >> On Sep 30, 2011, at 3:59 PM, Jignesh Patel wrote:
> >>
> >>>
> >>>
> >>>
> >>>>
> >>>>
> >>>>
> >>>> I am trying to setup single node cluster using hadoop-0.20.204.0 and
> while setting I found my job tracker and task tracker are not starting. I am
> attaching the exception. I also don't know why my while formatting name node
> my IP address still doesn't show 127.0.0.1 as follows.
> >>>>
> >>>> 1/09/30 15:50:36 INFO namenode.NameNode: STARTUP_MSG:
> >>>> /************************************************************
> >>>> STARTUP_MSG: Starting NameNode
> >>>> STARTUP_MSG:   host = Jignesh-MacBookPro.local/192.168.1.120
> >>>> STARTUP_MSG:   args = [-format]
> >>>> STARTUP_MSG:   version = 0.20.204.0
> >>>> STARTUP_MSG:   build = git://hrt8n35.cc1.ygridcore.net/ on branch
> branch-0.20-security-204 -r 65e258bf0813ac2b15bb4c954660eaf9e8fba141;
> compiled by 'hortonow' on Thu Aug 25 23:35:31 UTC 2011
> >>>>
> >>> <hadoop-hadoop-user-tasktracker-Jignesh-MacBookPro.local.out>
> >>> <hadoop-hadoop-user-jobtracker-Jignesh-MacBookPro.local.log>
> >>>
> >>
> >>
> >
> >
> >
> > --
> > Harsh J
>
>

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message