Return-Path: X-Original-To: apmail-hadoop-mapreduce-user-archive@minotaur.apache.org Delivered-To: apmail-hadoop-mapreduce-user-archive@minotaur.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id D7E3EDA1E for ; Wed, 13 Mar 2013 14:02:48 +0000 (UTC) Received: (qmail 93444 invoked by uid 500); 13 Mar 2013 14:02:43 -0000 Delivered-To: apmail-hadoop-mapreduce-user-archive@hadoop.apache.org Received: (qmail 93246 invoked by uid 500); 13 Mar 2013 14:02:43 -0000 Mailing-List: contact user-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@hadoop.apache.org Delivered-To: mailing list user@hadoop.apache.org Received: (qmail 93218 invoked by uid 99); 13 Mar 2013 14:02:42 -0000 Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 13 Mar 2013 14:02:42 +0000 X-ASF-Spam-Status: No, hits=1.7 required=5.0 tests=FREEMAIL_ENVFROM_END_DIGIT,HTML_MESSAGE,RCVD_IN_DNSWL_LOW,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (nike.apache.org: domain of nitinpawar432@gmail.com designates 209.85.215.43 as permitted sender) Received: from [209.85.215.43] (HELO mail-la0-f43.google.com) (209.85.215.43) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 13 Mar 2013 14:02:36 +0000 Received: by mail-la0-f43.google.com with SMTP id ek20so1157661lab.30 for ; Wed, 13 Mar 2013 07:02:15 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:x-received:in-reply-to:references:date:message-id :subject:from:to:content-type; bh=FkZSS986Ei4TBLvLsoMDEJ4tbP8j0a6gNJVtx/KDfCo=; b=bI0bjLBTSOFs+Lh1Bm0S4kzqtfzfQFYoz/enbdmuQaOxPfJm6oIKw9q7FqDff/PngI mAHY3Bt0ldS+v6rvJmC+frS/JNZxyKoJYSIdauJBqKLY3ZMaySNR3HgHz+rnr8iQbgdN oFHebtOBkHfyHSM5qwC1tZTvEGXvPcn1u0371fWSmD20MOW6zJyuvTeyy+Pbzy7JXD0L +v1YXir0CCBv9se9s00yohmZId2GyH886ngK+zCDFxCRI6YEDxpq4iCExISdqvTHAFhB nvxcPznG+N5juiW/8uhZdAWhFbMG2I5NE4xneowuIxCFc4uc0H/RLfwa0ofW/VjoeraC d+HQ== MIME-Version: 1.0 X-Received: by 10.152.115.131 with SMTP id jo3mr5463150lab.0.1363183335817; Wed, 13 Mar 2013 07:02:15 -0700 (PDT) Received: by 10.114.15.8 with HTTP; Wed, 13 Mar 2013 07:02:15 -0700 (PDT) In-Reply-To: References: Date: Wed, 13 Mar 2013 19:32:15 +0530 Message-ID: Subject: Re: Small cluster setup. From: Nitin Pawar To: user@hadoop.apache.org Content-Type: multipart/alternative; boundary=001a11c366b27ec62604d7cedacf X-Virus-Checked: Checked by ClamAV on apache.org --001a11c366b27ec62604d7cedacf Content-Type: text/plain; charset=ISO-8859-1 Cyril, how did you install hadoop? when you start hadoop ... do you start it from the location where it is installed or from users home directory? try setting HADOOP_HOME (its deprecated but it helps to resolve issues like where the config files are located etc) On Wed, Mar 13, 2013 at 7:29 PM, Cyril Bogus wrote: > Thanks for the reply. > > I am running on Linux. The problem IS the config file but since I couldn't > figure out where, I made two copies of hadoop. One where it is looking for > it, and where other nodes will be looking for it. > > In my config file, everything is I have set hadoop in /home/hadoop but it > is looking for it in /home/owner/hadoop (for some processes at least) and > that was the problem. > > > On Tue, Mar 12, 2013 at 11:06 AM, Jean-Marc Spaggiari < > jean-marc@spaggiari.org> wrote: > >> Hi Cyril, >> >> Are you running in Cygwin? Or Linux? Also, you might want to share >> your configuration files if you want someone to take a look. >> >> JM >> >> 2013/3/8 Cyril Bogus : >> > I am trying to have a two node cluster. >> > Hadoop 1.0.4 >> > >> > the master is under the account A >> > the slave is under the account B >> > >> > I run into an exception when I try to start the cluster. >> > Here is my output >> > >> > A@owner-5:~$ /home/hadoop/bin/start-all.sh >> > Warning: $HADOOP_HOME is deprecated. >> > >> > namenode running as process 3020. Stop it first. >> > A@master: starting datanode, logging to >> > /home/hadoop/libexec/../logs/hadoop-A-datanode-owner-5.out >> > B@slave: Warning: $HADOOP_HOME is deprecated. >> > B@slave: >> > B@slave: starting datanode, logging to >> > /home/owner/hadoop//logs/hadoop-owner-datanode-owner-7.out >> > B@slave: Exception in thread "main" java.lang.NoClassDefFoundError: >> > org/apache/hadoop/util/PlatformName >> > B@slave: Caused by: java.lang.ClassNotFoundException: >> > org.apache.hadoop.util.PlatformName >> > B@slave: at java.net.URLClassLoader$1.run(URLClassLoader.java:202) >> > B@slave: at java.security.AccessController.doPrivileged(Native >> Method) >> > B@slave: at >> java.net.URLClassLoader.findClass(URLClassLoader.java:190) >> > B@slave: at java.lang.ClassLoader.loadClass(ClassLoader.java:306) >> > B@slave: at >> > sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301) >> > B@slave: at java.lang.ClassLoader.loadClass(ClassLoader.java:247) >> > B@slave: Could not find the main class: >> org.apache.hadoop.util.PlatformName. >> > Program will exit. >> > B@slave: Exception in thread "main" java.lang.NoClassDefFoundError: >> > org/apache/hadoop/hdfs/server/datanode/DataNode >> > A@master: secondarynamenode running as process 3352. Stop it first. >> > starting jobtracker, logging to >> > /home/hadoop/libexec/../logs/hadoop-A-jobtracker-owner-5.out >> > B@slave: Warning: $HADOOP_HOME is deprecated. >> > B@slave: >> > B@slave: starting tasktracker, logging to >> > /home/owner/hadoop//logs/hadoop-owner-tasktracker-owner-7.out >> > A@master: starting tasktracker, logging to >> > /home/hadoop/libexec/../logs/hadoop-A-tasktracker-owner-5.out >> > B@slave: Exception in thread "main" java.lang.NoClassDefFoundError: >> > org/apache/hadoop/util/PlatformName >> > B@slave: Caused by: java.lang.ClassNotFoundException: >> > org.apache.hadoop.util.PlatformName >> > B@slave: at java.net.URLClassLoader$1.run(URLClassLoader.java:202) >> > B@slave: at java.security.AccessController.doPrivileged(Native >> Method) >> > B@slave: at >> java.net.URLClassLoader.findClass(URLClassLoader.java:190) >> > B@slave: at java.lang.ClassLoader.loadClass(ClassLoader.java:306) >> > B@slave: at >> > sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301) >> > B@slave: at java.lang.ClassLoader.loadClass(ClassLoader.java:247) >> > B@slave: Could not find the main class: >> org.apache.hadoop.util.PlatformName. >> > Program will exit. >> > B@slave: Exception in thread "main" java.lang.NoClassDefFoundError: >> > org/apache/hadoop/mapred/TaskTracker >> > A@owner-5:~$ >> > >> > > -- Nitin Pawar --001a11c366b27ec62604d7cedacf Content-Type: text/html; charset=ISO-8859-1 Content-Transfer-Encoding: quoted-printable
Cyril,

how did you install hadoop?=A0
when you start hadoop ... do you start it from the location = where it is installed or from users home directory?=A0

=
try setting HADOOP_HOME (its deprecated but it helps to resolve = issues like where the config files are located etc)=A0


On Wed, Mar 13, 2013 a= t 7:29 PM, Cyril Bogus <cyrilbogus@gmail.com> wrote:
Thanks for the reply.<= br>
I am running on Linux. The problem IS the config file but since I co= uldn't figure out where, I made two copies of hadoop. One where it is l= ooking for it, and where other nodes will be looking for it.

In my config file, everything is I have set hadoop in /home/hadoo= p but it is looking for it in /home/owner/hadoop (for some processes at lea= st) and that was the problem.


On Tue, Mar 12, 2013 at 11:06 AM, Jean-Marc Spag= giari <jean-marc@spaggiari.org> wrote:
Hi Cyril,

Are you running in Cygwin? Or Linux? Also, you might want to share
your configuration files if you want someone to take a look.

JM

2013/3/8 Cyril Bogus <cyrilbogus@gmail.com>:
> I am trying to have a two node cluster.
> Hadoop 1.0.4
>
> the master is under the account A
> the slave is under the account B
>
> I run into an exception when I try to start the cluster.
> Here is my output
>
> A@owner-5:~$ /home/hadoop/bin/start-all.sh
> Warning: $HADOOP_HOME is deprecated.
>
> namenode running as process 3020. Stop it first.
> A@master: starting datanode, logging to
> /home/hadoop/libexec/../logs/hadoop-A-datanode-owner-5.out
> B@slave: Warning: $HADOOP_HOME is deprecated.
> B@slave:
> B@slave: starting datanode, logging to
> /home/owner/hadoop//logs/hadoop-owner-datanode-owner-7.out
> B@slave: Exception in thread "main" java.lang.NoClassDefFoun= dError:
> org/apache/hadoop/util/PlatformName
> B@slave: Caused by: java.lang.ClassNotFoundException:
> org.apache.hadoop.util.PlatformName
> B@slave: =A0 =A0 at java.net.URLClassLoader$1.run(URLClassLoader.java:= 202)
> B@slave: =A0 =A0 at java.security.AccessController.doPrivileged(Native= Method)
> B@slave: =A0 =A0 at java.net.URLClassLoader.findClass(URLClassLoader.j= ava:190)
> B@slave: =A0 =A0 at java.lang.ClassLoader.loadClass(ClassLoader.java:3= 06)
> B@slave: =A0 =A0 at
> sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301)
> B@slave: =A0 =A0 at java.lang.ClassLoader.loadClass(ClassLoader.java:2= 47)
> B@slave: Could not find the main class: org.apache.hadoop.util.Platfor= mName.
> Program will exit.
> B@slave: Exception in thread "main" java.lang.NoClassDefFoun= dError:
> org/apache/hadoop/hdfs/server/datanode/DataNode
> A@master: secondarynamenode running as process 3352. Stop it first. > starting jobtracker, logging to
> /home/hadoop/libexec/../logs/hadoop-A-jobtracker-owner-5.out
> B@slave: Warning: $HADOOP_HOME is deprecated.
> B@slave:
> B@slave: starting tasktracker, logging to
> /home/owner/hadoop//logs/hadoop-owner-tasktracker-owner-7.out
> A@master: starting tasktracker, logging to
> /home/hadoop/libexec/../logs/hadoop-A-tasktracker-owner-5.out
> B@slave: Exception in thread "main" java.lang.NoClassDefFoun= dError:
> org/apache/hadoop/util/PlatformName
> B@slave: Caused by: java.lang.ClassNotFoundException:
> org.apache.hadoop.util.PlatformName
> B@slave: =A0 =A0 at java.net.URLClassLoader$1.run(URLClassLoader.java:= 202)
> B@slave: =A0 =A0 at java.security.AccessController.doPrivileged(Native= Method)
> B@slave: =A0 =A0 at java.net.URLClassLoader.findClass(URLClassLoader.j= ava:190)
> B@slave: =A0 =A0 at java.lang.ClassLoader.loadClass(ClassLoader.java:3= 06)
> B@slave: =A0 =A0 at
> sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301)
> B@slave: =A0 =A0 at java.lang.ClassLoader.loadClass(ClassLoader.java:2= 47)
> B@slave: Could not find the main class: org.apache.hadoop.util.Platfor= mName.
> Program will exit.
> B@slave: Exception in thread "main" java.lang.NoClassDefFoun= dError:
> org/apache/hadoop/mapred/TaskTracker
> A@owner-5:~$
>




--
= Nitin Pawar
--001a11c366b27ec62604d7cedacf--