Return-Path: X-Original-To: apmail-hadoop-hdfs-user-archive@minotaur.apache.org Delivered-To: apmail-hadoop-hdfs-user-archive@minotaur.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 7C5241898E for ; Tue, 16 Jun 2015 15:56:08 +0000 (UTC) Received: (qmail 69660 invoked by uid 500); 16 Jun 2015 15:56:02 -0000 Delivered-To: apmail-hadoop-hdfs-user-archive@hadoop.apache.org Received: (qmail 69528 invoked by uid 500); 16 Jun 2015 15:56:02 -0000 Mailing-List: contact user-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@hadoop.apache.org Delivered-To: mailing list user@hadoop.apache.org Received: (qmail 69506 invoked by uid 99); 16 Jun 2015 15:56:02 -0000 Received: from Unknown (HELO spamd3-us-west.apache.org) (209.188.14.142) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 16 Jun 2015 15:56:02 +0000 Received: from localhost (localhost [127.0.0.1]) by spamd3-us-west.apache.org (ASF Mail Server at spamd3-us-west.apache.org) with ESMTP id A92DD182829 for ; Tue, 16 Jun 2015 15:56:01 +0000 (UTC) X-Virus-Scanned: Debian amavisd-new at spamd3-us-west.apache.org X-Spam-Flag: NO X-Spam-Score: 2.901 X-Spam-Level: ** X-Spam-Status: No, score=2.901 tagged_above=-999 required=6.31 tests=[DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, HTML_MESSAGE=3, URIBL_BLOCKED=0.001] autolearn=disabled Authentication-Results: spamd3-us-west.apache.org (amavisd-new); dkim=pass (2048-bit key) header.d=gmail.com Received: from mx1-us-west.apache.org ([10.40.0.8]) by localhost (spamd3-us-west.apache.org [10.40.0.10]) (amavisd-new, port 10024) with ESMTP id 0ELa87d0nKu4 for ; Tue, 16 Jun 2015 15:55:48 +0000 (UTC) Received: from mail-qk0-f182.google.com (mail-qk0-f182.google.com [209.85.220.182]) by mx1-us-west.apache.org (ASF Mail Server at mx1-us-west.apache.org) with ESMTPS id D370522F03 for ; Tue, 16 Jun 2015 15:55:47 +0000 (UTC) Received: by qkbp125 with SMTP id p125so6868666qkb.2 for ; Tue, 16 Jun 2015 08:55:41 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :content-type; bh=kUhS06YdMFRTVRXf8n5yHCGvEfZLVyHY+zNaw4XH4PQ=; b=wpxF53zM+lJSsuJnnFifbV/4h3+owt+UqoIyF19SDIlFVegfYM91AgfSpXapg4hJz1 bOuC3ONM5ZeeMzP2dq2nQcpG/C2EddNOhhatqGgpAkvY4mhFeSxMgTcyzSxv6qdbb7zP YBSazwmkmS5BGRtCO3lEbewW3IqlAHTpXBKorWzrDrfk3SdnKdOleH8SHZT4HdumSCC5 1KGmB+T3S1HwjMLhFOzrfVYqmZnNXT1G3MOS+oQv2yGJzAPoq7obmMLXcukOqXGTJjXn dJcuDQG20CxJ8SF7/SVwEJK3B9qsOSCzL7aTjPPV5H176h5LE4fj51Na0035FMb3aK5N CEfA== MIME-Version: 1.0 X-Received: by 10.55.15.232 with SMTP id 101mr2551558qkp.69.1434470141456; Tue, 16 Jun 2015 08:55:41 -0700 (PDT) Received: by 10.140.87.119 with HTTP; Tue, 16 Jun 2015 08:55:41 -0700 (PDT) In-Reply-To: References: Date: Tue, 16 Jun 2015 17:55:41 +0200 Message-ID: Subject: Re: Two hadoop nodes on same machine while a second machine not joining the cluster From: Arbi Akhina To: user@hadoop.apache.org Content-Type: multipart/alternative; boundary=001a11475d4c38f7050518a49bb5 --001a11475d4c38f7050518a49bb5 Content-Type: text/plain; charset=UTF-8 Here is the content of configuration files on both machines: Here is the content of *core-site.xml* fs.default.name hdfs://hadoop-server Here is the content of *mapred-site.xml* mapreduce.framework.name yarn On Tue, Jun 16, 2015 at 4:37 PM, vedavyasa reddy wrote: > hi, > check in slave node Hadoop_home/etc/hadoop/"core-site.xml"whether host > name of the master is given correctly or not. i.e., > "hdfs://master-hostname:9000" > > and if these is correct then check the "mapred-site.xml" whether "job > Tracker address" is given correct or not. > > On Tue, Jun 16, 2015 at 6:23 PM, Arbi Akhina > wrote: > >> Hi, >> >> I have a test cluster of two machines, on both of them hadoop is >> installed. I've configured the hadoop cluster but on admin UI (as in the >> below picture) I see that two nodes are running on the same master machine, >> and that the other machine has no Hadoop node. >> >> [image: enter image description here] >> >> On master machine following services are running: >> >> ~$ jps >> 26310 ResourceManager >> 27593 Jps >> 26216 DataNode >> 26135 NameNode >> 26557 NodeManager >> 26701 JobHistoryServer >> >> On the slave machine: >> >> ~$ jps >> 2614 DataNode >> 2920 Jps >> 2707 NodeManager >> >> I don't why the slave is not joining the cluster (It was before). I tried >> to shutdown all servers on both machines and format HDFS then restarting >> everything but that didn't help. Any help to figure what's causing that >> behavior is appreciated. >> > > --001a11475d4c38f7050518a49bb5 Content-Type: text/html; charset=UTF-8 Content-Transfer-Encoding: quoted-printable
Here is the content of configuration files on both ma= chines:

Here is the content of core-site.x= ml
<configuration&= gt;
=C2=A0 <property= >
=C2=A0 =C2=A0 <= name>fs.default.name</name>=
=C2=A0 =C2=A0 <valu= e>hdfs://hadoop-server</value>
=C2=A0 </property>
</configuration>

=
Here is the content of mapred-site.xml
<configuration>
=C2=A0 <property>
=C2=A0 =C2=A0 <name>mapreduce.framework.name</name>
=
=C2=A0 =C2=A0 <value>yarn<= /value>
=C2=A0 </= property>
</confi= guration>


On Tue, Jun 16, 2015 at 4:37 PM, v= edavyasa reddy <vedavyas.veda92@gmail.com> wrote:
hi,
check in slave nod= e Hadoop_home/etc/hadoop/"core-site.xml"whether host name of the = master is given correctly or not. i.e., "hdfs://master-hostname:9000&q= uot;

and if these is correct then check the "= mapred-site.xml" whether "job Tracker address" is given corr= ect or not.

On Tue, Jun 16, 2015 at 6:2= 3 PM, Arbi Akhina <arbi.akhina@gmail.com> wrote:

Hi,

I have a test cluster of two machines, on both of them hadoop is inst= alled. I've configured the hadoop cluster but on admin UI (as in the be= low picture) I see that two nodes are running on the same master machine, a= nd that the other machine has no Hadoop node.

3D"enter

On master machine following services are running:

~$ jps
26310 ResourceManager
27593 Jps
26216 DataNode
26135 NameNode
26557 NodeManager
26701 JobHistoryServer

On the slave machine:

~$ jps
2614 DataNode
2920 Jps
2707 NodeManager

I don't why the slave is not joining the clu= ster (It was before). I tried to shutdown all servers on both machines and = format HDFS then restarting everything but that didn't help. Any help t= o figure what's causing that behavior is appreciated.



--001a11475d4c38f7050518a49bb5--